Open Source LLM Projects
Discover 273 open source LLM repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. LLM projects here are most often combined with Python, AI Agents and AI. Last updated October 4, 2026.
273 repositories · updated October 4, 2026
guardrails: Validate LLM Inputs and Outputs
Guardrails is a Python framework for checking LLM inputs and outputs against configurable validators and for generating structured data. It suits teams building AI applications that need validation and error handling around model responses.
hiring-agent: Score Resumes with AI and GitHub Signals
Hiring Agent turns PDF resumes into structured profiles, enriches them with GitHub data, and scores them against configurable role rubrics. It is for teams exploring explainable resume prioritization, with human review remaining essential.
llm-guard: Add Security Checks to LLM Interactions
LLM Guard is a Python toolkit for screening prompts and model outputs for risks such as prompt injection, harmful content, and sensitive data. It is archived, so consider it for existing integrations or evaluation, not as a maintained security layer.
AuditNLG: Check and Improve Trust in Generated Text
AuditNLG is a Python library for evaluating generated text for factualness, safety, and instruction compliance. It combines model- and API-based checks with explanations and rewrite suggestions for research and language-model application teams.
odysseus: Run a Self-Hosted AI Workspace
Odysseus brings AI chat, agents, research, documents, email, notes, and calendar tools into a self-hosted workspace. It suits people who want one place to work with local or API-connected models and control their own deployment.
headroom: Compress Context for AI Agents
Headroom compresses tool outputs, logs, files, and retrieval context before they reach an LLM, helping reduce token use while retaining important details. It offers local library, proxy, and MCP integrations for agent workflows.
spacy-llm: Add LLM Tasks to spaCy NLP Pipelines
spacy-llm connects large language models to spaCy pipelines, turning model responses into structured NLP outputs without training data. It suits teams prototyping NLP tasks or combining LLM components with conventional spaCy processing.
MarkLLM: Implement and Evaluate LLM Watermarking
MarkLLM is a Python toolkit for implementing, visualizing, and evaluating text watermarking methods for large language models. It helps researchers compare watermark detection, robustness, and text-quality effects through shared APIs and evaluation pipelines.
GLM-5: Power Long-Horizon Coding and Agentic Tasks
GLM-5 is a family of large language models from Z.ai for complex coding, systems engineering, and long-running agent tasks. The repository provides model downloads, serving guidance, and fine-tuning references.
Qwen3-VL: Understand Images, Video, and Text with Multimodal Models
Qwen3-VL is a family of multimodal language models for interpreting images, video, and text. The repository provides inference examples, deployment guidance, and cookbooks for tasks such as OCR, spatial reasoning, and visual agents.
deliberation: Get Multi-Model Reviews and Consensus
Deliberation is an MCP server and coding-agent plugin that routes plans and code questions to external AI models for second opinions or arbiter-mediated consensus. It suits developers who want independent reviews before making consequential changes.
Open-LLM-VTuber: Talk to LLMs with a Live2D Avatar
Open-LLM-VTuber is a cross-platform AI companion for voice conversations with language models, paired with a customizable Live2D avatar. It supports local and hosted models, with web and desktop modes for users who want a more expressive, hands-free interface.