Open Source LLM Projects
Discover 274 open source LLM repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. LLM projects here are most often combined with Python, AI Agents and AI. Last updated October 4, 2026.
274 repositories · updated October 4, 2026
MaxKB: Build and Run Enterprise AI Agents
MaxKB is a self-hostable platform for building AI agents that use company knowledge, workflows, and external tools. It suits teams that want to add model-backed question answering to internal or customer-facing systems.
rig: Build LLM Applications in Rust
Rig is a Rust library for building modular LLM applications, with shared interfaces for model providers, vector stores, and agent workflows. It suits Rust developers who want to integrate multiple LLM services without building each integration from scratch.
text-extract-api: Extract Text and Data from Documents
A self-hostable API that turns PDFs, images, and Office files into Markdown or structured JSON using OCR and Ollama models. It suits teams that need document processing and PII removal with control over where files are processed.
ai-samples: Learn AI Development Patterns for .NET
.NET code samples show how to integrate AI services, build chat experiences, call functions, and evaluate model responses. The repository is archived, so use it as a reference and follow the current .NET AI documentation for maintained guidance.
smolvlm-realtime-webcam: Analyze Webcam Video with SmolVLM
A browser-based demo sends webcam frames to a llama.cpp server running SmolVLM 500M for real-time visual analysis. It suits developers exploring local vision models and webcam workflows, with performance depending on the model server and hardware.
shopping-assistant: Explore AI Shopping Workflows and Guardrails
A Java demo webshop for exploring AI shopping assistants, from guided product selection to stateful workflows and human confirmation. It also illustrates prompt-injection risks and an assistant designed to encourage higher spending.
quarkus-langchain4j-workshop: Learn to Build AI Apps with Quarkus
A hands-on workshop for learning how to build AI-infused applications with Quarkus and LangChain4j. Its step-by-step docs and runnable final states suit developers exploring Java-based AI application development.
repomix: Pack Codebases for AI Analysis
Repomix combines repository files into a structured, AI-friendly output for code review, exploration, and other LLM workflows. Use it from the CLI, website, or as an MCP server, with controls for file selection and token usage.
harbor: Run a Preconfigured Local AI Stack
Harbor is a CLI and companion app for starting connected local LLM services with Docker Compose. It suits people experimenting with models and AI tools who want a shared setup without wiring each service by hand.
llamacoder: Generate Small Apps from a Prompt
Llama Coder turns a natural-language prompt into a small app, with an in-browser preview. It suits developers exploring prompt-driven app generation or adapting the project to build their own AI coding experience.