Open Source LLM Projects
Discover 273 open source LLM repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. LLM projects here are most often combined with Python, AI Agents and AI. Last updated October 4, 2026.
273 repositories · updated October 4, 2026
genaiscript: Build LLM Workflows with JavaScript
GenAIScript is a JavaScript and TypeScript toolkit for assembling prompts and orchestrating language models, tools, and data. The repository is marked deprecated and archived, so it may suit existing users better than new projects.
translation-agent: Improve Translations with an LLM Reflection Workflow
translation-agent is a Python demonstration that uses an LLM to translate text, review its own draft, and revise it. It suits experimentation with style, regional language, and terminology, but is not presented as mature production software.
promptfoo: Evaluate and Red-Team LLM Applications
Promptfoo is a CLI and library for evaluating prompts, comparing models, and testing LLM applications for security risks. It suits developers who want repeatable quality and vulnerability checks locally or in CI/CD.
jan: Run AI Models Locally or Connect to Cloud Models
Jan is a desktop AI assistant for downloading and running language models on your computer, with optional connections to cloud providers. It suits people who want local control and privacy alongside custom assistants and an OpenAI-compatible local API.
LocalAI: Run AI Models on Your Own Hardware
LocalAI serves language, vision, audio, and image models through compatible APIs on local or distributed hardware. It suits developers and teams who want a flexible self-hosted AI service without depending on a GPU.
UFO: Automate Desktop Tasks Across Devices with AI Agents
UFO combines a Windows desktop agent with a framework for coordinating agents across devices and platforms. Use it for Windows automation or multi-step workflows that need task planning, device assignment, and parallel execution.
llms-txt-hub: Discover llms.txt Implementations and Tools
A categorized directory of websites and tools implementing the proposed llms.txt standard. Use it to find AI-ready documentation resources, explore examples, or add an implementation to the collection.
langsmith-sdk: Trace and Evaluate LLM Applications
LangSmith SDKs let Python and JavaScript/TypeScript applications send traces to the LangSmith platform for debugging, evaluation, and monitoring. Use them when you need visibility into model or agent behavior during development or operation.
infinity: Serve Embedding and Reranking Models via API
Infinity is a Python serving engine for text embeddings, reranking, and selected image, audio, and late-interaction models. It provides an OpenAI-aligned REST API with multiple inference backends for teams deploying models from Hugging Face.
agent-service-toolkit: Build and Serve LangGraph Agents
A Python starter toolkit that connects LangGraph agents to a FastAPI service, reusable client, and Streamlit chat interface. It suits developers who want an end-to-end foundation for building, testing, and customizing agent applications.
LLMBox: Train and Evaluate Large Language Models
LLMBox is a Python library for training and evaluating large language models through a unified pipeline. It suits researchers and developers who want configurable fine-tuning workflows and a broad set of model and benchmark evaluation options.
read-frog: Learn Languages While Reading the Web
Read Frog is a browser extension for language learners who want translation and AI-assisted study tools alongside everyday web reading. It supports multiple AI providers, selection and subtitle translation, text-to-speech, and flashcards.