LLM Serving Open Source Projects
Discover 2 open source LLM Serving repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. LLM Serving projects here are most often combined with LLM, Python and API. Last updated October 16, 2026.
LightLLM: Serve Large Language Models
LightLLM is a Python framework for running and serving large language models. It combines model inference with serving features for teams building scalable LLM endpoints or experimenting with serving systems.
ActiveHealth 68/100
PythonLLMMachine Learning
Added Jul 4, 2026 View details
langcorn: Serve LangChain Apps with FastAPI
LangCorn uses LangChain and FastAPI to expose chains, pipelines, and custom run functions as REST endpoints. It suits Python developers who want a quick API layer for LangChain apps, but the repository is currently inactive.
InactiveHealth 21/100
PythonAPILLM
Added Mar 2, 2026 View details