Inference Server Open Source Projects

Discover 1 open source Inference Server repository from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Inference Server projects here are most often combined with Framework, LLM and Machine Learning. Last updated October 14, 2026.

LightLLM: Serve Large Language Models

LightLLM: Serve Large Language Models

LightLLM is a Python framework for running and serving large language models. It combines model inference with serving features for teams building scalable LLM endpoints or experimenting with serving systems.

ActiveHealth 68/100

PythonLLMMachine Learning
Added Jul 4, 2026 View details

Related topics

Framework 101LLM 217Machine Learning 168Python 634