Model Serving Open Source Projects
Discover 2 open source Model Serving repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Model Serving projects here are most often combined with Machine Learning, Python and Agent Orchestration. Last updated October 17, 2026.
litgpt: Train, Fine-Tune, and Serve Large Language Models
LitGPT is a Python toolkit for pretraining, fine-tuning, evaluating, and serving a range of large language models. It offers configurable workflows and efficient training options for researchers and teams that want direct control over model code.
ActiveHealth 47/100
flyte: Orchestrate ML Pipelines, Models, and Agents
Flyte is a Python-first orchestration platform for reliably running ML pipelines, models, and agents at scale on Kubernetes. It supports async tasks and model serving, while its open-source Flyte 2 backend is still in development.
ActiveHealth 81/100