Model Inference Open Source Projects

Discover 1 open source Model Inference repository from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Model Inference projects here are most often combined with AI, C and CLI. Last updated October 6, 2026.

colibri: Run Large MoE Models on Local Hardware

colibri is a C inference engine that streams mixture-of-experts model weights from disk, letting large open models run on machines with limited RAM and no required GPU. It also provides a local dashboard and OpenAI- and Anthropic-compatible APIs.

NewHealth 79/100

CAILLM

Added Jul 11, 2026 View details

colibri: Run Large MoE Models on Local Hardware

Related topics