Our take
- Activity
- 88
- Community
- 24
- Issues
- 58
- Pull requests
- 84
+11 stars in the last 30 days
- Merges more pull requests than 95% of the projects we track
- Releases more often than 92% of the projects we track
Project history
Daily GitHub snapshots since Oct 7, 2026. History covers stars and forks; health signals are not tracked historically.
Stars
296Forks
46Change since Nov 16, 2026: 0 stars·0 forks
Overview
TurboLLM is a local LLM runtime and web app that manages model downloads, inference engines, and API access from one place. Its main distinction is that it can use different llama-server-compatible engines, rather than limiting users to a single bundled runtime, and can benchmark and tune settings for the available hardware.
It is aimed at people who want to run models on their own machine and connect them to existing tools or coding agents. The web UI and compatible APIs make it useful beyond interactive chat, while its engine flexibility is especially relevant when a fork supports features unavailable in standard runtimes.
Key Features
- Browser-based interface for downloading, loading, and chatting with local models.
- OpenAI-compatible and Anthropic-compatible APIs, including support for Claude Code integrations.
- Support for custom llama-server-compatible engines and selected engine types such as MLX and vLLM.
- Hardware-aware benchmarking, load-parameter tuning, and measured generation speeds.
- Model library support for existing GGUF folders and Hugging Face downloads.
- Command-line launcher and a local gateway that can load requested models on demand.
- Runs on Windows, macOS, and Linux, with CPU fallback when a GPU is unavailable.
Use Cases
- Developers can connect Claude Code or other compatible tools to models running on their own hardware.
- Local-LLM users can try community engine forks without replacing their full workflow or manually tuning every launch flag.
- Teams can expose a local inference API to tools on a LAN, with API-key authentication enabled when sharing.
- Users with existing GGUF collections can manage and load those models without downloading them again.
Getting Started
With Node.js 22.13.0 or newer, run:
npx turbollm
See the repository README for setup, engine options, configuration, and API details.
Alternatives
- LocalAI: LocalAI emphasizes a broad API-serving stack for language, vision, audio, and image models, while TurboLLM focuses on local language models with hardware-aware tuning and engine choice.
- textgen: TextGen centers on a private desktop and web UI for managing and using local models, while TurboLLM emphasizes hardware-aware tuning and OpenAI- or Anthropic-compatible APIs.
| Project | Language | License | Stars | Status |
|---|---|---|---|---|
| TurboLLM | TypeScript | – | 278 | Not checked yet |
| LocalAI | Go | MIT | 49.4k | Active |
| textgen | Python | AGPL-3.0 | 47.7k | Active |
Considerations
TurboLLM requires Node.js and a terminal command to start, so it is not currently a one-click desktop installer. A GPU is recommended for accelerated inference, though the README describes a CPU fallback. Some capabilities, including remote access and Turbo Link, are marked experimental. The README identifies the license as FSL-1.1 with a future Apache-2.0 grant; this is source-available rather than an unrestricted permissive license, so review its terms before redistribution or commercial product use.
Found this useful?
Share it with someone who would like TurboLLM.