On Device AI Open Source Projects
Discover 2 open source On Device AI repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. On Device AI projects here are most often combined with LLM, AI and C++. Last updated October 3, 2026.
OGAD: Private, On-Device AI with an OpenAI-Compatible Local Gateway
OGAD (Off Grid AI Desktop) is an open-source, AGPL-licensed application for private, on-device AI. It enables users to run various open models, including text, vision, image, and voice, entirely locally through a single OpenAI-compatible gateway. This ensures complete data privacy with no cloud dependencies, accounts, or API keys.
cactus: Run AI Inference on Phones and Wearables
Cactus is a C++ inference engine for running language, vision, and speech models on mobile and edge devices. It combines quantization, device-focused kernels, and optional cloud handoff for applications that need local inference with a fallback for harder queries.