Discover 2 open source On Device Inference repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. On Device Inference projects here are most often combined with LLM, AI and Cross Platform. Last updated October 26, 2026.
torchchat is a PyTorch-native codebase for running large language models locally with Python, C++ runners, and mobile apps. It supports desktop, server, iOS, and Android workflows, but is archived and no longer under active development.
ArchivedHealth 35/100
PocketPal AI is a React Native app for chatting with language models directly on iOS and Android devices. It suits people who want private, offline AI, with model downloads and optional voice and tool features.
ActiveHealth 60/100