Repository History
3 repositories tagged with local
torchchat: Run PyTorch LLMs Locally on Servers, Desktop, and Mobile
torchchat is a PyTorch-native codebase designed to showcase the ability to run large language models (LLMs) seamlessly across various platforms. It enables local execution of LLMs using Python, within C/C++ applications on desktop or servers, and directly on iOS and Android devices. Although no longer under active development, it remains a valuable resource for understanding and implementing local LLM deployment strategies.
tortoise.cpp: Local Text-to-Speech with GGML and C++
tortoise.cpp is a C++ re-implementation of the popular Tortoise-TTS model, leveraging the efficient GGML library. This project enables high-quality, local text-to-speech generation without the need for Python dependencies. It aims to make advanced speech synthesis more accessible and performant on various hardware configurations.
Harbor: Effortless Local LLM Stack Management with CLI and App
Harbor is a comprehensive containerized toolkit designed to simplify the setup and management of local LLM environments. It allows users to effortlessly run LLM backends, APIs, frontends, and various related services with simple commands or via a companion application. This project streamlines experimentation and development with large language models on your local machine.