Repository History
72 repositories tagged with llm
torchchat: Run PyTorch LLMs Locally on Servers, Desktop, and Mobile
torchchat is a PyTorch-native codebase designed to showcase the ability to run large language models (LLMs) seamlessly across various platforms. It enables local execution of LLMs using Python, within C/C++ applications on desktop or servers, and directly on iOS and Android devices. Although no longer under active development, it remains a valuable resource for understanding and implementing local LLM deployment strategies.
Evidently: Open-Source ML and LLM Observability Framework
Evidently is an open-source Python library designed for evaluating, testing, and monitoring machine learning and large language model systems. It provides over 100 built-in metrics for various tasks, from data drift detection to LLM judges, supporting both tabular and text data. This framework helps ensure the quality and performance of AI-powered systems throughout their lifecycle.
Guardrails: Enhancing LLM Reliability and Structured Data Generation
Guardrails is a Python framework designed to build reliable AI applications by adding guardrails to large language models. It helps detect, quantify, and mitigate risks in LLM inputs/outputs, and facilitates the generation of structured data. This framework ensures more predictable and safer interactions with AI models.
Loop Engineering: Orchestrating AI Agents with Practical Patterns and Tools
Loop Engineering is a GitHub repository offering practical patterns, starters, and CLI tools for building robust AI coding agent systems. It shifts the focus from individual prompt crafting to designing control systems that orchestrate agents over time. This project empowers developers to create autonomous, iterative AI workflows for various development tasks.
MarkLLM: An Open-Source Toolkit for LLM Watermarking
MarkLLM is an open-source toolkit designed to simplify the research and application of watermarking technologies for large language models (LLMs). It offers a unified framework for implementing various watermarking algorithms, alongside robust visualization and comprehensive evaluation tools. This toolkit helps researchers and the broader community understand and assess the authenticity and origin of machine-generated text.
GLM-5: Flagship Models for Long-Horizon Agentic Engineering
GLM-5 is a series of flagship models, including GLM-5.2, GLM-5.1, and GLM-5, developed by zai-org for complex systems engineering and long-horizon agentic tasks. These models offer advanced coding capabilities, impressive context lengths, and state-of-the-art performance on various benchmarks. They are designed to sustain effective problem-solving over extended sessions through iterative reasoning and strategy revision.
Deliberation: Multi-Agent LLM Consensus for Code and Plan Review
Deliberation is an innovative GitHub repository that enables Claude Code to leverage multiple LLMs like GPT, Gemini, Grok, and 400+ OpenRouter models for expert second opinions and arbiter-mediated consensus. It provides specialized AI agents for tasks such as code review, security analysis, and architectural design, ensuring comprehensive and reliable feedback. This project helps developers get diverse perspectives and achieve higher quality in their work.
Open-LLM-VTuber: Your Offline, Cross-Platform AI Companion with Live2D
Open-LLM-VTuber is an innovative open-source project that brings a customizable, voice-interactive AI companion to your desktop. It supports real-time voice interaction, visual perception, and dynamic Live2D avatars, all running completely offline across Windows, macOS, and Linux. This project allows users to create a personalized AI companion with extensive model support and advanced interaction features, ensuring privacy and flexibility.
MOSS-TTS Family: Open-Source High-Fidelity Speech and Sound Generation
The MOSS-TTS Family offers an open-source suite of models for high-fidelity, highly expressive speech and sound generation. Designed for complex real-world scenarios, it covers stable long-form speech, multi-speaker dialogue, voice design, environmental sound effects, and real-time streaming TTS. This comprehensive family of models from MOSI.AI and OpenMOSS team provides robust solutions for diverse audio generation needs.
PEFT: State-of-the-Art Parameter-Efficient Fine-Tuning
PEFT (Parameter-Efficient Fine-Tuning) is a cutting-edge library from Hugging Face designed to efficiently adapt large pretrained models for various downstream applications. It dramatically reduces computational and storage costs by fine-tuning only a small subset of model parameters. This approach enables achieving performance comparable to fully fine-tuned models, making advanced AI accessible on more modest hardware.
Context7 Platform: Up-to-date Code Documentation for LLMs and AI Editors
Context7 Platform provides up-to-date, version-specific code documentation directly to LLMs and AI code editors. It eliminates outdated information and hallucinated APIs, ensuring accurate and relevant code generation. This tool significantly enhances the capabilities of AI coding assistants by integrating real-time documentation into their context.
WeClone: Create Your AI Digital Twin from Chat History with LLMs
WeClone is an innovative open-source project that provides a comprehensive solution for creating your personal AI digital twin. It allows users to fine-tune Large Language Models (LLMs) using their chat history, capturing unique communication styles. The resulting AI can then be integrated with various chatbots, bringing your digital self to life.