Repository History
8 repositories tagged with Large Language Models
RouteLLM: Optimize LLM Costs and Maintain Quality with Intelligent Routing
RouteLLM is a powerful framework designed to serve and evaluate LLM routers, enabling significant cost savings without compromising response quality. It intelligently routes simpler queries to cheaper models while maintaining high performance, offering a drop-in replacement for existing OpenAI clients or a compatible server. This solution helps balance the dilemma of LLM deployment costs versus model capabilities.
EasyInstruct: An Easy-to-Use Instruction Processing Framework for LLMs
EasyInstruct is an open-source Python framework designed to simplify instruction processing for Large Language Models (LLMs). Accepted at ACL 2024, it offers modularized components for instruction generation, selection, and prompting, supporting various LLMs like GPT-4 and LLaMA. This framework is ideal for researchers and developers working on LLM-based experiments and applications.
ChatArena: Multi-Agent Language Game Environments for LLMs
ChatArena is a Python library designed to provide multi-agent language game environments for Large Language Models (LLMs), aiming to foster the development of communication and collaboration capabilities in AI. It offers a flexible framework for defining players, environments, and interactions based on Markov Decision Processes. Please note that as of August 11, 2025, this project has been deprecated due to a lack of widespread community use and is no longer receiving updates or support.
Kimi-k1.5: Scaling Reinforcement Learning with LLMs and Multimodality
Kimi-k1.5 introduces an o1-level multi-modal model that significantly advances reinforcement learning with Large Language Models. It demonstrates state-of-the-art performance in short-CoT tasks, outperforming leading models like GPT-4o and Claude Sonnet 3.5, and matches o1 performance in long-CoT scenarios across various modalities. This project highlights key innovations in long context scaling and improved policy optimization.
HiveChat: An AI Chat Bot for Teams Supporting Multiple LLMs
HiveChat is an AI chat application designed for small and medium-sized teams, offering support for a wide range of large language models including Deepseek, OpenAI, Claude, and Gemini. It provides robust features for user and model management, enabling administrators to configure access and token limits for different user groups. This platform streamlines AI integration, making advanced conversational AI accessible and manageable for organizations.
AI Engineering Toolkit: 100+ Libraries for LLM Development
The AI Engineering Toolkit is a comprehensive, curated list featuring over 100 libraries and frameworks essential for AI engineers. It provides battle-tested tools, frameworks, and reference implementations to develop, deploy, and optimize applications built with Large Language Models. This resource aims to help engineers build better LLM apps faster, smarter, and production-ready.
Transformer Lab App: An Open Source Platform for Frontier AI/ML Workflows
Transformer Lab App is an open-source machine learning research platform designed for frontier AI/ML workflows. It provides a comprehensive toolkit for large language models, allowing users to train, tune, and chat on their own machines, whether locally, on-prem, or in the cloud. Backed by Mozilla, this cross-platform application simplifies experimentation with a wide range of models.
gptpdf: Effortlessly Parse PDFs into Markdown with GPT-4o
gptpdf is a powerful Python library that leverages large visual models like GPT-4o to accurately parse PDF documents into clean Markdown format. With just 293 lines of code, it excels at preserving typography, math formulas, tables, and images. This tool offers an efficient and cost-effective solution for converting complex PDFs.