Repository History
2 repositories tagged with GPT
LightLLM: A Lightweight and High-Speed LLM Inference and Serving Framework
LightLLM is a Python-based framework designed for efficient Large Language Model (LLM) inference and serving. It stands out for its lightweight architecture, impressive scalability, and high-speed performance, making it an excellent choice for deploying LLMs. The framework integrates and builds upon the strengths of various leading open-source implementations to deliver optimized results.
Helicone: Open Source LLM Observability Platform and AI Gateway
Helicone is an open-source LLM observability platform and AI Gateway for AI engineers. It provides one-line code integration to monitor, evaluate, and experiment with large language models, offering features like cost tracking, prompt management, and intelligent routing. The platform supports a wide range of inference providers and frameworks, simplifying LLM development and deployment.