Repository History
15 repositories tagged with API
LitServe: Build Custom Inference Engines for AI Models
LitServe is a powerful framework from Lightning AI designed to help developers build custom inference engines for a wide range of AI models and systems. It provides expert control over serving, supporting agents, multi-modal systems, RAG, and pipelines without the typical MLOps overhead. This framework offers a flexible and efficient solution for deploying AI models, whether self-hosted or managed on the Lightning AI platform.
OpenMeter: Real-time Usage Metering and Billing for Modern Applications
OpenMeter is an open-source platform designed for real-time metering and billing in AI, API, and DevOps contexts. It enables the collection and aggregation of millions of usage events, facilitating robust usage-based billing models. This tool provides essential infrastructure for companies looking to monetize their services based on actual consumption.
claude-code-proxy: Use Anthropic Clients with OpenAI and Gemini Models
`claude-code-proxy` is a powerful proxy server that allows developers to use Anthropic clients, such as Claude Code, with various backend models including OpenAI, Gemini, or even Anthropic's own models. It provides seamless translation of API requests and responses, offering flexibility and control over your AI model choices. This tool is ideal for integrating different LLM providers without modifying existing Anthropic client code.