Repository History
3 repositories tagged with Kubernetes
Inference Gateway: Unifying LLM Providers with a High-Performance API
Inference Gateway is an open-source, cloud-native, high-performance proxy server designed to unify access to various language model APIs. It provides a single OpenAI-compatible endpoint, simplifying interactions with multiple LLM providers, from local solutions like Ollama to major cloud platforms. This gateway enables seamless integration and management of diverse AI models, enhancing portability and data privacy.
SandBase Harness: Local-First AI Agent Runtime with Sandboxed Sessions
SandBase Harness is a local-first, self-hosted runtime for AI agents, offering sandboxed sessions, memory, and credentials. This TypeScript-based project provides a robust infrastructure for managing and observing AI agents, ensuring auditability and secure execution on your own machine or infrastructure.
Flyte: Scalable Workflow Orchestration for Data and ML
Flyte is an open-source, scalable, and flexible workflow orchestration platform that seamlessly unifies data, machine learning, and analytics stacks. It leverages Kubernetes as its underlying platform, enabling the construction of robust and reproducible production-grade pipelines.