Repository History
138 repositories tagged with LLM
llm-d Router: Intelligent Orchestration for Multi-Phase LLM Inference
The `llm-d-router` is a sophisticated Go service designed as an intelligent entry point for large language model (LLM) inference requests. It orchestrates complex, multi-phase LLM inference pipelines across specialized worker pools, routing requests through an Inference Gateway to disaggregated vLLM workers. By exposing OpenAI-compatible APIs, it simplifies integration and leverages Kubernetes for scalable, efficient deployments.
LLM Wiki: Build a Self-Maintaining, Interlinked Knowledge Base with AI
LLM Wiki is a powerful cross-platform desktop application designed to transform your documents into an organized, interlinked knowledge base automatically. Unlike traditional RAG systems, it incrementally builds and maintains a persistent wiki from your sources, ensuring knowledge is compiled once and kept current. This innovative approach offers a dynamic and evolving personal knowledge management solution.
HarnessRouter: Unified Interface for AI Agent Harnesses
HarnessRouter Community Edition provides a self-hosted, Apache-2.0 licensed unified interface for various AI agent harnesses like Codex, Claude Code, and Hermes. It allows users to run multiple agents through a single API, offering features such as sessions, streaming, file handling, and cancellation. The project implements the open-standard Unified Harness Protocol (UHP), ensuring users maintain control over their keys and infrastructure.
Maka: A High-Performance Agent Workspace for AI Tasks
Apache Maka (Incubating) is a high-performance agent workspace designed to maintain a complete, append-only record of all agent actions. It focuses on measurable performance, local-first operation, and robust recovery mechanisms. This project provides a unified execution authority for desktop, TUI, and CLI clients, ensuring consistent agent behavior across platforms.
uta: A CLI Agent Orchestrator for Parallel AI Task Management
uta is a command-line interface (CLI) agent orchestrator designed to decompose complex goals into parallel subtasks. It can dispatch these tasks to various agent CLIs like Claude Code or Gemini CLI, record every step of the process, and synthesize the final results. This tool enhances agent capabilities by enabling parallelism and cross-provider task execution.
Open Code Review: AI-Powered Code Review Tool from Alibaba
Open Code Review is an AI-powered command-line interface tool for code review, battle-tested at Alibaba's scale. It leverages a hybrid architecture, combining deterministic engineering with an LLM agent, to provide secure, fast, and efficient code analysis. This tool generates precise, line-level comments and supports a multi-language ruleset, ensuring high-quality code reviews.
AgentShield: Python Firewall for AI Agent Spend Control
AgentShield is a pure Python library designed to prevent runaway AI agents from exceeding budget limits. It offers 10 composable spend rules, evaluated in under 1ms, providing robust cost control. Although its core development has transitioned to sipi.bot, the AgentShield Python package remains available for existing users and its test fixtures are open-source.
session-to-skill: Automate AI Agent Skill Creation from OpenCode Sessions
session-to-skill is a powerful tool designed to transform OpenCode shared sessions into fully validated, reusable, and publishable AI agent skills. It automates the process of extracting patterns, applying TRACE validation and security checks, and packaging the skill into a ZIP file, streamlining development for platforms like SkillHub.
Curie: Automated and Rigorous Scientific Experimentation with AI Agents
Curie is an innovative AI-agent framework designed for automating rigorous scientific experimentation. It streamlines the entire research lifecycle, from hypothesis formulation to result interpretation, ensuring precision, reliability, and reproducibility. This empowers scientists to accelerate their research processes significantly.
Apache Maka: A High-Performance Agent Workspace for AI Tasks
Apache Maka is an incubating project from The Apache Software Foundation, offering a high-performance agent workspace designed to meticulously record all agent activities. It provides a local-first environment for AI agents, allowing users to bring their own models and ensuring transparent, measurable task completion. This project aims to set a new standard for agent reliability and accountability.
Tau: A Minimalist Python Coding Agent for Your Terminal
Tau is a Python port of Pi's minimalist coding agent, designed to live in your terminal. It allows users to make requests like "explain this repo" or "add tests," and it can read files, edit code, and run commands. Beyond its utility, Tau also serves as a teaching project, demonstrating how coding agents are built with a small, readable codebase.
SandBase CLI: Connect Your AI Agent to 2,000+ Models and APIs
SandBase CLI is an open-source command-line interface and local MCP server that supercharges AI agents. It connects 25 popular AI clients, such as Claude Code, Cursor, and ChatGPT, to over 2,000 AI models and APIs, simplifying complex integrations. This powerful tool streamlines AI agent development by offering a unified gateway, removing the hassle of API key management and configuration.