Kv Cache Open Source Projects
Discover 2 open source Kv Cache repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Kv Cache projects here are most often combined with LLM, C++ and Distributed Systems. Last updated October 28, 2026.
tair-kvcache: Manage and Simulate LLM Inference KV Caches
Alibaba Cloud Tair KVCache combines global KV-cache management with HiSim, a CPU-based simulator for LLM inference performance. It is aimed at teams integrating cache storage with inference engines or evaluating workloads before allocating GPU resources.
ActiveHealth 52/100
LightLLM: Serve Large Language Models
LightLLM is a Python framework for running and serving large language models. It combines model inference with serving features for teams building scalable LLM endpoints or experimenting with serving systems.
ActiveHealth 68/100