Inference Simulation Open Source Projects

Discover 1 open source Inference Simulation repository from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Inference Simulation projects here are most often combined with C++, Distributed Systems and LLM. Last updated October 28, 2026.

tair-kvcache: Manage and Simulate LLM Inference KV Caches

tair-kvcache: Manage and Simulate LLM Inference KV Caches

Alibaba Cloud Tair KVCache combines global KV-cache management with HiSim, a CPU-based simulator for LLM inference performance. It is aimed at teams integrating cache storage with inference engines or evaluating workloads before allocating GPU resources.

ActiveHealth 52/100

C++LLMDistributed Systems
Added Oct 28, 2026 View details

Related topics

C++ 46Distributed Systems 27LLM 217