shimmy: Run GGUF Models with Airframe WebGPU
Shimmy is a single-binary, OpenAI-compatible inference server for GGUF models, built on Airframe, a pure-Rust WebGPU transformer engine. It runs locally on supported GPUs and serves chat and completion requests without Python or a C++ toolchain.
ActiveHealth 34/100
RustAILLM
Added Sep 28, 2026 View details
