Repository History
2 repositories tagged with MoE
Colibri: Run 744B GLM-5.2 MoE on Consumer Machines with Pure C
Colibri is an innovative project that enables running the massive 744B-parameter GLM-5.2 Mixture-of-Experts (MoE) model on consumer-grade machines with as little as 25GB of RAM. It achieves this remarkable feat through a pure C engine with zero dependencies, streaming model experts from disk on demand. This allows users to interact with a frontier-class LLM without requiring expensive GPU hardware.
Wan2.2: Open and Advanced Large-Scale Video Generative Models
Wan2.2 is an open-source and advanced suite of large-scale video generative models, introducing innovations like a Mixture-of-Experts (MoE) architecture for enhanced capacity and cinematic-level aesthetics. It offers efficient high-definition video generation capabilities, including text-to-video, image-to-video, speech-to-video, and character animation. This powerful framework is designed for both industrial and academic applications, pushing the boundaries of AI-driven video creation.