Repository History
2 repositories tagged with Quantization
xTuring: Build, Personalize, and Control Your Own LLMs
xTuring is an open-source framework designed to simplify the process of building, personalizing, and controlling Large Language Models (LLMs). It provides an easy way to fine-tune open-source LLMs on your own data, offering features from data pre-processing to efficient training and inference. This tool empowers developers to create private, personalized LLMs locally or in their private cloud environments.
AIMET: Advanced Quantization and Compression for Neural Networks
AIMET, the AI Model Efficiency Toolkit, is an open-source Python library developed by Qualcomm Innovation Center, Inc. It provides advanced techniques for quantizing and compressing trained deep learning models. This toolkit helps improve runtime performance and reduce memory footprint, making models more efficient for deployment on edge devices while minimizing accuracy loss.