Repository History
10 repositories tagged with large-language-models
LangTest: A Comprehensive Library for Safe & Effective Language Models
LangTest is an open-source Python library dedicated to ensuring the safety and effectiveness of language models. It offers a comprehensive framework for testing model quality, covering robustness, bias, fairness, and accuracy across various NLP tasks and LLM providers. With LangTest, developers can generate and execute over 60 distinct test types with just one line of code, promoting responsible AI development.
EvalPlus: Rigorous Evaluation for LLM-Synthesized Code
EvalPlus is a robust framework designed for the rigorous evaluation of code generated by Large Language Models (LLMs). It extends standard benchmarks like HumanEval and MBPP with significantly more tests, offering precise assessment of code correctness and efficiency. This tool is crucial for developers and researchers aiming to thoroughly validate LLM-synthesized code.
XGrammar: Fast, Flexible, and Portable Structured Generation for LLMs
XGrammar is an open-source library for efficient, flexible, and portable structured generation, developed by mlc-ai. It leverages constrained decoding to guarantee 100% structural correctness for outputs like JSON and regex. Optimized for near-zero overhead, XGrammar offers universal deployment across various platforms, hardware, and programming languages, making it a leading solution for structured output from large language models.
LLM Guard: The Security Toolkit for LLM Interactions
LLM Guard is an open-source security toolkit developed by Protect AI, designed to fortify the safety of Large Language Models. It offers comprehensive protection against various threats, including prompt injection, data leakage, and harmful language, ensuring secure and reliable LLM interactions.
MarkLLM: An Open-Source Toolkit for LLM Watermarking
MarkLLM is an open-source toolkit designed to simplify the research and application of watermarking technologies for large language models (LLMs). It offers a unified framework for implementing various watermarking algorithms, alongside robust visualization and comprehensive evaluation tools. This toolkit helps researchers and the broader community understand and assess the authenticity and origin of machine-generated text.
langcorn: Serve LangChain LLM Apps and Agents with FastAPI
Langcorn is an innovative API server designed to effortlessly deploy LangChain models and pipelines. It leverages the high-performance FastAPI framework, offering a robust and scalable solution for serving large language model applications. With features like easy installation, built-in authentication, and support for custom API keys, Langcorn streamlines the process of bringing your LLM projects to production.
EasyEdit: An Easy-to-Use Knowledge Editing Framework for LLMs
EasyEdit is an open-source framework designed for efficient knowledge editing in Large Language Models (LLMs). It provides a unified, easy-to-use platform to modify, insert, or erase specific knowledge within LLMs without negatively impacting overall performance. This tool is crucial for aligning LLMs with evolving user needs and correcting factual inaccuracies.
LitGPT: High-Performance LLMs for Pretraining, Finetuning, and Deployment
LitGPT, by Lightning AI, is a comprehensive GitHub repository offering over 20 high-performance Large Language Models (LLMs). It provides robust recipes and tools to pretrain, finetune, and deploy these models at scale. Designed with minimal abstractions, LitGPT ensures blazing fast, minimal, and performant solutions for enterprise-grade AI development.
ggml: A Low-Level Tensor Library for Machine Learning
ggml is an innovative tensor library designed for machine learning, emphasizing low-level, cross-platform implementation. It offers features like integer quantization, automatic differentiation, and broad hardware support, all while maintaining zero third-party dependencies and efficient memory usage. This project is actively developed and forms the backbone for other popular projects like llama.cpp and whisper.cpp.
FinGPT: Open-Source Large Language Models Revolutionizing Financial AI
FinGPT is an open-source initiative providing large language models specifically designed for the financial sector. It aims to democratize access to advanced AI for finance, offering cost-effective and adaptable solutions for tasks like sentiment analysis and robo-advisory, addressing the dynamic nature of financial data.