OSRepos
Discover open source projects through curated analysis, useful topics, and repository deep dives.
Featured repository
RAGChecker: A Fine-grained Framework for Diagnosing RAG Systems
RAGChecker is an advanced automatic evaluation framework developed by Amazon Science, specifically designed to assess and diagnose Retrieval-Augmented Generation (RAG) systems. It offers a comprehensive suite of metrics and tools for in-depth analysis of RAG performance. This framework empowers developers and researchers to thoroughly evaluate and enhance their RAG systems with precision.
Explore by topic
Jump into the most common areas across analyzed repositories.
Recently analyzed
Fresh repository analysis from the OSRepos archive.
RAGChecker: A Fine-grained Framework for Diagnosing RAG Systems
RAGChecker is an advanced automatic evaluation framework developed by Amazon Science, specifically designed to assess and diagnose Retrieval-Augmented Generation (RAG) systems. It offers a comprehensive suite of metrics and tools for in-depth analysis of RAG performance. This framework empowers developers and researchers to thoroughly evaluate and enhance their RAG systems with precision.
rerankers: Unified API for Reranking and Cross-Encoder Models
rerankers is a lightweight, low-dependency Python library that provides a unified API for various reranking and cross-encoder models. It simplifies the integration of different reranking approaches into retrieval architectures, offering a consistent interface for diverse models like cross-encoders, RankGPT, T5, and API-based rerankers. This library aims to make reranking more accessible and easier to implement for developers.
LLM Compressor: Optimize LLMs for Deployment with vLLM
LLM Compressor is a Transformers-compatible Python library designed to apply various compression algorithms to Large Language Models (LLMs). It enables optimized deployment, especially with vLLM, by offering a comprehensive set of quantization techniques for weights, activations, and KV Cache. This tool seamlessly integrates with Hugging Face models, making LLM optimization accessible and efficient.
LightLLM: A Lightweight and High-Speed LLM Inference and Serving Framework
LightLLM is a Python-based framework designed for efficient Large Language Model (LLM) inference and serving. It stands out for its lightweight architecture, impressive scalability, and high-speed performance, making it an excellent choice for deploying LLMs. The framework integrates and builds upon the strengths of various leading open-source implementations to deliver optimized results.
torchchat: Run PyTorch LLMs Locally on Servers, Desktop, and Mobile
torchchat is a PyTorch-native codebase designed to showcase the ability to run large language models (LLMs) seamlessly across various platforms. It enables local execution of LLMs using Python, within C/C++ applications on desktop or servers, and directly on iOS and Android devices. Although no longer under active development, it remains a valuable resource for understanding and implementing local LLM deployment strategies.
TensorRT-LLM: Optimizing Large Language Model Inference on NVIDIA GPUs
TensorRT-LLM is an open-source library by NVIDIA designed to optimize inference for Large Language Models (LLMs) and Visual Generation models. It offers a user-friendly Python API, state-of-the-art optimizations, and specialized kernels to ensure efficient performance on NVIDIA GPUs. This powerful tool enables developers to deploy LLMs with high throughput and low latency, from single-GPU setups to multi-node deployments.
Discover something different
A rotating sample from deeper in the archive.
typed-ffmpeg: Type-Safe FFmpeg Bindings for Python and TypeScript
typed-ffmpeg offers a modern, type-safe interface to FFmpeg for both Python and TypeScript. It provides extensive support for complex filters with detailed typing, documentation, and features like JSON serialization of filter graphs and automatic FFmpeg validation. This project enhances functionality by addressing common limitations found in similar tools, ensuring a robust development experience.
MongoDB MCP Server: Connect to MongoDB and Atlas with Model Context Protocol
The MongoDB MCP Server is a Model Context Protocol server designed to facilitate interaction with MongoDB databases and MongoDB Atlas clusters. It provides a standardized way for clients to access and manage MongoDB data and Atlas resources, supporting a wide range of database and Atlas-specific tools.
newsnow: Elegant Real-time News Reading with a Clean UI
newsnow offers an elegant and clean UI for reading real-time and trending news. It supports features like GitHub OAuth login, data synchronization, and adaptive scraping intervals to ensure an optimal and up-to-date news experience. This project, built with TypeScript, is designed for easy deployment on platforms like Cloudflare Pages or Vercel.
Stay Updated
Get notified about new repositories and updates. Join our community of developers!