OSRepos
Discover open source projects through curated analysis, useful topics, and repository deep dives.
Featured repository
TensorRT-LLM: Optimizing Large Language Model Inference on NVIDIA GPUs
TensorRT-LLM is an open-source library by NVIDIA designed to optimize inference for Large Language Models (LLMs) and Visual Generation models. It offers a user-friendly Python API, state-of-the-art optimizations, and specialized kernels to ensure efficient performance on NVIDIA GPUs. This powerful tool enables developers to deploy LLMs with high throughput and low latency, from single-GPU setups to multi-node deployments.
Explore by topic
Jump into the most common areas across analyzed repositories.
Recently analyzed
Fresh repository analysis from the OSRepos archive.
TensorRT-LLM: Optimizing Large Language Model Inference on NVIDIA GPUs
TensorRT-LLM is an open-source library by NVIDIA designed to optimize inference for Large Language Models (LLMs) and Visual Generation models. It offers a user-friendly Python API, state-of-the-art optimizations, and specialized kernels to ensure efficient performance on NVIDIA GPUs. This powerful tool enables developers to deploy LLMs with high throughput and low latency, from single-GPU setups to multi-node deployments.
Docling: Streamline Document Processing for Generative AI Applications
Docling is a powerful Python library designed to simplify document processing, preparing diverse formats for generative AI applications. It offers advanced parsing capabilities, including sophisticated PDF understanding, and provides a unified document representation. With seamless integrations into the AI ecosystem, Docling empowers developers to build robust AI solutions.
Llama Cloud Services: Knowledge Agents and Management in the Cloud
Llama Cloud Services offers tools for building knowledge agents and managing data in the cloud. It provides robust capabilities for parsing various document types, including PDF, DOCX, and PPTX, into structured formats. Users should note that this repository is deprecated, with migration recommended to the new `llama-cloud` packages for continued support and improved performance.
DataDreamer: Streamlining Synthetic Data Generation and LLM Workflows
DataDreamer is an open-source Python library designed for efficient prompting, synthetic data generation, and model training workflows. It simplifies the process of creating complex LLM workflows, generating high-quality synthetic datasets, and aligning or fine-tuning models. Built to be simple, efficient, and research-grade, DataDreamer empowers users to build reproducible and shareable AI solutions.
DeepFabric: High-Quality Synthetic Data for Agentic AI Systems
DeepFabric is an open-source Python library designed to generate high-quality synthetic training data for language models and agent evaluations. It excels at creating domain-specific datasets that teach models to think, plan, and act effectively, including correct tool usage and adherence to schema structures. This comprehensive pipeline also integrates training and evaluation capabilities, ensuring robust model development.
EasyInstruct: An Easy-to-Use Instruction Processing Framework for LLMs
EasyInstruct is an open-source Python framework designed to simplify instruction processing for Large Language Models (LLMs). Accepted at ACL 2024, it offers modularized components for instruction generation, selection, and prompting, supporting various LLMs like GPT-4 and LLaMA. This framework is ideal for researchers and developers working on LLM-based experiments and applications.
Discover something different
A rotating sample from deeper in the archive.
Hiring Agent: An AI Agent for Resume Evaluation and Scoring
Hiring Agent is an open-source AI agent designed to evaluate and score resumes objectively. It extracts structured data from PDF resumes, enriches it with GitHub profile signals, and provides a fair, explainable evaluation with detailed scores and evidence. This tool supports both local LLMs via Ollama and cloud-based options like Google Gemini.
YunoHost: Simplify Your Server Administration with This OS
YunoHost is an operating system designed to significantly simplify server administration. This core repository contains the main codebase, primarily written in Python and Bash, enabling users to self-host various services with ease. It offers a user-friendly interface and robust tools for managing your personal server.
Server Tools (st): Streamline Ubuntu Server Management with a Modern CLI
Server Tools (st) is a lightweight, modular CLI designed to simplify the management of headless Ubuntu servers. It offers a comprehensive suite of commands for system updates, package installations, backups, and diagnostics. This tool aims to make server administration effortless and efficient for developers and system administrators.
Stay Updated
Get notified about new repositories and updates. Join our community of developers!