Repository History
57 repositories tagged with llm
POML: Structured Prompt Engineering for LLMs with a Markup Language
POML (Prompt Orchestration Markup Language) is a novel markup language developed by Microsoft for advanced prompt engineering. It brings structure, maintainability, and versatility to LLM applications by addressing common challenges like unstructured prompts and complex data integration. Developers can systematically organize prompt components, integrate diverse data types, and manage presentation variations for more sophisticated and reliable LLM interactions.
AI File Sorter: Organize Your Files with Local AI and Visual LLMs
AI File Sorter is a powerful cross-platform desktop application designed to automate file organization using AI. It leverages local LLMs for privacy-first categorization and can even suggest better filenames for images based on their visual content. This tool helps reduce clutter and improve file discoverability across various storage locations.
vLLM CLI: A Powerful Command-Line Interface for Serving LLMs with vLLM
vLLM CLI is an intuitive command-line interface tool designed to simplify serving Large Language Models using vLLM. It offers both interactive and direct CLI modes, enabling efficient model management, real-time server monitoring, and advanced configuration. This tool streamlines the deployment and management of LLMs, making it accessible for various use cases.
lagent: A Lightweight Framework for Building LLM-Based Agents
lagent is a lightweight, open-source framework developed by InternLM, designed for efficiently building large language model (LLM)-based agents. It provides a PyTorch-inspired design philosophy, making it intuitive for developers to create and manage multi-agent applications. This framework simplifies the process of agent communication, memory management, and tool integration.
Gurubase: AI-Powered Q&A Assistant Issue Tracker
Gurubase is a platform designed to transform your content into a 24/7 AI support assistant. This GitHub repository serves as the official hub for managing issues, feature requests, and bug reports related to the Gurubase product. It provides a centralized place for the community to contribute to the product's improvement.
Biomni: A General-Purpose Biomedical AI Agent for Research
Biomni is a general-purpose biomedical AI agent designed to autonomously execute a wide range of research tasks across diverse biomedical subfields. It integrates cutting-edge large language model reasoning with retrieval-augmented planning and code-based execution. This powerful tool helps scientists significantly enhance research productivity and generate testable hypotheses.
FastRTC: Real-Time Communication Library for Python Functions
FastRTC is a powerful Python library designed for real-time communication, enabling developers to transform any Python function into an audio and video stream over WebRTC or WebSockets. It simplifies the creation of interactive, real-time applications, particularly in the AI domain, by handling complex streaming logistics. This library offers robust features for building conversational AI, live video analysis, and more.
joinly: Make Your Meetings Accessible to AI Agents
joinly.ai is an open-source connector middleware designed to integrate AI agents into video calls. It enables agents to actively participate, interact in real-time, and perform tasks during meetings across platforms like Google Meet, Zoom, and Microsoft Teams. The project emphasizes a privacy-first approach, offering self-hosting capabilities and flexibility with various LLM, TTS, and STT providers.
mcp-server-chart: Empowering Chart Generation and Data Analysis with AntV
mcp-server-chart is a powerful Model Context Protocol (MCP) server from AntV, specializing in chart generation and data analysis. It provides over 25 diverse chart types, enabling users to create rich visualizations through various MCP tools and integrations. This TypeScript-based solution simplifies complex data representation, making it accessible for a wide range of analytical needs, including LLM-powered applications.
LitGPT: High-Performance LLMs for Pretraining, Finetuning, and Deployment
LitGPT, by Lightning AI, is a comprehensive GitHub repository offering over 20 high-performance Large Language Models (LLMs). It provides robust recipes and tools to pretrain, finetune, and deploy these models at scale. Designed with minimal abstractions, LitGPT ensures blazing fast, minimal, and performant solutions for enterprise-grade AI development.
AstrBot: Agentic IM ChatBot Infrastructure for Multi-Platform AI
AstrBot is an open-source, agentic IM chatbot infrastructure designed for seamless integration across multiple messaging platforms. It offers a powerful and user-friendly plugin system, supporting a wide range of advanced AI models and LLM platforms. This makes it an ideal solution for building reliable and scalable conversational AI applications, from personal AI companions to enterprise knowledge bases.
Agentless: An Agentless Approach to Solve Software Development Problems
Agentless is an innovative open-source project that offers an agentless approach to automatically solve software development problems. It streamlines the bug-fixing process through localization, repair, and patch validation phases. This tool aims to enhance efficiency in addressing software issues, particularly demonstrated by its performance on benchmarks like SWE-bench lite.