Repository History
Explore all analyzed open source repositories
LangWatch: The Platform for LLM Evaluations and AI Agent Testing
LangWatch is an open-source platform designed for end-to-end LLM evaluations and AI agent testing. It helps teams test, simulate, evaluate, and monitor LLM-powered agents both before release and in production. Built for robust regression testing, simulations, and production observability, LangWatch eliminates the need for custom tooling.
Langsmith-sdk: Client SDK for LLM Debugging, Evaluation, and Monitoring
The Langsmith-sdk provides client SDKs for interacting with the LangSmith platform, enabling robust debugging, evaluation, and monitoring of language models and intelligent agents. It offers native integrations with both LangChain Python and LangChain JS, making it an essential tool for LLM application development.
HertzBeat: An AI-Powered Open Source Real-time Observability System
HertzBeat is an advanced, AI-powered open source observability system designed for real-time monitoring. It offers unified collection, centralized alerting, and intelligent management for a wide range of IT infrastructure, eliminating the need for agents. This comprehensive solution simplifies observability requirements for modern IT environments.
Karpor: Intelligence and Visualization for Kubernetes Clusters
Karpor is an open-source Kubernetes Visualization Tool designed to bring intelligence to your clusters. It provides advanced search, insightful analytics, and AI-powered operations for developers and platform engineering teams. Gain crucial visibility and streamline management across your Kubernetes environments with Karpor.
Prometheus: The Monitoring System and Time Series Database
Prometheus is an open-source systems and service monitoring system, part of the Cloud Native Computing Foundation. It excels at collecting metrics as time series data, evaluating rule expressions, and triggering alerts. Its multi-dimensional data model and powerful PromQL query language make it a robust choice for modern observability needs.
Grafana: The Open and Composable Observability and Data Visualization Platform
Grafana is a powerful open-source platform designed for monitoring and observability. It enables users to query, visualize, and set alerts on metrics, logs, and traces from diverse data sources. This platform helps teams create dynamic dashboards, fostering a data-driven culture through shared insights.
OpenLLMetry: Open-Source Observability for LLM Applications with OpenTelemetry
OpenLLMetry provides open-source observability for Generative AI (GenAI) and Large Language Model (LLM) applications, built upon the OpenTelemetry standard. It offers comprehensive tracing and monitoring capabilities, allowing seamless integration with existing observability solutions like Datadog, Honeycomb, and Grafana. This project simplifies the process of gaining insights into your LLM-powered systems.