Repository History
3 repositories tagged with mlops
LangTest: A Comprehensive Library for Safe & Effective Language Models
LangTest is an open-source Python library dedicated to ensuring the safety and effectiveness of language models. It offers a comprehensive framework for testing model quality, covering robustness, bias, fairness, and accuracy across various NLP tasks and LLM providers. With LangTest, developers can generate and execute over 60 distinct test types with just one line of code, promoting responsible AI development.
Evidently: Open-Source ML and LLM Observability Framework
Evidently is an open-source Python library designed for evaluating, testing, and monitoring machine learning and large language model systems. It provides over 100 built-in metrics for various tasks, from data drift detection to LLM judges, supporting both tabular and text data. This framework helps ensure the quality and performance of AI-powered systems throughout their lifecycle.
Giskard-OSS: Open-Source Evaluation & Testing Library for LLM Agents
Giskard-OSS is an open-source Python library designed for evaluating and testing AI systems, particularly LLM-based applications and traditional ML models. It automatically detects performance, bias, and security issues, offering comprehensive tools for ensuring the reliability and safety of AI. The library includes a powerful RAG Evaluation Toolkit (RAGET) for in-depth assessment of Retrieval Augmented Generation applications.