Repository History
3 repositories tagged with ai-testing
aimock: Comprehensive Mocking for AI Application Testing
aimock is a powerful tool designed for comprehensive testing of AI applications by mocking various AI APIs and services. It offers a unified solution to simulate interactions with LLM APIs, vector databases, and other AI infrastructure, ensuring deterministic and efficient testing workflows. With features like record and replay, chaos testing, and seamless framework integrations, aimock significantly simplifies the development and validation of robust AI systems.
LangTest: A Comprehensive Library for Safe & Effective Language Models
LangTest is an open-source Python library dedicated to ensuring the safety and effectiveness of language models. It offers a comprehensive framework for testing model quality, covering robustness, bias, fairness, and accuracy across various NLP tasks and LLM providers. With LangTest, developers can generate and execute over 60 distinct test types with just one line of code, promoting responsible AI development.
Giskard-OSS: Open-Source Evaluation & Testing Library for LLM Agents
Giskard-OSS is an open-source Python library designed for evaluating and testing AI systems, particularly LLM-based applications and traditional ML models. It automatically detects performance, bias, and security issues, offering comprehensive tools for ensuring the reliability and safety of AI. The library includes a powerful RAG Evaluation Toolkit (RAGET) for in-depth assessment of Retrieval Augmented Generation applications.