Open Source Testing Projects
Software testing checks whether applications behave as expected, helps uncover defects, and reduces the risk of changes causing regressions. It ranges from checking individual functions to validating complete systems, and can include generated inputs, simulated services, network inspection, and security-focused testing. As applications increasingly use machine learning models and automated agents, testing also helps assess output quality, reliability, and safety across varied scenarios.
Open source testing tools include test frameworks, data generators, mocks and fakes, protocol debugging utilities, fuzzers, and evaluation systems. When choosing one, consider its maturity, license, maintenance activity, supported languages and platforms, integration with your development workflow, and resource requirements. Testing tools are useful to developers, quality engineers, security teams, and researchers building or maintaining software, APIs, and AI-enabled applications.
26 repositories · updated October 3, 2026
Agent Anvil: CI-First Evaluation Harness for Tool-Using AI Agents
Agent Anvil is a robust, CI-first evaluation harness designed for AI agents that utilize tools. It meticulously runs scenario suites, captures detailed traces of agent behavior, and provides semantic grading to identify issues. The platform excels at clustering failures and suggesting concrete fixes for prompts, tools, and guardrails, ensuring agents behave safely and effectively.
Meshtastic-MCP: AI Tooling for Meshtastic Device Control and Testing
Meshtastic-MCP provides an MCP server and agent skills designed for AI tooling to discover, drive, observe, and test Meshtastic devices and applications. It offers a comprehensive suite of capabilities, from portable device control to advanced hardware-free end-to-end testing and replay functionalities. This project aims to streamline the development and testing of Meshtastic ecosystems.
ios-simulator-skill: Enhance Claude's iOS App Development with Simulator Skill
The ios-simulator-skill is a production-ready skill for Claude Code, designed to build, test, and automate iOS applications efficiently. It optimizes Claude's interaction with the iOS Simulator and Xcode builds, significantly reducing token wastage from LLM output. This skill provides 27 scripts for robust semantic UI navigation, accessibility testing, and device lifecycle management.
aimock: Comprehensive Mocking for AI Application Testing
aimock is a powerful tool designed for comprehensive testing of AI applications by mocking various AI APIs and services. It offers a unified solution to simulate interactions with LLM APIs, vector databases, and other AI infrastructure, ensuring deterministic and efficient testing workflows. With features like record and replay, chaos testing, and seamless framework integrations, aimock significantly simplifies the development and validation of robust AI systems.
nose2: The Successor to nose, Based on unittest2
nose2 is a powerful testing framework for Python, designed as the successor to the popular nose project. Built upon Python's standard `unittest` module, it extends its capabilities to provide a more flexible and feature-rich testing experience. It aims to make writing and running tests in Python simpler and more efficient.
Green: A Clean, Colorful, and Fast Python Test Runner
Green is an innovative Python test runner designed for clarity, speed, and visual appeal. It provides a clean, colorful, and fast way to execute `unittest` based tests, enhancing the developer experience with detailed, aligned output and parallel execution.
Freezegun: Time Travel for Your Python Tests
Freezegun is a powerful Python library designed to simplify testing by allowing your tests to travel through time. It achieves this by mocking the `datetime` module, enabling developers to freeze time at a specific point or even simulate its progression. This functionality is crucial for ensuring consistent and reliable test results when dealing with time-sensitive logic.
httmock: A Powerful Mocking Library for Python Requests
httmock is an essential Python library designed for mocking HTTP requests made by the popular `requests` library. It allows developers to easily simulate API responses, making it ideal for testing applications that interact with external services. With httmock, you can control network interactions, ensuring reliable and repeatable tests without relying on actual network calls.
HTTPretty: Intercepting HTTP Requests for Python Testing
HTTPretty is a powerful Python library designed to intercept HTTP requests at the socket level, effectively faking the entire socket module. It provides a robust solution for mocking external HTTP services, making it ideal for test-driven development and reliable API integration testing. Developers can use HTTPretty to simulate various HTTP responses, ensuring comprehensive and isolated testing environments.
Mocket: A Comprehensive Socket Mocking Framework for Python
Mocket is a powerful Python framework designed for monkey-patching the `socket` and `ssl` modules, enabling robust testing of network-dependent applications. It serves as both a low-level framework for building custom clients and a ready-to-use mock for HTTP/HTTPS calls, supporting various environments including asyncio and MicroPython. This tool simplifies the process of isolating and testing Python clients that communicate over the socket protocol.
vcrpy: Simplify and Speed Up Python HTTP Testing
vcrpy is a Python library that automatically mocks your HTTP interactions, making testing simpler and significantly faster. Inspired by Ruby's VCR, it records HTTP requests and responses to a 'cassette' file during the first test run, then replays them in subsequent runs, eliminating actual network traffic. This approach ensures deterministic tests, allows offline development, and boosts test execution speed.
Mixer: A Powerful Fixture Replacement for Python ORMs and ODMs
Mixer is a versatile Python library designed to replace fixtures and generate test data efficiently. It supports various ORMs and ODMs, including Django, SQLAlchemy, Flask-SQLAlchemy, Mongoengine, and Marshmallow, making it an invaluable tool for testing and development workflows.