Open Source Testing Projects
Discover 53 open source Testing repositories from GitHub, each with an analysis of what it does, key features, use cases and alternatives. Testing projects here are most often combined with Python, Developer Tools and Library. Last updated October 4, 2026.
53 repositories · updated October 4, 2026
JailbreakEval: Compare LLM Jailbreak Evaluators
JailbreakEval brings together automated methods for assessing whether language-model responses comply with jailbreak attempts. Researchers can compare evaluators across datasets, while developers can build and benchmark new evaluation methods.
pytype: Analyze Python Types Statically
pytype is a static type analyzer for Python that uses type inference alongside annotations to find type problems without running code. Its final supported Python version is 3.12, so it is best suited to existing projects that target that version.
shortest: Write End-to-End Tests in Natural Language
Shortest is a TypeScript end-to-end testing framework that turns natural-language instructions into browser tests, using Anthropic Claude and Playwright. It suits teams that want to describe user flows plainly while retaining hooks for custom assertions and setup.
insomnia: Design, Test, and Debug APIs
Insomnia is a cross-platform API client for designing, testing, and debugging APIs across protocols including REST, GraphQL, WebSockets, SSE, and gRPC. It supports local, Git, and cloud storage for project data.
bruno: Explore and Test APIs with a Local-First Client
Bruno is an API client for exploring requests, testing APIs, and running collections from a desktop app or CLI. It stores collections as plain-text files on your device, making them suitable for Git-based collaboration without cloud sync.
promptfoo: Evaluate and Red-Team LLM Applications
Promptfoo is a CLI and library for evaluating prompts, comparing models, and testing LLM applications for security risks. It suits developers who want repeatable quality and vulnerability checks locally or in CI/CD.
GeoPort: Simulate an iPhone's Location from Desktop
GeoPort is a desktop app for simulating an iOS device's location on iOS 17 and 18. It is aimed at developers testing location-based apps and users who need to change a device's simulated location, with Windows and macOS packages available from releases.
inspector: Test and Debug MCP Servers and Apps
MCPJam Inspector helps developers test, inspect, and evaluate MCP servers and apps across clients and models. Use it to debug protocol and OAuth behavior, run repeatable evaluations, and check for regressions in CI.
responses: Mock Python Requests in Tests
Responses intercepts Python Requests calls and serves registered mock responses, so tests can exercise HTTP client code without contacting real services. It supports request matching, callbacks, call assertions, and ordered response sequences.
docker-android: Run Android Emulators in Docker
Docker-Android packages Android emulators in containers for app development and testing. It provides browser-based viewing, ADB access and integrations for automation workflows, with virtualization support required for local emulator runs.
ladder: Proxy Web Requests and Modify Responses
Ladder is a self-hosted HTTP proxy for testing how websites deliver content to different clients. It can modify headers, URLs, and HTML, helping developers and researchers inspect paywall and access-control behavior for legitimate testing.
giskard-oss: Test and Red-Team LLM Agents
Giskard is a Python toolkit for evaluating agent behavior and probing AI systems for vulnerabilities. It suits teams building LLM agents or RAG applications that need repeatable checks, safety testing, and adversarial evaluation.