{"name":"AutoResearch: AI/ML Research Agents from Idea to Paper-Ready Evidence","description":"AutoResearch is an open-source agent workflow designed for AI and machine learning research. It automates the entire research process, from generating ideas and planning experiments to execution, analysis, and independent evaluation. This project helps researchers produce paper-ready evidence efficiently and with traceable provenance.","github":"https://github.com/EvoMap/AutoResearch","url":"https://osrepos.com/repo/evomap-autoresearch","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/evomap-autoresearch","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/evomap-autoresearch.md","json":"https://osrepos.com/repo/evomap-autoresearch.json","topics":["Python","AI","Machine Learning","Research Agents","Automation","Open Source"],"keywords":["Python","AI","Machine Learning","Research Agents","Automation","Open Source"],"stars":null,"summary":"AutoResearch is an open-source agent workflow designed for AI and machine learning research. It automates the entire research process, from generating ideas and planning experiments to execution, analysis, and independent evaluation. This project helps researchers produce paper-ready evidence efficiently and with traceable provenance.","content":"## Introduction\n\nAutoResearch, an open-source project by EvoMap, is an advanced agent workflow designed to streamline AI and machine learning research. It guides the entire research process, from initial idea generation and experiment planning to implementation, execution, result analysis, and independent evaluation. The goal is to produce a comprehensive evidence package ready for paper writing, significantly reducing manual effort and enhancing research quality.\n\nThis system addresses common challenges in AI/ML research by grounding problem discovery in real signals, incorporating domain knowledge, and validating claims through cross-model review, source records, experiment logs, critic reports, and blind reviews. It aims to minimize unsupported generation, unclear provenance, inflated self-evaluation, and overinterpretation of results, while preserving all necessary evidence and state for researcher review.\n\n## Why Use It and Key Benefits\n\nAutoResearch offers several core capabilities that make it a powerful tool for researchers:\n\n*   **Cross-domain Idea Generation**: Discover new problems by combining recent external signals (papers, communities, open-source trends) with your local domain knowledge and constraints.\n*   **Independent Multi-Model Review**: Utilize at least three distinct models during idea generation to ensure independent development and cross-review of candidate ideas, enhancing objectivity.\n*   **Stateful Experiment Execution**: Plans, code, queues, logs, and conclusions are persistently stored, allowing long-running experiments to resume seamlessly after interruptions.\n*   **Pilot Before Scaling**: Test the feasibility of experiments at a lower cost before committing to full-scale execution, enabling early stopping or revision.\n*   **Traceable Evidence and Sources**: All research artifacts, including Forge sources, knowledge directions, experiment results, critic reports, and blind reviews, are meticulously recorded for full transparency.\n*   **Support for Negative Results**: The system preserves evidence and allows for early termination when a hypothesis fails, preventing the forced narrative of success in every experiment.\n\n## Installation\n\nTo get started with AutoResearch, follow these steps to set up your environment:\n\n1.  **Clone the Repository and Check the Environment**:\n    Prepare a Linux or SSH machine with Git, Python 3.10+, and `python3-venv` installed.\n\n    bash\ngit clone https://github.com/EvoMap/AutoResearch.git\ncd AutoResearch\nbash scripts/bringup.sh\n    \n\n    `bringup.sh` sets up the Python environment, installs dependencies, runs baseline tests, and checks model configuration without contacting model services.\n\n2.  **Configure Model Services**:\n    Create local configuration files for API keys and provider settings.\n\n    bash\ntest -f .env || cp .env.example .env\ntest -f config/providers.local.json || \\\n  cp config/providers.example.json config/providers.local.json\n    \n\n    Edit `.env` for API URLs/keys and `config/providers.local.json` for endpoints and model assignments. AutoResearch supports various combinations of Gemini, GPT, or Claude models.\n\n3.  **Test the APIs**:\n    Verify your model configurations by sending a small number of real requests.\n\n    bash\nset -a\n. ./.env\nset +a\n.venv/bin/python scripts/preflight.py --live\n    \n\n    An exit code `0` indicates that normal roles have usable models and multi-model stages meet independence requirements.\n\n## Examples\n\nAutoResearch supports two main workflows: Idea Generation and Idea Execution.\n\n### Idea Generation: Cross-Domain Discovery\n\nThis workflow helps you discover and plan new research directions.\n\n1.  **Run the Pipeline**:\n    Execute the default entrypoint to collect signals, filter, intersect with local knowledge, generate and review ideas, and plan experiments.\n\n    bash\n.venv/bin/python idea_generation.py\n    \n\n    Main outputs are found in `data/candidates/`, `data/verified/`, `data/idea_forge/`, and `logs/`.\n\n2.  **Select and Export an Idea**:\n    List executable plans from a forge file and then export a selected plan for execution.\n\n    bash\n.venv/bin/python src/idea_provenance.py list \\\n  --forge-file data/idea_forge/forge_YYYYMMDD_HHMM.json\n\n.venv/bin/python src/idea_provenance.py export \\\n  --forge-file data/idea_forge/forge_YYYYMMDD_HHMM.json \\\n  --result-index 1 \\\n  --plan-index 1 \\\n  --output data/ideas/my_experiment.txt\n    \n\n### Idea Execution\n\nIf you already have a research idea, you can directly proceed with execution.\n\n1.  **Prepare the Execution Environment**:\n    Install Bun 1.3+, Node.js, Conda (or another Python environment manager), and the Ralph Loop plugin for Claude Code.\n\n    bash\ncd ar-runtime\nbun install --frozen-lockfile\ncd ..\n    \n\n2.  **Generate the Execution Configuration**:\n    Create machine-local settings and project the unified provider configuration.\n\n    bash\ntest -f ar-runtime/.claude/settings.local.json || \\\n  cp ar-runtime/.claude/settings.local.example.json \\\n     ar-runtime/.claude/settings.local.json\n\nset -a\n. ./.env\nset +a\n.venv/bin/python scripts/render_env.py\n.venv/bin/python scripts/preflight.py --live --tools\n    \n\n3.  **Start the Coordinator**:\n    Run the Claude Code CLI in an isolated environment and start the coordinator with your idea.\n\n    bash\ncd ar-runtime\nclaude --dangerously-skip-permissions\n# Inside Claude Code:\n# /ar-coordinator ../data/ideas/my_experiment.txt ../data/projects/my_experiment\n    \n\n    For non-interactive runs, use the supervisor script:\n\n    bash\ncd ar-runtime\nscripts/ar-supervisor.sh \\\n  ../data/ideas/my_experiment.txt \\\n  ../data/projects/my_experiment\n    \n\n4.  **Inspect Project Results**:\n    Generate a dashboard to visualize the progress and results of your project.\n\n    bash\n.venv/bin/python src/generate_project_dashboard.py my_experiment\n    \n\n## Links\n\n*   **GitHub Repository**: [EvoMap/AutoResearch](https://github.com/EvoMap/AutoResearch){target=\"_blank\"}\n*   **EvoMap Ecosystem**: [EvoMap](https://evomap.ai){target=\"_blank\"}\n*   **arXiv Report**: [arXiv:2608.17906](https://arxiv.org/abs/2608.17906){target=\"_blank\"}\n*   **Unified Provider Configuration**: [Documentation](https://github.com/EvoMap/AutoResearch/blob/main/docs/unified_provider_config.md){target=\"_blank\"}\n*   **Model Provider Setup and Validation**: [Documentation](https://github.com/EvoMap/AutoResearch/blob/main/docs/llm_provider_setup.md){target=\"_blank\"}\n*   **Execution State Machine**: [Documentation](https://github.com/EvoMap/AutoResearch/blob/main/ar-runtime/ar-coordinator-startup-flow.md){target=\"_blank\"}","metrics":{"detailViews":2,"githubClicks":0},"dates":{"published":null,"modified":"2026-09-22T19:21:09.000Z"}}