Awesome Auto Research Hub Papers · Datasets · Projects
← Back to papers

AlphaResearch: Accelerating New Algorithm Discovery with Language Models

arXiv 2025 68.1 method

TLDR

AlphaResearch is an autonomous agent that discovers new algorithms via iterative proposal, programming, and optimization using dual rewards from execution and simulated peer review.

Reasoning

The paper presents a novel dual-environment approach combining verifiable execution rewards with simulated peer review, achieving state-of-the-art results on open-ended algorithmic problems. Strengths include a clear methodology and strong empirical results, but the evaluation is limited to eight problems and the simulated peer review may not fully capture real-world dynamics.

Read-first score

Read-first score 68.1, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 76.

Methodology quality 25%
100

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=analysis,baseline,benchmark,dataset,experiment,result

Recency 8%
86.7

Uses a gentle age decay so recent papers surface without erasing older foundations. 2025

Topical relevance 42%
63.3

Uses existing LLM keyword relevance scores normalized to 0-100. AI scientist,automated scientific discovery,autonomous research agent,automated research,literature review agent,survey generation,automated experimentation,experiment design agent,AI for scientific research,paper writing agent,research automation,scientific discovery agent

Reproducibility 25%
38

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=dataset

Field roles

FrontierMethodology anchor

Rank sensitivity

Stability: volatile; rank range: 22.

Keyword Scores

autonomous research agent
10
automated scientific discovery
9
scientific discovery agent
9
automated research
8
automated experimentation
8
AI for scientific research
8
research automation
8
experiment design agent
7
AI scientist
6
literature review agent
1
survey generation
1
paper writing agent
1

Deep Analysis

Innovations

  • Autonomous research agent that iteratively proposes ideas, programs to verify, and optimizes proposals
  • Dual environment combining execution-based verifiable reward and simulated peer review reward
  • Benchmark dataset of eight open-ended algorithmic problems
  • Discovery of best-of-known algorithm for packing circles problem

Methodology

AlphaResearch is an autonomous agent that iterates through proposing ideas, programming verification, and optimizing proposals. It uses a dual reward system: execution-based verifiable reward and a simulated peer review environment reward. It is evaluated on a constructed dataset of eight open-ended algorithmic problems.

Key Results

AlphaResearch outperforms other agentic discovery systems on six open-ended problems, and its discovered algorithm for packing circles achieves best-of-known performance, surpassing human researchers and AlphaEvolve.

Limitations

  • Remaining challenges of autonomous research agents are acknowledged but not specified in the abstract

Tags

CL