How Is Automated Research Evaluated? A Survey of Benchmarks and Evaluation Practices

Dataset Analysis

Automated research systems support literature synthesis, ideation, experiments, writing, and peer review, but their evaluation is dispersed across tasks, benchmarks, and studies that are difficult to compare directly. We review this literat...