⌁ Awesome Auto Research Hub Papers · Datasets · Projects
中文 GitHub
← Back to papers

A Vocabulary for Multi-Agent Automated Research Systems

arXiv 2026 40.7 survey, theory

TLDR

Introduces a vocabulary for describing and comparing multi-agent automated research systems, covering agents, operations, communication, and evaluation.

Reasoning

The paper provides a structured framework to describe and compare automated research systems, which is a strength for conceptual clarity. However, it lacks empirical validation, real-world experiments, or concrete implementations, limiting its immediate practical impact.

Read-first score

Read-first score 40.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 37.

Recency 8%
100

Uses a gentle age decay so recent papers surface without erasing older foundations. 2026

Methodology quality 25%
40

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=none

Reproducibility 25%
38

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=artifact

Topical relevance 42%
30.8

Uses existing LLM keyword relevance scores normalized to 0-100. AI scientist,automated scientific discovery,autonomous research agent,automated research,literature review agent,survey generation,automated experimentation,experiment design agent,AI for scientific research,paper writing agent,research automation,scientific discovery agent

Field roles

Frontier

Rank sensitivity

Stability: volatile; rank range: 48.

Keyword Scores

automated research
8
research automation
7
AI for scientific research
5
autonomous research agent
4
scientific discovery agent
4
automated scientific discovery
3
automated experimentation
3
AI scientist
2
experiment design agent
1
literature review agent
0
survey generation
0
paper writing agent
0

Deep Analysis

Innovations

  • A vocabulary of eight dimensions to describe and compare design choices in multi-agent automated research systems
  • Decomposition of system taste into generative taste (novelty of proposals) and evaluative taste (proxy score fidelity)
  • Treating the evaluator as an explicit system component, turning structural design questions into testable choices

Methodology

The paper proposes a conceptual vocabulary that specifies eight axes of design for multi-agent research systems, and then demonstrates its descriptive power by instantiating it on several recent autoresearch systems to show coverage of diverse designs.

Key Results

The vocabulary is shown to cover a wide range of existing autoresearch system designs, confirming its generality.

Resources

Paper

Tags