Awesome Auto Research Hub Papers · Datasets · Projects
← Back to papers

SurveyG: A Multi-Agent LLM Framework with Hierarchical Citation Graph for Automated Survey Generation

arXiv 2025 58.4 method, application

TLDR

SurveyG uses hierarchical citation graphs and multi-agent LLMs to generate coherent, structured survey papers with human and LLM evaluation.

Reasoning

The paper introduces a novel framework that leverages hierarchical citation graphs to capture research evolution, addressing a key limitation of existing survey generation methods. Strengths include a structured multi-agent validation stage and empirical evaluation with human experts. Weaknesses are not apparent from the abstract alone, but the reliance on LLM-as-a-judge may introduce bias.

Read-first score

Read-first score 58.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 61.

Methodology quality 25%
90

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=benchmark,evaluation,experiment,result,validation

Recency 8%
86.7

Uses a gentle age decay so recent papers surface without erasing older foundations. 2025

Topical relevance 42%
50.8

Uses existing LLM keyword relevance scores normalized to 0-100. AI scientist,automated scientific discovery,autonomous research agent,automated research,literature review agent,survey generation,automated experimentation,experiment design agent,AI for scientific research,paper writing agent,research automation,scientific discovery agent

Reproducibility 25%
30

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=none

Field roles

FrontierMethodology anchor

Rank sensitivity

Stability: volatile; rank range: 24.

Keyword Scores

survey generation
10
literature review agent
9
paper writing agent
8
automated research
7
research automation
7
AI for scientific research
6
autonomous research agent
4
automated scientific discovery
3
scientific discovery agent
3
AI scientist
2
automated experimentation
1
experiment design agent
1

Deep Analysis

Innovations

  • Hierarchical citation graph with three layers (Foundation, Development, Frontier) capturing research evolution
  • Multi-agent framework combining horizontal search within layers and vertical depth traversal across layers for multi-level summaries
  • Multi-agent validation stage ensuring consistency, coverage, and factual accuracy
  • Integration of citation dependencies and semantic relatedness into survey generation

Methodology

SurveyG constructs a hierarchical citation graph where nodes are papers and edges represent citation and semantic relations. Papers are organized into Foundation, Development, and Frontier layers; the agent performs horizontal and vertical traversal to generate multi-level summaries, which are consolidated into a structured outline. A multi-agent validation stage then refines the final survey.

Key Results

SurveyG outperforms state-of-the-art frameworks in human expert and LLM-as-a-judge evaluations, producing surveys that are more comprehensive and better structured to the field's knowledge taxonomy.

Tags

AI