Unlocking the Visual Record of Materials Science: A Large-Scale Multimodal Dataset from Scientific Literature

arXiv 2026 40.7 system, benchmark

TLDR

A pipeline to decompose compound figures in materials science papers into sub-panels with structured annotations, creating a large multimodal dataset.

Reasoning

Strengths: addresses a critical bottleneck in scientific figure understanding, provides an open-source pipeline and dataset with high-quality annotations and benchmarks. Weaknesses: limited to materials science domain, no direct evaluation on downstream scientific discovery or automation tasks.

Read-first score

Read-first score 40.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 17.

Recency 8%

100

Uses a gentle age decay so recent papers surface without erasing older foundations. 2026

Methodology quality 25%

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=baseline,benchmark,dataset,experiment

Reproducibility 25%

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=code,dataset

Topical relevance 42%

14.2

Uses existing LLM keyword relevance scores normalized to 0-100. AI scientist,automated scientific discovery,autonomous research agent,automated research,literature review agent,survey generation,automated experimentation,experiment design agent,AI for scientific research,paper writing agent,research automation,scientific discovery agent

Field roles

Frontier

Rank sensitivity

Stability: volatile; rank range: 13.

Keyword Scores

AI for scientific research

literature review agent

research automation

automated research

AI scientist

automated scientific discovery

survey generation

scientific discovery agent

autonomous research agent

automated experimentation

experiment design agent

paper writing agent

Resources

Paper