Awesome Auto Research Hub Papers · Datasets · Projects
← Back to papers

SciCode: A Research Coding Benchmark Curated by Scientists

arXiv '24 2024 35.3 benchmark

Read-first score

Read-first score 35.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals.

Reproducibility 33%
81

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=True; dataset=False; markers=code,github

Recency 11%
75.1

Uses a gentle age decay so recent papers surface without erasing older foundations. 2024

Topical relevance 56%
0

Matches configured research keywords against title, abstract, tags, and analysis text. matched=0

Field roles

Reproducibility anchor

Rank sensitivity

Stability: volatile; rank range: 110.

Tags