Negative Knowledge as Failure-aware Shared Memory for AutoResearch
TLDR
Proposes a negative knowledge memory layer for AI research agents that records failures, improving performance on scientific tasks while using fewer tokens.
Reasoning
Strengths: Novel concept of structured negative knowledge, demonstrated on multiple tasks with transfer learning. Weaknesses: Limited to two settings, may need broader validation.
Read-first score
Read-first score 73.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 80.
Field roles
Rank sensitivity
Stability: volatile; rank range: 15.
Keyword Scores
Deep Analysis
Innovations
- Proposes a negative knowledge memory layer where a curator agent converts failed attempts into bounded, typed records in a shared bank, and a downstream research agent explicitly adopts or rejects those records before proposing its next experiment.
Methodology
A curator agent converts each failed attempt into a bounded, typed record in a shared negative knowledge bank. A downstream research agent then explicitly adopts or rejects those records before proposing its next experiment. The system is evaluated on same-task retry (ScienceAgentBench) and cross-task scientific research on two nonlinear math-physics PDE problems.
Key Results
The negative knowledge layer outperforms vanilla AutoResearch baselines while using fewer tokens, and agents with the negative knowledge bank solve new PDE tasks that all baselines fail to solve. The negative knowledge bank also transfers to enhance AutoResearch on different PDE problems.