Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generation
TLDR
Introduces Text2CAD-Bench, a benchmark for evaluating text-to-parametric CAD generation across geometric complexity and real-world domains.
Reasoning
The paper's strength lies in its systematic benchmark design with 600 human-curated examples spanning four complexity levels and dual-style prompts, addressing a gap in existing benchmarks. Weaknesses include reliance on evaluating existing models without proposing a new method, and limited detail on the benchmark's construction or validation in the abstract.
Read-first score
Read-first score 48.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 67.
Field roles
Rank sensitivity
Stability: volatile; rank range: 39.
Keyword Scores
Deep Analysis
Innovations
- First benchmark systematically evaluating text-to-CAD across geometric complexity and application diversity
- Hierarchical benchmark with four levels (L1-L4) from basic primitives to real-world domains beyond mechanical parts
- Dual-style prompts: geometric descriptions for non-expert users and procedural sequences for expert-level conventions
Methodology
We construct Text2CAD-Bench, a benchmark of 600 human-curated examples spanning four levels of geometric complexity and application diversity, each paired with geometric and procedural prompts. We evaluate mainstream general LLMs and domain-specific models on this benchmark.
Key Results
Current models perform reasonably on basic geometry but degrade substantially on complex topology and advanced features.