Text-to-CAD Retrieval: a Strong Baseline
TLDR
Introduces text-to-CAD retrieval as a new task and proposes a strong baseline using multi-modal embeddings from procedural sequences and point clouds.
Reasoning
Strengths: formalizes an underexplored task, establishes a benchmark, and proposes a novel multi-modal alignment framework. Weaknesses: limited to retrieval without generative results, and no quantitative results are reported in the abstract.
Read-first score
Read-first score 54.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 57.
Field roles
Rank sensitivity
Stability: volatile; rank range: 32.
Keyword Scores
Deep Analysis
Innovations
- Formal introduction of text-to-CAD retrieval as a new cross-modal retrieval task
- Unified framework learning multi-modal CAD embeddings from both procedural sequences and geometric point clouds
- Novel feature decoder that reconstructs masked sequence features via cross-attention with text and point features for implicit multi-modal alignment
- Efficient inference by removing the auxiliary decoder and using concatenated sequence-point features
Methodology
The framework encodes CAD models using a sequence encoder for construction logic and a point encoder for geometric point clouds, and text queries via a text encoder. During training, a feature decoder reconstructs masked sequence features through cross-attention with text and point features to align modalities. At inference, the decoder is discarded and retrieval is performed using concatenated sequence-point features.
Key Results
The proposed method establishes a strong baseline for text-to-CAD retrieval, enabling efficient cross-modal retrieval and supporting downstream tasks like retrieval-augmented generation.