PerceptUI: PerceptUI: LLM Agents as Human-Aligned Synthetic Users for UI/UX Evaluation
TLDR
PerceptUI uses persona-conditioned LLM agents to predict user responses for UI/UX evaluation, achieving human-level realism.
Reasoning
The paper introduces a novel two-stage training framework for persona-conditioned UI/UX evaluation, demonstrating strong empirical results across multiple domains. However, it is narrowly focused on UI/UX and does not address world models or dynamics prediction, making the keyword scores zero.
Read-first score
Read-first score 39.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 0.
Field roles
Rank sensitivity
Stability: volatile; rank range: 302.
Keyword Scores
Deep Analysis
Innovations
- Persona-conditioned UI/UX evaluation that predicts specific user responses with natural-language rationales
- Contrastive reflection fine-tuning to distill teacher-generated rationales from human decisions
- Reflective prompt-evolution step from the model's own failure traces
- Achieves human-level realism and generalizes to unseen questions and personas
Methodology
PerceptUI is a framework trained in two stages: first, contrastive reflection fine-tuning distills teacher-generated rationales by extracting lessons from human decisions; second, a reflective prompt-evolution step improves the model using its own failure traces. The model is evaluated across multiple domains and datasets.
Key Results
PerceptUI achieves human-level realism in predicting user responses, generalizes to unseen questions and personas, and yields population-level response distributions.