Reason-Mediated Behavioral Models for Auditing LLM Social Simulators
Quick summary
arXiv:2607.24649v2 Announce Type: replace Abstract: Large language models are increasingly used as social simulators, including as synthetic survey respondents. Most evaluations ask whether simulated outcomes resemble human outcomes. We argue that this is necessary but too weak: a simulator can match the final answer while using the wrong rationale-derived reason pattern. We study this problem through a 94-person sunscreen concept test in which each respondent evaluated three product concepts and wrote open-ended rationales. We map those rationales into signed reason states $Z$, where positive
Key takeaways
- arXiv:2607.24649v2 Announce Type: replace Abstract: Large language models are increasingly used as social simulators, including as synthetic survey respondents.
- Most evaluations ask whether simulated outcomes resemble human outcomes.
- We argue that this is necessary but too weak: a simulator can match the final answer while using the wrong rationale-derived reason pattern.
Why it matters
The value of this work lies as much in how it was tested as in the claim itself. Sample design, baselines, uncertainty and replication help separate a laboratory result from real-world impact.
Member comments