Human Adults and LLMs as Scientists: Who Benefits from Active Exploration?
This paper investigates whether adults' struggles with conjunctive causal rules persist when they have agency through active exploration.
This paper demonstrates that active exploration can improve adults' conjunctive causal reasoning, which is a novel finding compared to prior work.
Before reading this…
Applications
- →Improving human causal reasoning
- →Developing more efficient exploration strategies for computers
To understand this paper, make sure you know these concepts first:
- Understanding of causal learning and conjunctive causal rulesfind papers →
- Basic knowledge of machine learning and large language modelsfind papers →
Abstract
More Like ThisA long-standing finding in the causal learning literature is that adults struggle to identify conjunctive causal rules, where an effect requires the simultaneous presence of multiple causes, while performing better in disjunctive settings. However, most demonstrations of this ``conjunctive handicap'' rely on passive observation paradigms with limited evidence, where learners have no control over evidence generation. This paper asks whether this bias persists when adults are granted agency through active exploration. Using a modified ``blicket detector'' task, adult participants freely intervened to identify causal objects under conjunctive or disjunctive rule structures. We show that active exploration substantially improves adults' conjunctive causal reasoning, although conjunctive rules still require more tests to infer than disjunctive rules. We further compare human performance to a range of large language models in the same setting. While some state-of-the-art models approach human-level performance on hypothesis inference accuracy, they often exhibit less efficient exploration strategies and similar conjunctive-disjunctive performance gaps.