Andreas Plesner
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper introduces GraphARC, a new benchmark for abstract reasoning on graph-structured data, demonstrating that current state-of-the-art language models struggle with full graph transformation tasks, revealing a comprehension-execution gap.
The paper introduces GraphARC, a new benchmark for abstract reasoning on graph-structured data, demonstrating that current state-of-the-art language models struggle with full graph transformation tasks, revealing a comprehension-execution gap.
Papers
GraphARC: A Comprehensive Benchmark for Graph-Based Abstract Reasoning
The paper introduces GraphARC, a new benchmark for abstract reasoning on graph-structured data, demonstrating that current state-of-the-art language models struggle with full graph transformation task…