Ryan Cotterell
2 indexed papers
Recent (6 mo)
2With code
0Influential cites
0Benchmarked
0Publications per year
226
Top categories
Formal Lang.×2NLP×2ML×2AI×1Complexity×1
Frequent co-authors
Research Timeline
2026
Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
The paper analyzes the expressivity of padded transformers, proving that their computational power is primarily determined by model depth and numeric precision, rather than attention type or width.
An Algebraic View of the Expressivity of Recurrent Language Models
The paper provides a unified algebraic framework to determine the formal language expressivity of recurrent neural language models, resolving conflicts in existing literature by linking expressivity to algebraic properties of the network's structure.
Highlighted terms show continued research focus across papers
Papers
cs.FLcs.CLcs.LGRecentJun 1, 2026
An Algebraic View of the Expressivity of Recurrent Language Models
The paper provides a unified algebraic framework to determine the formal language expressivity of recurrent neural language models, resolving conflicts in existing literature by linking expressivity t…
View →
cs.LGcs.AIcs.CCRecentMay 28, 2026