William Merrill
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper analyzes the expressivity of padded transformers, proving that their computational power is primarily determined by model depth and numeric precision, rather than attention type or width.
The paper analyzes the expressivity of padded transformers, proving that their computational power is primarily determined by model depth and numeric precision, rather than attention type or width.
Papers
Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
The paper analyzes the expressivity of padded transformers, proving that their computational power is primarily determined by model depth and numeric precision, rather than attention type or width.