Average-Hard Attention Transformers are Constant-Depth Uniform Threshold Circuits. - Lena Strobl (CoRR, 2023)

Transformers as Recognizers of Formal Languages: A Survey on Expressivity. - Lena Strobl; William Merrill; Gail Weiss; David Chiang 001; Dana Angluin (CoRR, 2023)

Simulating Hard Attention Using Soft Attention. - Andy Yang; Lena Strobl; David Chiang 001; Dana Angluin (CoRR, 2024)

What Formal Languages Can Transformers Express? A Survey. - Lena Strobl; William Merrill; Gail Weiss; David Chiang 001; Dana Angluin (Trans. Assoc. Comput. Linguistics, 2024)

Transformers as Transducers. - Lena Strobl; Dana Angluin; David Chiang 001; Jonathan Rawski; Ashish Sabharwal (Trans. Assoc. Comput. Linguistics, 2025)

Concise One-Layer Transformers Can Do Function Evaluation (Sometimes). - Lena Strobl; Dana Angluin; Robert Frank 001 (CoRR, 2025)