It is not just about the Melody: How Europe Votes for its Favorite Songs. - Anej Svete; Jakob Hostnik (CoRR, 2020)

Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs. - Anej Svete; Benjamin Dayan; Ryan Cotterell; Tim Vieira; Jason Eisner (EMNLP, 2022)

On the Representational Capacity of Recurrent Neural Language Models. - Franz Nowak; Anej Svete; Li Du; Ryan Cotterell (EMNLP, 2023)

Recurrent Neural Language Models as Probabilistic Finite-state Automata. - Anej Svete; Ryan Cotterell (EMNLP, 2023)

A Geometric Notion of Causal Probing. - Clément Guerner; Anej Svete; Tianyu Liu 004; Alexander Warstadt; Ryan Cotterell (CoRR, 2023)

Formal Aspects of Language Modeling. - Ryan Cotterell; Anej Svete; Clara Meister; Tianyu Liu 004; Li Du (CoRR, 2023)

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages. - Nadav Borenstein; Anej Svete; Robin Chan; Josef Valvoda; Franz Nowak; Isabelle Augenstein; Eleanor Chodroff; Ryan Cotterell (ACL (1), 2024)

On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning. - Franz Nowak; Anej Svete; Alexandra Butoi; Ryan Cotterell (ACL (1), 2024)

On Efficiently Representing Regular Languages as RNNs. - Anej Svete; Robin Chan; Ryan Cotterell (ACL (Findings), 2024)

An L* Algorithm for Deterministic Weighted Regular Languages. - Clemente Pasti; Talu Karagöz; Franz Nowak; Anej Svete; Reda Boumasmoud; Ryan Cotterell (EMNLP, 2024)

Can Transformers Learn n-gram Language Models? - Anej Svete; Nadav Borenstein; Mike Zhou; Isabelle Augenstein; Ryan Cotterell (EMNLP, 2024)

A Probability-Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors. - Naaman Tan; Josef Valvoda; Tianyu Liu 004; Anej Svete; Yanxia Qin; Min-Yen Kan; Ryan Cotterell (EMNLP, 2024)

The Role of n-gram Smoothing in the Age of Neural Networks. - Luca Malagutti; Andrius Buinovskij; Anej Svete; Clara Meister; Afra Amini; Ryan Cotterell (NAACL-HLT, 2024)

Transformers Can Represent n-gram Language Models. - Anej Svete; Ryan Cotterell (NAACL-HLT, 2024)

Lower Bounds on the Expressivity of Recurrent Neural Language Models. - Anej Svete; Franz Nowak; Anisha Mohamed Sahabdeen; Ryan Cotterell (NAACL-HLT, 2024)

On Affine Homotopy between Language Encoders. - Robin Chan; Reda Boumasmoud; Anej Svete; Yuxin Ren; Qipeng Guo; Zhijing Jin 001; Shauli Ravfogel; Mrinmaya Sachan; Bernhard Schölkopf; Mennatallah El-Assady; Ryan Cotterell (NeurIPS, 2024)

A Theoretical Result on the Inductive Bias of RNN Language Models. - Anej Svete; Robin Shing Moon Chan; Ryan Cotterell (CoRR, 2024)

Transformers Can Represent n-gram Language Models. - Anej Svete; Ryan Cotterell (CoRR, 2024)

What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages. - Nadav Borenstein; Anej Svete; Robin Shing Moon Chan; Josef Valvoda; Franz Nowak; Isabelle Augenstein; Eleanor Chodroff; Ryan Cotterell (CoRR, 2024)

A Fundamental Trade-off in Aligned Language Models and its Relation to Sampling Adaptors. - Naaman Tan; Josef Valvoda; Anej Svete; Tianyu Liu 004; Yanxia Qin; Min-Yen Kan; Ryan Cotterell (CoRR, 2024)

Can Transformers Learn n-gram Language Models? - Anej Svete; Nadav Borenstein; Mike Zhou; Isabelle Augenstein; Ryan Cotterell (CoRR, 2024)

An L* Algorithm for Deterministic Weighted Regular Languages. - Clemente Pasti; Talu Karagöz; Anej Svete; Franz Nowak; Reda Boumasmoud; Ryan Cotterell (CoRR, 2024)

Counterfactual Generation from Language Models. - Shauli Ravfogel; Anej Svete; Vésteinn Snæbjarnarson; Ryan Cotterell (CoRR, 2024)

Information Locality as an Inductive Bias for Neural Language Models. - Taiga Someya; Anej Svete; Brian DuSell; Timothy J. O'Donnell; Mario Giulianelli; Ryan Cotterell (ACL (1), 2025)

Training Neural Networks as Recognizers of Formal Languages. - Alexandra Butoi; Ghazal Khalighinejad; Anej Svete; Josef Valvoda; Ryan Cotterell; Brian DuSell (ICLR, 2025)

Gumbel Counterfactual Generation From Language Models. - Shauli Ravfogel; Anej Svete; Vésteinn Snæbjarnarson; Ryan Cotterell (ICLR, 2025)

Unique Hard Attention: A Tale of Two Sides. - Selim Jerad; Anej Svete; Jiaoda Li; Ryan Cotterell (CoRR, 2025)