Induction of Probabilistic Synchronous Tree-Insertion Grammars for Machine Translation. - Rebecca Nesson; Stuart M. Shieber; Alexander M. Rush (AMTA, 2006)

Dual Decomposition for Parsing with Non-Projective Head Automata. - Terry Koo; Alexander M. Rush; Michael Collins 001; Tommi S. Jaakkola; David A. Sontag (EMNLP, 2010)

On Dual Decomposition and Linear Programming Relaxations for Natural Language Processing. - Alexander M. Rush; David A. Sontag; Michael Collins 001; Tommi S. Jaakkola (EMNLP, 2010)

Dual Decomposition for Natural Language Processing. - Michael Collins 001; Alexander M. Rush (ACL (Tutorial Abstracts), 2011)

Exact Decoding of Syntactic Translation Models through Lagrangian Relaxation. - Alexander M. Rush; Michael Collins 001 (ACL, 2011)

Improved Parsing and POS Tagging Using Inter-Sentence Consistency Constraints. - Alexander M. Rush; Roi Reichart; Michael Collins 001; Amir Globerson (EMNLP-CoNLL, 2012)

Vine Pruning for Efficient Multi-Pass Dependency Parsing. - Alexander M. Rush; Slav Petrov (HLT-NAACL, 2012)

A Tutorial on Dual Decomposition and Lagrangian Relaxation for Inference in Natural Language Processing. - Alexander M. Rush; Michael Collins 001 (J. Artif. Intell. Res., 2012)

Spectral Learning of Refinement HMMs. - Karl Stratos; Alexander M. Rush; Shay B. Cohen; Michael Collins 001 (CoNLL, 2013)

Optimal Beam Search for Machine Translation. - Alexander M. Rush; Yin-Wen Chang; Michael Collins 001 (EMNLP, 2013)

A Constrained Viterbi Relaxation for Bidirectional Word Alignment. - Yin-Wen Chang; Alexander M. Rush; John DeNero; Michael Collins 001 (ACL (1), 2014)

Lagrangian relaxation for natural language decoding. - Alexander M. Rush (2014)

Learning Anaphoricity and Antecedent Ranking Features for Coreference Resolution. - Sam Wiseman; Alexander M. Rush; Stuart M. Shieber; Jason Weston (ACL (1), 2015)

A Neural Attention Model for Abstractive Sentence Summarization. - Alexander M. Rush; Sumit Chopra; Jason Weston (EMNLP, 2015)

A Fast Variational Approach for Learning Markov Random Field Language Models. - Yacine Jernite; Alexander M. Rush; David A. Sontag (ICML, 2015)

Transforming Dependencies into Phrase Structures. - Lingpeng Kong; Alexander M. Rush; Noah A. Smith (HLT-NAACL, 2015)

Character-Aware Neural Language Models. - Yoon Kim; Yacine Jernite; David A. Sontag; Alexander M. Rush (AAAI, 2016)

Sentence-Level Grammatical Error Identification as Sequence-to-Sequence Correction. - Allen Schmaltz; Yoon Kim; Alexander M. Rush; Stuart M. Shieber (BEA@NAACL-HLT, 2016)

Sequence-Level Knowledge Distillation. - Yoon Kim; Alexander M. Rush (EMNLP, 2016)

An Embedding Model for Predicting Roll-Call Votes. - Peter Kraft; Hirsh Jain; Alexander M. Rush (EMNLP, 2016)

Word Ordering Without Syntax. - Allen Schmaltz; Alexander M. Rush; Stuart M. Shieber (EMNLP, 2016)

Sequence-to-Sequence Learning as Beam-Search Optimization. - Sam Wiseman; Alexander M. Rush (EMNLP, 2016)

Abstractive Sentence Summarization with Attentive Recurrent Neural Networks. - Sumit Chopra; Michael Auli; Alexander M. Rush (HLT-NAACL, 2016)

Learning Global Features for Coreference Resolution. - Sam Wiseman; Alexander M. Rush; Stuart M. Shieber (HLT-NAACL, 2016)

Antecedent Prediction Without a Pipeline. - Sam Wiseman; Alexander M. Rush; Stuart M. Shieber (CORBON@HLT-NAACL, 2016)

What You Get Is What You See: A Visual Markup Decompiler. - Yuntian Deng; Anssi Kanervisto; Alexander M. Rush (CoRR, 2016)

Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks. - Hendrik Strobelt; Sebastian Gehrmann; Bernd Huber; Hanspeter Pfister; Alexander M. Rush (CoRR, 2016)

OpenNMT: Open-Source Toolkit for Neural Machine Translation. - Guillaume Klein; Yoon Kim; Yuntian Deng; Jean Senellart; Alexander M. Rush (ACL (System Demonstrations), 2017)

Coarse-to-Fine Attention Models for Document Summarization. - Jeffrey Ling; Alexander M. Rush (NFiS@EMNLP, 2017)

Adapting Sequence Models for Sentence Correction. - Allen Schmaltz; Yoon Kim; Alexander M. Rush; Stuart M. Shieber (EMNLP, 2017)

Challenges in Data-to-Document Generation. - Sam Wiseman; Stuart M. Shieber; Alexander M. Rush (EMNLP, 2017)

Structured Attention Networks. - Yoon Kim; Carl Denton; Luong Hoang; Alexander M. Rush (ICLR (Poster), 2017)

Lie-Access Neural Turing Machines. - Greg Yang; Alexander M. Rush (ICLR (Poster), 2017)

Image-to-Markup Generation with Coarse-to-Fine Attention. - Yuntian Deng; Anssi Kanervisto; Jeffrey Ling; Alexander M. Rush (ICML, 2017)

Adversarially Regularized Autoencoders for Generating Discrete Structures. - Junbo Jake Zhao; Yoon Kim; Kelly Zhang; Alexander M. Rush; Yann LeCun (CoRR, 2017)

OpenNMT: Open-source Toolkit for Neural Machine Translation. - Guillaume Klein; Yoon Kim; Yuntian Deng; Josep Maria Crego; Jean Senellart; Alexander M. Rush (CoRR, 2017)

OpenNMT System Description for WNMT 2018: 800 words/sec on a single-core CPU. - Jean Senellart; Dakun Zhang; Bo Wang; Guillaume Klein; Jean-Pierre Ramatchandirin; Josep Maria Crego; Alexander M. Rush (NMT@ACL, 2018)

OpenNMT: Neural Machine Translation Toolkit. - Guillaume Klein; Yoon Kim; Yuntian Deng; Vincent Nguyen; Jean Senellart; Alexander M. Rush (AMTA (1), 2018)

Bottom-Up Abstractive Summarization. - Sebastian Gehrmann; Yuntian Deng; Alexander M. Rush (EMNLP, 2018)

Entity Tracking Improves Cloze-style Reading Comprehension. - Luong Hoang; Sam Wiseman; Alexander M. Rush (EMNLP, 2018)

Training for Diversity in Image Paragraph Captioning. - Luke Melas-Kyriazi; Alexander M. Rush; George Han (EMNLP, 2018)

Debugging Sequence-to-Sequence Models with Seq2Seq-Vis. - Hendrik Strobelt; Sebastian Gehrmann; Michael Behrisch 001; Adam Perer; Hanspeter Pfister; Alexander M. Rush (BlackboxNLP@EMNLP, 2018)

Learning Neural Templates for Text Generation. - Sam Wiseman; Stuart M. Shieber; Alexander M. Rush (EMNLP, 2018)

Semi-Amortized Variational Autoencoders. - Yoon Kim; Sam Wiseman; Andrew C. Miller; David A. Sontag; Alexander M. Rush (ICML, 2018)

Weightless: Lossy weight encoding for deep neural network compression. - Brandon Reagen; Udit Gupta; Bob Adolf; Michael Mitzenmacher; Alexander M. Rush; Gu-Yeon Wei; David Brooks 001 (ICML, 2018)

Adversarially Regularized Autoencoders. - Junbo Jake Zhao; Yoon Kim; Kelly Zhang; Alexander M. Rush; Yann LeCun (ICML, 2018)

End-to-End Content and Plan Selection for Data-to-Text Generation. - Sebastian Gehrmann; Falcon Z. Dai; Henry Elder; Alexander M. Rush (INLG, 2018)

Latent Alignment and Variational Attention. - Yuntian Deng; Yoon Kim; Justin T. Chiu; Demi Guo; Alexander M. Rush (NeurIPS, 2018)

A Tutorial on Deep Latent Variable Models of Natural Language. - Yoon Kim; Sam Wiseman; Alexander M. Rush (CoRR, 2018)

LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks. - Hendrik Strobelt; Sebastian Gehrmann; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2018)

MASR: A Modular Accelerator for Sparse RNNs. - Udit Gupta; Brandon Reagen; Lillian Pentecost; Marco Donato; Thierry Tambe; Alexander M. Rush; Gu-Yeon Wei; David Brooks 001 (PACT, 2019)

Don't Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference. - Yonatan Belinkov; Adam Poliak; Stuart M. Shieber; Benjamin Van Durme; Alexander M. Rush (ACL (1), 2019)

GLTR: Statistical Detection and Visualization of Generated Text. - Sebastian Gehrmann; Hendrik Strobelt; Alexander M. Rush (ACL (3), 2019)

Compound Probabilistic Context-Free Grammars for Grammar Induction. - Yoon Kim; Chris Dyer; Alexander M. Rush (ACL (1), 2019)

Simple Unsupervised Summarization by Contextual Matching. - Jiawei Zhou; Alexander M. Rush (ACL (1), 2019)

Avoiding Latent Variable Collapse with Generative Skip Models. - Adji B. Dieng; Yoon Kim; Alexander M. Rush; David M. Blei (AISTATS, 2019)

Commonsense Knowledge Mining from Pretrained Models. - Joe Davison; Joshua Feldman; Alexander M. Rush (EMNLP/IJCNLP (1), 2019)

Neural Linguistic Steganography. - Zachary M. Ziegler; Yuntian Deng; Alexander M. Rush (EMNLP/IJCNLP (1), 2019)

Tensor Variable Elimination for Plated Factor Graphs. - Fritz Obermeyer; Eli Bingham; Martin Jankowiak; Neeraj Pradhan; Justin T. Chiu; Alexander M. Rush; Noah D. Goodman (ICML, 2019)

Latent Normalizing Flows for Discrete Sequences. - Zachary M. Ziegler; Alexander M. Rush (ICML, 2019)

Generating Abstractive Summaries with Finetuned Language Models. - Sebastian Gehrmann; Zachary M. Ziegler; Alexander M. Rush (INLG, 2019)

Unsupervised Recurrent Neural Network Grammars. - Yoon Kim; Alexander M. Rush; Lei Yu 008; Adhiguna Kuncoro; Chris Dyer; Gábor Melis (NAACL-HLT (1), 2019)

On Adversarial Removal of Hypothesis-only Bias in Natural Language Inference. - Yonatan Belinkov; Adam Poliak; Stuart M. Shieber; Benjamin Van Durme; Alexander M. Rush (*SEM@NAACL-HLT, 2019)

Encoder-Agnostic Adaptation for Conditional Language Generation. - Zachary M. Ziegler; Luke Melas-Kyriazi; Sebastian Gehrmann; Alexander M. Rush (CoRR, 2019)

AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference. - Thierry Tambe; En-Yu Yang; Zishen Wan; Yuntian Deng; Vijay Janapa Reddi; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (CoRR, 2019)

A Hierarchy of Graph Neural Networks Based on Learnable Local Features. - Michael Lingzhi Li; Meng Dong; Jiawei Zhou; Alexander M. Rush (CoRR, 2019)

Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models. - Hendrik Strobelt; Sebastian Gehrmann; Michael Behrisch 001; Adam Perer; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2019)

What is Learned in Visually Grounded Neural Syntax Acquisition. - Noriyuki Kojima; Hadar Averbuch-Elor; Alexander M. Rush; Yoav Artzi (ACL, 2020)

Posterior Control of Blackbox Generation. - Xiang Lisa Li; Alexander M. Rush (ACL, 2020)

Torch-Struct: Deep Structured Prediction Library. - Alexander M. Rush (ACL (demo), 2020)

Algorithm-Hardware Co-Design of Adaptive Floating-Point Encodings for Resilient Deep Learning Inference. - Thierry Tambe; En-Yu Yang; Zishen Wan; Yuntian Deng; Vijay Janapa Reddi; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (DAC, 2020)

Scaling Hidden Markov Language Models. - Justin T. Chiu; Alexander M. Rush (EMNLP (1), 2020)

Sequence-Level Mixed Sample Data Augmentation. - Demi Guo; Yoon Kim; Alexander M. Rush (EMNLP (1), 2020)

Adversarial Semantic Collisions. - Congzheng Song; Alexander M. Rush; Vitaly Shmatikov (EMNLP (1), 2020)

Transformers: State-of-the-Art Natural Language Processing. - Thomas Wolf 008; Lysandre Debut; Victor Sanh; Julien Chaumond; Clement Delangue; Anthony Moi; Pierric Cistac; Tim Rault; Rémi Louf; Morgan Funtowicz; Joe Davison; Sam Shleifer; et al. (EMNLP (Demos), 2020)

Improving Event Duration Prediction via Time-aware Pre-training. - Zonglin Yang 001; Xinya Du; Alexander M. Rush; Claire Cardie (EMNLP (Findings), 2020)

Cascaded Text Generation with Markov Transformers. - Yuntian Deng; Alexander M. Rush (NeurIPS, 2020)

Latent Template Induction with Gumbel-CRFs. - Yao Fu; Chuanqi Tan; Bin Bi; Mosha Chen; Yansong Feng 002; Alexander M. Rush (NeurIPS, 2020)

Movement Pruning: Adaptive Sparsity by Fine-Tuning. - Victor Sanh; Thomas Wolf 008; Alexander M. Rush (NeurIPS, 2020)

Automating Botnet Detection with Graph Neural Networks. - Jiawei Zhou; Zhiying Xu; Alexander M. Rush; Minlan Yu (CoRR, 2020)

MiniConf - A Virtual Conference Framework. - Alexander M. Rush; Hendrik Strobelt (CoRR, 2020)

Document-level Event-based Extraction Using Generative Template-filling Transformers. - Xinya Du; Alexander M. Rush; Claire Cardie (CoRR, 2020)

Pre-trained Summarization Distillation. - Sam Shleifer; Alexander M. Rush (CoRR, 2020)

EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP. - Thierry Tambe; Coleman Hooper; Lillian Pentecost; En-Yu Yang; Marco Donato; Victor Sanh; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (CoRR, 2020)

LAN: A Materials Notation for Two-Dimensional Layered Assemblies. - Georgios A. Tritsaris; Yiqi Xie; Alexander M. Rush; Stephen Carr; Marios Mattheakis; Efthimios Kaxiras (J. Chem. Inf. Model., 2020)

Visual Interaction with Deep Learning Models through Collaborative Semantic Inference. - Sebastian Gehrmann; Hendrik Strobelt; Robert Krüger; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2020)

Parameter-Efficient Transfer Learning with Diff Pruning. - Demi Guo; Alexander M. Rush; Yoon Kim (ACL/IJCNLP (1), 2021)

GRIT: Generative Role-filler Transformers for Document-level Event Entity Extraction. - Xinya Du; Alexander M. Rush; Claire Cardie (EACL, 2021)

Sequence-to-Lattice Models for Fast Translation. - Yuntian Deng; Alexander M. Rush (EMNLP (Findings), 2021)

Block Pruning For Faster Transformers. - François Lagunas; Ella Charlaix; Victor Sanh; Alexander M. Rush (EMNLP (1), 2021)

Datasets: A Community Library for Natural Language Processing. - Quentin Lhoest; Albert Villanova del Moral; Yacine Jernite; Abhishek Thakur; Patrick von Platen; Suraj Patil; Julien Chaumond; Mariama Drame; Julien Plu; Lewis Tunstall; Joe Davison; Mario Sasko; et al. (EMNLP (Demos), 2021)

Rationales for Sequential Predictions. - Keyon Vafa; Yuntian Deng; David M. Blei; Alexander M. Rush (EMNLP (1), 2021)

SM6: A 16nm System-on-Chip for Accurate and Noise-Robust Attention-Based NLP Applications : The 33rd Hot Chips Symposium - August 22-24, 2021. - Thierry Tambe; En-Yu Yang; Glenn G. Ko; Yuji Chai; Coleman Hooper; Marco Donato; Paul N. Whatmough; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (HCS, 2021)

Learning from others' mistakes: Avoiding dataset biases without modeling them. - Victor Sanh; Thomas Wolf 008; Yonatan Belinkov; Alexander M. Rush (ICLR, 2021)

9.8 A 25mm2 SoC for IoT Devices with 18ms Noise-Robust Speech-to-Text Latency via Bayesian Speech Denoising and Attention-Based Sequence-to-Sequence DNN Speech Recognition in 16nm FinFET. - Thierry Tambe; En-Yu Yang; Glenn G. Ko; Yuji Chai; Coleman Hooper; Marco Donato; Paul N. Whatmough; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (ISSCC, 2021)

Developmental Stage Classification of Embryos Using Two-Stream Neural Network with Linear-Chain Conditional Random Field. - Stanislav Lukyanenko; Won-Dong Jang; Donglai Wei 001; Robbert Struyven; Yoon Kim; Brian D. Leahy; Helen Y. Yang; Alexander M. Rush; Dalit Ben-Yosef; Daniel Needleman; Hanspeter Pfister (MICCAI (8), 2021)

EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference. - Thierry Tambe; Coleman Hooper; Lillian Pentecost; Tianyu Jia; En-Yu Yang; Marco Donato; Victor Sanh; Paul N. Whatmough; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (MICRO, 2021)

Template Filling with Generative Transformers. - Xinya Du; Alexander M. Rush; Claire Cardie (NAACL-HLT, 2021)

Low-Complexity Probing via Finding Subnetworks. - Victor Sanh; Alexander M. Rush (NAACL-HLT, 2021)

How many data points is a prompt worth? - Teven Le Scao; Alexander M. Rush (NAACL-HLT, 2021)

Low-Rank Constraints for Fast Inference in Structured Models. - Justin T. Chiu; Yuntian Deng; Alexander M. Rush (NeurIPS, 2021)

Low-Complexity Probing via Finding Subnetworks. - Steven Cao; Victor Sanh; Alexander M. Rush (CoRR, 2021)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Teven Le Scao; Arun Raja; Manan Dey; M. Saiful Bari; et al. (CoRR, 2021)

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. - Stephen H. Bach; Victor Sanh; Zheng Xin Yong; Albert Webson; Colin Raffel; Nihal V. Nayak; Abheesht Sharma; Taewoon Kim 002; M. Saiful Bari; Thibault Févry; Zaid Alyafeai; Manan Dey; et al. (ACL (demo), 2022)

Xatu: boosting existing DDoS detection systems using auxiliary signals. - Zhiying Xu; Sivaramakrishnan Ramanathan; Alexander M. Rush; Jelena Mirkovic; Minlan Yu (CoNEXT, 2022)

Model Criticism for Long-Form Text Generation. - Yuntian Deng; Volodymyr Kuleshov; Alexander M. Rush (EMNLP, 2022)

Unsupervised Text Deidentification. - John X. Morris; Justin T. Chiu; Ramin Zabih; Alexander M. Rush (EMNLP (Findings), 2022)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Arun Raja; Manan Dey; M Saiful Bari; Canwen Xu; et al. (ICLR, 2022)

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. - Stephen H. Bach; Victor Sanh; Zheng Xin Yong; Albert Webson; Colin Raffel; Nihal V. Nayak; Abheesht Sharma; Taewoon Kim 002; M. Saiful Bari; Thibault Févry; Zaid Alyafeai; Manan Dey; et al. (CoRR, 2022)

Explaining Patterns in Data with Language Models via Interpretable Autoprompting. - Chandan Singh; John X. Morris; Jyoti Aneja; Alexander M. Rush; Jianfeng Gao 001 (CoRR, 2022)

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements. - Leandro von Werra; Lewis Tunstall; Abhishek Thakur; Alexandra Sasha Luccioni; Tristan Thrush; Aleksandra Piktus; Felix Marty; Nazneen Rajani; Victor Mustar; Helen Ngo; Omar Sanseviero; Mario Sasko; et al. (CoRR, 2022)

ESB: A Benchmark For Multi-Domain End-to-End Speech Recognition. - Sanchit Gandhi; Patrick von Platen; Alexander M. Rush (CoRR, 2022)

Teal: Learning-Accelerated Optimization of Traffic Engineering. - Zhiying Xu; Francis Y. Yan; Rachee Singh; Justin T. Chiu; Alexander M. Rush; Minlan Yu (CoRR, 2022)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. - Teven Le Scao; Angela Fan; Christopher Akiki; Ellie Pavlick; Suzana Ilic; Daniel Hesslow; Roman Castagné; Alexandra Sasha Luccioni; François Yvon; Matthias Gallé; Jonathan Tow; Alexander M. Rush; et al. (CoRR, 2022)

GenNI: Human-AI Collaboration for Data-Backed Text Generation. - Hendrik Strobelt; Jambay Kinley; Robert Krüger; Johanna Beyer; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2022)

Abductive Commonsense Reasoning Exploiting Mutually Exclusive Explanations. - Wenting Zhao; Justin T. Chiu; Claire Cardie; Alexander M. Rush (ACL (1), 2023)

Explaining Data Patterns in Natural Language with Language Models. - Chandan Singh; John X. Morris; Jyoti Aneja; Alexander M. Rush; Jianfeng Gao 001 (BlackboxNLP@EMNLP, 2023)

Symbolic Planning and Code Generation for Grounded Dialogue. - Justin T. Chiu; Wenting Zhao; Derek Chen; Saujas Vaduguru; Alexander M. Rush; Daniel Fried (EMNLP, 2023)

Text Embeddings Reveal (Almost) As Much As Text. - John X. Morris; Volodymyr Kuleshov; Vitaly Shmatikov; Alexander M. Rush (EMNLP, 2023)

MiniChain: A Small Library for Coding with Large Language Models. - Alexander M. Rush (EMNLP (Demos), 2023)

Tree Prompting: Efficient Task Adaptation without Fine-Tuning. - Chandan Singh; John X. Morris; Alexander M. Rush; Jianfeng Gao 001; Yuntian Deng (EMNLP, 2023)

Pretraining Without Attention. - Junxiong Wang; Jing Nathan Yan; Albert Gu; Alexander M. Rush (EMNLP (Findings), 2023)

Hop, Union, Generate: Explainable Multi-hop Reasoning without Rationale Supervision. - Wenting Zhao; Justin T. Chiu; Claire Cardie; Alexander M. Rush (EMNLP, 2023)

Markup-to-Image Diffusion Models with Scheduled Sampling. - Yuntian Deng; Noriyuki Kojima; Alexander M. Rush (ICLR, 2023)

A 12nm 18.1TFLOPs/W Sparse Transformer Processor with Entropy-Based Early Exit, Mixed-Precision Predication and Fine-Grained Power Management. - Thierry Tambe; Jeff Zhang 001; Coleman Hooper; Tianyu Jia; Paul N. Whatmough; Joseph Zuckerman; Maico Cassel dos Santos; Erik Jens Loscalzo; Davide Giri; Kenneth L. Shepard; Luca P. Carloni; Alexander M. Rush; et al. (ISSCC, 2023)

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. - Hugo Laurençon; Lucile Saulnier; Léo Tronchon; Stas Bekman; Amanpreet Singh; Anton Lozhkov; Thomas Wang; Siddharth Karamcheti; Alexander M. Rush; Douwe Kiela; Matthieu Cord; Victor Sanh (NeurIPS, 2023)

Scaling Data-Constrained Language Models. - Niklas Muennighoff; Alexander M. Rush; Boaz Barak; Teven Le Scao; Nouamane Tazi; Aleksandra Piktus; Sampo Pyysalo; Thomas Wolf 008; Colin A. Raffel (NeurIPS, 2023)

Teal: Learning-Accelerated Optimization of WAN Traffic Engineering. - Zhiying Xu; Francis Y. Yan; Rachee Singh; Justin T. Chiu; Alexander M. Rush; Minlan Yu (SIGCOMM, 2023)

OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. - Hugo Laurençon; Lucile Saulnier; Léo Tronchon; Stas Bekman; Amanpreet Singh; Anton Lozhkov; Thomas Wang; Siddharth Karamcheti; Alexander M. Rush; Douwe Kiela; Matthieu Cord; Victor Sanh (CoRR, 2023)

Zephyr: Direct Distillation of LM Alignment. - Lewis Tunstall; Edward Beeching; Nathan Lambert 001; Nazneen Rajani; Kashif Rasul; Younes Belkada; Shengyi Huang; Leandro von Werra; Clémentine Fourrier; Nathan Habib; Nathan Sarrazin; Omar Sanseviero; et al. (CoRR, 2023)

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling. - Sanchit Gandhi; Patrick von Platen; Alexander M. Rush (CoRR, 2023)

On What Basis? Predicting Text Preference Via Structured Comparative Reasoning. - Jing Nathan Yan; Tianqi Liu 002; Justin T. Chiu; Jiaming Shen; Zhen Qin 001; Yue Yu 001; Yao Zhao; Charu Lakshmanan; Yair Kurzion; Alexander M. Rush; Jialu Liu; Michael Bendersky (CoRR, 2023)

Named Tensor Notation. - David Chiang 001; Alexander M. Rush; Boaz Barak (Trans. Mach. Learn. Res., 2023)

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models. - Hendrik Strobelt; Albert Webson; Victor Sanh; Benjamin Hoover; Johanna Beyer; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2023)

End-to-end learning of multiple sequence alignments with differentiable Smith-Waterman. - Samantha Petti; Nicholas Bhattacharya; Roshan Rao; Justas Dauparas; Neil Thomas; Juannan Zhou; Alexander M. Rush; Peter K. Koo; Sergey Ovchinnikov 001 (Bioinform., 2023)

A 16-nm SoC for Noise-Robust Speech and NLP Edge AI Inference With Bayesian Sound Source Separation and Attention-Based DNNs. - Thierry Tambe; En-Yu Yang; Glenn G. Ko; Yuji Chai; Coleman Hooper; Marco Donato; Paul N. Whatmough; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (IEEE J. Solid State Circuits, 2023)

Predicting Text Preference Via Structured Comparative Reasoning. - Jing Nathan Yan; Tianqi Liu 002; Justin T. Chiu; Jiaming Shen; Zhen Qin 001; Yue Yu 001; Charumathi Lakshmanan; Yair Kurzion; Alexander M. Rush; Jialu Liu; Michael Bendersky (ACL (1), 2024)

Diffusion Models Without Attention. - Jing Nathan Yan; Jiatao Gu; Alexander M. Rush (CVPR, 2024)

ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models. - Yash Akhauri; Ahmed F. AbouElhamayed; Jordan Dotzel; Zhiru Zhang; Alexander M. Rush; Safeen Huda; Mohamed S. Abdelfattah (EMNLP, 2024)

I Could've Asked That: Reformulating Unanswerable Questions. - Wenting Zhao; Ge Gao; Claire Cardie; Alexander M. Rush (EMNLP, 2024)

Guess & Sketch: Language Model Guided Transpilation. - Celine Lee; Abdulrahman Mahmoud; Michal Kurek; Simone Campanoni; David Brooks 001; Stephen Chong; Gu-Yeon Wei; Alexander M. Rush (ICLR, 2024)

Language Model Inversion. - John X. Morris; Wenting Zhao; Justin T. Chiu; Vitaly Shmatikov; Alexander M. Rush (ICLR, 2024)

Entity Disambiguation via Fusion Entity Decoding. - Junxiong Wang; Ali Mousavi 003; Omar Attia; Ronak Pradeep; Saloni Potdar; Alexander M. Rush; Umar Farooq Minhas; Yunyao Li 001 (NAACL-HLT, 2024)

The Mamba in the Llama: Distilling and Accelerating Hybrid Models. - Junxiong Wang; Daniele Paliotta; Avner May; Alexander M. Rush; Tri Dao (NeurIPS, 2024)

MambaByte: Token-free Selective State Space Model. - Junxiong Wang; Tushaar Gangavarapu; Jing Nathan Yan; Alexander M. Rush (CoRR, 2024)

Entity Disambiguation via Fusion Entity Decoding. - Junxiong Wang; Ali Mousavi 003; Omar Attia; Saloni Potdar; Alexander M. Rush; Umar Farooq Minhas; Yunyao Li 001 (CoRR, 2024)

Simple and Effective Masked Diffusion Language Models. - Subham Sekhar Sahoo; Marianne Arriola; Yair Schiff; Aaron Gokaslan; Edgar Marroquin; Justin T. Chiu; Alexander M. Rush; Volodymyr Kuleshov (CoRR, 2024)

Great Memory, Shallow Reasoning: Limits of kNN-LMs. - Shangyi Geng; Wenting Zhao; Alexander M. Rush (CoRR, 2024)

A Controlled Study on Long Context Extension and Generalization in LLMs. - Yi Lu; Jing Nathan Yan; Songlin Yang; Justin T. Chiu; Siyu Ren; Fei Yuan 006; Wenting Zhao; Zhiyong Wu 003; Alexander M. Rush (CoRR, 2024)

NetFlowGen: Leveraging Generative Pre-training for Network Traffic Dynamics. - Jiawei Zhou; Woojeong Kim; Zhiying Xu; Alexander M. Rush; Minlan Yu (CoRR, 2024)

Contextual Document Embeddings. - John Xavier Morris; Alexander M. Rush (ICLR, 2025)

Simple Guidance Mechanisms for Discrete Diffusion Models. - Yair Schiff; Subham Sekhar Sahoo; Hao Phung; Guanghan Wang; Sam Boshar; Hugo Dalla-torre; Bernardo P. de Almeida; Alexander M. Rush; Thomas Pierrot; Volodymyr Kuleshov (ICLR, 2025)

Compute-Constrained Data Selection. - Junjie Oscar Yin; Alexander M. Rush (ICLR, 2025)

Commit0: Library Generation from Scratch. - Wenting Zhao; Nan Jiang; Celine Lee; Justin T. Chiu; Claire Cardie; Matthias Gallé; Alexander M. Rush (ICLR, 2025)

Great Memory, Shallow Reasoning: Limits of kNN-LMs. - Shangyi Geng; Wenting Zhao; Alexander M. Rush (NAACL (Short Papers), 2025)

Challenges in Trustworthy Human Evaluation of Chatbots. - Wenting Zhao; Alexander M. Rush; Tanya Goyal (NAACL (Findings), 2025)

Multi-Turn Code Generation Through Single-Step Rewards. - Arnav Kumar Jain; Gonzalo Gonzalez-Pumariega; Wayne Chen; Alexander M. Rush; Wenting Zhao; Sanjiban Choudhury (CoRR, 2025)

Critical Thinking: Which Kinds of Complexity Govern Optimal Reasoning Length? - Celine Lee; Alexander M. Rush; Keyon Vafa (CoRR, 2025)

M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models. - Junxiong Wang; Wen-Ding Li; Daniele Paliotta; Daniel Ritter 007; Alexander M. Rush; Tri Dao (CoRR, 2025)

How much do language models memorize? - John X. Morris; Chawin Sitawarin; Chuan Guo 001; Narine Kokhlikyan; G. Edward Suh; Alexander M. Rush; Kamalika Chaudhuri; Saeed Mahloujifar (CoRR, 2025)

Approximating Language Model Training Data from Weights. - John X. Morris; Junjie Oscar Yin; Woojeong Kim; Vitaly Shmatikov; Alexander M. Rush (CoRR, 2025)

OverFill: Two-Stage Models for Efficient Language Model Decoding. - Woojeong Kim; Junxiong Wang; Jing Nathan Yan; Mohamed Abdelfattah; Alexander M. Rush (CoRR, 2025)