Lexical modeling of non-native speech for automatic speech recognition. - Karen Livescu; James R. Glass (ICASSP, 2000)

Segment-based recognition on the phonebook task: initial results and observations on duration modeling. - Karen Livescu; James R. Glass (INTERSPEECH, 2001)

Structurally discriminative graphical models for automatic speech recognition - results from the 2001 Johns Hopkins Summer Workshop. - Geoffrey Zweig; Jeff A. Bilmes; Thomas Richardson 001; Karim Filali; Karen Livescu; Peng Xu; Kirk Jackson; Yigal Brandman; Eric D. Sandness; Eva Holtz; Jerry Torres; Bill Byrne (ICASSP, 2002)

Hidden feature models for speech recognition using dynamic Bayesian networks. - Karen Livescu; James R. Glass; Jeff A. Bilmes (INTERSPEECH, 2003)

Feature-based pronunciation modeling with trainable asynchrony probabilities. - Karen Livescu; James R. Glass (INTERSPEECH, 2004)

Feature-based Pronunciation Modeling for Speech Recognition. - Karen Livescu; James R. Glass (HLT-NAACL (Short Papers), 2004)

Landmark-Based Speech Recognition: Report of the 2004 Johns Hopkins Summer Workshop. - Mark Hasegawa-Johnson; James Baker; Sarah Borys; Ken Chen 001; Emily Coogan; Steven Greenberg; Amit Juneja; Katrin Kirchhoff; Karen Livescu; Srividya Mohan; Jennifer Muller; M. Kemal Sönmez; et al. (ICASSP (1), 2005)

Production domain modeling of pronunciation for visual speech recognition. - Kate Saenko; Karen Livescu; James R. Glass; Trevor Darrell (ICASSP (5), 2005)

Visual Speech Recognition with Loosely Synchronized Feature Streams. - Kate Saenko; Karen Livescu; Michael Siracusa; Kevin W. Wilson; James R. Glass; Trevor Darrell (ICCV, 2005)

Pronunciation modeling using a finite-state transducer representation. - Timothy J. Hazen; I. Lee Hetherington; Han Shu; Karen Livescu (Speech Commun., 2005)

Feature-based pronunciation modeling for automatic speech recognition. - Karen Livescu (2005)

An Asynchronous DBN for Audio-Visual speech Recognition. - Kate Saenko; Karen Livescu (SLT, 2006)

Monolingual and crosslingual comparison of tandem features derived from articulatory and phone MLPS. - Özgür Çetin; Mathew Magimai-Doss; Karen Livescu; Arthur Kantor; Simon King 001; Chris D. Bartels; Joe Frankel (ASRU, 2007)

An Articulatory Feature-Based Tandem Approach and Factored Observation Modeling. - Özgür Çetin; Arthur Kantor; Simon King 001; Chris D. Bartels; Mathew Magimai-Doss; Joe Frankel; Karen Livescu (ICASSP (4), 2007)

Manual Transcription of Conversational Speech at the Articulatory Feature Level. - Karen Livescu; Ari Bezman; Nash M. Borges; Lisa Yung; Özgür Çetin; Joe Frankel; Simon King 001; Mathew Magimai-Doss; Xuemin Chi; Lisa Lavoie (ICASSP (4), 2007)

Articulatory Feature-Based Methods for Acoustic and Audio-Visual Speech Recognition: Summary from the 2006 JHU Summer workshop. - Karen Livescu; Özgür Çetin; Mark Hasegawa-Johnson; Simon King 001; Chris D. Bartels; Nash M. Borges; Arthur Kantor; Partha Lal; Lisa Yung; Ari Bezman; Stephen Dawson-Haggerty; Bronwyn Woods; et al. (ICASSP (4), 2007)

Articulatory feature classifiers trained on 2000 hours of telephone speech. - Joe Frankel; Mathew Magimai-Doss; Simon King 001; Karen Livescu; Özgür Çetin (INTERSPEECH, 2007)

Invited talk: Phonological Models in Automatic Speech Recognition. - Karen Livescu (SIGMORPHON, 2008)

Multi-view learning of acoustic features for speaker recognition. - Karen Livescu; Mark Stoehr (ASRU, 2009)

On the phonetic information in ultrasonic microphone signals. - Karen Livescu; Bo Zhu 004; James R. Glass (ICASSP, 2009)

Multi-view clustering via canonical correlation analysis. - Kamalika Chaudhuri; Sham M. Kakade; Karen Livescu; Karthik Sridharan (ICML, 2009)

Multistream Articulatory Feature-Based Models for Visual Speech Recognition. - Kate Saenko; Karen Livescu; James R. Glass; Trevor Darrell (IEEE Trans. Pattern Anal. Mach. Intell., 2009)

Modeling pronunciation variation with context-dependent articulatory feature decision trees. - Samuel R. Bowman; Karen Livescu (INTERSPEECH, 2010)

Audio-visual anticipatory coarticulation modeling by human and machine. - Louis H. Terry; Karen Livescu; Janet B. Pierrehumbert; Aggelos K. Katsaggelos (INTERSPEECH, 2010)

A factored conditional random field model for articulatory feature forced transcription. - Rohit Prabhavalkar; Eric Fosler-Lussier; Karen Livescu (ASRU, 2011)

Lexical access experiments with context-dependent articulatory feature-based models. - Preethi Jyothi; Karen Livescu; Eric Fosler-Lussier (ICASSP, 2011)

Nearest Neighbors with Learned Distances for Phonetic Frame Classification. - John Labiak; Karen Livescu (INTERSPEECH, 2011)

Articulatory Feature Classification Using Nearest Neighbors. - Arild Brandrud Næss; Karen Livescu; Rohit Prabhavalkar (INTERSPEECH, 2011)

Discriminative Pronunciation Modeling: A Large-Margin, Feature-Rich Approach. - Hao Tang 002; Joseph Keshet; Karen Livescu (ACL (1), 2012)

Stochastic optimization for PCA and PLS. - Raman Arora; Andrew Cotter; Karen Livescu; Nathan Srebro (Allerton Conference, 2012)

Discriminatively learning factorized finite state pronunciation models from dynamic Bayesian networks. - Preethi Jyothi; Eric Fosler-Lussier; Karen Livescu (INTERSPEECH, 2012)

Kernel CCA for multi-view learning of acoustic features using articulatory measurements. - Raman Arora; Karen Livescu (MLSLP, 2012)

Discriminative spoken term detection with limited data. - Rohit Prabhavalkar; Joseph Keshet; Karen Livescu; Eric Fosler-Lussier (MLSLP, 2012)

American sign language fingerspelling recognition with phonological feature-based tandem models. - Taehwan Kim 003; Karen Livescu; Gregory Shakhnarovich (SLT, 2012)

Subword Modeling for Automatic Speech Recognition: Past, Present, and Emerging Approaches. - Karen Livescu; Eric Fosler-Lussier; Florian Metze (IEEE Signal Process. Mag., 2012)

Fixed-dimensional acoustic embeddings of variable-length segments in low-resource settings. - Keith D. Levin; Katharine Henry; Aren Jansen; Karen Livescu (ASRU, 2013)

Multi-view CCA-based acoustic features for phonetic recognition across speakers and domains. - Raman Arora; Karen Livescu (ICASSP, 2013)

Discriminative articulatory models for spoken term detection in low-resource conversational settings. - Rohit Prabhavalkar; Karen Livescu; Eric Fosler-Lussier; Joseph Keshet (ICASSP, 2013)

Fingerspelling Recognition with Semi-Markov Conditional Random Fields. - Taehwan Kim 003; Gregory Shakhnarovich; Karen Livescu (ICCV, 2013)

Deep Canonical Correlation Analysis. - Galen Andrew; Raman Arora; Jeff A. Bilmes; Karen Livescu (ICML (3), 2013)

Discriminative training of WFST factors with application to pronunciation modeling. - Preethi Jyothi; Eric Fosler-Lussier; Karen Livescu (INTERSPEECH, 2013)

Tailoring Continuous Word Representations for Dependency Parsing. - Mohit Bansal; Kevin Gimpel; Karen Livescu (ACL (2), 2014)

Multi-view learning with supervision for transformed bottleneck features. - Raman Arora; Karen Livescu (ICASSP, 2014)

A comparison of training approaches for discriminative segmental models. - Hao Tang 002; Kevin Gimpel; Karen Livescu (INTERSPEECH, 2014)

Revisiting Word Neighborhoods for Speech Recognition. - Preethi Jyothi; Karen Livescu (SIGMORPHON/SIGFSM, 2014)

Reconstruction of articulatory measurements with smoothed low-rank matrix completion. - Weiran Wang; Raman Arora; Karen Livescu (SLT, 2014)

Stochastic optimization for deep CCA via nonlinear orthogonal iterations. - Weiran Wang; Raman Arora; Karen Livescu; Nathan Srebro (Allerton, 2015)

Discriminative segmental cascades for feature-rich phone recognition. - Hao Tang 002; Weiran Wang; Kevin Gimpel; Karen Livescu (ASRU, 2015)

Unsupervised learning of acoustic features via deep canonical correlation analysis. - Weiran Wang; Raman Arora; Karen Livescu; Jeff A. Bilmes (ICASSP, 2015)

On Deep Multi-View Representation Learning. - Weiran Wang; Raman Arora; Karen Livescu; Jeff A. Bilmes (ICML, 2015)

Deep Multilingual Correlation for Improved Word Embeddings. - Ang Lu; Weiran Wang; Mohit Bansal; Kevin Gimpel; Karen Livescu (HLT-NAACL, 2015)

From Paraphrase Database to Compositional Paraphrase Model and Back. - John Wieting; Mohit Bansal; Kevin Gimpel; Karen Livescu (Trans. Assoc. Comput. Linguistics, 2015)

Charagram: Embedding Words and Sentences via Character n-grams. - John Wieting; Mohit Bansal; Kevin Gimpel; Karen Livescu (EMNLP, 2016)

Signer-independent fingerspelling recognition with deep neural network adaptation. - Taehwan Kim 003; Weiran Wang; Hao Tang 002; Karen Livescu (ICASSP, 2016)

Deep convolutional acoustic word embeddings using word-pair side information. - Herman Kamper; Weiran Wang; Karen Livescu (ICASSP, 2016)

Nonparametric Canonical Correlation Analysis. - Tomer Michaeli; Weiran Wang; Karen Livescu (ICML, 2016)

Efficient Segmental Cascades for Speech Recognition. - Hao Tang 002; Weiran Wang; Kevin Gimpel; Karen Livescu (INTERSPEECH, 2016)

Triphone State-Tying via Deep Canonical Correlation Analysis. - Weiran Wang; Hao Tang 002; Karen Livescu (INTERSPEECH, 2016)

Mapping Unseen Words to Task-Trained Embedding Spaces. - Pranava Swaroop Madhyastha; Mohit Bansal; Kevin Gimpel; Karen Livescu (Rep4NLP@ACL, 2016)

Discriminative acoustic word embeddings: Tecurrent neural network-based approaches. - Shane Settle; Karen Livescu (SLT, 2016)

End-to-end training approaches for discriminative segmental models. - Hao Tang 002; Weiran Wang; Kevin Gimpel; Karen Livescu (SLT, 2016)

Jointly learning to align and convert graphemes to phonemes with neural attention models. - Shubham Toshniwal; Karen Livescu (SLT, 2016)

Discriminative Acoustic Word Embeddings: Recurrent Neural Network-Based Approaches. - Shane Settle; Karen Livescu (CoRR, 2016)

On Deep Multi-View Representation Learning: Objectives and Optimization. - Weiran Wang; Raman Arora; Karen Livescu; Jeff A. Bilmes (CoRR, 2016)

Large-Scale Approximate Kernel Canonical Correlation Analysis. - Weiran Wang; Karen Livescu (ICLR (Poster), 2016)

Deep Variational Canonical Correlation Analysis. - Weiran Wang; Honglak Lee; Karen Livescu (CoRR, 2016)

Towards Universal Paraphrastic Sentence Embeddings. - John Wieting; Mohit Bansal; Kevin Gimpel; Karen Livescu (ICLR, 2016)

Articulatory feature-based pronunciation modeling. - Karen Livescu; Preethi Jyothi; Eric Fosler-Lussier (Comput. Speech Lang., 2016)

Speech Production in Speech Technologies: Introduction to the CSL Special Issue. - Karen Livescu; Frank Rudzicz; Eric Fosler-Lussier; Mark Hasegawa-Johnson; Jeff A. Bilmes (Comput. Speech Lang., 2016)

An embedded segmental K-means model for unsupervised segmentation and clustering of speech. - Herman Kamper; Karen Livescu; Sharon Goldwater (ASRU, 2017)

Multitask training with unlabeled data for end-to-end sign language fingerspelling recognition. - Bowen Shi; Karen Livescu (ASRU, 2017)

Multi-view Recurrent Neural Acoustic Word Embeddings. - Wanjia He; Weiran Wang; Karen Livescu (ICLR (Poster), 2017)

Visually Grounded Learning of Keyword Prediction from Untranscribed Speech. - Herman Kamper; Shane Settle; Gregory Shakhnarovich; Karen Livescu (INTERSPEECH, 2017)

Query-by-Example Search with Discriminative Neural Acoustic Word Embeddings. - Shane Settle; Keith D. Levin; Herman Kamper; Karen Livescu (INTERSPEECH, 2017)

Acoustic Feature Learning via Deep Variational Canonical Correlation Analysis. - Qingming Tang; Weiran Wang; Karen Livescu (INTERSPEECH, 2017)

Multitask Learning with Low-Level Auxiliary Tasks for Encoder-Decoder Based Speech Recognition. - Shubham Toshniwal; Hao Tang 002; Liang Lu 001; Karen Livescu (INTERSPEECH, 2017)

Learning to Embed Words in Context for Syntactic Tasks. - Lifu Tu; Kevin Gimpel; Karen Livescu (Rep4NLP@ACL, 2017)

Joint Modeling of Text and Acoustic-Prosodic Cues for Neural Parsing. - Trang Tran 001; Shubham Toshniwal; Mohit Bansal; Kevin Gimpel; Karen Livescu; Mari Ostendorf (CoRR, 2017)

Semantic keyword spotting by learning from images and speech. - Herman Kamper; Gregory Shakhnarovich; Karen Livescu (CoRR, 2017)

Lexicon-free fingerspelling recognition from video: Data, models, and signer adaptation. - Taehwan Kim 003; Jonathan Keane; Weiran Wang; Hao Tang 002; Jason Riggle; Gregory Shakhnarovich; Diane Brentari; Karen Livescu (Comput. Speech Lang., 2017)

End-to-End Neural Segmental Models for Speech Recognition. - Hao Tang 002; Liang Lu 001; Lingpeng Kong; Kevin Gimpel; Karen Livescu; Chris Dyer; Noah A. Smith; Steve Renals (IEEE J. Sel. Top. Signal Process., 2017)

Variational Sequential Labelers for Semi-Supervised Learning. - Mingda Chen; Qingming Tang; Karen Livescu; Kevin Gimpel (EMNLP, 2018)

A Study of All-Convolutional Encoders for Connectionist Temporal Classification. - Kalpesh Krishna; Liang Lu 001; Kevin Gimpel; Karen Livescu (ICASSP, 2018)

Acoustic Feature Learning Using Cross-Domain Articulatory Measurements. - Qingming Tang; Weiran Wang; Karen Livescu (ICASSP, 2018)

Low-Resource Speech-to-Text Translation. - Sameer Bansal; Herman Kamper; Karen Livescu; Adam Lopez; Sharon Goldwater (INTERSPEECH, 2018)

Parsing Speech: a Neural Approach to Integrating Lexical and Acoustic-Prosodic Information. - Trang Tran 001; Shubham Toshniwal; Mohit Bansal; Kevin Gimpel; Karen Livescu; Mari Ostendorf (NAACL-HLT, 2018)

American Sign Language Fingerspelling Recognition in the Wild. - Bowen Shi; Aurora Martinez Del Rio; Jonathan Keane; Jonathan Michaux; Diane Brentari; Greg Shakhnarovich; Karen Livescu (SLT, 2018)

A Comparison of Techniques for Language Model Integration in Encoder-Decoder Speech Recognition. - Shubham Toshniwal; Anjuli Kannan; Chung-Cheng Chiu; Yonghui Wu; Tara N. Sainath; Karen Livescu (SLT, 2018)

Hierarchical Multitask Learning for CTC-based Speech Recognition. - Kalpesh Krishna; Shubham Toshniwal; Karen Livescu (CoRR, 2018)

Visually Grounded Neural Syntax Acquisition. - Haoyue Shi 001; Jiayuan Mao; Kevin Gimpel; Karen Livescu (ACL (1), 2019)

Semantic Query-by-example Speech Search Using Visual Grounding. - Herman Kamper; Aristotelis Anastassiou; Karen Livescu (ICASSP, 2019)

Acoustically Grounded Word Embeddings for Improved Acoustics-to-word Speech Recognition. - Shane Settle; Kartik Audhkhasi; Karen Livescu; Michael Picheny (ICASSP, 2019)

Fingerspelling Recognition in the Wild With Iterative Visual Attention. - Bowen Shi; Aurora Martinez Del Rio; Jonathan Keane; Diane Brentari; Greg Shakhnarovich; Karen Livescu (ICCV, 2019)

Pre-Trained Text Embeddings for Enhanced Text-to-Speech Synthesis. - Tomoki Hayashi; Shinji Watanabe 001; Tomoki Toda; Kazuya Takeda; Shubham Toshniwal; Karen Livescu (INTERSPEECH, 2019)

On the Contributions of Visual and Textual Supervision in Low-Resource Semantic Speech Retrieval. - Ankita Pasad; Bowen Shi; Herman Kamper; Karen Livescu (INTERSPEECH, 2019)

Pre-training on high-resource speech recognition improves low-resource speech-to-text translation. - Sameer Bansal; Herman Kamper; Karen Livescu; Adam Lopez; Sharon Goldwater (NAACL-HLT (1), 2019)

Semantic Speech Retrieval With a Visually Grounded Model of Untranscribed Speech. - Herman Kamper; Gregory Shakhnarovich; Karen Livescu (IEEE ACM Trans. Audio Speech Lang. Process., 2019)

Discrete Latent Variable Representations for Low-Resource Text Classification. - Shuning Jin; Sam Wiseman; Karl Stratos; Karen Livescu (ACL, 2020)

PeTra: A Sparsely Supervised Memory Model for People Tracking. - Shubham Toshniwal; Allyson Ettinger; Kevin Gimpel; Karen Livescu (ACL, 2020)

On the Role of Supervision in Unsupervised Constituency Parsing. - Haoyue Shi 001; Karen Livescu; Kevin Gimpel (EMNLP (1), 2020)

Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networks. - Shubham Toshniwal; Sam Wiseman; Allyson Ettinger; Karen Livescu; Kevin Gimpel (EMNLP (1), 2020)

Unsupervised Pre-Training of Bidirectional Speech Encoders via Masked Reconstruction. - Weiran Wang; Qingming Tang; Karen Livescu (ICASSP, 2020)

Multilingual Jointly Trained Acoustic and Written Word Embeddings. - Yushi Hu; Shane Settle; Karen Livescu (INTERSPEECH, 2020)

A Cross-Task Analysis of Text Span Representations. - Shubham Toshniwal; Haoyue Shi 001; Bowen Shi; Lingyu Gao; Karen Livescu; Kevin Gimpel (RepL4NLP@ACL, 2020)

A Correspondence Variational Autoencoder for Unsupervised Acoustic Word Embeddings. - Puyuan Peng; Herman Kamper; Karen Livescu (CoRR, 2020)

Substructure Substitution: Structured Data Augmentation for NLP. - Haoyue Shi 001; Karen Livescu; Kevin Gimpel (ACL/IJCNLP (Findings), 2021)

Layer-Wise Analysis of a Self-Supervised Speech Representation Model. - Ankita Pasad; Ju-Chieh Chou; Karen Livescu (ASRU, 2021)

Fingerspelling Detection in American Sign Language. - Bowen Shi; Diane Brentari; Greg Shakhnarovich; Karen Livescu (CVPR, 2021)

Learning Speech Models from Multi-Modal Data. - Karen Livescu (Interspeech, 2021)

Acoustic Span Embeddings for Multilingual Query-by-Example Search. - Yushi Hu; Shane Settle; Karen Livescu (SLT, 2021)

Whole-Word Segmental Speech Recognition with Acoustic Word Embeddings. - Bowen Shi; Shane Settle; Karen Livescu (SLT, 2021)

Learning Chess Blindfolded: Evaluating Language Models on State Tracking. - Shubham Toshniwal; Sam Wiseman; Karen Livescu; Kevin Gimpel (CoRR, 2021)

On Generalization in Coreference Resolution. - Shubham Toshniwal; Patrick Xia 002; Sam Wiseman; Karen Livescu; Kevin Gimpel (CoRR, 2021)

Chess as a Testbed for Language Model State Tracking. - Shubham Toshniwal; Sam Wiseman; Karen Livescu; Kevin Gimpel (AAAI, 2022)

Searching for fingerspelled content in American Sign Language. - Bowen Shi; Diane Brentari; Greg Shakhnarovich; Karen Livescu (ACL (1), 2022)

Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing. - Freda Shi; Kevin Gimpel; Karen Livescu (ACL (1), 2022)

Open-Domain Sign Language Translation Learned from Online Video. - Bowen Shi; Diane Brentari; Gregory Shakhnarovich; Karen Livescu (EMNLP, 2022)

Baked-in State Probing. - Shubham Toshniwal; Sam Wiseman; Karen Livescu; Kevin Gimpel (EMNLP (Findings), 2022)

SLUE: New Benchmark Tasks For Spoken Language Understanding Evaluation on Natural Speech. - Suwon Shon; Ankita Pasad; Felix Wu; Pablo Brusco; Yoav Artzi; Karen Livescu; Kyu Jeong Han (ICASSP, 2022)

On the Use of External Data for Spoken Named Entity Recognition. - Ankita Pasad; Felix Wu; Suwon Shon; Karen Livescu; Kyu Jeong Han (NAACL-HLT, 2022)

TTIC's WMT-SLT 22 Sign Language Translation System. - Bowen Shi; Diane Brentari; Gregory Shakhnarovich; Karen Livescu (WMT, 2022)

Editorial Editorial of Special Issue on Self-Supervised Learning for Speech and Audio Processing. - Hung-Yi Lee; Shinji Watanabe 001; Karen Livescu; Abdelrahman Mohamed; Tara N. Sainath (IEEE J. Sel. Top. Signal Process., 2022)

Self-Supervised Speech Representation Learning: A Review. - Abdelrahman Mohamed; Hung-yi Lee; Lasse Borgholt; Jakob D. Havtorn; Joakim Edin; Christian Igel; Katrin Kirchhoff; Shang-Wen Li 001; Karen Livescu; Lars Maaløe; Tara N. Sainath; Shinji Watanabe 001 (IEEE J. Sel. Top. Signal Process., 2022)

SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks. - Suwon Shon; Siddhant Arora; Chyi-Jiunn Lin; Ankita Pasad; Felix Wu; Roshan S. Sharma; Wei-Lun Wu; Hung-yi Lee; Karen Livescu; Shinji Watanabe 001 (ACL (1), 2023)

Few-Shot Spoken Language Understanding Via Joint Speech-Text Models. - Chung-Ming Chien; Mingjiamei Zhang; Ju-Chieh Chou; Karen Livescu (ASRU, 2023)

Audio-Visual Neural Syntax Acquisition. - Cheng-I Jeff Lai; Freda Shi; Puyuan Peng; Yoon Kim; Kevin Gimpel; Shiyu Chang; Yung-Sung Chuang; Saurabhchand Bhati; David D. Cox; David Harwath; Yang Zhang 001; Karen Livescu; et al. (ASRU, 2023)

Toward Joint Language Modeling for Speech Units and Text. - Ju-Chieh Chou; Chung-Ming Chien; Wei-Ning Hsu; Karen Livescu; Arun Babu; Alexis Conneau; Alexei Baevski; Michael Auli (EMNLP (Findings), 2023)

Comparative Layer-Wise Analysis of Self-Supervised Speech Models. - Ankita Pasad; Bowen Shi; Karen Livescu (ICASSP, 2023)

Context-Aware Fine-Tuning of Self-Supervised Speech Models. - Suwon Shon; Felix Wu; Kwangyoun Kim; Prashant Sridhar; Karen Livescu; Shinji Watanabe 001 (ICASSP, 2023)

TTIC's Submission to WMT-SLT 23. - Marcelo Sandoval-Castañeda; Yanhong Li; Bowen Shi; Diane Brentari; Karen Livescu; Gregory Shakhnarovich (WMT, 2023)

Self-Supervised Video Transformers for Isolated Sign Language Recognition. - Marcelo Sandoval-Castañeda; Yanhong Li; Diane Brentari; Karen Livescu; Gregory Shakhnarovich (CoRR, 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

On the Evaluation of Speech Foundation Models for Spoken Language Understanding. - Siddhant Arora; Ankita Pasad; Chung-Ming Chien; Jionghao Han; Roshan S. Sharma; Jee-weon Jung; Hira Dhamyal; William Chen; Suwon Shon; Hung-yi Lee; Karen Livescu; Shinji Watanabe 001 (ACL (Findings), 2024)

Structured Tree Alignment for Evaluation of (Speech) Constituency Parsing. - Freda Shi; Kevin Gimpel; Karen Livescu (ACL (1), 2024)

Towards Robust Speech Representation Learning for Thousands of Languages. - William Chen; Wangyou Zhang; Yifan Peng 003; Xinjian Li; Jinchuan Tian; Jiatong Shi; Xuankai Chang; Soumi Maiti; Karen Livescu; Shinji Watanabe 001 (EMNLP, 2024)

AV2WAV: Diffusion-Based Re-Synthesis from Continuous Self-Supervised Features for Audio-Visual Speech Enhancement. - Ju-Chieh Chou; Chung-Ming Chien; Karen Livescu (ICASSP, 2024)

Generative Context-Aware Fine-Tuning of Self-Supervised Speech Models. - Suwon Shon; Kwangyoun Kim; Prashant Sridhar; Yi-Te Hsu; Shinji Watanabe 001; Karen Livescu (ICASSP, 2024)

Self-Supervised Speech Representations are More Phonetic than Semantic. - Kwanghee Choi; Ankita Pasad; Tomohiko Nakamura; Satoru Fukayama; Karen Livescu; Shinji Watanabe 001 (INTERSPEECH, 2024)

Convolution-Augmented Parameter-Efficient Fine-Tuning for Speech Recognition. - Kwangyoun Kim; Suwon Shon; Yi-Te Hsu; Prashant Sridhar; Karen Livescu; Shinji Watanabe 001 (INTERSPEECH, 2024)

ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets. - Jiatong Shi; Shih-Heng Wang; William Chen; Martijn Bartelds; Vanya Bannihatti Kumar; Jinchuan Tian; Xuankai Chang; Dan Jurafsky; Karen Livescu; Hung-yi Lee; Shinji Watanabe 001 (INTERSPEECH, 2024)

DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding. - Suwon Shon; Kwangyoun Kim; Yi-Te Hsu; Prashant Sridhar; Shinji Watanabe 001; Karen Livescu (INTERSPEECH, 2024)

On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models. - Jinchuan Tian; Yifan Peng 003; William Chen; Kwanghee Choi; Karen Livescu; Shinji Watanabe 001 (INTERSPEECH, 2024)

UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions. - Siddhant Arora; Hayato Futami; Jee-weon Jung; Yifan Peng 003; Roshan S. Sharma; Yosuke Kashiwagi; Emiru Tsunoo; Karen Livescu; Shinji Watanabe 001 (NAACL-HLT, 2024)

Speech Recognition For Analysis of Police Radio Communication. - Tejes Srivastava; Ju-Chieh Chou; Priyank Shroff; Karen Livescu; Christopher Graziul (SLT, 2024)

Approaching Deep Learning through the Spectral Dynamics of Weights. - David Yunis; Kumar Kshitij Patel; Samuel Wheeler; Pedro Savarese; Gal Vardi; Karen Livescu; Michael Maire; Matthew R. Walter (CoRR, 2024)

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. - Chien-yu Huang; Wei-Chih Chen; Shu-Wen Yang; Andy T. Liu; Chen-An Li; Yu-Xiang Lin; Wei-Cheng Tseng; Anuj Diwan; Yi-Jen Shih; Jiatong Shi; William Chen; Xuanjun Chen; et al. (CoRR, 2024)

What Do Self-Supervised Speech Models Know About Words? - Ankita Pasad; Chung-Ming Chien; Shane Settle; Karen Livescu (Trans. Assoc. Comput. Linguistics, 2024)

SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale. - Shester Gueuwou; Xiaodan Du 001; Greg Shakhnarovich; Karen Livescu (ACL (Findings), 2025)

SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction. - Shester Gueuwou; Xiaodan Du 001; Greg Shakhnarovich; Karen Livescu; Alexander H. Liu (ACL (1), 2025)

Constructing Datasets From Public Police Body Camera Footage. - Jamie Rosas-Smith; Martijn Bartelds; Ruizhe Huang; Leibny Paola García-Perera; Karen Livescu; Dan Jurafsky; Anjalie Field (ICASSP, 2025)

Chunk-Distilled Language Modeling. - Yanhong Li; Karen Livescu; Jiawei Zhou (ICLR, 2025)

CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition. - Martijn Bartelds; Ananjan Nandi; Moussa Koulako Bala Doumbouya; Dan Jurafsky; Tatsunori Hashimoto; Karen Livescu (CoRR, 2025)

On The Landscape of Spoken Language Models: A Comprehensive Survey. - Siddhant Arora; Kai-Wei Chang; Chung-Ming Chien; Yifan Peng 003; Haibin Wu; Yossi Adi; Emmanuel Dupoux; Hung-Yi Lee; Karen Livescu; Shinji Watanabe 001 (CoRR, 2025)

On the Predictive Power of Representation Dispersion in Language Models. - Yanhong Li; Ming Li; Karen Livescu; Jiawei Zhou (CoRR, 2025)

Flow-SLM: Joint Learning of Linguistic and Acoustic Information for Spoken Language Modeling. - Ju-Chieh Chou; Jiawei Zhou; Karen Livescu (CoRR, 2025)