The Double Scheme: Deadlock-Free Dynamic Reconfiguration of Cut-Through Networks. - Ruoming Pang; Timothy Mark Pinkston; José Duato (ICPP, 2000)

Oblivious Hashing: A Stealthy Software Integrity Verification Primitive. - Yuqun Chen; Ramarathnam Venkatesan; Matthew Cary; Ruoming Pang; Saurabh Sinha; Mariusz H. Jakubowski (Information Hiding, 2002)

Defensive Programming: Using an Annotation Toolkit to Build DoS-Resistant Software. - Xiaohu Qie; Ruoming Pang; Larry L. Peterson (OSDI, 2002)

A high-level programming environment for packet trace anonymization and transformation. - Ruoming Pang; Vern Paxson (SIGCOMM, 2003)

Deadlock-Free Dynamic Reconfiguration Schemes for Increased Network Dependability. - Timothy Mark Pinkston; Ruoming Pang; José Duato (IEEE Trans. Parallel Distributed Syst., 2003)

Characteristics of internet background radiation. - Ruoming Pang; Vinod Yegneswaran; Paul Barford; Vern Paxson; Larry L. Peterson (Internet Measurement Conference, 2004)

Reliability and Security in the CoDeeN Content Distribution Network. - Limin Wang 010; KyoungSoo Park; Ruoming Pang; Vivek S. Pai; Larry L. Peterson (USENIX ATC, General Track, 2004)

The dark side of the Web: an open proxy's view. - Vivek S. Pai; Limin Wang 010; KyoungSoo Park; Ruoming Pang; Larry L. Peterson (Comput. Commun. Rev., 2004)

A First Look at Modern Enterprise Traffic. - Ruoming Pang; Mark Allman; Mike Bennett; Jason Lee 001; Vern Paxson; Brian Tierney (Internet Measurement Conference, 2005)

Part I: A Theory for Deadlock-Free Dynamic Network Reconfiguration. - José Duato; Olav Lysne; Ruoming Pang; Timothy Mark Pinkston (IEEE Trans. Parallel Distributed Syst., 2005)

binpac: a yacc for writing application protocol parsers. - Ruoming Pang; Vern Paxson; Robin Sommer; Larry L. Peterson (Internet Measurement Conference, 2006)

Rethinking Hardware Support for Network Analysis and Intrusion Prevention. - Vern Paxson; Krste Asanovic; Sarang Dharmapurikar; John W. Lockwood; Ruoming Pang; Robin Sommer; Nicholas Weaver (HotSec, 2006)

The devil and packet trace anonymization. - Ruoming Pang; Mark Allman; Vern Paxson; Jason Lee 001 (Comput. Commun. Rev., 2006)

Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions. - Jonathan Shen; Ruoming Pang; Ron J. Weiss; Mike Schuster; Navdeep Jaitly; Zongheng Yang; Zhifeng Chen; Yu Zhang 033; Yuxuan Wang 002; R. J. Skerry-Ryan; Rif A. Saurous; Yannis Agiomyrgiannakis; et al. (ICASSP, 2018)

Compression of End-to-End Models. - Ruoming Pang; Tara N. Sainath; Rohit Prabhavalkar; Suyog Gupta; Yonghui Wu; Shuyuan Zhang 002; Chung-Cheng Chiu (INTERSPEECH, 2018)

Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis. - Ye Jia; Yu Zhang 033; Ron J. Weiss; Quan Wang; Jonathan Shen; Fei Ren; Zhifeng Chen; Patrick Nguyen; Ruoming Pang; Ignacio López-Moreno; Yonghui Wu (NeurIPS, 2018)

MnasNet: Platform-Aware Neural Architecture Search for Mobile. - Mingxing Tan; Bo Chen 019; Ruoming Pang; Vijay Vasudevan; Quoc V. Le (CoRR, 2018)

Domain Adaptive Transfer Learning with Specialist Models. - Jiquan Ngiam; Daiyi Peng; Vijay Vasudevan; Simon Kornblith; Quoc V. Le; Ruoming Pang (CoRR, 2018)

Monotonic Infinite Lookback Attention for Simultaneous Machine Translation. - Naveen Arivazhagan; Colin Cherry; Wolfgang Macherey; Chung-Cheng Chiu; Semih Yavuz; Ruoming Pang; Wei Li 133; Colin Raffel (ACL (1), 2019)

A Comparison of End-to-End Models for Long-Form Speech Recognition. - Chung-Cheng Chiu; Anjuli Kannan; Rohit Prabhavalkar; Zhifeng Chen; Tara N. Sainath; Yonghui Wu; Wei Han 002; Yu Zhang 033; Ruoming Pang; Sergey Kishchenko; Patrick Nguyen; Arun Narayanan; et al. (ASRU, 2019)

MnasNet: Platform-Aware Neural Architecture Search for Mobile. - Mingxing Tan; Bo Chen 019; Ruoming Pang; Vijay Vasudevan; Mark Sandler 002; Andrew Howard 002; Quoc V. Le (CVPR, 2019)

Semi-supervised Training for End-to-end Models via Weak Distillation. - Bo Li 028; Tara N. Sainath; Ruoming Pang; Zelin Wu (ICASSP, 2019)

Streaming End-to-end Speech Recognition for Mobile Devices. - Yanzhang He; Tara N. Sainath; Rohit Prabhavalkar; Ian McGraw; Raziel Alvarez; Ding Zhao; David Rybach; Anjuli Kannan; Yonghui Wu; Ruoming Pang; Qiao Liang 001; Deepti Bhatia; et al. (ICASSP, 2019)

Searching for MobileNetV3. - Andrew Howard 002; Ruoming Pang; Hartwig Adam; Quoc V. Le; Mark Sandler 002; Bo Chen 019; Weijun Wang; Liang-Chieh Chen; Mingxing Tan; Grace Chu; Vijay Vasudevan; Yukun Zhu (ICCV, 2019)

Hierarchical Generative Modeling for Controllable Speech Synthesis. - Wei-Ning Hsu; Yu Zhang 033; Ron J. Weiss; Heiga Zen; Yonghui Wu; Yuxuan Wang 002; Yuan Cao 007; Ye Jia; Zhifeng Chen; Jonathan Shen; Patrick Nguyen; Ruoming Pang (ICLR (Poster), 2019)

Two-Pass End-to-End Speech Recognition. - Tara N. Sainath; Ruoming Pang; David Rybach; Yanzhang He; Rohit Prabhavalkar; Wei Li 133; Mirkó Visontai; Qiao Liang 001; Trevor Strohman; Yonghui Wu; Ian McGraw; Chung-Cheng Chiu (INTERSPEECH, 2019)

Shallow-Fusion End-to-End Contextual Biasing. - Ding Zhao; Tara N. Sainath; David Rybach; Pat Rondon; Deepti Bhatia; Bo Li 028; Ruoming Pang (INTERSPEECH, 2019)

Zanzibar: Google's Consistent, Global Authorization System. - Ruoming Pang; Ramón Cáceres; Mike Burrows; Zhifeng Chen; Pratik Dave; Nathan Germer; Alexander Golynski; Kevin Graney; Nina Kang; Lea Kissner; Jeffrey L. Korn; Abhishek Parmar; et al. (USENIX ATC, 2019)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection. - Golnaz Ghiasi; Tsung-Yi Lin; Ruoming Pang; Quoc V. Le (CoRR, 2019)

EfficientDet: Scalable and Efficient Object Detection. - Mingxing Tan; Ruoming Pang; Quoc V. Le (CVPR, 2020)

BigNAS: Scaling up Neural Architecture Search with Big Single-Stage Models. - Jiahui Yu; Pengchong Jin; Hanxiao Liu; Gabriel Bender; Pieter-Jan Kindermans; Mingxing Tan; Thomas S. Huang; Xiaodan Song; Ruoming Pang; Quoc Le 001 (ECCV (7), 2020)

Deliberation Model Based Two-Pass End-To-End Speech Recognition. - Ke Hu; Tara N. Sainath; Ruoming Pang; Rohit Prabhavalkar (ICASSP, 2020)

Towards Fast and Accurate Streaming End-To-End ASR. - Bo Li 028; Shuo-Yiin Chang; Tara N. Sainath; Ruoming Pang; Yanzhang He; Trevor Strohman; Yonghui Wu (ICASSP, 2020)

A Streaming On-Device End-To-End Model Surpassing Server-Side Conventional Model Quality and Latency. - Tara N. Sainath; Yanzhang He; Bo Li 028; Arun Narayanan; Ruoming Pang; Antoine Bruguier; Shuo-Yiin Chang; Wei Li 133; Raziel Alvarez; Zhifeng Chen; Chung-Cheng Chiu; David Garcia; et al. (ICASSP, 2020)

An Attention-Based Joint Acoustic and Text on-Device End-To-End Model. - Tara N. Sainath; Ruoming Pang; Ron J. Weiss; Yanzhang He; Chung-Cheng Chiu; Trevor Strohman (ICASSP, 2020)

Conformer: Convolution-augmented Transformer for Speech Recognition. - Anmol Gulati; James Qin; Chung-Cheng Chiu; Niki Parmar; Yu Zhang 033; Jiahui Yu; Wei Han 002; Shibo Wang; Zhengdong Zhang; Yonghui Wu; Ruoming Pang (INTERSPEECH, 2020)

ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context. - Wei Han 002; Zhengdong Zhang; Yu Zhang 033; Jiahui Yu; Chung-Cheng Chiu; James Qin; Anmol Gulati; Ruoming Pang; Yonghui Wu (INTERSPEECH, 2020)

Parallel Rescoring with Transformer for Streaming On-Device Speech Recognition. - Wei Li 133; James Qin; Chung-Cheng Chiu; Ruoming Pang; Yanzhang He (INTERSPEECH, 2020)

Improving Tail Performance of a Deliberation E2E ASR Model Using a Large Text Corpus. - Cal Peyser; Sepand Mavandadi; Tara N. Sainath; James Apfel; Ruoming Pang; Shankar Kumar (INTERSPEECH, 2020)

Emitting Word Timings with End-to-End Models. - Tara N. Sainath; Ruoming Pang; David Rybach; Basi García; Trevor Strohman (INTERSPEECH, 2020)

A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latency. - Tara N. Sainath; Yanzhang He; Bo Li 028; Arun Narayanan; Ruoming Pang; Antoine Bruguier; Shuo-Yiin Chang; Wei Li 133; Raziel Alvarez; Zhifeng Chen; Chung-Cheng Chiu; David Garcia; et al. (CoRR, 2020)

Universal ASR: Unify and Improve Streaming ASR with Full-context Modeling. - Jiahui Yu; Wei Han 002; Anmol Gulati; Chung-Cheng Chiu; Bo Li 028; Tara N. Sainath; Yonghui Wu; Ruoming Pang (CoRR, 2020)

Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition. - Yu Zhang 033; James Qin; Daniel S. Park; Wei Han 002; Chung-Cheng Chiu; Ruoming Pang; Quoc V. Le; Yonghui Wu (CoRR, 2020)

w2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training. - Yu-An Chung; Yu Zhang 033; Wei Han 002; Chung-Cheng Chiu; James Qin; Ruoming Pang; Yonghui Wu (ASRU, 2021)

Scaling End-to-End Models for Large-Scale Multilingual ASR. - Bo Li 028; Ruoming Pang; Tara N. Sainath; Anmol Gulati; Yu Zhang 033; James Qin; Parisa Haghani; W. Ronny Huang; Min Ma; Junwen Bai (ASRU, 2021)

Searching for Fast Model Families on Datacenter Accelerators. - Sheng Li 007; Mingxing Tan; Ruoming Pang; Andrew Li; Liqun Cheng; Quoc V. Le; Norman P. Jouppi (CVPR, 2021)

Improving Streaming Automatic Speech Recognition with Non-Streaming Model Distillation on Unsupervised Data. - Thibault Doutre; Wei Han 002; Min Ma; Zhiyun Lu; Chung-Cheng Chiu; Ruoming Pang; Arun Narayanan; Ananya Misra; Yu Zhang 033; Liangliang Cao (ICASSP, 2021)

A Better and Faster end-to-end Model for Streaming ASR. - Bo Li 028; Anmol Gulati; Jiahui Yu; Tara N. Sainath; Chung-Cheng Chiu; Arun Narayanan; Shuo-Yiin Chang; Ruoming Pang; Yanzhang He; James Qin; Wei Han 002; Qiao Liang 001; et al. (ICASSP, 2021)

Cascaded Encoders for Unifying Streaming and Non-Streaming ASR. - Arun Narayanan; Tara N. Sainath; Ruoming Pang; Jiahui Yu; Chung-Cheng Chiu; Rohit Prabhavalkar; Ehsan Variani; Trevor Strohman (ICASSP, 2021)

Dynamic Sparsity Neural Networks for Automatic Speech Recognition. - Zhaofeng Wu; Ding Zhao; Qiao Liang 001; Jiahui Yu; Anmol Gulati; Ruoming Pang (ICASSP, 2021)

FastEmit: Low-Latency Streaming ASR with Sequence-Level Emission Regularization. - Jiahui Yu; Chung-Cheng Chiu; Bo Li 028; Shuo-Yiin Chang; Tara N. Sainath; Yanzhang He; Arun Narayanan; Wei Han 002; Anmol Gulati; Yonghui Wu; Ruoming Pang (ICASSP, 2021)

Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling. - Jiahui Yu; Wei Han 002; Anmol Gulati; Chung-Cheng Chiu; Bo Li 028; Tara N. Sainath; Yonghui Wu; Ruoming Pang (ICLR, 2021)

Bridging the Gap Between Streaming and Non-Streaming ASR Systems by Distilling Ensembles of CTC and RNN-T Models. - Thibault Doutre; Wei Han 002; Chung-Cheng Chiu; Ruoming Pang; Olivier Siohan; Liangliang Cao (Interspeech, 2021)

An Efficient Streaming Non-Recurrent On-Device End-to-End Model with Improvements to Rare-Word Modeling. - Tara N. Sainath; Yanzhang He; Arun Narayanan; Rami Botros; Ruoming Pang; David Rybach; Cyril Allauzen; Ehsan Variani; James Qin; Quoc-Nam Le-The; Shuo-Yiin Chang; Bo Li 028; et al. (Interspeech, 2021)

Unsupervised Learning of Disentangled Speech Content and Style Representation. - Andros Tjandra; Ruoming Pang; Yu Zhang 033; Shigeki Karita (Interspeech, 2021)

RNN-T Models Fail to Generalize to Out-of-Domain Audio: Causes and Solutions. - Chung-Cheng Chiu; Arun Narayanan; Wei Han 002; Rohit Prabhavalkar; Yu Zhang 033; Navdeep Jaitly; Ruoming Pang; Tara N. Sainath; Patrick Nguyen; Liangliang Cao; Yonghui Wu (SLT, 2021)

Transformer Based Deliberation for Two-Pass Speech Recognition. - Ke Hu; Ruoming Pang; Tara N. Sainath; Trevor Strohman (SLT, 2021)

Bridging the gap between streaming and non-streaming ASR systems bydistilling ensembles of CTC and RNN-T models. - Thibault Doutre; Wei Han 002; Chung-Cheng Chiu; Ruoming Pang; Olivier Siohan; Liangliang Cao (CoRR, 2021)

Scaling End-to-End Models for Large-Scale Multilingual ASR. - Bo Li 028; Ruoming Pang; Tara N. Sainath; Anmol Gulati; Yu Zhang 033; James Qin; Parisa Haghani; W. Ronny Huang; Min Ma (CoRR, 2021)

GSPMD: General and Scalable Parallelization for ML Computation Graphs. - Yuanzhong Xu; HyoukJoong Lee; Dehao Chen; Blake A. Hechtman; Yanping Huang; Rahul Joshi; Maxim Krikun; Dmitry Lepikhin; Andy Ly; Marcello Maggioni; Ruoming Pang; Noam Shazeer; et al. (CoRR, 2021)

Co-training Transformer with Videos and Images Improves Action Recognition. - Bowen Zhang 002; Jiahui Yu; Christopher Fifty; Wei Han; Andrew M. Dai; Ruoming Pang; Fei Sha (CoRR, 2021)

Transducer-Based Streaming Deliberation for Cascaded Encoders. - Ke Hu; Tara N. Sainath; Arun Narayanan; Ruoming Pang; Trevor Strohman (ICASSP, 2022)

Massively Multilingual ASR: A Lifelong Learning Solution. - Bo Li 028; Ruoming Pang; Yu Zhang 033; Tara N. Sainath; Trevor Strohman; Parisa Haghani; Yun Zhu; Brian Farris; Neeraj Gaur; Manasa Prasad (ICASSP, 2022)

Improving The Latency And Quality Of Cascaded Encoders. - Tara N. Sainath; Yanzhang He; Arun Narayanan; Rami Botros; Weiran Wang; David Qiu; Chung-Cheng Chiu; Rohit Prabhavalkar; Alexander Gruenstein; Anmol Gulati; Bo Li 028; David Rybach; et al. (ICASSP, 2022)

Vector-quantized Image Modeling with Improved VQGAN. - Jiahui Yu; Xin Li; Jing Yu Koh; Han Zhang 010; Ruoming Pang; James Qin; Alexander Ku; Yuanzhong Xu; Jason Baldridge; Yonghui Wu (ICLR, 2022)

Sentence-Select: Large-Scale Language Model Data Selection for Rare-Word Speech Recognition. - W. Ronny Huang; Cal Peyser; Tara N. Sainath; Ruoming Pang; Trevor D. Strohman; Shankar Kumar (INTERSPEECH, 2022)

A Language Agnostic Multilingual Streaming On-Device ASR System. - Bo Li 028; Tara N. Sainath; Ruoming Pang; Shuo-Yiin Chang; Qiumin Xu; Trevor Strohman; Vince Chen; Qiao Liang 001; Heguang Liu; Yanzhang He; Parisa Haghani; Sameer Bidichandani (INTERSPEECH, 2022)

Pathways: Asynchronous Distributed Dataflow for ML. - Paul Barham 001; Aakanksha Chowdhery; Jeff Dean; Sanjay Ghemawat; Steven Hand 001; Dan Hurt; Michael Isard; Hyeontaek Lim; Ruoming Pang; Sudip Roy 002; Brennan Saeta; Parker Schuh; et al. (MLSys, 2022)

BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition. - Yu Zhang 033; Daniel S. Park; Wei Han 002; James Qin; Anmol Gulati; Joel Shor; Aren Jansen; Yuanzhong Xu; Yanping Huang; Shibo Wang; Zongwei Zhou; Bo Li 028; et al. (IEEE J. Sel. Top. Signal Process., 2022)

Hyperscale Hardware Optimized Neural Architecture Search. - Sheng Li 007; Garrett Andersen; Tao Chen 003; Liqun Cheng; Julian Grady; Da Huang; Quoc V. Le; Andrew Li; Xin Li 082; Yang Li 005; Chen Liang; Yifeng Lu; et al. (ASPLOS (3), 2023)

STAIR: Learning Sparse Text and Image Representation in Grounded Tokens. - Chen Chen 005; Bowen Zhang 002; Liangliang Cao; Jiguang Shen; Tom Gunter; Albin Madappally Jose; Alexander Toshev; Yantao Zheng; Jonathon Shlens; Ruoming Pang; Yinfei Yang (EMNLP, 2023)

STAIR: Learning Sparse Text and Image Representation in Grounded Tokens. - Chen Chen 005; Bowen Zhang 002; Liangliang Cao; Jiguang Shen; Tom Gunter; Albin Madappally Jose; Alexander Toshev; Jonathon Shlens; Ruoming Pang; Yinfei Yang (CoRR, 2023)

Practical Conformer: Optimizing size, speed and flops of Conformer for on-Device and cloud ASR. - Rami Botros; Anmol Gulati; Tara N. Sainath; Krzysztof Choromanski; Ruoming Pang; Trevor Strohman; Weiran Wang; Jiahui Yu (CoRR, 2023)

Mobile V-MoEs: Scaling Down Vision Transformers via Sparse Mixture-of-Experts. - Erik A. Daxberger; Floris Weers; Bowen Zhang 002; Tom Gunter; Ruoming Pang; Marcin Eichner; Michael Emmersberger; Yinfei Yang; Alexander Toshev; Xianzhi Du (CoRR, 2023)

Instruction-Following Speech Recognition. - Cheng-I Jeff Lai; Zhiyun Lu; Liangliang Cao; Ruoming Pang (CoRR, 2023)

MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training. - Brandon McKinzie; Zhe Gan; Jean-Philippe Fauconnier; Sam Dodge; Bowen Zhang 002; Philipp Dufter; Dhruti Shah; Xianzhi Du; Futang Peng; Anton Belyi; Haotian Zhang 005; Karanjeet Singh 003; et al. (ECCV (29), 2024)

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training. - Brandon McKinzie; Zhe Gan; Jean-Philippe Fauconnier; Sam Dodge; Bowen Zhang 002; Philipp Dufter; Dhruti Shah; Xianzhi Du; Futang Peng; Floris Weers; Anton Belyi; Haotian Zhang 005; et al. (CoRR, 2024)

Revisiting MoE and Dense Speed-Accuracy Comparisons for LLM Training. - Xianzhi Du; Tom Gunter; Xiang Kong; Mark Lee; Zirui Wang; Aonan Zhang; Nan Du; Ruoming Pang (CoRR, 2024)

Large Language Model-guided Document Selection. - Xiang Kong; Tom Gunter; Ruoming Pang (CoRR, 2024)

Apple Intelligence Foundation Language Models. - Tom Gunter; Zirui Wang; Chong Wang; Ruoming Pang; Andy Narayanan; Aonan Zhang; Bowen Zhang 002; Chen Chen 005; Chung-Cheng Chiu; David Qiu; Deepak Gopinath; Dian Ang Yap; et al. (CoRR, 2024)

ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities. - Jiarui Lu; Thomas Holleis; Yizhe Zhang 002; Bernhard Aumayer; Feng Nan; Felix Bai; Shuang Ma; Shen Ma; Mengyu Li; Guoli Yin; Zirui Wang; Ruoming Pang (CoRR, 2024)

Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge? - Arduin Findeis; Floris Weers; Guoli Yin; Ke Ye; Ruoming Pang; Tom Gunter (ACL (1), 2025)

Improve Vision Language Model Chain-of-thought Reasoning. - Ruohong Zhang; Bowen Zhang 002; Yanghao Li; Haotian Zhang 005; Zhiqing Sun; Zhe Gan; Yinfei Yang; Ruoming Pang; Yiming Yang (ACL (1), 2025)

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics. - Siddhant Arora; Zhiyun Lu; Chung-Cheng Chiu; Ruoming Pang; Shinji Watanabe 001 (ICLR, 2025)

Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlo. - Shengyu Feng; Xiang Kong; Shuang Ma; Aonan Zhang; Dong Yin; Chong Wang; Ruoming Pang; Yiming Yang (ICLR, 2025)

EC-DIT: Scaling Diffusion Transformers with Adaptive Expert-Choice Routing. - Haotian Sun; Tao Lei; Bowen Zhang; Yanghao Li; Haoshuo Huang; Ruoming Pang; Bo Dai 001; Nan Du (ICLR, 2025)

ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities. - Jiarui Lu; Thomas Holleis; Yizhe Zhang 002; Bernhard Aumayer; Feng Nan; Haoping Bai; Shuang Ma; Shen Ma; Mengyu Li; Guoli Yin; Zirui Wang; Ruoming Pang (NAACL (Findings), 2025)

MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains. - Guoli Yin; Haoping Bai; Shuang Ma; Feng Nan; Yanchao Sun; Zhaoyang Xu; Shen Ma; Jiarui Lu; Xiang Kong; Aonan Zhang; Dian Ang Yap; Yizhe Zhang 002; et al. (NAACL (Findings), 2025)

Instruction-Following Pruning for Large Language Models. - Bairu Hou; Qibin Chen; Jianyu Wang; Guoli Yin; Chong Wang; Nan Du; Ruoming Pang; Shiyu Chang; Tao Lei (CoRR, 2025)

Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observations. - Ajay Jaiswal; Jianyu Wang; Yixiao Li; Pingzhi Li; Tianlong Chen 001; Zhangyang Wang; Chong Wang; Ruoming Pang; Xianzhi Du (CoRR, 2025)

RATTENTION: Towards the Minimal Sliding Window Size in Local-Global Attention Models. - Bailin Wang; Chang Lan; Chong Wang; Ruoming Pang (CoRR, 2025)

AXLearn: Modular Large Model Training on Heterogeneous Infrastructure. - Mark Lee; Tom Gunter; Chang Lan; John Peebles; Hanzhi Zhou; Kelvin Zou; Sneha Bangalore; Chung-Cheng Chiu; Nan Du; Xianzhi Du; Philipp Dufter; Ruixuan Hou; et al. (CoRR, 2025)

Apple Intelligence Foundation Language Models: Tech Report 2025. - Hanzhi Zhou; Erik Hornberger; Pengsheng Guo; Xiyou Zhou; Saiwen Wang; Xin Wang; Yifei He; Xuankai Chang; Rene Rauch; Louis D'hauwe; John Peebles; Alec Doane; et al. (CoRR, 2025)