ntust-nlp-2 at ROCLING-2021 Shared Task: BERT-based semantic analyzer with word-level information. - Ke-Han Lu; Kuan-Yu Chen 002 (ROCLING, 2021)

A Transformer-based Cross-modal Fusion Model with Adversarial Training for VQA Challenge 2021. - Ke-Han Lu; Bo-Han Fang; Kuan-Yu Chen 002 (CoRR, 2021)

A Context-Aware Knowledge Transferring Strategy for CTC-Based ASR. - Ke-Han Lu; Kuan-Yu Chen 002 (SLT, 2022)

Non-Autoregressive ASR Modeling Using Pre-Trained Language Models for Chinese Speech Recognition. - Fu-Hao Yu; Kuan-Yu Chen 002; Ke-Han Lu (IEEE ACM Trans. Audio Speech Lang. Process., 2022)

HypR: A comprehensive study for ASR hypothesis revising with a reference corpus. - Yi-Wei Wang; Ke-Han Lu; Kuan-Yu Chen 002 (CoRR, 2023)

Dynamic-Superb: Towards a Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark For Speech. - Chien-Yu Huang; Ke-Han Lu; Shih-Heng Wang; Chi-Yuan Hsiao; Chun-Yi Kuan; Haibin Wu; Siddhant Arora; Kai-Wei Chang; Jiatong Shi; Yifan Peng 003; Roshan S. Sharma; Shinji Watanabe 001; et al. (ICASSP, 2024)

Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR And Speech-to-Text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision. - Chih-Kai Yang; Kuan-Po Huang; Ke-Han Lu; Chun-Yi Kuan; Chi-Yuan Hsiao; Hung-Yi Lee (ICASSP Workshops, 2024)

DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment. - Ke-Han Lu; Zhehuai Chen; Szu-Wei Fu; He Huang 012; Boris Ginsburg; Yu-Chiang Frank Wang; Hung-yi Lee (INTERSPEECH, 2024)

HypR: A comprehensive study for ASR hypothesis revising with a reference corpus. - Yiwei Wang; Ke-Han Lu; Kuan-Yu Chen 001 (INTERSPEECH, 2024)

Speech-Copilot: Leveraging Large Language Models for Speech Processing Via Task Decomposition, Modularization, and Program Generation. - Chun-Yi Kuan; Chih-Kai Yang; Wei-Ping Huang; Ke-Han Lu; Hung-Yi Lee (SLT, 2024)

Listen and Speak Fairly: a Study on Semantic Gender Bias in Speech Integrated Large Language Models. - Yi-Cheng Lin; Tzu-Quan Lin; Chih-Kai Yang; Ke-Han Lu; Wei-Chih Chen; Chun-Yi Kuan; Hung-Yi Lee (SLT, 2024)

Codec-Superb @ SLT 2024: A Lightweight Benchmark For Neural Audio Codec Models. - Haibin Wu; Xuanjun Chen; Yi-Cheng Lin; Kaiwei Chang; Jiawei Du; Ke-Han Lu; Alexander H. Liu; Ho-Lam Chung; Yuan-Kuei Wu; Dongchao Yang; Songxiang Liu; Yi-Chiao Wu; et al. (SLT, 2024)

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. - Chien-yu Huang; Wei-Chih Chen; Shu-Wen Yang; Andy T. Liu; Chen-An Li; Yu-Xiang Lin; Wei-Cheng Tseng; Anuj Diwan; Yi-Jen Shih; Jiatong Shi; William Chen; Xuanjun Chen; et al. (CoRR, 2024)

Building a Taiwanese Mandarin Spoken Language Model: A First Attempt. - Chih-Kai Yang; Yu-Kuan Fu; Chen-An Li; Yi-Cheng Lin; Yu-Xiang Lin; Wei-Chih Chen; Ho-Lam Chung; Chun-Yi Kuan; Wei-Ping Huang; Ke-Han Lu; Tzu-Quan Lin; Hsiu-Hsuan Wang; et al. (CoRR, 2024)

SpeechCaps: Advancing Instruction-Based Universal Speech Models with Multi-Talker Speaking Style Captioning. - Chien-Yu Huang; Min-Han Shih; Ke-Han Lu; Chi-Yuan Hsiao; Hung-Yi Lee (ICASSP, 2025)

Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data. - Ke-Han Lu; Zhehuai Chen; Szu-Wei Fu; Chao-Han Huck Yang; Jagadeesh Balam; Boris Ginsburg; Yu-Chiang Frank Wang; Hung-Yi Lee (ICASSP, 2025)

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. - Chien-yu Huang; Wei-Chih Chen; Shu-Wen Yang; Andy T. Liu; Chen-An Li; Yu-Xiang Lin; Wei-Cheng Tseng; Anuj Diwan; Yi-Jen Shih; Jiatong Shi; William Chen; Chih-Kai Yang; et al. (ICLR, 2025)

Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models. - Chi-Yuan Hsiao; Ke-Han Lu; Kai-Wei Chang; Chih-Kai Yang; Wei-Chih Chen; Hung-yi Lee (CoRR, 2025)

Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models. - Ke-Han Lu; Chun-Yi Kuan; Hung-yi Lee (CoRR, 2025)

Reducing Object Hallucination in Large Audio-Language Models via Audio-Aware Decoding. - Tzu-Wen Hsu; Ke-Han Lu; Cheng-Han Chiang; Hung-yi Lee (CoRR, 2025)

DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignment. - Ke-Han Lu; Zhehuai Chen; Szu-Wei Fu; Chao-Han Huck Yang; Sung-Feng Huang; Chih-Kai Yang; Chee-En Yu; Chun-Wei Chen; Wei-Chih Chen; Chien-yu Huang; Yi-Cheng Lin; Yu-Xiang Lin; et al. (CoRR, 2025)