SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model. - Yi-Jen Shih; Hsuan-Fu Wang; Heng-Jui Chang; Layne Berry; Hung-yi Lee; David Harwath (SLT, 2022)

M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval. - Layne Berry; Yi-Jen Shih; Hsuan-Fu Wang; Heng-Jui Chang; Hung-Yi Lee; David Harwath (ICASSP, 2023)

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. - Yuan Tseng; Layne Berry; Yi-Ting Chen; I-Hsiang Chiu; Hsuan-Hao Lin; Max Liu; Puyuan Peng; Yi-Jen Shih; Hung-Yu Wang; Haibin Wu; Po-Yao Huang 001; Chun-Mao Lai; et al. (CoRR, 2023)

Theme Transformer: Symbolic Music Generation With Theme-Conditioned Transformer. - Yi-Jen Shih; Shih-Lun Wu; Frank Zalkow; Meinard Müller; Yi-Hsuan Yang (IEEE Trans. Multim., 2023)

Integrating Self-Supervised Speech Model with Pseudo Word-Level Targets from Visually-Grounded Speech Model. - Hung-Chieh Fang; Nai-Xuan Ye; Yi-Jen Shih; Puyuan Peng; Hsuan-Fu Wang; Layne Berry; Hung-Yi Lee; David Harwath (ICASSP Workshops, 2024)

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. - Yuan Tseng; Layne Berry; Yiting Chen; I-Hsiang Chiu; Hsuan-Hao Lin; Max Liu; Puyuan Peng; Yi-Jen Shih; Hung-Yu Wang; Haibin Wu; Poyao Huang 001; Chun-Mao Lai; et al. (ICASSP, 2024)

SpeechCLIP+: Self-Supervised Multi-Task Representation Learning for Speech Via Clip and Speech-Image Data. - Hsuan-Fu Wang; Yi-Jen Shih; Heng-Jui Chang; Layne Berry; Puyuan Peng; Hung-Yi Lee; Hsin-Min Wang; David Harwath (ICASSP Workshops, 2024)

Interface Design for Self-Supervised Speech Models. - Yi-Jen Shih; David Harwath (INTERSPEECH, 2024)

Self-Supervised Speech Models For Word-Level Stuttered Speech Detection. - Yi-Jen Shih; Zoi Gkalitsiou; Alexandros G. Dimakis; David Harwath (SLT, 2024)

Measuring Sound Symbolism In Audio-Visual Models. - Wei-Cheng Tseng; Yi-Jen Shih; David Harwath; Raymond Mooney (SLT, 2024)

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. - Chien-yu Huang; Wei-Chih Chen; Shu-Wen Yang; Andy T. Liu; Chen-An Li; Yu-Xiang Lin; Wei-Cheng Tseng; Anuj Diwan; Yi-Jen Shih; Jiatong Shi; William Chen; Xuanjun Chen; et al. (CoRR, 2024)

Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks. - Chien-yu Huang; Wei-Chih Chen; Shu-Wen Yang; Andy T. Liu; Chen-An Li; Yu-Xiang Lin; Wei-Cheng Tseng; Anuj Diwan; Yi-Jen Shih; Jiatong Shi; William Chen; Chih-Kai Yang; et al. (ICLR, 2025)