Learning Style Correlation for Elaborate Few-Shot Classification. - Junho Kim; Minsu Kim 001; Jung Uk Kim; Hong Joo Lee 001; Sangmin Lee 001; Joanna Hong; Yong Man Ro (ICIP, 2020)

Robust Video Facial Authentication With Unsupervised Mode Disentanglement. - Minsu Kim 001; Hong Joo Lee 001; Sangmin Lee 001; Yong Man Ro (ICIP, 2020)

Unsupervised Disentangling of Viewpoint and Residues Variations by Substituting Representations for Robust Face Recognition. - Minsu Kim 001; Joanna Hong; Junho Kim; Hong Joo Lee 001; Yong Man Ro (ICPR, 2020)

Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video. - Minsu Kim 001; Joanna Hong; Se Jin Park; Yong Man Ro (ICCV, 2021)

Interpretation of Lesional Detection via Counterfactual Generation. - Junho Kim; Minsu Kim 001; Yong Man Ro (ICIP, 2021)

Lip to Speech Synthesis with Visual Context Attentional GAN. - Minsu Kim 001; Joanna Hong; Yong Man Ro (NeurIPS, 2021)

Speech Reconstruction With Reminiscent Sound Via Visual Voice Memory. - Joanna Hong; Minsu Kim 001; Se Jin Park; Yong Man Ro (IEEE ACM Trans. Audio Speech Lang. Process., 2021)

Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading. - Minsu Kim 001; Jeong Hun Yeo; Yong Man Ro (AAAI, 2022)

SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory. - Se Jin Park; Minsu Kim 001; Joanna Hong; Jeongsoo Choi; Yong Man Ro (AAAI, 2022)

VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection. - Joanna Hong; Minsu Kim 001; Yong Man Ro (ECCV (36), 2022)

Speaker-Adaptive Lip Reading with User-Dependent Padding. - Minsu Kim 001; Hyunjun Kim; Yong Man Ro (ECCV (36), 2022)

Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition. - Joanna Hong; Minsu Kim 001; Daehun Yoo; Yong Man Ro (INTERSPEECH, 2022)

Meta Input: How to Leverage Off-the-Shelf Deep Neural Networks. - Minsu Kim 001; Youngjoon Yu; Sungjune Park; Yong Man Ro (CoRR, 2022)

CroMM-VSR: Cross-Modal Memory Augmented Visual Speech Recognition. - Minsu Kim 001; Joanna Hong; Se Jin Park; Yong Man Ro (IEEE Trans. Multim., 2022)

Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video. - Minsu Kim 001; Chae Won Kim; Yong Man Ro (AAAI, 2023)

Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring. - Joanna Hong; Minsu Kim 001; Jeongsoo Choi; Yong Man Ro (CVPR, 2023)

Lip-to-Speech Synthesis in the Wild with Multi-Task Learning. - Minsu Kim 001; Joanna Hong; Yong Man Ro (ICASSP, 2023)

Multi-Temporal Lip-Audio Memory for Visual Speech Recognition. - Jeong Hun Yeo; Minsu Kim 001; Yong Man Ro (ICASSP, 2023)

Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge. - Minsu Kim 001; Jeong Hun Yeo; Jeongsoo Choi; Yong Man Ro (ICCV, 2023)

Intelligible Lip-to-Speech Synthesis with Speech Units. - Jeongsoo Choi; Minsu Kim 001; Yong Man Ro (INTERSPEECH, 2023)

Exploring Phonetic Context in Lip Movement for Authentic Talking Face Generation. - Se Jin Park; Minsu Kim 001; Jeongsoo Choi; Yong Man Ro (CoRR, 2023)

Reprogramming Audio-driven Talking Face Synthesis into Text-driven. - Jeongsoo Choi; Minsu Kim 001; Se Jin Park; Yong Man Ro (CoRR, 2023)

Many-to-Many Spoken Language Translation via Unified Speech and Text Representation Learning with Unit-to-Unit Translation. - Minsu Kim 001; Jeongsoo Choi; Dahun Kim; Yong Man Ro (CoRR, 2023)

Visual Speech Recognition for Low-resource Languages with Automatic Labels From Whisper Model. - Jeong Hun Yeo; Minsu Kim 001; Shinji Watanabe 001; Yong Man Ro (CoRR, 2023)

DF-3DFace: One-to-Many Speech Synchronized 3D Face Animation with Diffusion. - Se Jin Park; Joanna Hong; Minsu Kim 001; Yong Man Ro (CoRR, 2023)

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation. - Se Jin Park; Chae Won Kim; Hyeongseop Rha; Minsu Kim 001; Joanna Hong; Jeong Hun Yeo; Yong Man Ro (ACL (1), 2024)

AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation. - Jeongsoo Choi; Se Jin Park; Minsu Kim 001; Yong Man Ro (CVPR, 2024)

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing. - Jeong Hun Yeo; Seunghee Han; Minsu Kim 001; Yong Man Ro (EMNLP (Findings), 2024)

Text-Driven Talking Face Synthesis by Reprogramming Audio-Driven Models. - Jeongsoo Choi; Minsu Kim 001; Se Jin Park; Yong Man Ro (ICASSP, 2024)

Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-Training and Multi-Modal Tokens. - Minsu Kim 001; Jeongsoo Choi; Soumi Maiti; Jeong Hun Yeo; Shinji Watanabe 001; Yong Man Ro (ICASSP, 2024)

Exploring Phonetic Context-Aware Lip-Sync for Talking Face Generation. - Se Jin Park; Minsu Kim 001; Jeongsoo Choi; Yong Man Ro (ICASSP, 2024)

Visual Speech Recognition for Languages with Limited Labeled Data Using Automatic Labels from Whisper. - Jeong Hun Yeo; Minsu Kim 001; Shinji Watanabe 001; Yong Man Ro (ICASSP, 2024)

Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation. - Minsu Kim 001; Jeong Hun Yeo; Se Jin Park; Hyeongseop Rha; Yong Man Ro (ACM Multimedia, 2024)

Multilingual Visual Speech Recognition with a Single Model by Learning with Discrete Visual Speech Units. - Minsu Kim 001; Jeong Hun Yeo; Jeongsoo Choi; Se Jin Park; Yong Man Ro (CoRR, 2024)

TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages. - Minsu Kim 001; Jee-weon Jung; Hyeongseop Rha; Soumi Maiti; Siddhant Arora; Xuankai Chang; Shinji Watanabe 001; Yong Man Ro (CoRR, 2024)

Textless Unit-to-Unit Training for Many-to-Many Multilingual Speech-to-Speech Translation. - Minsu Kim 001; Jeongsoo Choi; Dahun Kim; Yong Man Ro (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model. - Jeong Hun Yeo; Minsu Kim 001; Jeongsoo Choi; Dae Hoe Kim; Yong Man Ro (IEEE Trans. Multim., 2024)

Prompt Tuning of Deep Neural Networks for Speaker-Adaptive Visual Speech Recognition. - Minsu Kim 001; Hyung-Il Kim; Yong Man Ro (IEEE Trans. Pattern Anal. Mach. Intell., 2025)

Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations. - Jeong Hun Yeo; Minsu Kim 001; Chae Won Kim; Stavros Petridis; Yong Man Ro (CoRR, 2025)