Prediction of ice-breaking between participants using prosodic features in the first meeting dialogue. - Hirofumi Inaguma; Koji Inoue; Shizuka Nakamura; Katsuya Takanashi; Tatsuya Kawahara (ASSP4MI@ICMI, 2016)

Social Signal Detection in Spontaneous Dialogue Using Bidirectional LSTM-CTC. - Hirofumi Inaguma; Koji Inoue; Masato Mimura; Tatsuya Kawahara (INTERSPEECH, 2017)

An End-to-End Approach to Joint Social Signal Detection and Automatic Speech Recognition. - Hirofumi Inaguma; Masato Mimura; Koji Inoue; Kazuyoshi Yoshii; Tatsuya Kawahara (ICASSP, 2018)

Acoustic-to-Word Attention-Based Model Complemented with Character-Level CTC-Based Model. - Sei Ueno; Hirofumi Inaguma; Masato Mimura; Tatsuya Kawahara (ICASSP, 2018)

The JHU/KyotoU Speech Translation System for IWSLT 2018. - Hirofumi Inaguma; Xuan Zhang 008; Zhiqi Wang; Adithya Renduchintala; Shinji Watanabe 001; Kevin Duh (IWSLT, 2018)

Improving OOV Detection and Resolution with External Language Models in Acoustic-to-Word ASR. - Hirofumi Inaguma; Masato Mimura; Shinsuke Sakai; Tatsuya Kawahara (SLT, 2018)

Leveraging Sequence-to-Sequence Speech Synthesis for Enhancing Acoustic-to-Word Speech Recognition. - Masato Mimura; Sei Ueno; Hirofumi Inaguma; Shinsuke Sakai; Tatsuya Kawahara (SLT, 2018)

Multilingual End-to-End Speech Translation. - Hirofumi Inaguma; Kevin Duh; Tatsuya Kawahara; Shinji Watanabe 001 (ASRU, 2019)

A Comparative Study on Transformer vs RNN in Speech Applications. - Shigeki Karita; Xiaofei Wang 007; Shinji Watanabe 001; Takenori Yoshimura; Wangyou Zhang; Nanxin Chen; Tomoki Hayashi; Takaaki Hori; Hirofumi Inaguma; Ziyan Jiang; Masao Someki; Nelson Enrique Yalta Soplin; et al. (ASRU, 2019)

Language Model Integration Based on Memory Control for Sequence to Sequence Speech Recognition. - Jaejin Cho; Shinji Watanabe 001; Takaaki Hori; Murali Karthick Baskar; Hirofumi Inaguma; Jesús Villalba 001; Najim Dehak (ICASSP, 2019)

Transfer Learning of Language-independent End-to-end ASR with Language Model Fusion. - Hirofumi Inaguma; Jaejin Cho; Murali Karthick Baskar; Tatsuya Kawahara; Shinji Watanabe 001 (ICASSP, 2019)

ESPnet How2 Speech Translation System for IWSLT 2019: Pre-training, Knowledge Distillation, and Going Deeper. - Hirofumi Inaguma; Shun Kiyono; Nelson Enrique Yalta Soplin; Jun Suzuki 001; Kevin Duh; Shinji Watanabe 001 (IWSLT, 2019)

ESPnet-ST: All-in-One Speech Translation Toolkit. - Hirofumi Inaguma; Shun Kiyono; Kevin Duh; Shigeki Karita; Nelson Yalta; Tomoki Hayashi; Shinji Watanabe 001 (ACL (demo), 2020)

Minimum Latency Training Strategies for Streaming Sequence-to-Sequence ASR. - Hirofumi Inaguma; Yashesh Gaur; Liang Lu 001; Jinyu Li 001; Yifan Gong 001 (ICASSP, 2020)

End-to-End Speech-to-Dialog-Act Recognition. - Viet-Trung Dang; Tianyu Zhao 001; Sei Ueno; Hirofumi Inaguma; Tatsuya Kawahara (INTERSPEECH, 2020)

Distilling the Knowledge of BERT for Sequence-to-Sequence ASR. - Hayato Futami; Hirofumi Inaguma; Sei Ueno; Masato Mimura; Shinsuke Sakai; Tatsuya Kawahara (INTERSPEECH, 2020)

CTC-Synchronous Training for Monotonic Attention Model. - Hirofumi Inaguma; Masato Mimura; Tatsuya Kawahara (INTERSPEECH, 2020)

Enhancing Monotonic Multihead Attention for Streaming ASR. - Hirofumi Inaguma; Masato Mimura; Tatsuya Kawahara (INTERSPEECH, 2020)

The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans. - Shinji Watanabe 001; Florian Boyer; Xuankai Chang; Pengcheng Guo; Tomoki Hayashi; Yosuke Higuchi; Takaaki Hori; Wen-Chin Huang; Hirofumi Inaguma; Naoyuki Kamo; Shigeki Karita; Chenda Li; et al. (CoRR, 2020)

A Study of Transducer Based End-to-End ASR with ESPnet: Architecture, Auxiliary Loss and Decoding Strategies. - Florian Boyer; Yusuke Shinohara; Takaaki Ishii; Hirofumi Inaguma; Shinji Watanabe 001 (ASRU, 2021)

ASR Rescoring and Confidence Estimation with Electra. - Hayato Futami; Hirofumi Inaguma; Masato Mimura; Shinsuke Sakai; Tatsuya Kawahara (ASRU, 2021)

A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation. - Yosuke Higuchi; Nanxin Chen; Yuya Fujita; Hirofumi Inaguma; Tatsuya Komatsu; Jaesong Lee; Jumon Nozaki; Tianzi Wang; Shinji Watanabe 001 (ASRU, 2021)

Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. - Hirofumi Inaguma; Siddharth Dalmia; Brian Yan; Shinji Watanabe 001 (ASRU, 2021)

Recent Developments on Espnet Toolkit Boosted By Conformer. - Pengcheng Guo; Florian Boyer; Xuankai Chang; Tomoki Hayashi; Yosuke Higuchi; Hirofumi Inaguma; Naoyuki Kamo; Chenda Li; Daniel Garcia-Romero; Jiatong Shi; Jing Shi 003; Shinji Watanabe 001; et al. (ICASSP, 2021)

Improved Mask-CTC for Non-Autoregressive End-to-End ASR. - Yosuke Higuchi; Hirofumi Inaguma; Shinji Watanabe 001; Tetsuji Ogawa; Tetsunori Kobayashi (ICASSP, 2021)

ORTHROS: non-autoregressive end-to-end speech translation With dual-decoder. - Hirofumi Inaguma; Yosuke Higuchi; Kevin Duh; Tatsuya Kawahara; Shinji Watanabe 001 (ICASSP, 2021)

StableEmit: Selection Probability Discount for Reducing Emission Latency of Streaming Monotonic Attention ASR. - Hirofumi Inaguma; Tatsuya Kawahara (Interspeech, 2021)

VAD-Free Streaming Hybrid CTC/Attention ASR for Unsegmented Recording. - Hirofumi Inaguma; Tatsuya Kawahara (Interspeech, 2021)

ESPnet-ST IWSLT 2021 Offline Speech Translation System. - Hirofumi Inaguma; Brian Yan; Siddharth Dalmia; Pengcheng Guo; Jiatong Shi; Kevin Duh; Shinji Watanabe 001 (IWSLT, 2021)

Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation. - Hirofumi Inaguma; Tatsuya Kawahara; Shinji Watanabe 001 (NAACL-HLT, 2021)

Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring. - Hirofumi Inaguma; Yosuke Higuchi; Kevin Duh; Tatsuya Kawahara; Shinji Watanabe 001 (CoRR, 2021)

Fast and Low-Latency End-to-End Speech Recognition and Translation. - Hirofumi Inaguma (2021)

Non-autoregressive Error Correction for CTC-based ASR with Phone-conditioned Masked LM. - Hayato Futami; Hirofumi Inaguma; Sei Ueno; Masato Mimura; Shinsuke Sakai; Tatsuya Kawahara (INTERSPEECH, 2022)

Distilling the Knowledge of BERT for CTC-based ASR. - Hayato Futami; Hirofumi Inaguma; Masato Mimura; Shinsuke Sakai; Tatsuya Kawahara (CoRR, 2022)

Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks. - Yun Tang 002; Anna Y. Sun; Hirofumi Inaguma; Xinyue Chen; Ning Dong; Xutai Ma; Paden Tomasello; Juan Pino 001 (ACL (1), 2023)

Speech-to-Speech Translation for a Real-world Unwritten Language. - Peng-Jen Chen; Kevin Tran; Yilin Yang; Jingfei Du; Justine Kao; Yu-An Chung; Paden Tomasello; Paul-Ambroise Duquenne; Holger Schwenk; Hongyu Gong; Hirofumi Inaguma; Sravya Popuri; et al. (ACL (Findings), 2023)

UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units. - Hirofumi Inaguma; Sravya Popuri; Ilia Kulikov; Peng-Jen Chen; Changhan Wang; Yu-An Chung; Yun Tang 002; Ann Lee 001; Shinji Watanabe 001; Juan Pino 001 (ACL (1), 2023)

Simple and Effective Unsupervised Speech Translation. - Changhan Wang; Hirofumi Inaguma; Peng-Jen Chen; Ilia Kulikov; Yun Tang 002; Wei-Ning Hsu; Michael Auli; Juan Pino 001 (ACL (1), 2023)

ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. - Brian Yan; Jiatong Shi; Yun Tang 002; Hirofumi Inaguma; Yifan Peng 003; Siddharth Dalmia; Peter Polak; Patrick Fernandes; Dan Berrebbi; Tomoki Hayashi; Xiaohui Zhang 007; Zhaoheng Ni; et al. (ACL (demo), 2023)

Named Entity Detection and Injection for Direct Speech Translation. - Marco Gaido; Yun Tang 002; Ilia Kulikov; Rongqing Huang; Hongyu Gong; Hirofumi Inaguma (ICASSP, 2023)

Enhancing Speech-To-Speech Translation with Multiple TTS Targets. - Jiatong Shi; Yun Tang 002; Ann Lee 001; Hirofumi Inaguma; Changhan Wang; Juan Pino 001; Shinji Watanabe 001 (ICASSP, 2023)

Exploration on HuBERT with Multiple Resolution. - Jiatong Shi; Yun Tang 002; Hirofumi Inaguma; Hongyu Gong; Juan Pino 001; Shinji Watanabe 001 (INTERSPEECH, 2023)

Findings of the IWSLT 2023 Evaluation Campaign. - Sweta Agrawal; Antonios Anastasopoulos; Luisa Bentivogli; Ondrej Bojar; Claudia Borg; Marine Carpuat; Roldano Cattoni; Mauro Cettolo; Mingda Chen; William Chen; Khalid Choukri; Alexandra Chronopoulou; et al. (IWSLT@ACL, 2023)

Exploration on HuBERT with Multiple Resolutions. - Jiatong Shi; Yun Tang 002; Hirofumi Inaguma; Hongyu Gong; Juan Pino 001; Shinji Watanabe 001 (CoRR, 2023)

SeamlessM4T-Massively Multilingual & Multimodal Machine Translation. - Seamless Communication; Loïc Barrault; Yu-An Chung; Mariano Coria Meglioli; David Dale; Ning Dong; Paul-Ambroise Duquenne; Hady Elsahar; Hongyu Gong; Kevin Heffernan; John Hoffman; Christopher Klaiber; et al. (CoRR, 2023)

Efficient Monotonic Multihead Attention. - Xutai Ma; Anna Y. Sun; Siqi Ouyang; Hirofumi Inaguma; Paden Tomasello (CoRR, 2023)

Seamless: Multilingual Expressive and Streaming Speech Translation. - Loïc Barrault; Yu-An Chung; Mariano Coria Meglioli; David Dale; Ning Dong; Mark Duppenthaler; Paul-Ambroise Duquenne; Brian Ellis; Hady Elsahar; Justin Haaheim; John Hoffman; Min-Jae Hwang; et al. (CoRR, 2023)

Alignment Knowledge Distillation for Online Streaming Attention-Based Speech Recognition. - Hirofumi Inaguma; Tatsuya Kawahara (IEEE ACM Trans. Audio Speech Lang. Process., 2023)

Multi-resolution HuBERT: Multi-resolution Speech Self-Supervised Learning with Masked Unit Prediction. - Jiatong Shi; Hirofumi Inaguma; Xutai Ma; Ilia Kulikov; Anna Y. Sun (ICLR, 2024)

Investigating Decoder-only Large Language Models for Speech-to-text Translation. - Chao-Wei Huang; Hui Lu; Hongyu Gong; Hirofumi Inaguma; Ilia Kulikov; Ruslan Mavlyutov; Sravya Popuri (INTERSPEECH, 2024)

MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model. - Jiatong Shi; Xutai Ma; Hirofumi Inaguma; Anna Sun; Shinji Watanabe 001 (INTERSPEECH, 2024)

Massively Multilingual Forced Aligner Leveraging Self-Supervised Discrete Units. - Hirofumi Inaguma; Ilia Kulikov; Zhaoheng Ni; Sravya Popuri; Paden Tomasello (SLT, 2024)

MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model. - Jiatong Shi; Xutai Ma; Hirofumi Inaguma; Anna Y. Sun; Shinji Watanabe 001 (CoRR, 2024)

SSR: Alignment-Aware Modality Connector for Speech Language Models. - Weiting Tan; Hirofumi Inaguma; Ning Dong; Paden Tomasello; Xutai Ma (CoRR, 2024)

Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Dataset. - Vasu Agrawal; Akinniyi Akinyemi; Kathryn Alvero; Morteza Behrooz; Julia Buffalini; Fabio Maria Carlucci; Joy Chen; Junming Chen; Zhang Chen; Shiyang Cheng; Praveen Chowdary; Joe Chuang; et al. (CoRR, 2025)