An Evaluation of Parameter Generation Methods with Rich Context Models in HMM-Based Speech Synthesis. - Shinnosuke Takamichi; Tomoki Toda; Yoshinori Shiga; Hisashi Kawai; Sakriani Sakti; Satoshi Nakamura 001 (INTERSPEECH, 2012)

A method for translation of paralinguistic information. - Takatomo Kano; Sakriani Sakti; Shinnosuke Takamichi; Graham Neubig; Tomoki Toda; Satoshi Nakamura 001 (IWSLT, 2012)

Generalizing continuous-space translation of paralinguistic information. - Takatomo Kano; Shinnosuke Takamichi; Sakriani Sakti; Graham Neubig; Tomoki Toda; Satoshi Nakamura 001 (INTERSPEECH, 2013)

Improvements to HMM-based speech synthesis based on parameter generation with rich context models. - Shinnosuke Takamichi; Tomoki Toda; Yoshinori Shiga; Sakriani Sakti; Graham Neubig; Satoshi Nakamura 001 (INTERSPEECH, 2013)

Modulation spectrum-based post-filter for GMM-based Voice Conversion. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Satoshi Nakamura 001 (APSIPA, 2014)

Modified post-filter to recover modulation spectrum for HMM-based speech synthesis. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Satoshi Nakamura 001 (GlobalSIP, 2014)

A postfilter to modify the modulation spectrum in HMM-based speech synthesis. - Shinnosuke Takamichi; Tomoki Toda; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (ICASSP, 2014)

A hearing impairment simulation method using audiogram-based approximation of auditory charatecteristics. - Nozomi Jinbo; Shinnosuke Takamichi; Tomoki Toda; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (INTERSPEECH, 2014)

Parameter Generation Methods With Rich Context Models for High-Quality and Flexible Text-To-Speech Synthesis. - Shinnosuke Takamichi; Tomoki Toda; Yoshinori Shiga; Sakriani Sakti; Graham Neubig; Satoshi Nakamura 001 (IEEE J. Sel. Top. Signal Process., 2014)

The NAIST Text-to-Speech System for the Blizzard Challenge 2015. - Shinnosuke Takamichi; Kazuhiro Kobayashi; Kou Tanaka; Tomoki Toda; Satoshi Nakamura 001 (Blizzard Challenge, 2015)

Parameter generation algorithm considering Modulation Spectrum for HMM-based speech synthesis. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Satoshi Nakamura 001 (ICASSP, 2015)

Modulation spectrum-constrained trajectory training algorithm for GMM-based Voice Conversion. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Satoshi Nakamura 001 (ICASSP, 2015)

Preserving word-level emphasis in speech-to-speech translation using linear regression HSMMs. - Quoc Truong Do; Shinnosuke Takamichi; Sakriani Sakti; Graham Neubig; Tomoki Toda; Satoshi Nakamura 001 (INTERSPEECH, 2015)

Non-native speech synthesis preserving speaker individuality based on partial correction of prosodic and phonetic characteristics. - Yuji Oshima; Shinnosuke Takamichi; Tomoki Toda; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (INTERSPEECH, 2015)

Modulation spectrum-constrained trajectory training algorithm for HMM-based speech synthesis. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Satoshi Nakamura 001 (INTERSPEECH, 2015)

The NU-NAIST Voice Conversion System for the Voice Conversion Challenge 2016. - Kazuhiro Kobayashi; Shinnosuke Takamichi; Satoshi Nakamura 001; Tomoki Toda (INTERSPEECH, 2016)

Non-Native Text-to-Speech Preserving Speaker Individuality Based on Partial Correction of Prosodic and Phonetic Characteristics. - Yuji Oshima; Shinnosuke Takamichi; Tomoki Toda; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (IEICE Trans. Inf. Syst., 2016)

A Statistical Sample-Based Approach to GMM-Based Voice Conversion Using Tied-Covariance Acoustic Models. - Shinnosuke Takamichi; Tomoki Toda; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (IEICE Trans. Inf. Syst., 2016)

Postfilters to Modify the Modulation Spectrum for Statistical Parametric Speech Synthesis. - Shinnosuke Takamichi; Tomoki Toda; Alan W. Black; Graham Neubig; Sakriani Sakti; Satoshi Nakamura 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

Modulation spectrum-based speech parameter trajectory smoothing for DNN-based speech synthesis using FFT spectra. - Shinnosuke Takamichi (APSIPA, 2017)

The UTokyo speech synthesis system for Blizzard Challenge 2017. - Shinnosuke Takamichi; Daisuke Saito; Hiroshi Saruwatari; Nobuaki Minematsu (Blizzard Challenge, 2017)

Blind source separation based on independent low-rank matrix analysis with sparse regularization for time-series activity. - Yoshiki Mitsui; Daichi Kitamura; Shinnosuke Takamichi; Nobutaka Ono; Hiroshi Saruwatari (ICASSP, 2017)

Training algorithm to deceive Anti-Spoofing Verification for DNN-based speech synthesis. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (ICASSP, 2017)

Voice Conversion Using Sequence-to-Sequence Learning of Context Posterior Probabilities. - Hiroyuki Miyoshi; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (INTERSPEECH, 2017)

Sampling-Based Speech Parameter Generation Using Moment-Matching Networks. - Shinnosuke Takamichi; Tomoki Koriyama; Hiroshi Saruwatari (INTERSPEECH, 2017)

JSUT corpus: free large-scale Japanese speech corpus for end-to-end speech synthesis. - Ryosuke Sonobe; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2017)

Voice Conversion Using Input-to-Output Highway Networks. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2017)

Prosody-aware subword embedding considering Japanese intonation systems and its application to DNN-based multi-dialect speech synthesis. - Takanori Akiyama; Shinnosuke Takamichi; Hiroshi Saruwatari (APSIPA, 2018)

Data augmentation with moment-matching networks for i-vector based speaker verification. - Sayaka Shiota; Shinnosuke Takamichi; Tomoko Matsui (APSIPA, 2018)

A Revisit to Feature Handling for High-quality Voice Conversion Based on Gaussian Mixture Model. - Hitoshi Suda; Gaku Kotani; Shinnosuke Takamichi; Daisuke Saito (APSIPA, 2018)

Generative approach using the noise generation models for DNN-based speech synthesis trained from noisy speech. - Masakazu Une; Yuki Saito 001; Shinnosuke Takamichi; Daichi Kitamura; Ryoichi Miyazaki; Hiroshi Saruwatari (APSIPA, 2018)

Independent Deeply Learned Matrix Analysis for Multichannel Audio Source Separation. - Shinichi Mogami; Hayato Sumino; Daichi Kitamura; Norihiro Takamune; Shinnosuke Takamichi; Hiroshi Saruwatari; Nobutaka Ono (EUSIPCO, 2018)

Non-Parallel Voice Conversion Using Variational Autoencoders Conditioned by Phonetic Posteriorgrams and D-Vectors. - Yuki Saito 001; Yusuke Ijima; Kyosuke Nishida; Shinnosuke Takamichi (ICASSP, 2018)

Text-to-Speech Synthesis Using STFT Spectra Based on Low-/Multi-Resolution Generative Adversarial Networks. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (ICASSP, 2018)

Phase Reconstruction from Amplitude Spectrograms Based on Von-Mises-Distribution Deep Neural Network. - Shinnosuke Takamichi; Yuki Saito 001; Norihiro Takamune; Daichi Kitamura; Hiroshi Saruwatari (IWAENC, 2018)

CPJD Corpus: Crowdsourced Parallel Speech Corpus of Japanese Dialects. - Shinnosuke Takamichi; Hiroshi Saruwatari (LREC, 2018)

An end-to-end model for cross-lingual transformation of paralinguistic information. - Takatomo Kano; Shinnosuke Takamichi; Sakriani Sakti; Graham Neubig; Tomoki Toda; Satoshi Nakamura 001 (Mach. Transl., 2018)

Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEEE ACM Trans. Audio Speech Lang. Process., 2018)

Estimating confidence in voices using crowdsourcing for alleviating tension with altered auditory feedback. - Kana Naruse; Shinnosuke Takamichi; Tomohiro Tanikawa; Shigeo Yoshida; Takuji Narumi; Michitaka Hirose (AsianCHI@CHI, 2019)

Generative Moment Matching Network-based Random Modulation Post-filter for DNN-based Singing Voice Synthesis and Neural Double-tracking. - Hiroki Tamaru; Yuki Saito 001; Shinnosuke Takamichi; Tomoki Koriyama; Hiroshi Saruwatari (ICASSP, 2019)

Speech Quality Evaluation of Synthesized Japanese Speech Using EEG. - Ivan Halim Parmonangan; Hiroki Tanaka; Sakriani Sakti; Shinnosuke Takamichi; Satoshi Nakamura 001 (INTERSPEECH, 2019)

Spoken Dialogue Robot for Watching Daily Life of Elderly People. - Koichiro Yoshino; Yukitoshi Murase; Nurul Lubis; Kyoshiro Sugiyama; Hiroki Tanaka; Sakriani Sakti; Shinnosuke Takamichi; Satoshi Nakamura 001 (IWSDS, 2019)

Implementation of DNN-based real-time voice conversion and its improvements by audio data augmentation and mask-shaped device. - Riku Arakawa; Shinnosuke Takamichi; Hiroshi Saruwatari (SSW, 2019)

Subword tokenization based on DNN-based acoustic model for end-to-end prosody generation. - Masashi Aso; Shinnosuke Takamichi; Norihiro Takamune; Hiroshi Saruwatari (SSW, 2019)

Sparse Approximation of Gram Matrices for GMMN-based Speech Synthesis. - Tomoki Koriyama; Shinnosuke Takamichi; Takao Kobayashi (SSW, 2019)

V2S attack: building DNN-based voice conversion from automatic speaker verification. - Taiki Nakamura; Yuki Saito 001; Shinnosuke Takamichi; Yusuke Ijima; Hiroshi Saruwatari (SSW, 2019)

DNN-based Speaker Embedding Using Subjective Inter-speaker Similarity for Multi-speaker Modeling in Speech Synthesis. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (SSW, 2019)

TransVoice: Real-Time Voice Conversion for Augmenting Near-Field Speech Communication. - Riku Arakawa; Shinnosuke Takamichi; Hiroshi Saruwatari (UIST (Adjunct Volume), 2019)

JVS corpus: free Japanese multi-speaker voice corpus. - Shinnosuke Takamichi; Kentaro Mitsui; Yuki Saito 001; Tomoki Koriyama; Naoko Tanji; Hiroshi Saruwatari (CoRR, 2019)

Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion. - Yuki Okamoto; Keisuke Imoto; Tatsuya Komatsu; Shinnosuke Takamichi; Takumi Yagyu; Ryosuke Yamanishi; Yoichi Yamashita (CoRR, 2019)

Vocoder-free text-to-speech synthesis incorporating generative adversarial networks using low-/multi-frequency STFT amplitude spectra. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (Comput. Speech Lang., 2019)

Prosody Correction Preserving Speaker Individuality for Chinese-Accented Japanese HMM-Based Text-to-Speech Synthesis. - Daiki Sekizawa; Shinnosuke Takamichi; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2019)

Independent Deeply Learned Matrix Analysis for Determined Audio Source Separation. - Naoki Makishima; Shinichi Mogami; Norihiro Takamune; Daichi Kitamura; Hayato Sumino; Shinnosuke Takamichi; Hiroshi Saruwatari; Nobutaka Ono (IEEE ACM Trans. Audio Speech Lang. Process., 2019)

PJS: phoneme-balanced Japanese singing-voice corpus. - Junya Koguchi; Shinnosuke Takamichi; Masanori Morise (APSIPA, 2020)

RWCP-SSD-Onomatopoeia: Onomatopoeic Word Dataset for Environmental Sound Synthesis. - Yuki Okamoto; Keisuke Imoto; Shinnosuke Takamichi; Ryosuke Yamanishi; Takahiro Fukumori; Yoichi Yamashita (DCASE, 2020)

Humangan: Generative Adversarial Network With Human-Based Discriminator And Its Evaluation In Speech Perception Modeling. - Kazuki Fujii; Yuki Saito 001; Shinnosuke Takamichi; Yukino Baba; Hiroshi Saruwatari (ICASSP, 2020)

Lifter Training and Sub-Band Modeling for Computationally Efficient and High-Quality Voice Conversion Using Spectral Differentials. - Takaaki Saeki; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (ICASSP, 2020)

End-to-End Text-to-Speech Synthesis with Unaligned Multiple Language Units Based on Attention. - Masashi Aso; Shinnosuke Takamichi; Hiroshi Saruwatari (INTERSPEECH, 2020)

Real-Time, Full-Band, Online DNN-Based Voice Conversion System Using a Single CPU. - Takaaki Saeki; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (INTERSPEECH, 2020)

Cross-Lingual Text-To-Speech Synthesis via Domain Adaptation and Perceptual Similarity Regression in Speaker Space. - Detai Xin; Yuki Saito 001; Shinnosuke Takamichi; Tomoki Koriyama; Hiroshi Saruwatari (INTERSPEECH, 2020)

Investigating Effective Additional Contextual Factors in DNN-Based Spontaneous Speech Synthesis. - Yuki Yamashita; Tomoki Koriyama; Yuki Saito 001; Shinnosuke Takamichi; Yusuke Ijima; Ryo Masumura; Hiroshi Saruwatari (INTERSPEECH, 2020)

SMASH Corpus: A Spontaneous Speech Corpus Recording Third-person Audio Commentaries on Gameplay. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (LREC, 2020)

DNN-based Speech Synthesis Using Abundant Tags of Spontaneous Speech Corpus. - Yuki Yamashita; Tomoki Koriyama; Yuki Saito 001; Shinnosuke Takamichi; Yusuke Ijima; Ryo Masumura; Hiroshi Saruwatari (LREC, 2020)

JVS-MuSiC: Japanese multispeaker singing-voice corpus. - Hiroki Tamaru; Shinnosuke Takamichi; Naoko Tanji; Hiroshi Saruwatari (CoRR, 2020)

PJS: phoneme-balanced Japanese singing voice corpus. - Junya Koguchi; Shinnosuke Takamichi (CoRR, 2020)

JSSS: free Japanese speech corpus for summarization and simplification. - Shinnosuke Takamichi; Mamoru Komachi; Naoko Tanji; Hiroshi Saruwatari (CoRR, 2020)

Generative Moment Matching Network-Based Neural Double-Tracking for Synthesized and Natural Singing Voices. - Hiroki Tamaru; Yuki Saito 001; Shinnosuke Takamichi; Tomoki Koriyama; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2020)

DNN-Based Full-Band Speech Synthesis Using GMM Approximation of Spectral Envelope. - Junya Koguchi; Shinnosuke Takamichi; Masanori Morise; Hiroshi Saruwatari; Shigeki Sagayama (IEICE Trans. Inf. Syst., 2020)

Phase reconstruction from amplitude spectrograms based on directional-statistics deep neural networks. - Shinnosuke Takamichi; Yuki Saito 001; Norihiro Takamune; Daichi Kitamura; Hiroshi Saruwatari (Signal Process., 2020)

Acoustic model-based subword tokenization and prosodic-context extraction without language knowledge for text-to-speech synthesis. - Masashi Aso; Shinnosuke Takamichi; Norihiro Takamune; Hiroshi Saruwatari (Speech Commun., 2020)

Emotion-Controllable Speech Synthesis Using Emotion Soft Labels and Fine-Grained Prosody Factors. - Xuan Luo; Shinnosuke Takamichi; Tomoki Koriyama; Yuki Saito 001; Hiroshi Saruwatari (APSIPA ASC, 2021)

Low-Latency Incremental Text-to-Speech Synthesis with Distilled Context Prediction Network. - Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (ASRU, 2021)

Japanese EFL Learners' Speaking Practice Utilizing Text-to-Speech Technology Within a Team-Based Flipped Learning Framework. - Yasushige Ishikawa; Shinnosuke Takamichi; Takatoyo Umemoto; Masao Aikawa; Kishio Sakamoto; Kikuko Yui; Shigeo Fujiwara; Ayako Suto; Koichi Nishiyama (HCI (23), 2021)

Humanacgan: Conditional Generative Adversarial Network with Human-Based Auxiliary Classifier and its Evaluation in Phoneme Perception. - Yota Ueda; Kazuki Fujii; Yuki Saito 001; Shinnosuke Takamichi; Yukino Baba; Hiroshi Saruwatari (ICASSP, 2021)

Disentangled Speaker and Language Representations Using Mutual Information Minimization and Domain Adaptation for Cross-Lingual TTS. - Detai Xin; Tatsuya Komatsu; Shinnosuke Takamichi; Hiroshi Saruwatari (ICASSP, 2021)

Digital Speech Makeup: Voice Conversion Based Altered Auditory Feedback for Transforming Self-Representation. - Riku Arakawa; Zendai Kashino; Shinnosuke Takamichi; Adrien Verhulst; Masahiko Inami (ICMI, 2021)

Cross-Lingual Speaker Adaptation Using Domain Adaptation and Speaker Consistency Loss for Text-To-Speech Synthesis. - Detai Xin; Yuki Saito 001; Shinnosuke Takamichi; Tomoki Koriyama; Hiroshi Saruwatari (Interspeech, 2021)

Lightweight Voice Anonymization Based on Data-Driven Optimization of Cascaded Voice Modification Modules. - Hiroto Kai; Shinnosuke Takamichi; Sayaka Shiota; Hitoshi Kiya (SLT, 2021)

Audiobook Speech Synthesis Conditioned by Cross-Sentence Context-Aware Word Embeddings. - Wataru Nakata; Tomoki Koriyama; Shinnosuke Takamichi; Naoko Tanji; Yusuke Ijima; Ryo Masumura; Hiroshi Saruwatari (SSW, 2021)

Accent Modeling of Low-Resourced Dialect in Pitch Accent Language Using Variational Autoencoder. - Kazuya Yufune; Tomoki Koriyama; Shinnosuke Takamichi; Hiroshi Saruwatari (SSW, 2021)

Onoma-to-wave: Environmental sound synthesis from onomatopoeic words. - Yuki Okamoto; Keisuke Imoto; Shinnosuke Takamichi; Ryosuke Yamanishi; Takahiro Fukumori; Yoichi Yamashita (CoRR, 2021)

ESPnet2-TTS: Extending the Edge of TTS Research. - Tomoki Hayashi; Ryuichi Yamamoto; Takenori Yoshimura; Peter Wu; Jiatong Shi; Takaaki Saeki; Yooncheol Ju; Yusuke Yasuda; Shinnosuke Takamichi; Shinji Watanabe 001 (CoRR, 2021)

JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verification. - Shinnosuke Takamichi; Ludwig Kürzinger; Takaaki Saeki; Sayaka Shiota; Shinji Watanabe 001 (CoRR, 2021)

Noise Robust Acoustic Anomaly Detection System with Nonnegative Matrix Factorization Based on Generalized Gaussian Distribution. - Akihito Aiba; Minoru Yoshida; Daichi Kitamura; Shinnosuke Takamichi; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2021)

DNN-Based Low-Musical-Noise Single-Channel Speech Enhancement Based on Higher-Order-Moments Matching. - Satoshi Mizoguchi; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2021)

Real-Time Full-Band Voice Conversion with Sub-Band Modeling and Data-Driven Phase Estimation of Spectral Differentials. - Takaaki Saeki; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEICE Trans. Inf. Syst., 2021)

Incremental Text-to-Speech Synthesis Using Pseudo Lookahead With Large Pretrained Language Model. - Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (IEEE Signal Process. Lett., 2021)

Perceptual-Similarity-Aware Deep Speaker Representation Learning for Multi-Speaker Generative Modeling. - Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEEE ACM Trans. Audio Speech Lang. Process., 2021)

Predicting VQVAE-based Character Acting Style from Quotation-Annotated Text for Audiobook Speech Synthesis. - Wataru Nakata; Tomoki Koriyama; Shinnosuke Takamichi; Yuki Saito 001; Yusuke Ijima; Ryo Masumura; Hiroshi Saruwatari (INTERSPEECH, 2022)

Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History. - Yuto Nishimura; Yuki Saito 001; Shinnosuke Takamichi; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2022)

SelfRemaster: Self-Supervised Speech Restoration with Analysis-by-Synthesis Approach Using Channel Modeling. - Takaaki Saeki; Shinnosuke Takamichi; Tomohiko Nakamura; Naoko Tanji; Hiroshi Saruwatari (INTERSPEECH, 2022)

UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022. - Takaaki Saeki; Detai Xin; Wataru Nakata; Tomoki Koriyama; Shinnosuke Takamichi; Hiroshi Saruwatari (INTERSPEECH, 2022)

STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent. - Yuki Saito 001; Yuto Nishimura; Shinnosuke Takamichi; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2022)

J-MAC: Japanese multi-speaker audiobook corpus for speech synthesis. - Shinnosuke Takamichi; Wataru Nakata; Naoko Tanji; Hiroshi Saruwatari (INTERSPEECH, 2022)

Personalized Filled-pause Generation with Group-wise Prediction Models. - Yuta Matsunaga; Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (LREC, 2022)

Robustness of Signal Processing-Based Pseudonymization Method Against Decryption Attack. - Hiroto Kai; Shinnosuke Takamichi; Sayaka Shiota; Hitoshi Kiya (Odyssey, 2022)

VTTS: Visual-Text To Speech. - Yoshifumi Nakano; Takaaki Saeki; Shinnosuke Takamichi; Katsuhito Sudoh; Hiroshi Saruwatari (SLT, 2022)

Speaking-Rate-Controllable HiFi-GAN Using Feature Interpolation. - Detai Xin; Shinnosuke Takamichi; Takuma Okamoto; Hisashi Kawai; Hiroshi Saruwatari (CoRR, 2022)

Exploring the Effectiveness of Self-supervised Learning and Classifier Chains in Emotion Recognition of Nonverbal Vocalizations. - Detai Xin; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2022)

How Should We Evaluate Synthesized Environmental Sounds. - Yuki Okamoto; Keisuke Imoto; Shinnosuke Takamichi; Takahiro Fukumori; Yoichi Yamashita (CoRR, 2022)

Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesis. - Yuta Matsunaga; Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2022)

Spontaneous speech synthesis with linguistic-speech consistency training using pseudo-filled pauses. - Yuta Matsunaga; Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2022)

Text-to-speech synthesis from dark data with evaluation-in-the-loop data selection. - Kentaro Seki; Shinnosuke Takamichi; Takaaki Saeki; Hiroshi Saruwatari (CoRR, 2022)

Lightweight and irreversible speech pseudonymization based on data-driven optimization of cascaded voice modification modules. - Hiroto Kai; Shinnosuke Takamichi; Sayaka Shiota; Hitoshi Kiya (Comput. Speech Lang., 2022)

Yodas: Youtube-Oriented Dataset for Audio and Speech. - Xinjian Li; Shinnosuke Takamichi; Takaaki Saeki; William Chen; Sayaka Shiota; Shinji Watanabe 001 (ASRU, 2023)

COCO-NUT: Corpus of Japanese Utterance and Voice Characteristics Description for Prompt-Based Control. - Aya Watanabe; Shinnosuke Takamichi; Yuki Saito 001; Wataru Nakata; Detai Xin; Hiroshi Saruwatari (ASRU, 2023)

jaCappella Corpus: A Japanese a Cappella Vocal Ensemble Corpus. - Tomohiko Nakamura; Shinnosuke Takamichi; Naoko Tanji; Satoru Fukayama; Hiroshi Saruwatari (ICASSP, 2023)

Visual Onoma-to-Wave: Environmental Sound Synthesis from Visual Onomatopoeias and Sound-Source Images. - Hien Ohnaka; Shinnosuke Takamichi; Keisuke Imoto; Yuki Okamoto; Kazuki Fujii; Hiroshi Saruwatari (ICASSP, 2023)

MID-Attribute Speaker Generation Using Optimal-Transport-Based Interpolation of Gaussian Mixture Models. - Aya Watanabe; Shinnosuke Takamichi; Yuki Saito 001; Detai Xin; Hiroshi Saruwatari (ICASSP, 2023)

Improving Speech Prosody of Audiobook Text-To-Speech Synthesis with Acoustic and Textual Contexts. - Detai Xin; Sharath Adavanne; Federico Ang; Ashish Kulkarni; Shinnosuke Takamichi; Hiroshi Saruwatari (ICASSP, 2023)

Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretraining. - Takaaki Saeki; Soumi Maiti; Xinjian Li; Shinji Watanabe 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IJCAI, 2023)

How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics. - Joonyong Park; Shinnosuke Takamichi; Tomohiko Nakamura; Kentaro Seki; Detai Xin; Hiroshi Saruwatari (INTERSPEECH, 2023)

CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center. - Yuki Saito 001; Eiji Iimori; Shinnosuke Takamichi; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2023)

ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings. - Yuki Saito 001; Shinnosuke Takamichi; Eiji Iimori; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2023)

HumanDiffusion: diffusion model using perceptual gradients. - Yota Ueda; Shinnosuke Takamichi; Yuki Saito 001; Norihiro Takamune; Hiroshi Saruwatari (INTERSPEECH, 2023)

Laughter Synthesis using Pseudo Phonetic Tokens with a Large-scale In-the-wild Laughter Corpus. - Detai Xin; Shinnosuke Takamichi; Ai Morimatsu; Hiroshi Saruwatari (INTERSPEECH, 2023)

TimToShape: Supporting Practice of Musical Instruments by Visualizing Timbre with 2D Shapes based on Crossmodal Correspondences. - Kota Arai; Yutaro Hirao; Takuji Narumi; Tomohiko Nakamura; Shinnosuke Takamichi; Shigeo Yoshida (IUI, 2023)

Improving robustness of spontaneous speech synthesis with linguistic speech regularization and pseudo-filled-pause insertion. - Yuta Matsunaga; Takaaki Saeki; Shinnosuke Takamichi; Hiroshi Saruwatari (SSW, 2023)

SelfRemaster: Self-Supervised Speech Restoration for Historical Audio Resources. - Takaaki Saeki; Shinnosuke Takamichi; Tomohiko Nakamura; Naoko Tanji; Hiroshi Saruwatari (IEEE Access, 2023)

Foley Sound Synthesis at the DCASE 2023 Challenge. - Keunwoo Choi; Jaekwon Im; Laurie M. Heller; Brian McFee; Keisuke Imoto; Yuki Okamoto; Mathieu Lagrange; Shinnosuke Takamichi (CoRR, 2023)

Environmental sound conversion from vocal imitations and sound event labels. - Yuki Okamoto; Keisuke Imoto; Shinnosuke Takamichi; Ryotaro Nagase; Takahiro Fukumori; Yoichi Yamashita (CoRR, 2023)

JVNV: A Corpus of Japanese Emotional Speech with Verbal Content and Nonverbal Expressions. - Detai Xin; Junfeng Jiang; Shinnosuke Takamichi; Yuki Saito 001; Akiko Aizawa; Hiroshi Saruwatari (IEEE DataPort, 2023)

Real-Time Noise Estimation for Lombard-Effect Speech Synthesis in Human-Avatar Dialogue Systems. - Yuto Ishikawa; Osamu Take; Tomohiko Nakamura; Norihiro Takamune; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (APSIPA, 2024)

NecoBERT: Self-Supervised Learning Model Trained by Masked Language Modeling on Rich Acoustic Features Derived from Neural Audio Codec. - Wataru Nakata; Takaaki Saeki; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (APSIPA, 2024)

Character-Voice Embodiment Impacts on the Cognitive Task Performance with the Voice Ownership Illusion. - Yusuke Kunimi; Kentaro Kimura; Keigo Matsumoto; Shinnosuke Takamichi; Takuji Narumi; Masaaki Mochimaru (ICAT-EGVE, 2024)

Environmental Sound Synthesis from Vocal Imitations and Sound Event Labels. - Yuki Okamoto; Keisuke Imoto; Shinnosuke Takamichi; Ryotaro Nagase; Takahiro Fukumori; Yoichi Yamashita (ICASSP, 2024)

Diversity-Based Core-Set Selection for Text-to-Speech with Linguistic and Acoustic Features. - Kentaro Seki; Shinnosuke Takamichi; Takaaki Saeki; Hiroshi Saruwatari (ICASSP, 2024)

Do Learned Speech Symbols Follow Zipf's Law? - Shinnosuke Takamichi; Hiroki Maeda; Joonyong Park; Daisuke Saito; Hiroshi Saruwatari (ICASSP, 2024)

Noise-Robust Voice Conversion by Conditional Denoising Training Using Latent Variables of Recording Quality and Environment. - Takuto Igarashi; Yuki Saito 001; Kentaro Seki; Shinnosuke Takamichi; Ryuichi Yamamoto; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2024)

Textless Dependency Parsing by Labeled Sequence Prediction. - Shunsuke Kando; Yusuke Miyao; Jason Naradowsky; Shinnosuke Takamichi (INTERSPEECH, 2024)

SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics. - Takaaki Saeki; Soumi Maiti; Shinnosuke Takamichi; Shinji Watanabe 001; Hiroshi Saruwatari (INTERSPEECH, 2024)

SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark. - Yuki Saito 001; Takuto Igarashi; Kentaro Seki; Shinnosuke Takamichi; Ryuichi Yamamoto; Kentaro Tachibana; Hiroshi Saruwatari (INTERSPEECH, 2024)

Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals. - Kentaro Seki; Shinnosuke Takamichi; Norihiro Takamune; Yuki Saito 001; Kanami Imamura; Hiroshi Saruwatari (INTERSPEECH, 2024)

Who Finds This Voice Attractive? A Large-Scale Experiment Using In-the-Wild Data. - Hitoshi Suda; Aya Watanabe; Shinnosuke Takamichi (INTERSPEECH, 2024)

SaSLaW: Dialogue Speech Corpus with Audio-visual Egocentric Information Toward Environment-adaptive Dialogue Speech Synthesis. - Osamu Take; Shinnosuke Takamichi; Kentaro Seki; Yoshiaki Bando; Hiroshi Saruwatari (INTERSPEECH, 2024)

DNN-Based Ensemble Singing Voice Synthesis With Interactions Between Singers. - Hiroaki Hyodo; Shinnosuke Takamichi; Tomohiko Nakamura; Junya Koguchi; Hiroshi Saruwatari (SLT, 2024)

JVNV: A Corpus of Japanese Emotional Speech With Verbal Content and Nonverbal Expressions. - Detai Xin; Junfeng Jiang; Shinnosuke Takamichi; Yuki Saito 001; Akiko Aizawa; Hiroshi Saruwatari (IEEE Access, 2024)

Building speech corpus with diverse voice characteristics for its prompt-based representation. - Aya Watanabe; Shinnosuke Takamichi; Yuki Saito 001; Wataru Nakata; Detai Xin; Hiroshi Saruwatari (CoRR, 2024)

RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis. - Detai Xin; Xu Tan 003; Kai Shen; Zeqian Ju; Dongchao Yang; Yuancheng Wang; Shinnosuke Takamichi; Hiroshi Saruwatari; Shujie Liu 001; Jinyu Li 001; Sheng Zhao (CoRR, 2024)

J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modeling. - Wataru Nakata; Kentaro Seki; Hitomi Yanaka; Yuki Saito 001; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2024)

BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec. - Detai Xin; Xu Tan 003; Shinnosuke Takamichi; Hiroshi Saruwatari (CoRR, 2024)

Text-To-Speech Synthesis In The Wild. - Jee-weon Jung; Wangyou Zhang; Soumi Maiti; Yihan Wu; Xin Wang 037; Ji-Hoon Kim; Yuta Matsunaga; Seyun Um; Jinchuan Tian; Hye-jin Shim; Nicholas W. D. Evans; Joon Son Chung; et al. (CoRR, 2024)

SpoofCeleb: Speech Deepfake Detection and SASV In The Wild. - Jee-weon Jung; Yihan Wu; Xin Wang 037; Ji-Hoon Kim; Soumi Maiti; Yuta Matsunaga; Hye-jin Shim; Jinchuan Tian; Nicholas W. D. Evans; Joon Son Chung; Wangyou Zhang; Seyun Um; et al. (CoRR, 2024)

A Neural Transformer Framework for Simultaneous Tasks of Segmentation, Classification, and Caller Identification of Marmoset Vocalization. - Bin Wu; Sakriani Sakti; Shinnosuke Takamichi; Satoshi Nakamura 001 (CoRR, 2024)

Text-Inductive Graphone-Based Language Adaptation for Low-Resource Speech Synthesis. - Takaaki Saeki; Soumi Maiti; Xinjian Li; Shinji Watanabe 001; Shinnosuke Takamichi; Hiroshi Saruwatari (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

JNV corpus: A corpus of Japanese nonverbal vocalizations with diverse phrases and emotions. - Detai Xin; Shinnosuke Takamichi; Hiroshi Saruwatari (Speech Commun., 2024)

Measuring Time Delay Tolerance in Third-Person Live Commentary for Super Smash Bros. Ultimate. - Ryosuke Matsushita; Ryosuke Sakai; Koki Fukuda; Shinnosuke Takamichi; Kota Iura; Yuki Saito 001; Graham Neubig; Katsuhito Sudoh; Hiroya Takamura; Tatsuya Ishigaki (CoG, 2025)

Exploring the Effect of Segmentation and Vocabulary Size on Speech Tokenization for Speech Language Models. - Shunsuke Kando; Yusuke Miyao; Shinnosuke Takamichi (CoRR, 2025)

TTSOps: A Closed-Loop Corpus Optimization Framework for Training Multi-Speaker TTS Models from Dark Data. - Kentaro Seki; Shinnosuke Takamichi; Takaaki Saeki; Hiroshi Saruwatari (CoRR, 2025)

RELATE: Subjective evaluation dataset for automatic evaluation of relevance between text and audio. - Yusuke Kanamori; Yuki Okamoto; Taisei Takano; Shinnosuke Takamichi; Yuki Saito 001; Hiroshi Saruwatari (CoRR, 2025)

AudioBERTScore: Objective Evaluation of Environmental Sound Synthesis Based on Similarity of Audio embedding Sequences. - Minoru Kishi; Ryosuke Sakai; Shinnosuke Takamichi; Yusuke Kanamori; Yuki Okamoto (CoRR, 2025)

Voice Conversion for Likability Control via Automated Rating of Speech Synthesis Corpora. - Hitoshi Suda; Shinnosuke Takamichi; Satoru Fukayama (CoRR, 2025)

Active Learning for Text-to-Speech Synthesis with Informative Sample Collection. - Kentaro Seki; Shinnosuke Takamichi; Takaaki Saeki; Hiroshi Saruwatari (CoRR, 2025)