Yuki Mitsufuji

According to our database, Yuki Mitsufuji authored at least 242 papers between 2013 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction.

Mungyeom Kim, Minkyeong Jeon, Honggyu An, Jaewoo Jung, Hyuna Ko, Jisang Han, Hyeonseo Yu, Donghwan Shin, Sunghwan Hong, Takuya Narihira, Kazumi Fukuda, Yuki Mitsufuji, Seungryong Kim

CoRR, May, 2026

MusTBENCH: Benchmarking and Advancing Temporal Grounding in Music LLMs.

Daeyong Kwon, Qiyu Wu, Shinobu Kuriya, Junghyun Koo, Shuyang Cui, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji

CoRR, May, 2026

Learning to Route Languages for Multilingual Policy Optimization.

Geyang Guo, Hiromi Wakaki, Yuki Mitsufuji, Alan Ritter, Wei Xu

CoRR, May, 2026

Training data attribution in diffusion models via mirrored unlearning and noise-consistent skew.

Joan Serrà, Dipam Goswami, Fabio Morreale, Wei-Hsiang Liao, Yuki Mitsufuji

CoRR, May, 2026

Understanding and Accelerating the Training of Masked Diffusion Language Models.

Chunsan Hong, Sanghyun Lee, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Yuki Mitsufuji, Seungryong Kim, Jong Chul Ye

CoRR, May, 2026

MMAudio-LABEL: Audio Event Labeling via Audio Generation for Silent Video.

Kazuya Tateishi, Akira Takahashi, Atsuo Hiroe, Hirofumi Takeda, Shusuke Takahashi, Yuki Mitsufuji

CoRR, May, 2026

MMAudioReverbs: Video-Guided Acoustic Modeling for Dereverberation and Room Impulse Response Estimation.

Akira Takahashi, Ryosuke Sawata, Shusuke Takahashi, Yuki Mitsufuji

CoRR, May, 2026

Woosh: A Sound Effects Foundation Model.

Gaëtan Hadjeres, Marc Ferras, Khaled Koutini, Benno Weck, Alexandre Bittar, Thomas Hummel, Zineb Lahrichi, Hakim Missoum, Joan Serrà, Yuki Mitsufuji

CoRR, April, 2026

A Unified View of Drifting and Score-Based Models.

Chieh-Hsin Lai, Bac Nguyen, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon, Molei Tao

CoRR, March, 2026

Echoes Over Time: Unlocking Length Generalization in Video-to-Audio Generation Models.

Christian Simon, Masato Ishii, Wei-Yao Wang, Koichi Saito, Akio Hayakawa, Dongseok Shim, Zhi Zhong, Shuyang Cui, Shusuke Takahashi, Takashi Shibuya, Yuki Mitsufuji

CoRR, February, 2026

Information-Guided Noise Allocation for Efficient Diffusion Training.

Gabriel Raya, Bac Nguyen, Georgios Batzolis, Yuhta Takida, Dejan Stancevic, Naoki Murata, Chieh-Hsin Lai, Yuki Mitsufuji, Luca Ambrogioni

CoRR, February, 2026

GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning.

Naoki Murata, Yuhta Takida, Chieh-Hsin Lai, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji

CoRR, January, 2026

Summary of The Inaugural Music Source Restoration Challenge.

Yongyi Zang, Jiarui Hai, Wanying Ge, Qiuqiang Kong, Zheqi Dai, Helin Wang, Yuki Mitsufuji, Mark D. Plumbley

CoRR, January, 2026

Improved Object-Centric Diffusion Learning with Registers and Contrastive Alignment.

Bac Nguyen, Yuhta Takida, Naoki Murata, Chieh-Hsin Lai, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji

CoRR, January, 2026

Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion.

Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji

Trans. Mach. Learn. Res., 2026

Emergent, not Immanent: A Baradian Reading of Explainable AI.

Fabio Morreale, Joan Serrà, Yuki Mitsufuji

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry.

Junyoung Seo, Jisang Han, Jaewoo Jung, Siyoon Jin, Joungbin Lee, Takuya Narihira, Kazumi Fukuda, Takashi Shibuya, Donghoon Ahn, Shoukang Hu, Seungryong Kim, Yuki Mitsufuji

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing.

Xinlei Niu, Kin Wai Cheuk, Jing Zhang, Naoki Murata, Chieh-Hsin Lai, Michele Mancusi, Woosung Choi, Giorgio Fabbro, Wei-Hsiang Liao, Charles Patrick Martin, Yuki Mitsufuji

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

Do Foundational Audio Encoders Understand Music Structure?

Keisuke Toyama, Zhi Zhong, Akira Takahashi, Shusuke Takahashi, Yuki Mitsufuji

CoRR, December, 2025

Schrodinger Audio-Visual Editor: Object-Level Audiovisual Removal.

Weihan Xu, Kan Jen Cheng, Koichi Saito, Muhammad Jehanzeb Mirza, Tingle Li, Yisi Liu, Alexander H. Liu, Liming Wang, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji, Gopala Anumanchipalli, Paul Pu Liang

CoRR, December, 2025

AutoRefiner: Improving Autoregressive Video Diffusion Models via Reflective Refinement Over the Stochastic Sampling Path.

Zhengyang Yu, Akio Hayakawa, Masato Ishii, Qingtao Yu, Takashi Shibuya, Jing Zhang, Yuki Mitsufuji

CoRR, December, 2025

PAVAS: Physics-Aware Video-to-Audio Synthesis.

Oh Hyun-Bin, Yuhta Takida, Toshimitsu Uesaka, Tae-Hyun Oh, Yuki Mitsufuji

CoRR, December, 2025

Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Edits.

Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji

CoRR, December, 2025

C3G: Learning Compact 3D Representations with 2K Gaussians.

Honggyu An, Jaewoo Jung, Mungyeom Kim, Sunghwan Hong, Chaehyun Kim, Kazumi Fukuda, Minkyeong Jeon, Jisang Han, Takuya Narihira, Hyuna Ko, Junsu Kim, Yuki Mitsufuji, Seungryong Kim

CoRR, December, 2025

Distill, Forget, Repeat: A Framework for Continual Unlearning in Text-to-Image Diffusion Models.

Naveen George, Naoki Murata, Yuhta Takida, Konda Reddy Mopuri, Yuki Mitsufuji

CoRR, December, 2025

LLM2Fx-Tools: Tool Calling For Music Post-Production.

Seungheon Doh, Junghyun Koo, Marco A. Martínez Ramírez, Woosung Choi, Wei-Hsiang Liao, Qiyu Wu, Juhan Nam, Yuki Mitsufuji

CoRR, December, 2025

FoleyBench: A Benchmark For Video-to-Audio Models.

Satvik Dixit, Koichi Saito, Zhi Zhong, Yuki Mitsufuji, Chris Donahue

CoRR, November, 2025

MeanFlow Transformers with Representation Autoencoders.

Zheyuan Hu, Chieh-Hsin Lai, Ge Wu, Yuki Mitsufuji, Stefano Ermon

CoRR, November, 2025

Automatic Music Mixing using a Generative Model of Effect Embeddings.

Eloi Moliner, Marco A. Martínez Ramírez, Junghyun Koo, Wei-Hsiang Liao, Kin Wai Cheuk, Joan Serrà, Vesa Välimäki, Yuki Mitsufuji

CoRR, November, 2025

'Studies for': A Human-AI Co-Creative Sound Artwork Using a Real-time Multi-channel Sound Generation Model.

Chihiro Nagashima, Akira Takahashi, Zhi Zhong, Shusuke Takahashi, Yuki Mitsufuji

CoRR, October, 2025

The Principles of Diffusion Models.

Chieh-Hsin Lai, Yang Song, Dongjun Kim, Yuki Mitsufuji, Stefano Ermon

CoRR, October, 2025

MCA: Modality Composition Awareness for Robust Composed Multimodal Retrieval.

Qiyu Wu, Shuyang Cui, Satoshi Hayakawa, Wei-Yao Wang, Hiromi Wakaki, Yuki Mitsufuji

CoRR, October, 2025

Theoretical Refinement of CLIP by Utilizing Linear Structure of Optimal Similarity.

Naoki Yoshida, Satoshi Hayakawa, Yuhta Takida, Toshimitsu Uesaka, Hiromi Wakaki, Yuki Mitsufuji

CoRR, October, 2025

3D Scene Prompting for Scene-Consistent Camera-Controllable Video Generation.

Joungbin Lee, Jaewoo Jung, Jisang Han, Takuya Narihira, Kazumi Fukuda, Junyoung Seo, Sunghwan Hong, Yuki Mitsufuji, Seungryong Kim

CoRR, October, 2025

Automatic Music Sample Identification with Multi-Track Contrastive Learning.

Alain Riou, Joan Serrà, Yuki Mitsufuji

CoRR, October, 2025

MSRBench: A Benchmarking Dataset for Music Source Restoration.

Yongyi Zang, Jiarui Hai, Wanying Ge, Qiuqiang Kong, Zheqi Dai, Helin Wang, Yuki Mitsufuji, Mark D. Plumbley

CoRR, October, 2025

MMAudioSep: Taming Video-to-Audio Generative Model Towards Video/Text-Queried Sound Separation.

Akira Takahashi, Shusuke Takahashi, Yuki Mitsufuji

CoRR, October, 2025

Leveraging Whisper Embeddings for Audio-based Lyrics Matching.

Eleonora Mancini, Joan Serrà, Paolo Torroni, Yuki Mitsufuji

CoRR, October, 2025

Attribution-by-design: Ensuring Inference-Time Provenance in Generative Music Systems.

Fabio Morreale, Wiebke Hutiri, Joan Serrà, Alice Xiang, Yuki Mitsufuji

CoRR, October, 2025

TalkCuts: A Large-Scale Dataset for Multi-Shot Human Speech Video Generation.

Jiaben Chen, Zixin Wang, Ailing Zeng, Yang Fu, Xueyang Yu, Siyuan Cen, Julian Tanke, Yihang Chen, Koichi Saito, Yuki Mitsufuji, Chuang Gan

CoRR, October, 2025

SONA: Learning Conditional, Unconditional, and Mismatching-Aware Discriminator.

Yuhta Takida, Satoshi Hayakawa, Takashi Shibuya, Masaaki Imaizumi, Naoki Murata, Bac Nguyen, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuki Mitsufuji

CoRR, October, 2025

SoundReactor: Frame-level Online Video-to-Audio Generation.

Koichi Saito, Julian Tanke, Christian Simon, Masato Ishii, Kazuki Shimada, Zachary Novack, Zhi Zhong, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji

CoRR, October, 2025

VIRTUE: Visual-Interactive Text-Image Universal Embedder.

Wei-Yao Wang, Kazuya Tateishi, Qiyu Wu, Shusuke Takahashi, Yuki Mitsufuji

CoRR, October, 2025

CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Models.

Zheyuan Hu, Chieh-Hsin Lai, Yuki Mitsufuji, Stefano Ermon

CoRR, September, 2025

Reverse Engineering of Music Mixing Graphs with Differentiable Processors and Iterative Pruning.

Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji

CoRR, September, 2025

SAVGBench Dataset.

Kazuki Shimada, Christian Simon, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

Dataset, September, 2025

Music Arena: Live Evaluation for Text-to-Music.

Yonghyun Kim, Wayne Chi, Anastasios N. Angelopoulos, Wei-Lin Chiang, Koichi Saito, Shinji Watanabe, Yuki Mitsufuji, Chris Donahue

CoRR, July, 2025

Stereo Sound Event Localization and Detection with Onscreen/offscreen Classification.

Kazuki Shimada, Archontis Politis, Irán R. Román, Parthasaarathy Sudarsanam, David Diaz-Guerra, Ruchi Pandey, Kengo Uchida, Yuichiro Koyama, Naoya Takahashi, Takashi Shibuya, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji

CoRR, July, 2025

Theory-Informed Improvements to Classifier-Free Guidance for Discrete Diffusion Models.

Kevin Rojas, Ye He, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji, Molei Tao

CoRR, July, 2025

Denoising Multi-Beta VAE: Representation Learning for Disentanglement and Generation.

Anshuk Uppal, Yuhta Takida, Chieh-Hsin Lai, Yuki Mitsufuji

CoRR, July, 2025

Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution.

Yong-Hyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Woosung Choi, Kin Wai Cheuk, Junghyun Koo, Yuki Mitsufuji

CoRR, July, 2025

Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance.

Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji

CoRR, June, 2025

Large-Scale Training Data Attribution for Music Generative Models via Unlearning.

Woosung Choi, Junghyun Koo, Kin Wai Cheuk, Joan Serrà, Marco A. Martínez Ramírez, Yukara Ikemiya, Naoki Murata, Yuhta Takida, Wei-Hsiang Liao, Yuki Mitsufuji

CoRR, June, 2025

Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry.

Junyoung Seo, Jisang Han, Jaewoo Jung, Siyoon Jin, Joungbin Lee, Takuya Narihira, Kazumi Fukuda, Takashi Shibuya, Donghoon Ahn, Shoukang Hu, Seungryong Kim, Yuki Mitsufuji

CoRR, June, 2025

DCASE2025 Task3 Stereo SELD Dataset.

Kazuki Shimada, Archontis Politis, Irán R. Román, Parthasaarathy Sudarsanam, David Diaz-Guerra, Ruchi Pandey, Kengo Uchida, Yuichiro Koyama, Naoya Takahashi, Takashi Shibuya, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji

Dataset, June, 2025

Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image.

Anubhav Jain, Yuya Kobayashi, Naoki Murata, Yuhta Takida, Takashi Shibuya, Yuki Mitsufuji, Niv Cohen, Nasir D. Memon, Julian Togelius

CoRR, April, 2025

DiffVox: A Differentiable Model for Capturing and Analysing Professional Effects Distributions.

Chin-Yun Yu, Marco A. Martínez Ramírez, Junghyun Koo, Ben Hayes, Wei-Hsiang Liao, György Fazekas, Yuki Mitsufuji

CoRR, April, 2025

D^2USt3R: Enhancing 3D Reconstruction with 4D Pointmaps for Dynamic Scenes.

Jisang Han, Honggyu An, Jaewoo Jung, Takuya Narihira, Junyoung Seo, Kazumi Fukuda, Chaehyun Kim, Sunghwan Hong, Yuki Mitsufuji, Seungryong Kim

CoRR, April, 2025

CARE: Aligning Language Models for Regional Cultural Awareness.

Geyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura, Yuki Mitsufuji, Alan Ritter, Wei Xu

CoRR, April, 2025

DCASE2025 Task3 Stereo SELD Dataset.

Kazuki Shimada, Archontis Politis, Irán R. Román, Parthasaarathy Sudarsanam, David Diaz-Guerra, Ruchi Pandey, Kengo Uchida, Yuichiro Koyama, Naoya Takahashi, Takashi Shibuya, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji

Dataset, April, 2025

Distillation of Discrete Diffusion through Dimensional Correlations.

Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji

Dataset, April, 2025

Cross-Modal Learning for Music-to-Music-Video Description Generation.

Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji

CoRR, March, 2025

Training Consistency Models with Variational Noise Coupling.

Gianluigi Silvestri, Luca Ambrogioni, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji

CoRR, February, 2025

HumanGif: Single-View Human Diffusion with Generative Prior.

Shoukang Hu, Takuya Narihira, Kazumi Fukuda, Ryosuke Sawata, Takashi Shibuya, Yuki Mitsufuji

CoRR, February, 2025

G2D2: Gradient-Guided Discrete Diffusion for Inverse Problem Solving.

Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji

Trans. Mach. Learn. Res., 2025

GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models.

Muhammad Jehanzeb Mirza, Mengjie Zhao, Zhuoyuan Mao, Sivan Doveh, Wei Lin, Paul Gavrikov, Michael Dorkenwald, Shiqi Yang, Saurav Jha, Hiromi Wakaki, Yuki Mitsufuji, Horst Possegger, Rogério Feris, Leonid Karlinsky, James R. Glass

Trans. Mach. Learn. Res., 2025

Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation.

Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Nathaniel Williams, George J. Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, J. Zico Kolter

Trans. Mach. Learn. Res., 2025

Music Foundation Model as Generic Booster for Music Downstream Tasks.

Wei-Hsiang Liao, Yuhta Takida, Yukara Ikemiya, Zhi Zhong, Chieh-Hsin Lai, Giorgio Fabbro, Kazuki Shimada, Keisuke Toyama, Kin Wai Cheuk, Marco A. Martínez Ramírez, Shusuke Takahashi, Stefan Uhlich, Taketo Akama, Woosung Choi, Yuichiro Koyama, Yuki Mitsufuji

Trans. Mach. Learn. Res., 2025

Reductive, Exclusionary, Normalising: The Limits of Generative AI Music.

Fabio Morreale, Marco A. Martínez Ramírez, Raul Masu, Wei-Hsiang Liao, Yuki Mitsufuji

Trans. Int. Soc. Music. Inf. Retr., 2025

SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet.

Zhi Zhong, Akira Takahashi, Shuyang Cui, Keisuke Toyama, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2025

Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Prior.

Chin-Yun Yu, Marco A. Martínez Ramírez, Junghyun Koo, Wei-Hsiang Liao, Yuki Mitsufuji, György Fazekas

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2025

Schrödinger Bridge Consistency Trajectory Models for Speech Enhancement.

Shuichiro Nishigori, Koichi Saito, Naoki Murata, Masato Hirano, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2025

Can Large Language Models Predict Audio Effects Parameters from Natural Language?

Seungheon Doh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Juhan Nam, Yuki Mitsufuji

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2025

CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation.

Yuanhong Chen, Kazuki Shimada, Christian Simon, Yukara Ikemiya, Takashi Shibuya, Yuki Mitsufuji

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixtures.

Yen-Tung Yeh, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yi-Hsuan Yang, Yuki Mitsufuji

Proceedings of the 26th International Society for Music Information Retrieval Conference, 2025

ITO-Master: Inference-Time Optimization for Audio Effects Modeling of Music Mastering Processors.

Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Michele Mancusi, Yuki Mitsufuji

Proceedings of the 26th International Society for Music Information Retrieval Conference, 2025

Aligning Text-to-Music Evaluation with Human Preferences.

Yichen Huang, Zachary Novack, Koichi Saito, Jiatong Shi, Shinji Watanabe, Yuki Mitsufuji, John Thickstun, Chris Donahue

Proceedings of the 26th International Society for Music Information Retrieval Conference, 2025

Enhancing Neural Audio Fingerprint Robustness to Audio Degradation for Music Identification.

Recep Oguz Araz, Guillem Cortès-Sebastià, Emilio Molina, Joan Serrà, Xavier Serra, Yuki Mitsufuji, Dmitry Bogdanov

Proceedings of the 26th International Society for Music Information Retrieval Conference, 2025

Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning.

Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A. Martínez Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon

Proceedings of the 26th International Society for Music Information Retrieval Conference, 2025

A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?

Yigitcan Özer, Woosung Choi, Joan Serrà, Mayank Kumar Singh, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the 26th Annual Conference of the International Speech Communication Association, 2025

Improving Vector-Quantized Image Modeling with Latent Consistency-Matching Diffusion.

Bac Nguyen, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji

Proceedings of the International Joint Conference on Neural Networks, 2025

StereoSync: Spatially-Aware Stereo Audio Generation from Video.

Christian Marinoni, Riccardo F. Gramaccioni, Kazuki Shimada, Takashi Shibuya, Yuki Mitsufuji, Danilo Comminiello

Proceedings of the International Joint Conference on Neural Networks, 2025

Efficiency without Compromise: CLIP-aided Text-to-Image GANs with Increased Diversity.

Yuya Kobayashi, Yuhta Takida, Takashi Shibuya, Yuki Mitsufuji

Proceedings of the International Joint Conference on Neural Networks, 2025

A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Joint Generation.

Masato Ishii, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji

Proceedings of the International Joint Conference on Neural Networks, 2025

VCT: Training Consistency Models with Variational Noise Coupling.

Gianluigi Silvestri, Luca Ambrogioni, Chieh-Hsin Lai, Yuhta Takida, Yuki Mitsufuji

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Supervised Contrastive Learning from Weakly-Labeled Audio Segments for Musical Version Matching.

Joan Serrà, Recep Oguz Araz, Dmitry Bogdanov, Yuki Mitsufuji

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Distillation of Discrete Diffusion through Dimensional Correlations.

Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi, Hiromi Wakaki, Yuki Mitsufuji

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Weighted Point Set Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metric.

Toshimitsu Uesaka, Taiji Suzuki, Yuhta Takida, Chieh-Hsin Lai, Naoki Murata, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation.

Koichi Saito, Dongjun Kim, Takashi Shibuya, Chieh-Hsin Lai, Zhi Zhong, Yuhta Takida, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Jump Your Steps: Optimizing Sampling Schedule of Discrete Diffusion Models.

Yong-Hyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Mining your own secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models.

Saurav Jha, Shiqi Yang, Masato Ishii, Mengjie Zhao, Christian Simon, Muhammad Jehanzeb Mirza, Dong Gong, Lina Yao, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

HERO: Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning.

Ayano Hiranaka, Shang-Fu Chen, Chieh-Hsin Lai, Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao, Shao-Hua Sun, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

MMDisCo: Multi-Modal Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generation.

Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Towards Reporting Bias in Visual-Language Datasets: Bi-Modal Data Augmentation by Decoupling Object-Attribute Association.

Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji

Proceedings of the IEEE/CVF International Conference on Computer Vision, ICCV 2025, 2025

Transformed Low-rank Adaptation via Tensor Decomposition and Its Applications to Text-to-image Models.

Zerui Tao, Yuhta Takida, Naoki Murata, Qibin Zhao, Yuki Mitsufuji

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

TITAN-Guide: Taming Inference-Time Alignment for Guided Text-to-Video Diffusion Models.

Christian Simon, Masato Ishii, Akio Hayakawa, Zhi Zhong, Shusuke Takahashi, Takashi Shibuya, Yuki Mitsufuji

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges.

Geoffroy Peeters, Zafar Rafii, Magdalena Fuentes, Zhiyao Duan, Emmanouil Benetos, Juhan Nam, Yuki Mitsufuji

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer.

Michele Mancusi, Yurii Halychanskyi, Kin Wai Cheuk, Eloi Moliner, Chieh-Hsin Lai, Stefan Uhlich, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Yuki Mitsufuji

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

Variable Bitrate Residual Vector Quantization for Audio Coding.

Yunkee Chae, Woosung Choi, Yuhta Takida, Junghyun Koo, Yukara Ikemiya, Zhi Zhong, Kin Wai Cheuk, Marco A. Martínez Ramírez, Kyogu Lee, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

30+ Years of Source Separation Research: Achievements and Future Challenges.

Shoko Araki, Nobutaka Ito, Reinhold Haeb-Umbach, Gordon Wichern, Zhong-Qiu Wang, Yuki Mitsufuji

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

DeepResonance: Enhancing Multimodal Music Understanding via Music-centric Multi-way Instruction Tuning.

Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Hiromi Wakaki, Yuki Mitsufuji

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

CARE: Multilingual Human Preference Learning for Cultural Awareness.

Geyang Guo, Tarek Naous, Hiromi Wakaki, Yukiko Nishimura, Yuki Mitsufuji, Alan Ritter, Wei Xu

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training.

Kengo Uchida, Takashi Shibuya, Yuhta Takida, Naoki Murata, Julian Tanke, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2025

Dyadic Mamba: Long-term Dyadic Human Motion Synthesis.

Julian Tanke, Takashi Shibuya, Kengo Uchida, Koichi Saito, Yuki Mitsufuji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2025

VinaBench: Benchmark for Faithful and Consistent Visual Narratives.

Silin Gao, Sheryl Mathew, Li Mi, Sepideh Mamooler, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Syrielle Montariol, Antoine Bosselut

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis.

Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander G. Schwing, Yuki Mitsufuji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Classifier-Free Guidance Inside the Attraction Basin May Cause Memorization.

Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir D. Memon, Julian Togelius, Yuki Mitsufuji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Performance Analysis of Active Noise Control Over a Spatial Region.

Jihui Aimee Zhang, Thushara D. Abhayapala, Naoki Murata, Prasanga N. Samarasinghe, Yu Maeno, Yuki Mitsufuji

Proceedings of the Asia Pacific Signal and Information Processing Association Annual Summit and Conference, 2025

2024

The whole is greater than the sum of its parts: improving music source separation by bridging networks.

Ryosuke Sawata, Naoya Takahashi, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

EURASIP J. Audio Speech Music. Process., December, 2024

SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer.

Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

Dataset, April, 2024

The Sound Demixing Challenge 2023 - Cinematic Demixing Track.

Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji

Trans. Int. Soc. Music. Inf. Retr., January, 2024

The Sound Demixing Challenge 2023 - Music Demixing Track.

Giorgio Fabbro, Stefan Uhlich, Chieh-Hsin Lai, Woosung Choi, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Igor Gadelha, Geraldo Ramos, Eddie Hsu, Hugo Rodrigues, Fabian-Robert Stöter, Alexandre Défossez, Yi Luo, Jianwei Yu, Dipam Chakraborty, Sharada P. Mohanty, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Nabarun Goswami, Tatsuya Harada, Minseok Kim, Jun Hyung Lee, Yuanliang Dong, Xinran Zhang, Jiafeng Liu, Yuki Mitsufuji

Trans. Int. Soc. Music. Inf. Retr., January, 2024

HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayes.

Yuhta Takida, Yukara Ikemiya, Takashi Shibuya, Kazuki Shimada, Woosung Choi, Chieh-Hsin Lai, Naoki Murata, Toshimitsu Uesaka, Kengo Uchida, Wei-Hsiang Liao, Yuki Mitsufuji

Trans. Mach. Learn. Res., 2024

Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis.

Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander G. Schwing, Yuki Mitsufuji

CoRR, 2024

SAVGBench: Benchmarking Spatially Aligned Audio-Video Generation.

Kazuki Shimada, Christian Simon, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2024

TraSCE: Trajectory Steering for Concept Erasure.

Anubhav Jain, Yuya Kobayashi, Takashi Shibuya, Yuhta Takida, Nasir D. Memon, Julian Togelius, Yuki Mitsufuji

CoRR, 2024

Blind Inverse Problem Solving Made Easy by Text-to-Image Latent Diffusion.

Michail Dontas, Yutong He, Naoki Murata, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov

CoRR, 2024

OpenMU: Your Swiss Army Knife for Music Understanding.

Mengjie Zhao, Zhi Zhong, Zhuoyuan Mao, Shiqi Yang, Wei-Hsiang Liao, Shusuke Takahashi, Hiromi Wakaki, Yuki Mitsufuji

CoRR, 2024

Mitigating Embedding Collapse in Diffusion Models for Categorical Data.

Bac Nguyen, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Stefano Ermon, Yuki Mitsufuji

CoRR, 2024

G2D2: Gradient-guided Discrete Diffusion for image inverse problem solving.

Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Bac Nguyen, Stefano Ermon, Yuki Mitsufuji

CoRR, 2024

<i>Jump Your Steps</i>: Optimizing Sampling Schedule of Discrete Diffusion Models.

Yong-Hyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Yuki Mitsufuji

CoRR, 2024

VRVQ: Variable Bitrate Residual Vector Quantization for Audio Compression.

Yunkee Chae, Woosung Choi, Yuhta Takida, Junghyun Koo, Yukara Ikemiya, Zhi Zhong, Kin Wai Cheuk, Marco A. Martínez Ramírez, Kyogu Lee, Wei-Hsiang Liao, Yuki Mitsufuji

CoRR, 2024

Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning.

Ayano Hiranaka, Shang-Fu Chen, Chieh-Hsin Lai, Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao, Shao-Hua Sun, Yuki Mitsufuji

CoRR, 2024

Bellman Diffusion: Generative Modeling as Learning a Linear Operator in the Distribution Space.

Yangming Li, Chieh-Hsin Lai, Carola-Bibiane Schönlieb, Yuki Mitsufuji, Stefano Ermon

CoRR, 2024

A Survey on Diffusion Models for Inverse Problems.

Giannis Daras, Hyungjin Chung, Chieh-Hsin Lai, Yuki Mitsufuji, Jong Chul Ye, Peyman Milanfar, Alexandros G. Dimakis, Mauricio Delbracio

CoRR, 2024

LOCKEY: A Novel Approach to Model Authentication and Deepfake Tracking.

Mayank Kumar Singh, Naoya Takahashi, Wei-Hsiang Liao, Yuki Mitsufuji

CoRR, 2024

Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer.

Michele Mancusi, Yurii Halychanskyi, Kin Wai Cheuk, Chieh-Hsin Lai, Stefan Uhlich, Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Giorgio Fabbro, Yuki Mitsufuji

CoRR, 2024

DisMix: Disentangling Mixtures of Musical Instruments for Source-level Pitch and Timbre Manipulation.

Yin-Jyun Luo, Kin Wai Cheuk, Woosung Choi, Toshimitsu Uesaka, Keisuke Toyama, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Wei-Hsiang Liao, Simon Dixon, Yuki Mitsufuji

CoRR, 2024

GRAFX: An Open-Source Library for Audio Processing Graphs in PyTorch.

Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji

CoRR, 2024

SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond.

Marco Comunità, Zhi Zhong, Akira Takahashi, Shiqi Yang, Mengjie Zhao, Koichi Saito, Yukara Ikemiya, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2024

Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Data.

Yu-Hua Chen, Woosung Choi, Wei-Hsiang Liao, Marco A. Martínez Ramírez, Kin Wai Cheuk, Yuki Mitsufuji, Jyh-Shing Roger Jang, Yi-Hsuan Yang

CoRR, 2024

ComperDial: Commonsense Persona-grounded Dialogue Dataset and Benchmark.

Hiromi Wakaki, Yuki Mitsufuji, Yoshinori Maeda, Yukiko Nishimura, Silin Gao, Mengjie Zhao, Keiichi Yamada, Antoine Bosselut

CoRR, 2024

MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training.

Kengo Uchida, Takashi Shibuya, Yuhta Takida, Naoki Murata, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2024

Searching For Music Mixing Graphs: A Pruning Approach.

Sungho Lee, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Giorgio Fabbro, Kyogu Lee, Yuki Mitsufuji

CoRR, 2024

SoundCTM: Uniting Score-based and Consistency Models for Text-to-Sound Generation.

Koichi Saito, Dongjun Kim, Takashi Shibuya, Chieh-Hsin Lai, Zhi Zhong, Yuhta Takida, Yuki Mitsufuji

CoRR, 2024

Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generation.

Akio Hayakawa, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji

CoRR, 2024

Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation.

Shiqi Yang, Zhi Zhong, Mengjie Zhao, Shusuke Takahashi, Masato Ishii, Takashi Shibuya, Yuki Mitsufuji

CoRR, 2024

Understanding Multimodal Contrastive Learning Through Pointwise Mutual Information.

Toshimitsu Uesaka, Taiji Suzuki, Yuhta Takida, Chieh-Hsin Lai, Naoki Murata, Yuki Mitsufuji

CoRR, 2024

MR-MT3: Memory Retaining Multi-Track Music Transcription to Mitigate Instrument Leakage.

Hao Hao Tan, Kin Wai Cheuk, Taemin Cho, Wei-Hsiang Liao, Yuki Mitsufuji

CoRR, 2024

GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping.

Junyoung Seo, Kazumi Fukuda, Takashi Shibuya, Takuya Narihira, Naoki Murata, Shoukang Hu, Chieh-Hsin Lai, Seungryong Kim, Yuki Mitsufuji

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teacher.

Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

SpecMaskGIT: Masked Generative Modeling of Audio Spectrogram for Efficient Audio Synthesis and Beyond.

Marco Comunità, Zhi Zhong, Akira Takahashi, Shiqi Yang, Mengjie Zhao, Koichi Saito, Yukara Ikemiya, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the 25th International Society for Music Information Retrieval Conference, 2024

Towards Assessing Data Replication in Music Generation With Music Similarity Metrics on Raw Audio.

Roser Batlle-Roca, Wei-Hsiang Liao, Xavier Serra, Yuki Mitsufuji, Emilia Gómez

Proceedings of the 25th International Society for Music Information Retrieval Conference, 2024

SilentCipher: Deep Audio Watermarking.

Mayank Kumar Singh, Naoya Takahashi, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the 25th Annual Conference of the International Speech Communication Association, 2024

MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models.

Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024

SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer.

Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion.

Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yutong He, Yuki Mitsufuji, Stefano Ermon

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Manifold Preserving Guided Diffusion.

Yutong He, Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J. Zico Kolter, Ruslan Salakhutdinov, Stefano Ermon

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Zero- and Few-Shot Sound Event Localization and Detection.

Kazuki Shimada, Kengo Uchida, Yuichiro Koyama, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji, Tatsuya Kawahara

Proceedings of the IEEE International Conference on Acoustics, 2024

Diffusion-Based Speech Enhancement with Joint Generative and Predictive Decoders.

Hao Shi, Kazuki Shimada, Masato Hirano, Takashi Shibuya, Yuichiro Koyama, Zhi Zhong, Shusuke Takahashi, Tatsuya Kawahara, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2024

VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance.

Carlos Hernandez-Olivan, Koichi Saito, Naoki Murata, Chieh-Hsin Lai, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2024

Enhancing Semantic Communication with Deep Generative Models: An Overview.

Eleonora Grassucci, Yuki Mitsufuji, Ping Zhang, Danilo Comminiello

Proceedings of the IEEE International Conference on Acoustics, 2024

Timbre-Trap: A Low-Resource Framework for Instrument-Agnostic Music Transcription.

Frank Cwitkowitz, Kin Wai Cheuk, Woosung Choi, Marco A. Martínez Ramírez, Keisuke Toyama, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2024

BIGVSAN: Enhancing Gan-Based Neural Vocoders with Slicing Adversarial Network.

Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2024

On the Language Encoder of Contrastive Cross-modal Models.

Mengjie Zhao, Junya Ono, Zhi Zhong, Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Takashi Shibuya, Hiromi Wakaki, Yuki Mitsufuji

Proceedings of the Findings of the Association for Computational Linguistics, 2024

DiffuCOMET: Contextual Commonsense Knowledge Diffusion.

Silin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network.

Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji

Dataset, September, 2023

SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer.

Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

Dataset, July, 2023

SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer.

Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

Dataset, July, 2023

STARSS23: Sony-TAu Realistic Spatial Soundscapes 2023.

Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Aapo Hakala, Shusuke Takahashi, Daniel Aleksander Krause, Naoya Takahashi, Sharath Adavanne, Yuichiro Koyama, Kengo Uchida, Yuki Mitsufuji, Tuomas Virtanen

Dataset, March, 2023

STARSS23: Sony-TAu Realistic Spatial Soundscapes 2023.

Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Aapo Hakala, Shusuke Takahashi, Daniel Aleksander Krause, Naoya Takahashi, Sharath Adavanne, Yuichiro Koyama, Kengo Uchida, Yuki Mitsufuji, Tuomas Virtanen

Dataset, March, 2023

Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association.

Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji

CoRR, 2023

Enhancing Semantic Communication with Deep Generative Models - An ICASSP Special Session Overview.

Eleonora Grassucci, Yuki Mitsufuji, Ping Zhang, Danilo Comminiello

CoRR, 2023

The Sound Demixing Challenge 2023 - Cinematic Demixing Track.

Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada P. Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman A. Solovyev, Alexander L. Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji

CoRR, 2023

On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularization.

Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji, Stefano Ermon

CoRR, 2023

The Whole Is Greater than the Sum of Its Parts: Improving DNN-based Music Source Separation.

Ryosuke Sawata, Naoya Takahashi, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2023

Diffusion-based Signal Refiner for Speech Separation.

Masato Hirano, Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2023

Cross-modal Face- and Voice-style Transfer.

Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

CoRR, 2023

Adversarially Slicing Generative Networks: Discriminator Slices Feature for One-Dimensional Optimal Transport.

Yuhta Takida, Masaaki Imaizumi, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

CoRR, 2023

Extending Audio Masked Autoencoders toward Audio Restoration.

Zhi Zhong, Hao Shi, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2023

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events.

Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam, Daniel Aleksander Krause, Kengo Uchida, Sharath Adavanne, Aapo Hakala, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Automatic Piano Transcription With Hierarchical Frequency-Time Transformer.

Keisuke Toyama, Taketo Akama, Yukara Ikemiya, Yuhta Takida, Wei-Hsiang Liao, Yuki Mitsufuji

Proceedings of the 24th International Society for Music Information Retrieval Conference, 2023

Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement.

Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration.

Naoki Murata, Koichi Saito, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon

Proceedings of the International Conference on Machine Learning, 2023

FP-Diffusion: Improving Score-based Diffusion Models by Enforcing the Underlying Score Fokker-Planck Equation.

Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon

Proceedings of the International Conference on Machine Learning, 2023

CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videos.

Hao-Wen Dong, Naoya Takahashi, Yuki Mitsufuji, Julian J. McAuley, Taylor Berg-Kirkpatrick

Proceedings of the Eleventh International Conference on Learning Representations, 2023

An Attention-Based Approach to Hierarchical Multi-Label Music Instrument Classification.

Zhi Zhong, Masato Hirano, Kazuki Shimada, Kazuya Tateishi, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2023

Hierarchical Diffusion Models for Singing Voice Neural Vocoder.

Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2023

Unsupervised Vocal Dereverberation with Diffusion-Based Generative Models.

Koichi Saito, Naoki Murata, Toshimitsu Uesaka, Chieh-Hsin Lai, Yuhta Takida, Takao Fukui, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2023

Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects.

Junghyun Koo, Marco A. Martínez Ramírez, Wei-Hsiang Liao, Stefan Uhlich, Kyogu Lee, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2023

Diffroll: Diffusion-Based Generative Music Transcription with Unsupervised Pretraining Capability.

Kin Wai Cheuk, Ryosuke Sawata, Toshimitsu Uesaka, Naoki Murata, Naoya Takahashi, Shusuke Takahashi, Dorien Herremans, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2023

PeaCoK: Persona Commonsense Knowledge for Consistent and Engaging Narratives.

Silin Gao, Beatriz Borges, Soyoung Oh, Deniz Bayazit, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

CrossNet-Open-Unmix for Music Source Separation (X-UMXL).

Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

Dataset, September, 2022

STARSS22: Sony-TAu Realistic Spatial Soundscapes 2022 dataset.

Archontis Politis, Yuki Mitsufuji, Parthasaarathy Sudarsanam, Kazuki Shimada, Sharath Adavanne, Yuichiro Koyama, Daniel Aleksander Krause, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen

Dataset, May, 2022

STARSS22: Sony-TAu Realistic Spatial Soundscapes 2022 dataset.

Adavanne Politis, Yuki Mitsufuji, Parthasaarathy Sudarsanam, Kazuki Shimada, Sharath Adavanne, Yuichiro Koyama, Daniel Krause, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen

Dataset, March, 2022

Preventing oversmoothing in VAE via generalized variance parameterization.

Yuhta Takida, Wei-Hsiang Liao, Chieh-Hsin Lai, Toshimitsu Uesaka, Shusuke Takahashi, Yuki Mitsufuji

Neurocomputing, 2022

A Versatile Diffusion-based Generative Refiner for Speech Enhancement.

Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2022

Robust One-Shot Singing Voice Conversion.

Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

CoRR, 2022

Regularizing Score-based Models with Score Fokker-Planck Equations.

Chieh-Hsin Lai, Yuhta Takida, Naoki Murata, Toshimitsu Uesaka, Yuki Mitsufuji, Stefano Ermon

CoRR, 2022

Removing Distortion Effects in Music Using Deep Neural Networks.

Johannes Imort, Giorgio Fabbro, Marco A. Martínez Ramírez, Stefan Uhlich, Yuichiro Koyama, Yuki Mitsufuji

CoRR, 2022

Automatic music mixing with deep learning and out-of-domain data.

Marco A. Martínez Ramírez, Wei-Hsiang Liao, Chihiro Nagashima, Giorgio Fabbro, Stefan Uhlich, Yuki Mitsufuji

Proceedings of the 23rd International Society for Music Information Retrieval Conference, 2022

Distortion Audio Effects: Learning How to Recover the Clean Signal.

Johannes Imort, Giorgio Fabbro, Marco A. Martínez Ramírez, Stefan Uhlich, Yuichiro Koyama, Yuki Mitsufuji

Proceedings of the 23rd International Society for Music Information Retrieval Conference, 2022

SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantization.

Yuhta Takida, Takashi Shibuya, Wei-Hsiang Liao, Chieh-Hsin Lai, Junki Ohmura, Toshimitsu Uesaka, Naoki Murata, Shusuke Takahashi, Toshiyuki Kumakura, Yuki Mitsufuji

Proceedings of the International Conference on Machine Learning, 2022

Amicable Examples for Informed Source Separation.

Naoya Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2022

Multi-ACCDOA: Localizing And Detecting Overlapping Sounds From The Same Class With Auxiliary Duplicating Permutation Invariant Training.

Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Naoya Takahashi, Emiru Tsunoo, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2022

Spatial Mixup: Directional Loudness Modification as Data Augmentation for Sound Event Localization and Detection.

Ricardo Falcón Pérez, Kazuki Shimada, Yuichiro Koyama, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2022

Spatial Data Augmentation with Simulated Room Impulse Responses for Sound Event Localization and Detection.

Yuichiro Koyama, Kazuhide Shigemi, Masafumi Takahashi, Kazuki Shimada, Naoya Takahashi, Emiru Tsunoo, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2022

Music Source Separation With Deep Equilibrium Models.

Yuichiro Koyama, Naoki Murata, Stefan Uhlich, Giorgio Fabbro, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2022

Automatic DJ Transitions with Differentiable Audio Effects and Generative Adversarial Networks.

Bo-Yu Chen, Wei-Han Hsu, Wei-Hsiang Liao, Marco A. Martínez Ramírez, Yuki Mitsufuji, Yi-Hsuan Yang

Proceedings of the IEEE International Conference on Acoustics, 2022

ComFact: A Benchmark for Linking Contextual Commonsense Knowledge.

Silin Gao, Jena D. Hwang, Saya Kanno, Hiromi Wakaki, Yuki Mitsufuji, Antoine Bosselut

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

STARSS22: A Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events.

Archontis Politis, Kazuki Shimada, Parthasaarathy Sudarsanam, Sharath Adavanne, Daniel Krause, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji, Tuomas Virtanen

Proceedings of the 7th Workshop on Detection and Classification of Acoustic Scenes and Events 2022, 2022

2021

CrossNet-Open-Unmix for Music Source Separation (X-UMX-HQ).

Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

Dataset, May, 2021

CrossNet-Open-Unmix for Music Source Separation (X-UMX).

Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

Dataset, April, 2021

Multichannel Blind Source Separation Based on Evanescent-Region-Aware Non-Negative Tensor Factorization in Spherical Harmonic Domain.

Yuki Mitsufuji, Norihiro Takamune, Shoichi Koyama, Hiroshi Saruwatari

IEEE ACM Trans. Audio Speech Lang. Process., 2021

Source Mixing and Separation Robust Audio Steganography.

Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

CoRR, 2021

Music Demixing Challenge at ISMIR 2021.

Yuki Mitsufuji, Giorgio Fabbro, Stefan Uhlich, Fabian-Robert Stöter

CoRR, 2021

Ensemble of ACCDOA- and EINV2-based Systems with D3Nets and Impulse Response Simulation for Sound Event Localization and Detection.

Kazuki Shimada, Naoya Takahashi, Yuichiro Koyama, Shusuke Takahashi, Emiru Tsunoo, Masafumi Takahashi, Yuki Mitsufuji

CoRR, 2021

Training Speech Enhancement Systems with Noisy Speech Datasets.

Koichi Saito, Stefan Uhlich, Giorgio Fabbro, Yuki Mitsufuji

CoRR, 2021

Preventing Posterior Collapse Induced by Oversmoothing in Gaussian VAE.

Yuhta Takida, Wei-Hsiang Liao, Toshimitsu Uesaka, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2021

Hierarchical disentangled representation learning for singing voice conversion.

Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji

Proceedings of the International Joint Conference on Neural Networks, 2021

Adversarial Attacks on Audio Source Separation.

Naoya Takahashi, Shota Inoue, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2021

Accdoa: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization And Detection.

Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2021

All For One And One For All: Improving Music Separation By Bridging Networks.

Ryosuke Sawata, Stefan Uhlich, Shusuke Takahashi, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2021

Densely Connected Multi-Dilated Convolutional Networks for Dense Prediction Tasks.

Naoya Takahashi, Yuki Mitsufuji

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Psychophysiological Effect of Immersive Spatial Audio Experience Enhanced Using Sound Field Synthesis.

Yasuhide Hyodo, Chihiro Sugai, Junya Suzuki, Masafumi Takahashi, Masahiko Koizumi, Asako Tomura, Yuki Mitsufuji, Yota Komoriya

Proceedings of the 9th International Conference on Affective Computing and Intelligent Interaction, 2021

2020

Open-Unmix for Speech Enhancement (UMX SE).

Stefan Uhlich, Yuki Mitsufuji

Dataset, May, 2020

Multichannel Non-Negative Matrix Factorization Using Banded Spatial Covariance Matrices in Wavenumber Domain.

Yuki Mitsufuji, Stefan Uhlich, Norihiro Takamune, Daichi Kitamura, Shoichi Koyama, Hiroshi Saruwatari

IEEE ACM Trans. Audio Speech Lang. Process., 2020

Spherical-Harmonic-Domain Feedforward Active Noise Control Using Sparse Decomposition of Reference Signals from Distributed Sensor Arrays.

Yu Maeno, Yuki Mitsufuji, Prasanga N. Samarasinghe, Naoki Murata, Thushara D. Abhayapala

IEEE ACM Trans. Audio Speech Lang. Process., 2020

Densely connected multidilated convolutional networks for dense prediction tasks.

Naoya Takahashi, Yuki Mitsufuji

CoRR, 2020

D3Net: Densely connected multidilated DenseNet for music source separation.

Naoya Takahashi, Yuki Mitsufuji

CoRR, 2020

Sound Event Localization and Detection Using Activity-Coupled Cartesian DOA Vector and RD3net.

Kazuki Shimada, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji

CoRR, 2020

Improving Voice Separation by Incorporating End-To-End Speech Recognition.

Naoya Takahashi, Mayank Kumar Singh, Sakya Basak, Sudarsanam Parthasaarathy, Sriram Ganapathy, Yuki Mitsufuji

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Array-Geometry-Aware Spatial Active Noise Control Based on Direction-of-Arrival Weighting.

Yu Maeno, Yuhta Takida, Naoki Murata, Yuki Mitsufuji

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

Open-Unmix - A Reference Implementation for Music Source Separation.

Fabian-Robert Stöter, Stefan Uhlich, Antoine Liutkus, Yuki Mitsufuji

Dataset, September, 2019

Open-Unmix - A Reference Implementation for Music Source Separation.

Fabian-Robert Stöter, Stefan Uhlich, Antoine Liutkus, Yuki Mitsufuji

J. Open Source Softw., 2019

Closing the Training/Inference Gap for Deep Attractor Networks.

Cyril Cadoux, Stefan Uhlich, Marc Ferras, Yuki Mitsufuji

CoRR, 2019

Recursive Speech Separation for Unknown Number of Speakers.

Naoya Takahashi, Sudarsanam Parthasaarathy, Nabarun Goswami, Yuki Mitsufuji

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Global and Local Mode-domain Adaptive Algorithms for Spatial Active Noise Control Using Higher-order Sources.

Naoki Murata, Jihui Zhang, Yu Maeno, Yuki Mitsufuji

Proceedings of the IEEE International Conference on Acoustics, 2019

2018

Improving DNN-based Music Source Separation using Phase Features.

Joachim Muth, Stefan Uhlich, Nathanaël Perraudin, Thomas Kemp, Fabien Cardinaux, Yuki Mitsufuji

CoRR, 2018

Mmdenselstm: An Efficient Combination of Convolutional and Recurrent Neural Networks for Audio Source Separation.

Naoya Takahashi, Nabarun Goswami, Yuki Mitsufuji

Proceedings of the 16th International Workshop on Acoustic Signal Enhancement, 2018

Mode-Domain Spatial Active Noise Control Using Multiple Circular Arrays.

Yu Maeno, Yuki Mitsufuji, Prasanga N. Samarasinghe, Thushara D. Abhayapala

Proceedings of the 16th International Workshop on Acoustic Signal Enhancement, 2018

PhaseNet: Discretized Phase Modeling with Deep Neural Networks for Audio Source Separation.

Naoya Takahashi, Purvi Agrawal, Nabarun Goswami, Yuki Mitsufuji

Proceedings of the 19th Annual Conference of the International Speech Communication Association, 2018

Mode Domain Spatial Active Noise Control Using Sparse Signal Representation.

Yu Maeno, Yuki Mitsufuji, Thushara D. Abhayapala

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

2017

Multi-Scale multi-band densenets for audio source separation.

Naoya Takahashi, Yuki Mitsufuji

Proceedings of the 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2017

Improving music source separation based on deep neural networks through data augmentation and network blending.

Stefan Uhlich, Marcello Porcu, Franck Giron, Michael Enenkl, Thomas Kemp, Naoya Takahashi, Yuki Mitsufuji

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

Supervised monaural source separation based on autoencoders.

Keiichi Osako, Yuki Mitsufuji, Rita Singh, Bhiksha Raj

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

2016

Multichannel blind source separation based on non-negative tensor factorization in wavenumber domain.

Yuki Mitsufuji, Shoichi Koyama, Hiroshi Saruwatari

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

Deep neural network based instrument extraction from music.

Stefan Uhlich, Franck Giron, Yuki Mitsufuji

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

NMF-based blind source separation using a linear predictive coding error clustering criterion.

Xin Guo, Stefan Uhlich, Yuki Mitsufuji

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

2014

On the use of a spatial cue as prior information for stereo sound source separation based on spatially weighted non-negative tensor factorization.

Yuki Mitsufuji, Axel Roebel

EURASIP J. Adv. Signal Process., 2014

Online NON-negative Tensor Deconvolution for source detection in 3DTV audio.

Yuki Mitsufuji, Marco Liuni, Alex Baker, Axel Roebel

Proceedings of the IEEE International Conference on Acoustics, 2014

2013

Sound source separation based on non-negative tensor factorization incorporating spatial cue as prior knowledge.

Yuki Mitsufuji, Axel Roebel

Proceedings of the IEEE International Conference on Acoustics, 2013