Zhiyao Duan

According to our database, Zhiyao Duan authored at least 114 papers between 2007 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

MusicHiFi: Fast High-Fidelity Stereo Vocoding.

Ge Zhu, Juan Pablo Cáceres, Zhiyao Duan, Nicholas J. Bryan

CoRR, 2024

Toward Fully Self-Supervised Multi-Pitch Estimation.

Frank Cwitkowitz, Zhiyao Duan

CoRR, 2024

Cacophony: An Improved Contrastive Audio-Text Model.

Ge Zhu, Zhiyao Duan

CoRR, 2024

2023

Editorial for TISMIR Special Collection: Cultural Diversity in MIR Research.

Zhiyao Duan, Peter van Kranenburg, Juhan Nam, Preeti Rao

Trans. Int. Soc. Music. Inf. Retr., January, 2023

EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis.

Ge Zhu, Yutong Wen, Marc-André Carbonneau, Zhiyao Duan

CoRR, 2023

SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription.

Yongyi Zang, Yi Zhong, Frank Cwitkowitz, Zhiyao Duan

CoRR, 2023

SingFake: Singing Voice Deepfake Detection.

Yongyi Zang, You Zhang, Mojtaba Heydari, Zhiyao Duan

CoRR, 2023

Phase perturbation improves channel robustness for speech spoofing countermeasures.

Yongyi Zang, You Zhang, Zhiyao Duan

CoRR, 2023

Mitigating Cross-Database Differences for Learning Unified HRTF Representation.

Yutong Wen, You Zhang, Zhiyao Duan

Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2023

Harmonic Analysis With Neural Semi-CRF.

Qiaoyu Yang, Frank Cwitkowitz, Zhiyao Duan

Proceedings of the 24th International Society for Music Information Retrieval Conference, 2023

Transcription Free Filler Word Detection with Neural Semi-CRFs.

Ge Zhu, Yujia Yan, Juan Pablo Cáceres, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2023

HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields.

You Zhang, Yuxiang Wang, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2023

SingNet: a real-time Singing Voice beat and Downbeat Tracking System.

Mojtaba Heydari, Ju-Chiang Wang, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2023

SAMO: Speaker Attractor Multi-Center One-Class Learning For Voice Anti-Spoofing.

Siwen Ding, You Zhang, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2023

2022

Speech Driven Talking Face Generation From a Single Image and an Emotion Condition.

Sefik Emre Eskimez, You Zhang, Zhiyao Duan

IEEE Trans. Multim., 2022

Draw and Listen! A Sketch-Based System for Music Inpainting.

Christodoulos Benetatos, Zhiyao Duan

Trans. Int. Soc. Music. Inf. Retr., 2022

Music Source Separation With Generative Flow.

Ge Zhu, Jordan Darefsky, Fei Jiang, Anton Selitskiy, Zhiyao Duan

IEEE Signal Process. Lett., 2022

ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Rhythm.

Meiying Chen, Zhiyao Duan

CoRR, 2022

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations.

Yuxiang Wang, You Zhang, Zhiyao Duan, Mark Bocko

CoRR, 2022

A Data-Driven Methodology for Considering Feasibility and Pairwise Likelihood in Deep Learning Based Guitar Tablature Transcription Systems.

Frank Cwitkowitz, Jonathan Driedger, Zhiyao Duan

CoRR, 2022

A New Fusion Strategy for Spoofing Aware Speaker Verification.

You Zhang, Ge Zhu, Zhiyao Duan

CoRR, 2022

A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification.

You Zhang, Ge Zhu, Zhiyao Duan

Proceedings of the Odyssey 2022: The Speaker and Language Recognition Workshop, 28 June, 2022

DyViSE: Dynamic Vision-Guided Speaker Embedding for Audio-Visual Speaker Diarization.

Abudukelimu Wuerkaixi, Kunda Yan, You Zhang, Zhiyao Duan, Changshui Zhang

Proceedings of the 24th IEEE International Workshop on Multimedia Signal Processing, 2022

Rethinking Audio-Visual Synchronization for Active Speaker Detection.

Abudukelimu Wuerkaixi, You Zhang, Zhiyao Duan, Changshui Zhang

Proceedings of the 32nd IEEE International Workshop on Machine Learning for Signal Processing, 2022

Singing beat tracking with Self-supervised front-end and linear transformers.

Mojtaba Heydari, Zhiyao Duan

Proceedings of the 23rd International Society for Music Information Retrieval Conference, 2022

A Study of The Robustness of Raw Waveform Based Speaker Embeddings Under Mismatched Conditions.

Ge Zhu, Frank Cwitkowitz, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2022

Progressive Teacher-Student Training Framework for Music Tagging.

Rui Lu, Baigong Zheng, Jiarui Hai, Fei Tao, Zhiyao Duan, Ji Liu

Proceedings of the IEEE International Conference on Acoustics, 2022

A Novel 1D State Space for Efficient Music Rhythmic Analysis.

Mojtaba Heydari, Matthew C. McCallum, Andreas F. Ehmann, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Audiovisual Singing Voice Separation.

Bochen Li, Yuxuan Wang, Zhiyao Duan

Trans. Int. Soc. Music. Inf. Retr., 2021

One-Class Learning Towards Synthetic Voice Spoofing Detection.

You Zhang, Fei Jiang, Zhiyao Duan

IEEE Signal Process. Lett., 2021

Learning Sparse Analytic Filters for Piano Transcription.

Frank Cwitkowitz, Mojtaba Heydari, Zhiyao Duan

CoRR, 2021

UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021.

Xinhui Chen, You Zhang, Ge Zhu, Zhiyao Duan

CoRR, 2021

Skipping the Frame-Level: Event-Based Piano Transcription With Neural Semi-CRFs.

Yujia Yan, Frank Cwitkowitz, Zhiyao Duan

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

CollageNet: Fusing arbitrary melody and accompaniment into a coherent song.

Abudukelimu Wuerkaixi, Christodoulos Benetatos, Zhiyao Duan, Changshui Zhang

Proceedings of the 22nd International Society for Music Information Retrieval Conference, 2021

BeatNet: CRNN and Particle Filtering for Online Joint Beat, Downbeat and Meter Tracking.

Mojtaba Heydari, Frank Cwitkowitz, Zhiyao Duan

Proceedings of the 22nd International Society for Music Information Retrieval Conference, 2021

Y-Vector: Multiscale Waveform Encoder for Speaker Embedding.

Ge Zhu, Fei Jiang, Zhiyao Duan

Proceedings of the Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August, 2021

An Empirical Study on Channel Effects for Synthetic Voice Spoofing Countermeasure Systems.

You Zhang, Ge Zhu, Fei Jiang, Zhiyao Duan

Proceedings of the Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August, 2021

Don't Look Back: An Online Beat Tracking Method Using RNN and Enhanced Particle Filtering.

Mojtaba Heydari, Zhiyao Duan

Proceedings of the IEEE International Conference on Acoustics, 2021

2020

Noise-Resilient Training Method for Face Landmark Generation From Speech.

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

IEEE ACM Trans. Audio Speech Lang. Process., 2020

Speaker Attractor Network: Generalizing Speech Separation to Unseen Numbers of Sources.

Fei Jiang, Zhiyao Duan

IEEE Signal Process. Lett., 2020

Do not look back: an online beat tracking method using RNN and enhanced particle filtering.

Mojtaba Heydari, Zhiyao Duan

CoRR, 2020

One-class learning towards generalized voice spoofing detection.

You Zhang, Fei Jiang, Zhiyao Duan

CoRR, 2020

Raw-x-vector: Multi-scale Time Domain Speaker Embedding Network.

Ge Zhu, Fei Jiang, Zhiyao Duan

CoRR, 2020

Themes Inferred Audio-visual Correspondence Learning.

Runze Su, Fei Tao, Xudong Liu, Haoran Wei, Xiaorong Mei, Zhiyao Duan, Lei Yuan, Ji Liu, Yuying Xie

CoRR, 2020

When Counterpoint Meets Chinese Folk Melodies.

Nan Jiang, Sheng Jin, Zhiyao Duan, Changshui Zhang

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

BachDuet: A Deep Learning System for Human-Machine Counterpoint Improvisation.

Christodoulos Benetatos, Joseph VanderStel, Zhiyao Duan

Proceedings of the 20th International Conference on New Interfaces for Musical Expression, 2020

End-To-End Generation of Talking Faces from Noisy Speech.

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Vroom!: A Search Engine for Sounds by Vocal Imitation Queries.

Yichi Zhang, Junbo Hu, Yiting Zhang, Bryan Pardo, Zhiyao Duan

Proceedings of the CHIIR '20: Conference on Human Information Interaction and Retrieval, 2020

RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning.

Nan Jiang, Sheng Jin, Zhiyao Duan, Changshui Zhang

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications.

Bochen Li, Xinzhao Liu, Karthik Dinesh, Zhiyao Duan, Gaurav Sharma

IEEE Trans. Multim., 2019

Online Audio-Visual Source Association for Chamber Music Performances.

Bochen Li, Karthik Dinesh, Chenliang Xu, Gaurav Sharma, Zhiyao Duan

Trans. Int. Soc. Music. Inf. Retr., 2019

Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation.

Yichi Zhang, Bryan Pardo, Zhiyao Duan

IEEE ACM Trans. Audio Speech Lang. Process., 2019

Audio-Visual Deep Clustering for Speech Separation.

Rui Lu, Zhiyao Duan, Changshui Zhang

IEEE ACM Trans. Audio Speech Lang. Process., 2019

Audiovisual Analysis of Music Performances: Overview of an Emerging Field.

Zhiyao Duan, Slim Essid, Cynthia C. S. Liem, Gaël Richard, Gaurav Sharma

IEEE Signal Process. Mag., 2019

Automatic Music Transcription: An Overview.

Emmanouil Benetos, Simon Dixon, Zhiyao Duan, Sebastian Ewert

IEEE Signal Process. Mag., 2019

Adversarial Training for Speech Super-Resolution.

Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan

IEEE J. Sel. Top. Signal Process., 2019

Spoofing Speaker Verification Systems with Deep Multi-speaker Text-to-speech Synthesis.

Mingrui Yuan, Zhiyao Duan

CoRR, 2019

Sound Search by Text Description or Vocal Imitation?

Yichi Zhang, Yiting Zhang, Zhiyao Duan

CoRR, 2019

Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss.

Lele Chen, Ross K. Maddox, Zhiyao Duan, Chenliang Xu

CoRR, 2019

Audio-Visual Event Localization in the Wild.

Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, Chenliang Xu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

Sound to Visual: Hierarchical Cross-Modal Talking Face Generation.

Lele Chen, Haitian Zheng, Ross K. Maddox, Zhiyao Duan, Chenliang Xu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss.

Lele Chen, Ross K. Maddox, Zhiyao Duan, Chenliang Xu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Listen and Look: Audio-Visual Matching Assisted Speech Source Separation.

Rui Lu, Zhiyao Duan, Changshui Zhang

IEEE Signal Process. Lett., 2018

Front-end speech enhancement for commercial speaker verification systems.

Sefik Emre Eskimez, Peter Soufleris, Zhiyao Duan, Wendi B. Heinzelman

Speech Commun., 2018

Part-invariant Model for Music Generation and Harmonization.

Yujia Yan, Ethan Lustig, Joseph VanderStel, Zhiyao Duan

Proceedings of the 19th International Society for Music Information Retrieval Conference, 2018

Skeleton Plays Piano: Online Generation of Pianist Body Movements from MIDI Performance.

Bochen Li, Akira Maezawa, Zhiyao Duan

Proceedings of the 19th International Society for Music Information Retrieval Conference, 2018

Joint Speaker Diarization and Recognition Using Convolutional and Recurrent Neural Networks.

Zhihan Zhou, Yichi Zhang, Zhiyao Duan

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Visualization and Interpretation of Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation.

Yichi Zhang, Zhiyao Duan

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Score-Aligned Polyphonic Microtiming Estimation.

Xueyang Wang, Ryan Stables, Bochen Li, Zhiyao Duan

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Multi-Scale Recurrent Neural Network for Sound Event Detection.

Rui Lu, Zhiyao Duan, Changshui Zhang

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition.

Sefik Emre Eskimez, Zhiyao Duan, Wendi B. Heinzelman

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Generating Talking Face Landmarks from Speech.

Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan

Proceedings of the Latent Variable Analysis and Signal Separation, 2018

Audio-Visual Event Localization in Unconstrained Videos.

Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, Chenliang Xu

Proceedings of the Computer Vision - ECCV 2018, 2018

Lip Movements Generation at a Glance.

Lele Chen, Zhiheng Li, Ross K. Maddox, Zhiyao Duan, Chenliang Xu

Proceedings of the Computer Vision - ECCV 2018, 2018

Vocal Imitation Set: a dataset of vocally imitated sound events using the AudioSet ontology.

Bongjun Kim, Madhav Ghei, Bryan Pardo, Zhiyao Duan

Proceedings of the Workshop on Detection and Classification of Acoustic Scenes and Events, 2018

2017

Piano Transcription With Convolutional Sparse Lateral Inhibition.

Andrea Cogliati, Zhiyao Duan, Brendt Wohlberg

IEEE Signal Process. Lett., 2017

Enhanced multiclass SVM with thresholding fusion for speech-based emotion classification.

Na Yang, Jianbo Yuan, Yun Zhou, Ilker Demirkol, Zhiyao Duan, Wendi B. Heinzelman, Melissa Sturge-Apple

Int. J. Speech Technol., 2017

IMINET: Convolutional semi-siamese networks for sound search by vocal imitation.

Yichi Zhang, Zhiyao Duan

Proceedings of the 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2017

Metric learning based data augmentation for environmental sound classification.

Rui Lu, Zhiyao Duan, Changshui Zhang

Proceedings of the 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2017

Deep Cross-Modal Audio-Visual Generation.

Lele Chen, Sudhanshu Srivastava, Zhiyao Duan, Chenliang Xu

Proceedings of the on Thematic Workshops of ACM Multimedia 2017, Mountain View, CA, USA, October 23, 2017

Video-Based Vibrato Detection and Analysis for Polyphonic String Music.

Bochen Li, Karthik Dinesh, Gaurav Sharma, Zhiyao Duan

Proceedings of the 18th International Society for Music Information Retrieval Conference, 2017

A Metric for Music Notation Transcription Accuracy.

Andrea Cogliati, Zhiyao Duan

Proceedings of the 18th International Society for Music Information Retrieval Conference, 2017

Deep ranking: Triplet MatchNet for music metric learning.

Rui Lu, Kailun Wu, Zhiyao Duan, Changshui Zhang

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

See and listen: Score-informed association of sound tracks to players in chamber music performance videos.

Bochen Li, Karthik Dinesh, Zhiyao Duan, Gaurav Sharma

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

Visually informed multi-pitch analysis of string ensembles.

Karthik Dinesh, Bochen Li, Xinzhao Liu, Zhiyao Duan, Gaurav Sharma

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

2016

An Approach to Score Following for Piano Performances With the Sustained Effect.

Bochen Li, Zhiyao Duan

IEEE ACM Trans. Audio Speech Lang. Process., 2016

Context-Dependent Piano Music Transcription With Convolutional Sparse Coding.

Andrea Cogliati, Zhiyao Duan, Brendt Wohlberg

IEEE ACM Trans. Audio Speech Lang. Process., 2016

Creating A Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications.

Bochen Li, Xinzhao Liu, Karthik Dinesh, Zhiyao Duan, Gaurav Sharma

CoRR, 2016

Transcribing Human Piano Performances into Music Notation.

Andrea Cogliati, David Temperley, Zhiyao Duan

Proceedings of the 17th International Society for Music Information Retrieval Conference, 2016

WISE: Web-based Interactive Speech Emotion Classification.

Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi B. Heinzelman

Proceedings of the 4th Workshop on Sentiment Analysis where AI meets Psychology (SAAIP 2016) co-located with 25th International Joint Conference on Artificial Intelligence (IJCAI 2016), 2016

IMISOUND: An unsupervised system for sound query by vocal imitation.

Yichi Zhang, Zhiyao Duan

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

Emotion classification: How does an automated system compare to Naive human coders?

Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi B. Heinzelman

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

Rotational reset strategy for online semi-supervised NMF-based speech enhancement for long recordings.

Jun Zhou, Shuo Chen, Zhiyao Duan

Proceedings of the 2015 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2015

Retrieving sounds by vocal imitation recognition.

Yichi Zhang, Zhiyao Duan

Proceedings of the 25th IEEE International Workshop on Machine Learning for Signal Processing, 2015

Piano music transcription with fast convolutional sparse coding.

Andrea Cogliati, Zhiyao Duan, Brendt Wohlberg

Proceedings of the 25th IEEE International Workshop on Machine Learning for Signal Processing, 2015

Score Following for Piano Performances with Sustain-Pedal Effects.

Bochen Li, Zhiyao Duan

Proceedings of the 16th International Society for Music Information Retrieval Conference, 2015

Piano music transcription modeling note temporal evolution.

Andrea Cogliati, Zhiyao Duan

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

2014

Combining rhythm-based and pitch-based methods for background and melody separation.

Zafar Rafii, Zhiyao Duan, Bryan Pardo

IEEE ACM Trans. Audio Speech Lang. Process., 2014

Multi-pitch Streaming of Harmonic Sound Mixtures.

Zhiyao Duan, Jinyu Han, Bryan Pardo

IEEE ACM Trans. Audio Speech Lang. Process., 2014

Note-level Music Transcription by Maximum Likelihood Sampling.

Zhiyao Duan, David Temperley

Proceedings of the 15th International Society for Music Information Retrieval Conference, 2014

A novel cepstral representation for timbre modeling of sound sources in polyphonic mixtures.

Zhiyao Duan, Bryan Pardo, Laurent Daudet

Proceedings of the IEEE International Conference on Acoustics, 2014

2012

Speech Enhancement by Online Non-negative Spectrogram Decomposition in Non-stationary Noise Environments.

Zhiyao Duan, Gautham J. Mysore, Paris Smaragdis

Proceedings of the INTERSPEECH 2012, 2012

Online PLCA for Real-Time Semi-supervised Source Separation.

Zhiyao Duan, Gautham J. Mysore, Paris Smaragdis

Proceedings of the Latent Variable Analysis and Signal Separation, 2012

2011

Soundprism: An Online System for Score-Informed Source Separation of Music Audio.

Zhiyao Duan, Bryan Pardo

IEEE J. Sel. Top. Signal Process., 2011

Aligning Semi-Improvised Music Audio with Its Lead Sheet.

Zhiyao Duan, Bryan Pardo

Proceedings of the 12th International Society for Music Information Retrieval Conference, 2011

A state space model for online polyphonic audio-score alignment.

Zhiyao Duan, Bryan Pardo

Proceedings of the IEEE International Conference on Acoustics, 2011

2010

Multiple Fundamental Frequency Estimation by Modeling Spectral Peaks and Non-Peak Regions.

Zhiyao Duan, Bryan Pardo, Changshui Zhang

IEEE Trans. Speech Audio Process., 2010

Song-level multi-pitch tracking by heavily constrained clustering.

Zhiyao Duan, Jinyu Han, Bryan Pardo

Proceedings of the IEEE International Conference on Acoustics, 2010

2009

Harmonically Informed Multi-Pitch Tracking.

Zhiyao Duan, Jinyu Han, Bryan Pardo

Proceedings of the 10th International Society for Music Information Retrieval Conference, 2009

2008

Unsupervised Single-Channel Music Source Separation by Average Harmonic Structure Modeling.

Zhiyao Duan, Yungang Zhang, Changshui Zhang, Zhenwei Shi

IEEE Trans. Speech Audio Process., 2008

Collective Annotation of Music from Multiple Semantic Categories.

Zhiyao Duan, Lie Lu, Changshui Zhang

Proceedings of the ISMIR 2008, 2008

Audio tonality mode classification without tonic annotations.

Zhiyao Duan, Lie Lu, Changshui Zhang

Proceedings of the 2008 IEEE International Conference on Multimedia and Expo, 2008

2007

Multi-Pitch Estimation Based on Partial Event and Support Transfer.

Zhiyao Duan, Dan Zhang, Changshui Zhang, Zhenwei Shi

Proceedings of the 2007 IEEE International Conference on Multimedia and Expo, 2007

Excitation signal Extraction for Guitar tones.

Nelson Lee, Zhiyao Duan, Julius O. Smith III

Proceedings of the 2007 International Computer Music Conference, 2007