Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal.

[BibT_eX]

[DOI]

Hanting Wang

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting.

[BibT_eX]

[DOI]

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

Speech Token Prediction via Compressed-to-fine Language Modeling for Speech Generation.

[BibT_eX]

[DOI]

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

Multimodal Conditional Retrieval with High Controllability.

[BibT_eX]

[DOI]

Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining, V.2, 2025

Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval.

[BibT_eX]

[DOI]

Proceedings of the 26th Annual Conference of the International Speech Communication Association, 2025

IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models.

[BibT_eX]

[DOI]

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Diff-Prompt: Diffusion-Driven Prompt Generator with Mask Supervision.

[BibT_eX]

[DOI]

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noises.

[BibT_eX]

[DOI]

Zirun Guo

Tao Jin

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup.

[BibT_eX]

[DOI]

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?

[BibT_eX]

[DOI]

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces.

[BibT_eX]

[DOI]

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Open-Set Cross Modal Generalization via Multimodal Unified Representation.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Curriculum Learning aided Audio-Visual Speech Recognition with Arbitrary Speaker Number.

[BibT_eX]

[DOI]

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

PACHAT: Persona-Aware Speech Assistant for Multi-party Dialogue.

[BibT_eX]

[DOI]

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

Towards Transformer-Based Aligned Generation with Self-Coherence Guidance.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

ConceptGuard: Continual Personalized Text-to-Image Generation with Forgetting and Confusion Mitigation.

[BibT_eX]

[DOI]

Zirun Guo

Tao Jin

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics, 2025

T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback.

[BibT_eX]

[DOI]

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

Speech Watermarking with Discrete Intermediate Representations.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, 2025

A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, 2025

Bridging the Gap for Test-Time Multimodal Sentiment Analysis.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, 2025

2024

Multi-Granularity Relational Attention Network for Audio-Visual Question Answering.

[BibT_eX]

[DOI]

IEEE Trans. Circuits Syst. Video Technol., August, 2024

GTADT: Gated tone-sensitive acne grading via augmented domain transfer.

[BibT_eX]

[DOI]

Multim. Tools Appl., 2024

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup.

[BibT_eX]

[DOI]

CoRR, 2024

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.

[BibT_eX]

[DOI]

CoRR, 2024

Extending Multi-modal Contrastive Representations.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

E<sup>3</sup>: Exploring Embodied Emotion Through A Large-Scale Egocentric Video Dataset.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Action Imitation in Common Action Space for Customized Action Image Synthesis.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Classifier-guided Gradient Modulation for Enhanced Multimodal Learning.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt.

[BibT_eX]

[DOI]

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning.

[BibT_eX]

[DOI]

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Low-rank Prompt Interaction for Continual Vision-Language Retrieval.

[BibT_eX]

[DOI]

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts.

[BibT_eX]

[DOI]

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding.

[BibT_eX]

[DOI]

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.

[BibT_eX]

[DOI]

Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2024

Non-confusing Generation of Customized Concepts in Diffusion Models.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

AudioVSR: Enhancing Video Speech Recognition with Audio Data.

[BibT_eX]

[DOI]

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation.

[BibT_eX]

[DOI]

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment.

[BibT_eX]

[DOI]

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition.

[BibT_eX]

[DOI]

Zirun Guo

Tao Jin

Zhou Zhao

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Electromagnetic Imaging Boosted Visual Object Recognition Under Difficult Visual Conditions.

[BibT_eX]

[DOI]

IEEE Trans. Geosci. Remote. Sens., 2023

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.

[BibT_eX]

[DOI]

CoRR, 2023

Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers.

[BibT_eX]

[DOI]

CoRR, 2023

Extending Multi-modal Contrastive Representations.

[BibT_eX]

[DOI]

CoRR, 2023

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.

[BibT_eX]

[DOI]

CoRR, 2023

Rethinking Missing Modality Learning from a Decoding Perspective.

[BibT_eX]

[DOI]

Proceedings of the 31st ACM International Conference on Multimedia, 2023

Exploring Group Video Captioning with Efficient Relational Approximation.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Gloss Attention for Gloss-free Sign Language Translation.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

DATE: Domain Adaptive Product Seeker for E-Commerce.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning.

[BibT_eX]

[DOI]

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Semantic-conditioned Dual Adaptation for Cross-domain Query-based Visual Segmentation.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

TAVT: Towards Transferable Audio-Visual Text Generation.

[BibT_eX]

[DOI]

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment.

[BibT_eX]

[DOI]

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Interaction augmented transformer with decoupled decoding for video captioning.

[BibT_eX]

[DOI]

Neurocomputing, 2022

MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation.

[BibT_eX]

[DOI]

Proceedings of the MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10, 2022

Prior Knowledge and Memory Enriched Transformer for Sign Language Translation.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

2021

Generalizable Multi-linear Attention Network.

[BibT_eX]

[DOI]

Tao Jin

Zhou Zhao

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation.

[BibT_eX]

[DOI]

Tao Jin

Zhou Zhao

Proceedings of the MM '21: ACM Multimedia Conference, Virtual Event, China, October 20, 2021

2020

SBAT: Video Captioning with Sparse Boundary-Aware Transformer.

[BibT_eX]

[DOI]

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

Dual Low-Rank Multimodal Fusion.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

2019

Recurrent convolutional video captioning with global and local attention.

[BibT_eX]

[DOI]

Tao Jin

Yingming Li

Zhongfei Zhang

Neurocomputing, 2019

Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning.

[BibT_eX]

[DOI]

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Tao Jin

Timeline

Legend:

Links

Online presence:

On csauthors.net:

Bibliography

Loading...