Xin Wang

According to our database, Xin Wang authored at least 83 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Muffin or Chihuahua? Challenging Large Vision-Language Models with Multipanel VQA.

Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Xinze Guan, Xin Eric Wang

CoRR, 2024

2023

ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models.

Kaiwen Zhou, Kwonjoon Lee, Teruhisa Misu, Xin Eric Wang

CoRR, 2023

Evaluating Multi-Agent Coordination Abilities in Large Language Models.

Saaket Agashe, Yue Fan, Xin Eric Wang

CoRR, 2023

MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens.

Kaizhi Zheng, Xuehai He, Xin Eric Wang

CoRR, 2023

T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation.

Jialu Wang, Xinyue Gabby Liu, Zonglin Di, Yang Liu, Xin Eric Wang

CoRR, 2023

R2H: Building Multimodal Navigation Helpers that Respond to Help.

Yue Fan, Kaizhi Zheng, Jing Gu, Xin Eric Wang

CoRR, 2023

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation.

Wanrong Zhu, Xinyi Wang, Yujie Lu, Tsu-Jui Fu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang

CoRR, 2023

Discriminative Diffusion Models as Few-shot Vision and Language Learners.

Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang

CoRR, 2023

Multimodal Procedural Planning via Dual Text-Image Prompting.

Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Eric Wang, William Yang Wang

CoRR, 2023

CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirection.

Swati Jindal, Xin Eric Wang

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation.

Yujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

PHOTOSWAP: Personalized Subject Swapping in Images.

Jing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, Hyunjoon Jung, Xin Eric Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models.

Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation.

Kaiwen Zhou, Kaizhi Zheng, Connor Pryor, Yilin Shen, Hongxia Jin, Lise Getoor, Xin Eric Wang

Proceedings of the International Conference on Machine Learning, 2023

Neuro-Symbolic Procedural Planning with Commonsense Prompting.

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis.

Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment.

Zhen Zhang, Jialu Wang, Xin Eric Wang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Visualize Before You Write: Imagination-Guided Open-Ended Text Generation.

Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

Multimodal Graph Transformer for Multimodal Question Answering.

Xuehai He, Xin Eric Wang

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation.

Jialu Wang, Xinyue Liu, Zonglin Di, Yang Liu, Xin Eric Wang

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Parameter-Efficient Model Adaptation for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

ComCLIP: Training-Free Compositional Image and Text Matching.

Kenan Jiang, Xuehai He, Ruize Xu, Xin Eric Wang

CoRR, 2022

Anticipating the Unseen Discrepancy for Vision and Language Navigation.

Yujie Lu, Huiliang Zhang, Ping Nie, Weixi Feng, Wenda Xu, Xin Eric Wang, William Yang Wang

CoRR, 2022

JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents.

Kaizhi Zheng, Kaiwen Zhou, Jing Gu, Yue Fan, Jialu Wang, Zonglin Di, Xuehai He, Xin Eric Wang

CoRR, 2022

Neuro-Symbolic Causal Language Planning with Commonsense Prompting.

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang

CoRR, 2022

Aerial Vision-and-Dialog Navigation.

Yue Fan, Winson Chen, Tongzhou Jiang, Chun Zhou, Yi Zhang, Xin Eric Wang

CoRR, 2022

Parameter-efficient Fine-tuning for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

CoRR, 2022

VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation.

Kaizhi Zheng, Xiaotong Chen, Odest Chadwicke Jenkins, Xin Eric Wang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Diagnosing Vision-and-Language Navigation: What Really Matters.

Wanrong Zhu, Yuankai Qi, Pradyumna Narayana, Kazoo Sone, Sugato Basu, Xin Wang, Qi Wu, Miguel P. Eckstein, William Yang Wang

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Imagination-Augmented Natural Language Understanding.

Yujie Lu, Wanrong Zhu, Xin Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Understanding Instance-Level Impact of Fairness Constraints.

Jialu Wang, Xin Eric Wang, Yang Liu

Proceedings of the International Conference on Machine Learning, 2022

CPL: Counterfactual Prompt Learning for Vision and Language Models.

Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun R. Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Wang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

FedVLN: Privacy-Preserving Federated Vision-and-Language Navigation.

Kaiwen Zhou, Xin Eric Wang

Proceedings of the Computer Vision - ECCV 2022, 2022

Language-Driven Artistic Style Transfer.

Tsu-Jui Fu, Xin Eric Wang, William Yang Wang

Proceedings of the Computer Vision - ECCV 2022, 2022

M³L: Language-based Video Editing via Multi-Modal Multi-Level Transformers.

Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning.

Juncheng Li, Junlin Xie, Long Qian, Linchao Zhu, Siliang Tang, Fei Wu, Yi Yang, Yueting Zhuang, Xin Eric Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Assessing Multilingual Fairness in Pre-trained Multimodal Representations.

Jialu Wang, Yang Liu, Xin Eric Wang

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Masking.

Tianyi Luo, Rui Meng, Xin Wang, Yang Liu

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions.

Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Wang

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Vision-Language Navigation Policy Learning and Adaptation.

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Wang, William Yang Wang, Lei Zhang

IEEE Trans. Pattern Anal. Mach. Intell., 2021

CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection.

Swati Jindal, Xin Eric Wang

CoRR, 2021

ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation.

Wanrong Zhu, Xin Eric Wang, An Yan, Miguel P. Eckstein, William Yang Wang

CoRR, 2021

Language-Driven Image Style Transfer.

Tsu-Jui Fu, Xin Eric Wang, William Yang Wang

CoRR, 2021

Language-based Video Editing via Multi-Modal Multi-Level Transformer.

Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

CoRR, 2021

Visual Question Rewriting for Increasing Response Rate.

Jiayi Wei, Xilian Li, Yi Zhang, Xin Eric Wang

Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation.

Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Wang, William Yang Wang, Tamara L. Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search.

Jialu Wang, Yang Liu, Xin Eric Wang

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation.

Wanrong Zhu, Xin Wang, Tsu-Jui Fu, An Yan, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

L2C: Describing Visual Differences Needs Semantic Understanding of Individuals.

An Yan, Xin Wang, Tsu-Jui Fu, William Yang Wang

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

2020

Closing the Loop Between Language and Vision for Embodied Agents.

Xin Wang

PhD thesis, 2020

Relational Graph Learning for Grounded Video Description Generation.

Wenqiao Zhang, Xin Eric Wang, Siliang Tang, Haizhou Shi, Haochen Shi, Jun Xiao, Yueting Zhuang, William Yang Wang

Proceedings of the MM '20: The 28th ACM International Conference on Multimedia, 2020

Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations.

Wanrong Zhu, Xin Wang, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation.

Jiannan Xiang, Xin Wang, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

SSCR: Iterative Language-Based Image Editing via Self-Supervised Counterfactual Reasoning.

Tsu-Jui Fu, Xin Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Environment-Agnostic Multitask Learning for Natural Language Grounded Navigation.

Xin Eric Wang, Vihan Jain, Eugene Ie, William Yang Wang, Zornitsa Kozareva, Sujith Ravi

Proceedings of the Computer Vision - ECCV 2020, 2020

Counterfactual Vision-and-Language Navigation via Adversarial Path Sampler.

Tsu-Jui Fu, Xin Eric Wang, Matthew F. Peterson, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

Proceedings of the Computer Vision - ECCV 2020, 2020

REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments.

Yuankai Qi, Qi Wu, Peter Anderson, Xin Wang, William Yang Wang, Chunhua Shen, Anton van den Hengel

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation.

Juncheng Li, Xin Wang, Siliang Tang, Haizhou Shi, Fei Wu, Yueting Zhuang, William Yang Wang

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphs.

Pengda Qin, Xin Wang, Wenhu Chen, Chunyun Zhang, Weiran Xu, William Yang Wang

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Counterfactual Vision-and-Language Navigation via Adversarial Path Sampling.

Tsu-Jui Fu, Xin Wang, Matthew F. Peterson, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

CoRR, 2019

Cross-Lingual Vision-Language Navigation.

An Yan, Xin Wang, Jiangtao Feng, Lei Li, William Yang Wang

CoRR, 2019

Not All Actions Are Equal: Learning to Stop in Language-Grounded Urban Navigation.

Jiannan Xiang, Xin Wang, William Yang Wang

Proceedings of the Visually Grounded Interaction and Language (ViGIL), 2019

Natural Language Grounded Multitask Navigation.

Xin Wang, Vihan Jain, Eugene Ie, William Yang Wang, Zornitsa Kozareva, Sujith Ravi

Proceedings of the Visually Grounded Interaction and Language (ViGIL), 2019

Extract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation.

Jiawei Wu, Xin Wang, William Yang Wang

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

VaTeX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research.

Xin Wang, Jiawei Wu, Junkun Chen, Lei Li, Yuan-Fang Wang, William Yang Wang

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

TIGEr: Text-to-Image Grounding for Image Caption Evaluation.

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

MAN: Moment Alignment Network for Natural Language Moment Retrieval via Iterative Graph Adjustment.

Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang, Larry S. Davis

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation.

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Wang, William Yang Wang, Lei Zhang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Self-Supervised Dialogue Learning.

Jiawei Wu, Xin Wang, William Yang Wang

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Self-Supervised Learning for Contextualized Extractive Summarization.

Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, William Yang Wang

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models.

Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning.

Xin Wang, Jiawei Wu, Da Zhang, Yu Su, William Yang Wang

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Virtual dictionary based kernel sparse representation for face recognition.

Zizhu Fan, Da Zhang, Xin Wang, Qi Zhu, Yuan-Fang Wang

Pattern Recognit., 2018

Enhancing the Robustness of Prior Network in Out-of-Distribution Detection.

Wenhu Chen, Yilin Shen, Xin Wang, William Yang Wang

CoRR, 2018

Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning.

Xin Wang, Yuan-Fang Wang, William Yang Wang

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

XL-NBT: A Cross-lingual Neural Belief Tracking Framework.

Wenhu Chen, Jianshu Chen, Yu Su, Xin Wang, Dong Yu, Xifeng Yan, William Yang Wang

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation.

Xin Wang, Wenhan Xiong, Hongmin Wang, William Yang Wang

Proceedings of the Computer Vision - ECCV 2018, 2018

Video Captioning via Hierarchical Reinforcement Learning.

Xin Wang, Wenhu Chen, Jiawei Wu, Yuan-Fang Wang, William Yang Wang

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

S3D: Single Shot multi-Span Detector via Fully 3D Convolutional Networks.

Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang

Proceedings of the British Machine Vision Conference 2018, 2018

No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling.

Xin Wang, Wenhu Chen, Yuan-Fang Wang, William Yang Wang

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Deep Reinforcement Learning for Visual Object Tracking in Videos.

Da Zhang, Hamid Maei, Xin Wang, Yuan-Fang Wang

CoRR, 2017

Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer.

Xin Wang, Geoffrey Oxholm, Da Zhang, Yuan-Fang Wang

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2013

A Novel Information Search and Recommendation Services Platform Based on an Indexing Network (Short Paper).

Xiaodong Deng, Ming Jiang, Haichun Sun, Yangjie Zhang, Junjun Liu, Yu Guo, Xin Wang, Dajie Ge, Pengwei Wang, Zhijun Ding, Hongzhong Chen

Proceedings of the 2013 IEEE 6th International Conference on Service-Oriented Computing and Applications, 2013