Research on the Integration Techniques of Task-Oriented Geospatial Information Service for Battlefield. - Zhe Gan; Xiaoan Tang; Yaomin Yang; Haiyan Yang; Maoyin Sun (ESIAT (2), 2009)

A General Geo-spatial Multi-scale Conceptual Model for Automatic Generalization. - Yaoming Yang; Xiaoan Tang; Zhe Gan; Haiyan Jiang (ESIAT (2), 2009)

Learning Deep Sigmoid Belief Networks with Data Augmentation. - Zhe Gan; Ricardo Henao; David E. Carlson; Lawrence Carin (AISTATS, 2015)

Scalable Deep Poisson Factor Analysis for Topic Modeling. - Zhe Gan; Changyou Chen; Ricardo Henao; David E. Carlson; Lawrence Carin (ICML, 2015)

Deep Temporal Sigmoid Belief Networks for Sequence Modeling. - Zhe Gan; Chunyuan Li; Ricardo Henao; David E. Carlson; Lawrence Carin (NIPS, 2015)

Deep Poisson Factor Modeling. - Ricardo Henao; Zhe Gan; James Lu; Lawrence Carin (NIPS, 2015)

Inference of gene networks associated with the host response to infectious disease. - Zhe Gan; Xin Yuan 002; Ricardo Henao; Ephraim L. Tsalik; Lawrence Carin (Big Data over Networks, 2016)

Bridging the Gap between Stochastic Gradient MCMC and Stochastic Optimization. - Changyou Chen; David E. Carlson; Zhe Gan; Chunyuan Li; Lawrence Carin (AISTATS, 2016)

Learning Weight Uncertainty with Stochastic Gradient MCMC for Shape Classification. - Chunyuan Li; Andrew Stevens 005; Changyou Chen; Yunchen Pu; Zhe Gan; Lawrence Carin (CVPR, 2016)

Factored Temporal Sigmoid Belief Networks for Sequence Learning. - Jiaming Song; Zhe Gan; Lawrence Carin (ICML, 2016)

Variational Autoencoder for Deep Learning of Images, Labels and Captions. - Yunchen Pu; Zhe Gan; Ricardo Henao; Xin Yuan 002; Chunyuan Li; Andrew Stevens 005; Lawrence Carin (NIPS, 2016)

Unsupervised Learning of Sentence Representations using Convolutional Neural Networks. - Zhe Gan; Yunchen Pu; Ricardo Henao; Chunyuan Li; Xiaodong He 001; Lawrence Carin (CoRR, 2016)

Unsupervised Learning with Truncated Gaussian Graphical Models. - Qinliang Su; Xuejun Liao; Chunyuan Li; Zhe Gan; Lawrence Carin (AAAI, 2017)

Scalable Bayesian Learning of Recurrent Neural Networks for Language Modeling. - Zhe Gan; Chunyuan Li; Changyou Chen; Yunchen Pu; Qinliang Su; Lawrence Carin (ACL (1), 2017)

StyleNet: Generating Attractive Visual Captions with Styles. - Chuang Gan 001; Zhe Gan; Xiaodong He 001; Jianfeng Gao 001; Li Deng 001 (CVPR, 2017)

Semantic Compositional Networks for Visual Captioning. - Zhe Gan; Chuang Gan 001; Xiaodong He 001; Yunchen Pu; Kenneth Tran; Jianfeng Gao 001; Lawrence Carin; Li Deng 001 (CVPR, 2017)

Learning Generic Sentence Representations Using Convolutional Neural Networks. - Zhe Gan; Yunchen Pu; Ricardo Henao; Chunyuan Li; Xiaodong He 001; Lawrence Carin (EMNLP, 2017)

Character-level deep conflation for business data analytics. - Zhe Gan; P. D. Singh; Ameet Joshi; Xiaodong He 001; Jianshu Chen; Jianfeng Gao 001; Li Deng 001 (ICASSP, 2017)

Adaptive DCTNet for audio signal classification. - Yin Xian; Yunchen Pu; Zhe Gan; Liang Lu; Andrew Thompson 001 (ICASSP, 2017)

Adaptive Feature Abstraction for Translating Video to Language. - Yunchen Pu; Martin Renqiang Min; Zhe Gan; Lawrence Carin (ICLR (Workshop), 2017)

Stochastic Gradient Monomial Gamma Sampler. - Yizhe Zhang 002; Changyou Chen; Zhe Gan; Ricardo Henao; Lawrence Carin (ICML, 2017)

Adversarial Feature Matching for Text Generation. - Yizhe Zhang 002; Zhe Gan; Kai Fan 002; Zhi Chen 009; Ricardo Henao; Dinghan Shen; Lawrence Carin (ICML, 2017)

Triangle Generative Adversarial Networks. - Zhe Gan; Liqun Chen 001; Weiyao Wang 002; Yunchen Pu; Yizhe Zhang 002; Hao Liu 015; Chunyuan Li; Lawrence Carin (NIPS, 2017)

VAE Learning via Stein Variational Gradient Descent. - Yunchen Pu; Zhe Gan; Ricardo Henao; Chunyuan Li; Shaobo Han; Lawrence Carin (NIPS, 2017)

Adversarial Symmetric Variational Autoencoder. - Yunchen Pu; Weiyao Wang 002; Ricardo Henao; Liqun Chen 001; Zhe Gan; Chunyuan Li; Lawrence Carin (NIPS, 2017)

Deconvolutional Paragraph Representation Learning. - Yizhe Zhang 002; Dinghan Shen; Guoyin Wang 002; Zhe Gan; Ricardo Henao; Lawrence Carin (NIPS, 2017)

Stein Variational Autoencoder. - Yunchen Pu; Zhe Gan; Ricardo Henao; Chunyuan Li; Shaobo Han; Lawrence Carin (CoRR, 2017)

Adaptive Feature Abstraction for Translating Video to Text. - Yunchen Pu; Martin Renqiang Min; Zhe Gan; Lawrence Carin (AAAI, 2018)

Topic Compositional Neural Language Model. - Wenlin Wang; Zhe Gan; Wenqi Wang 001; Dinghan Shen; Jiaji Huang; Wei Ping; Sanjeev Satheesh; Lawrence Carin (AISTATS, 2018)

AttnGAN: Fine-Grained Text to Image Generation With Attentional Generative Adversarial Networks. - Tao Xu; Pengchuan Zhang; Qiuyuan Huang; Han Zhang 010; Zhe Gan; Xiaolei Huang 001; Xiaodong He 001 (CVPR, 2018)

JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets. - Yunchen Pu; Shuyang Dai; Zhe Gan; Weiyao Wang 002; Guoyin Wang 002; Yizhe Zhang 002; Ricardo Henao; Lawrence Carin (ICML, 2018)

Multi-Label Learning from Medical Plain Text with Convolutional Residual Models. - Xinyuan Zhang 001; Ricardo Henao; Zhe Gan; Yitong Li 001; Lawrence Carin (MLHC, 2018)

Adversarial Text Generation via Feature-Mover's Distance. - Liqun Chen 001; Shuyang Dai; Chenyang Tao; Haichao Zhang; Zhe Gan; Dinghan Shen; Yizhe Zhang 002; Guoyin Wang 002; Ruiyi Zhang 002; Lawrence Carin (NeurIPS, 2018)

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization. - Yizhe Zhang 002; Michel Galley; Jianfeng Gao 001; Zhe Gan; Xiujun Li; Chris Brockett; Bill Dolan (NeurIPS, 2018)

Adversarial Text Generation via Feature-Mover's Distance. - Liqun Chen 001; Shuyang Dai; Chenyang Tao; Dinghan Shen; Zhe Gan; Haichao Zhang; Yizhe Zhang 002; Lawrence Carin (CoRR, 2018)

Sequence Generation with Guider Network. - Ruiyi Zhang 002; Changyou Chen; Zhe Gan; Wenlin Wang; Liqun Chen 001; Dinghan Shen; Guoyin Wang 002; Lawrence Carin (CoRR, 2018)

Sequential Attention GAN for Interactive Image Editing via Dialogue. - Yu Cheng 001; Zhe Gan; Yitong Li 001; Jingjing Liu 001; Jianfeng Gao 001 (CoRR, 2018)

Deep Generative Models for Vision and Language Intelligence. - Zhe Gan (2018)

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation. - Qiuyuan Huang; Zhe Gan; Asli Celikyilmaz; Dapeng Oliver Wu; Jianfeng Wang; Xiaodong He 001 (AAAI, 2019)

Multi-step Reasoning via Recurrent Dual Attention for Visual Dialog. - Zhe Gan; Yu Cheng 001; Ahmed El Kholy; Linjie Li; Jingjing Liu 001; Jianfeng Gao 001 (ACL (1), 2019)

Tactical Rewind: Self-Correction via Backtracking in Vision-And-Language Navigation. - Liyiming Ke; Xiujun Li; Yonatan Bisk; Ari Holtzman; Zhe Gan; Jingjing Liu 001; Jianfeng Gao 001; Yejin Choi 001; Siddhartha S. Srinivasa (CVPR, 2019)

StoryGAN: A Sequential Conditional GAN for Story Visualization. - Yitong Li 001; Zhe Gan; Yelong Shen; Jingjing Liu 001; Yu Cheng 001; Yuexin Wu; Lawrence Carin; David E. Carlson; Jianfeng Gao 001 (CVPR, 2019)

TIGEr: Text-to-Image Grounding for Image Caption Evaluation. - Ming Jiang 018; Qiuyuan Huang; Lei Zhang 001; Xin Wang 061; Pengchuan Zhang; Zhe Gan; Jana Diesner; Jianfeng Gao 001 (EMNLP/IJCNLP (1), 2019)

Domain Adaptive Text Style Transfer. - Dianqi Li; Yizhe Zhang 002; Zhe Gan; Yu Cheng 001; Chris Brockett; Bill Dolan; Ming-Ting Sun (EMNLP/IJCNLP (1), 2019)

Patient Knowledge Distillation for BERT Model Compression. - Siqi Sun; Yu Cheng 001; Zhe Gan; Jingjing Liu 001 (EMNLP/IJCNLP (1), 2019)

Adversarial Domain Adaptation for Machine Reading Comprehension. - Huazheng Wang; Zhe Gan; Xiaodong Liu 003; Jingjing Liu 001; Jianfeng Gao 001; Hongning Wang (EMNLP/IJCNLP (1), 2019)

Relation-Aware Graph Attention Network for Visual Question Answering. - Linjie Li; Zhe Gan; Yu Cheng 001; Jingjing Liu 001 (ICCV, 2019)

Improving Sequence-to-Sequence Learning via Optimal Transport. - Liqun Chen 001; Yizhe Zhang 002; Ruiyi Zhang 002; Chenyang Tao; Zhe Gan; Haichao Zhang; Bai Li 001; Dinghan Shen; Changyou Chen; Lawrence Carin (ICLR (Poster), 2019)

Topic-Guided Variational Auto-Encoder for Text Generation. - Wenlin Wang; Zhe Gan; Hongteng Xu; Ruiyi Zhang 002; Guoyin Wang 002; Dinghan Shen; Changyou Chen; Lawrence Carin (NAACL-HLT (1), 2019)

Improving Textual Network Learning with Variational Homophilic Embeddings. - Wenlin Wang; Chenyang Tao; Zhe Gan; Guoyin Wang 002; Liqun Chen 001; Xinyuan Zhang 001; Ruiyi Zhang 002; Qian Yang 003; Ricardo Henao; Lawrence Carin (NeurIPS, 2019)

Topic-Guided Variational Autoencoders for Text Generation. - Wenlin Wang; Zhe Gan; Hongteng Xu; Ruiyi Zhang 002; Guoyin Wang 002; Dinghan Shen; Changyou Chen; Lawrence Carin (CoRR, 2019)

UNITER: Learning UNiversal Image-TExt Representations. - Yen-Chun Chen 001; Linjie Li; Licheng Yu; Ahmed El Kholy; Faisal Ahmed 001; Zhe Gan; Yu Cheng 001; Jingjing Liu 001 (CoRR, 2019)

FreeLB: Enhanced Adversarial Training for Language Understanding. - Chen Zhu 001; Yu Cheng 001; Zhe Gan; Siqi Sun; Tom Goldstein; Jingjing Liu 001 (CoRR, 2019)

Discourse-Aware Neural Extractive Model for Text Summarization. - Jiacheng Xu; Zhe Gan; Yu Cheng 001; Jingjing Liu 001 (CoRR, 2019)

Distilling the Knowledge of BERT for Text Generation. - Yen-Chun Chen 001; Zhe Gan; Yu Cheng 001; Jingzhou Liu; Jingjing Liu 001 (CoRR, 2019)

What Makes A Good Story? Designing Composite Rewards for Visual Storytelling. - Junjie Hu 001; Yu Cheng 001; Zhe Gan; Jingjing Liu 001; Jianfeng Gao 001; Graham Neubig (AAAI, 2020)

Graph-Driven Generative Models for Heterogeneous Multi-Task Learning. - Wenlin Wang; Hongteng Xu; Zhe Gan; Bai Li 001; Guoyin Wang 002; Liqun Chen 001; Qian Yang 003; Wenqi Wang 001; Lawrence Carin (AAAI, 2020)

Contrastively Smoothed Class Alignment for Unsupervised Domain Adaptation. - Shuyang Dai; Yu Cheng 001; Yizhe Zhang 002; Zhe Gan; Jingjing Liu 001; Lawrence Carin (ACCV (4), 2020)

MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network. - Yi Wei 006; Zhe Gan; Wenbo Li 001; Siwei Lyu; Ming-Ching Chang; Lei Zhang 001; Jianfeng Gao 001; Pengchuan Zhang (ACCV (4), 2020)

Distilling Knowledge Learned in BERT for Text Generation. - Yen-Chun Chen 001; Zhe Gan; Yu Cheng 001; Jingzhou Liu; Jingjing Liu 001 (ACL, 2020)

Discourse-Aware Neural Extractive Text Summarization. - Jiacheng Xu; Zhe Gan; Yu Cheng 001; Jingjing Liu 001 (ACL, 2020)

Improving Adversarial Text Generation by Modeling the Distant Future. - Ruiyi Zhang 002; Changyou Chen; Zhe Gan; Wenlin Wang; Dinghan Shen; Guoyin Wang 002; Zheng Wen; Lawrence Carin (ACL, 2020)

Nested-Wasserstein Self-Imitation Learning for Sequence Generation. - Ruiyi Zhang 002; Changyou Chen; Zhe Gan; Zheng Wen; Wenlin Wang; Lawrence Carin (AISTATS, 2020)

BachGAN: High-Resolution Image Synthesis From Salient Object Layout. - Yandong Li; Yu Cheng 001; Zhe Gan; Licheng Yu; Liqiang Wang 001; Jingjing Liu 001 (CVPR, 2020)

Violin: A Large-Scale Dataset for Video-and-Language Inference. - Jingzhou Liu; Wenhu Chen; Yu Cheng 001; Zhe Gan; Licheng Yu; Yiming Yang; Jingjing Liu 001 (CVPR, 2020)

Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models. - Jize Cao; Zhe Gan; Yu Cheng 001; Licheng Yu; Yen-Chun Chen 001; Jingjing Liu 001 (ECCV (6), 2020)

UNITER: UNiversal Image-TExt Representation Learning. - Yen-Chun Chen 001; Linjie Li; Licheng Yu; Ahmed El Kholy; Faisal Ahmed 001; Zhe Gan; Yu Cheng 001; Jingjing Liu 001 (ECCV (30), 2020)

Contextual Text Style Transfer. - Yu Cheng 001; Zhe Gan; Yizhe Zhang 002; Oussama Elachqar; Dianqi Li; Jingjing Liu 001 (EMNLP (Findings), 2020)

Multi-Fact Correction in Abstractive Text Summarization. - Yue Dong 002; Shuohang Wang; Zhe Gan; Yu Cheng 001; Jackie Chi Kit Cheung; Jingjing Liu 001 (EMNLP (1), 2020)

Hierarchical Graph Network for Multi-hop Question Answering. - Yuwei Fang; Siqi Sun; Zhe Gan; Rohit Pillai; Shuohang Wang; Jingjing Liu 001 (EMNLP (1), 2020)

HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training. - Linjie Li; Yen-Chun Chen 001; Yu Cheng 001; Zhe Gan; Licheng Yu; Jingjing Liu 001 (EMNLP (1), 2020)

Contrastive Distillation on Intermediate Representations for Language Model Compression. - Siqi Sun; Zhe Gan; Yuwei Fang; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001 (EMNLP (1), 2020)

Cross-Thought for Sentence Encoder Pre-training. - Shuohang Wang; Yuwei Fang; Siqi Sun; Zhe Gan; Yu Cheng 001; Jingjing Liu 001; Jing Jiang 001 (EMNLP (1), 2020)

POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training. - Yizhe Zhang 002; Guoyin Wang 002; Chunyuan Li; Zhe Gan; Chris Brockett; Bill Dolan (EMNLP (1), 2020)

FreeLB: Enhanced Adversarial Training for Natural Language Understanding. - Chen Zhu 001; Yu Cheng 001; Zhe Gan; Siqi Sun; Tom Goldstein; Jingjing Liu 001 (ICLR, 2020)

Graph Optimal Transport for Cross-Domain Alignment. - Liqun Chen 001; Zhe Gan; Yu Cheng 001; Linjie Li; Lawrence Carin; Jingjing Liu 001 (ICML, 2020)

CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information. - Pengyu Cheng; Weituo Hao; Shuyang Dai; Jiachang Liu 001; Zhe Gan; Lawrence Carin (ICML, 2020)

Sequential Attention GAN for Interactive Image Editing. - Yu Cheng 001; Zhe Gan; Yitong Li 001; Jingjing Liu 001; Jianfeng Gao 001 (ACM Multimedia, 2020)

Large-Scale Adversarial Training for Vision-and-Language Representation Learning. - Zhe Gan; Yen-Chun Chen 001; Linjie Li; Chen Zhu 001; Yu Cheng 001; Jingjing Liu 001 (NeurIPS, 2020)

POINTER: Constrained Text Generation via Insertion-based Generative Pre-training. - Yizhe Zhang 002; Guoyin Wang 002; Chunyuan Li; Zhe Gan; Chris Brockett; Bill Dolan (CoRR, 2020)

Adaptive Learning Rates with Maximum Variation Averaging. - Chen Zhu 001; Yu Cheng 001; Zhe Gan; Furong Huang; Jingjing Liu 001; Tom Goldstein (CoRR, 2020)

Accelerating Real-Time Question Answering via Question Generation. - Yuwei Fang; Shuohang Wang; Zhe Gan; Siqi Sun; Jingjing Liu 001 (CoRR, 2020)

Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding. - Shuohang Wang; Luowei Zhou; Zhe Gan; Yen-Chun Chen 001; Yuwei Fang; Siqi Sun; Yu Cheng 001; Jingjing Liu 001 (CoRR, 2020)

A Closer Look at the Robustness of Vision-and-Language Pre-trained Models. - Linjie Li; Zhe Gan; Jingjing Liu 001 (CoRR, 2020)

FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding. - Yuwei Fang; Shuohang Wang; Zhe Gan; Siqi Sun; Jingjing Liu 001 (AAAI, 2021)

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets. - Xiaohan Chen; Yu Cheng 001; Shuohang Wang; Zhe Gan; Zhangyang Wang; Jingjing Liu 001 (ACL/IJCNLP (1), 2021)

Cluster-Former: Clustering-based Sparse Transformer for Question Answering. - Shuohang Wang; Luowei Zhou; Zhe Gan; Yen-Chun Chen 001; Yuwei Fang; Siqi Sun; Yu Cheng 001; Jingjing Liu 001 (ACL/IJCNLP (Findings), 2021)

Wasserstein Contrastive Representation Distillation. - Liqun Chen 001; Dong Wang 037; Zhe Gan; Jingjing Liu 001; Ricardo Henao; Lawrence Carin (CVPR, 2021)

Less Is More: ClipBERT for Video-and-Language Learning via Sparse Sampling. - Jie Lei 003; Linjie Li; Luowei Zhou; Zhe Gan; Tamara L. Berg; Mohit Bansal; Jingjing Liu 001 (CVPR, 2021)

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models. - Linjie Li; Jie Lei 003; Zhe Gan; Jingjing Liu 001 (ICCV, 2021)

InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective. - Boxin Wang; Shuohang Wang; Yu Cheng 001; Zhe Gan; Ruoxi Jia 001; Bo Li 026; Jingjing Liu 001 (ICLR, 2021)

Improving Zero-Shot Voice Style Transfer via Disentangled Representation Learning. - Siyang Yuan; Pengyu Cheng; Ruiyi Zhang 002; Weituo Hao; Zhe Gan; Lawrence Carin (ICLR, 2021)

APo-VAE: Text Generation in Hyperbolic Space. - Shuyang Dai; Zhe Gan; Yu Cheng 001; Chenyang Tao; Lawrence Carin; Jingjing Liu 001 (NAACL-HLT, 2021)

Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective. - Tianlong Chen 001; Yu Cheng 001; Zhe Gan; Jingjing Liu 001; Zhangyang Wang (NeurIPS, 2021)

Chasing Sparsity in Vision Transformers: An End-to-End Exploration. - Tianlong Chen 001; Yu Cheng 001; Zhe Gan; Lu Yuan; Lei Zhang 001; Zhangyang Wang (NeurIPS, 2021)

The Elastic Lottery Ticket Hypothesis. - Xiaohan Chen; Yu Cheng 001; Shuohang Wang; Zhe Gan; Jingjing Liu 001; Zhangyang Wang (NeurIPS, 2021)

VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation. - Linjie Li; Jie Lei 003; Zhe Gan; Licheng Yu; Yen-Chun Chen 001; Rohit Pillai; Yu Cheng 001; Luowei Zhou; Xin Wang 061; William Yang Wang; Tamara L. Berg; Mohit Bansal; et al. (NeurIPS Datasets and Benchmarks, 2021)

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models. - Boxin Wang; Chejian Xu; Shuohang Wang; Zhe Gan; Yu Cheng 001; Jianfeng Gao 001; Ahmed Hassan Awadallah; Bo Li 026 (NeurIPS Datasets and Benchmarks, 2021)

MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of Gradients. - Chen Zhu 001; Yu Cheng 001; Zhe Gan; Furong Huang; Jingjing Liu 001; Tom Goldstein (ECML/PKDD (3), 2021)

Meta Module Network for Compositional Visual Reasoning. - Wenhu Chen; Zhe Gan; Linjie Li; Yu Cheng 001; William Yang Wang; Jingjing Liu 001 (WACV, 2021)

Ultra-Data-Efficient GAN Training: Drawing A Lottery Ticket First, Then Training It Toughly. - Tianlong Chen 001; Yu Cheng 001; Zhe Gan; Jingjing Liu 001; Zhangyang Wang (CoRR, 2021)

CUPID: Adaptive Curation of Pre-training Data for Video-and-Language Representation Learning. - Luowei Zhou; Jingjing Liu 001; Yu Cheng 001; Zhe Gan; Lei Zhang 001 (CoRR, 2021)

Playing Lottery Tickets with Vision and Language. - Zhe Gan; Yen-Chun Chen 001; Linjie Li; Tianlong Chen 001; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001 (CoRR, 2021)

Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE. - Junya Chen; Zhe Gan; Xuan Li; Qing Guo; Liqun Chen 001; Shuyang Gao; Tagyoung Chung; Yi Xu 011; Belinda Zeng; Wenlian Lu; Fan Li; Lawrence Carin; et al. (CoRR, 2021)

UFO: A UniFied TransfOrmer for Vision-Language Representation Learning. - Jianfeng Wang; Xiaowei Hu 006; Zhe Gan; Zhengyuan Yang; Xiyang Dai; Zicheng Liu 001; Yumao Lu; Lijuan Wang (CoRR, 2021)

Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling. - Zhengyuan Yang; Zhe Gan; Jianfeng Wang; Xiaowei Hu 006; Faisal Ahmed 001; Zicheng Liu 001; Yumao Lu; Lijuan Wang (CoRR, 2021)

Scaling Up Vision-Language Pre-training for Image Captioning. - Xiaowei Hu 006; Zhe Gan; Jianfeng Wang; Zhengyuan Yang; Zicheng Liu 001; Yumao Lu; Lijuan Wang (CoRR, 2021)

VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling. - Tsu-Jui Fu; Linjie Li; Zhe Gan; Kevin Lin; William Yang Wang; Lijuan Wang; Zicheng Liu 001 (CoRR, 2021)

MLP Architectures for Vision-and-Language Modeling: An Empirical Study. - Yixin Nie; Linjie Li; Zhe Gan; Shuohang Wang; Chenguang Zhu 001; Michael Zeng 001; Zicheng Liu 001; Mohit Bansal; Lijuan Wang (CoRR, 2021)

Efficient Robust Training via Backward Smoothing. - Jinghui Chen; Yu Cheng 001; Zhe Gan; Quanquan Gu; Jingjing Liu 001 (AAAI, 2022)

Playing Lottery Tickets with Vision and Language. - Zhe Gan; Yen-Chun Chen 001; Linjie Li; Tianlong Chen 001; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001; Lijuan Wang; Zicheng Liu 001 (AAAI, 2022)

An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA. - Zhengyuan Yang; Zhe Gan; Jianfeng Wang; Xiaowei Hu 006; Yumao Lu; Zicheng Liu 001; Lijuan Wang (AAAI, 2022)

Scaling Up Vision-Language Pretraining for Image Captioning. - Xiaowei Hu 006; Zhe Gan; Jianfeng Wang; Zhengyuan Yang; Zicheng Liu 001; Yumao Lu; Lijuan Wang (CVPR, 2022)

An Empirical Study of Training End-to-End Vision-and-Language Transformers. - Zi-Yi Dou; Yichong Xu; Zhe Gan; Jianfeng Wang; Shuohang Wang; Lijuan Wang; Chenguang Zhu 001; Pengchuan Zhang; Lu Yuan; Nanyun Peng 001; Zicheng Liu 001; Michael Zeng 001 (CVPR, 2022)

Injecting Semantic Concepts into End-to-End Image Captioning. - Zhiyuan Fang; Jianfeng Wang; Xiaowei Hu 006; Lin Liang; Zhe Gan; Lijuan Wang; Yezhou Yang; Zicheng Liu 001 (CVPR, 2022)

SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning. - Kevin Lin; Linjie Li; Chung-Ching Lin; Faisal Ahmed 001; Zhe Gan; Zicheng Liu 001; Yumao Lu; Lijuan Wang (CVPR, 2022)

UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling. - Zhengyuan Yang; Zhe Gan; Jianfeng Wang; Xiaowei Hu 006; Faisal Ahmed 001; Zicheng Liu 001; Yumao Lu; Lijuan Wang (ECCV (36), 2022)

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone. - Zi-Yi Dou; Aishwarya Kamath; Zhe Gan; Pengchuan Zhang; Jianfeng Wang; Linjie Li; Zicheng Liu 001; Ce Liu 001; Yann LeCun; Nanyun Peng 001; Jianfeng Gao 001; Lijuan Wang (NeurIPS, 2022)

NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis. - Jian Liang; Chenfei Wu; Xiaowei Hu 006; Zhe Gan; Jianfeng Wang; Lijuan Wang; Zicheng Liu 001; Yuejian Fang; Nan Duan (NeurIPS, 2022)

K-LITE: Learning Transferable Visual Models with External Knowledge. - Sheng Shen 001; Chunyuan Li; Xiaowei Hu 006; Yujia Xie; Jianwei Yang; Pengchuan Zhang; Zhe Gan; Lijuan Wang; Lu Yuan; Ce Liu 001; Kurt Keutzer; Trevor Darrell; et al. (NeurIPS, 2022)

Exploring Discrete Diffusion Models for Image Captioning. - Zixin Zhu; Yixuan Wei; Jianfeng Wang; Zhe Gan; Zheng Zhang 022; Le Wang 003; Gang Hua 001; Lijuan Wang; Zicheng Liu 001; Han Hu 001 (CoRR, 2022)

Vision-Language Pre-Training: Basics, Recent Advances, and Future Trends. - Zhe Gan; Linjie Li; Chunyuan Li; Lijuan Wang; Zicheng Liu 001; Jianfeng Gao 001 (Found. Trends Comput. Graph. Vis., 2022)

Adversarial Feature Augmentation and Normalization for Visual Recognition. - Tianlong Chen 001; Yu Cheng 001; Zhe Gan; Jianfeng Wang; Lijuan Wang; Jingjing Liu 001; Zhangyang Wang (Trans. Mach. Learn. Res., 2022)

GIT: A Generative Image-to-text Transformer for Vision and Language. - Jianfeng Wang; Zhengyuan Yang; Xiaowei Hu 006; Linjie Li; Kevin Lin; Zhe Gan; Zicheng Liu 001; Ce Liu 001; Lijuan Wang (Trans. Mach. Learn. Res., 2022)

An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling. - Tsu-Jui Fu; Linjie Li; Zhe Gan; Kevin Lin; William Yang Wang; Lijuan Wang; Zicheng Liu 001 (CVPR, 2023)

LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling. - Linjie Li; Zhe Gan; Kevin Lin; Chung-Ching Lin; Zicheng Liu 001; Ce Liu 001; Lijuan Wang (CVPR, 2023)

ReCo: Region-Controlled Text-to-Image Generation. - Zhengyuan Yang; Jianfeng Wang; Zhe Gan; Linjie Li; Kevin Lin; Chenfei Wu; Nan Duan; Zicheng Liu 001; Ce Liu 001; Michael Zeng 001; Lijuan Wang (CVPR, 2023)

Non-Contrastive Learning Meets Language-Image Pre-Training. - Jinghao Zhou; Li Dong 004; Zhe Gan; Lijuan Wang; Furu Wei (CVPR, 2023)

Generalized Decoding for Pixel, Image, and Language. - Xueyan Zou; Zi-Yi Dou; Jianwei Yang; Zhe Gan; Linjie Li; Chunyuan Li; Xiyang Dai; Harkirat Behl; Jianfeng Wang; Lu Yuan; Nanyun Peng 001; Lijuan Wang; et al. (CVPR, 2023)

An Empirical Study of Multimodal Model Merging. - Yi-Lin Sung; Linjie Li; Kevin Lin; Zhe Gan; Mohit Bansal; Lijuan Wang (EMNLP (Findings), 2023)

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation. - Yuhui Zhang; Brandon McKinzie; Zhe Gan; Vaishaal Shankar; Alexander Toshev (ICBINB, 2023)

Prompting GPT-3 To Be Reliable. - Chenglei Si; Zhe Gan; Zhengyuan Yang; Shuohang Wang; Jianfeng Wang; Jordan L. Boyd-Graber; Lijuan Wang (ICLR, 2023)

MOFI: Learning Image Representations from Noisy Entity Annotated Images. - Wentao Wu; Aleksei Timofeev; Chen Chen 005; Bowen Zhang 002; Kun Duan; Shuangning Liu; Yantao Zheng; Jonathon Shlens; Xianzhi Du; Zhe Gan; Yinfei Yang (CoRR, 2023)

From Scarcity to Efficiency: Improving CLIP Training via Visual-enriched Captions. - Zhengfeng Lai; Haotian Zhang 005; Wentao Wu; Haoping Bai; Aleksei Timofeev; Xianzhi Du; Zhe Gan; Jiulong Shan; Chen-Nee Chuah; Yinfei Yang; Meng Cao (CoRR, 2023)

InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Models. - Bingbing Wen; Zhengyuan Yang; Jianfeng Wang; Zhe Gan; Bill Howe; Lijuan Wang (CoRR, 2023)

Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generation. - Jaemin Cho 001; Linjie Li; Zhengyuan Yang; Zhe Gan; Lijuan Wang; Mohit Bansal (CVPR Workshops, 2024)

VeCLIP: Improving CLIP Training via Visual-Enriched Captions. - Zhengfeng Lai; Haotian Zhang 005; Bowen Zhang 002; Wentao Wu; Haoping Bai; Aleksei Timofeev; Xianzhi Du; Zhe Gan; Jiulong Shan; Chen-Nee Chuah; Yinfei Yang; Meng Cao (ECCV (42), 2024)

MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training. - Brandon McKinzie; Zhe Gan; Jean-Philippe Fauconnier; Sam Dodge; Bowen Zhang 002; Philipp Dufter; Dhruti Shah; Xianzhi Du; Futang Peng; Anton Belyi; Haotian Zhang 005; Karanjeet Singh 003; et al. (ECCV (29), 2024)

GRiT: A Generative Region-to-Text Transformer for Object Understanding. - Jialian Wu; Jianfeng Wang; Zhengyuan Yang; Zhe Gan; Zicheng Liu 001; Junsong Yuan 001; Lijuan Wang (ECCV (80), 2024)

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs. - Keen You; Haotian Zhang 005; Eldon Schoop; Floris Weers; Amanda Swearngin; Jeffrey Nichols 001; Yinfei Yang; Zhe Gan (ECCV (64), 2024)

Guiding Instruction-based Image Editing via Multimodal Large Language Models. - Tsu-Jui Fu; Wenze Hu; Xianzhi Du; William Yang Wang; Yinfei Yang; Zhe Gan (ICLR, 2024)

Compressing LLMs: The Truth is Rarely Pure and Never Simple. - Ajay Kumar Jaiswal; Zhe Gan; Xianzhi Du; Bowen Zhang; Zhangyang Wang; Yinfei Yang (ICLR, 2024)

Ferret: Refer and Ground Anything Anywhere at Any Granularity. - Haoxuan You; Haotian Zhang 005; Zhe Gan; Xianzhi Du; Bowen Zhang 002; Zirui Wang; Liangliang Cao; Shih-Fu Chang; Yinfei Yang (ICLR, 2024)

How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts. - Yusu Qian; Haotian Zhang 005; Yinfei Yang; Zhe Gan (CoRR, 2024)

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training. - Brandon McKinzie; Zhe Gan; Jean-Philippe Fauconnier; Sam Dodge; Bowen Zhang 002; Philipp Dufter; Dhruti Shah; Xianzhi Du; Futang Peng; Floris Weers; Anton Belyi; Haotian Zhang 005; et al. (CoRR, 2024)

Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models. - Haotian Zhang 005; Haoxuan You; Philipp Dufter; Bowen Zhang 002; Chen Chen 005; Hong-You Chen; Tsu-Jui Fu; William Yang Wang; Shih-Fu Chang; Zhe Gan; Yinfei Yang (CoRR, 2024)

Understanding Alignment in Multimodal LLMs: A Comprehensive Study. - Elmira Amirloo; Jean-Philippe Fauconnier; Christoph Roesmann; Christian Kerl; Rinu Boney; Yusu Qian; Zirui Wang; Afshin Dehghan; Yinfei Yang; Zhe Gan; Peter Grasch (CoRR, 2024)

SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models. - Mingze Xu; Mingfei Gao; Zhe Gan; Hong-You Chen; Zhengfeng Lai; Haiming Gang; Kai Kang; Afshin Dehghan (CoRR, 2024)

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning. - Haotian Zhang 005; Mingfei Gao; Zhe Gan; Philipp Dufter; Nina Wenzel; Forrest Huang; Dhruti Shah; Xianzhi Du; Bowen Zhang 002; Yanghao Li; Sam Dodge; Keen You; et al. (CoRR, 2024)

Contrastive Localized Language-Image Pre-Training. - Hong-You Chen; Zhengfeng Lai; Haotian Zhang 005; Xinze Wang; Marcin Eichner; Keen You; Meng Cao; Bowen Zhang 002; Yinfei Yang; Zhe Gan (CoRR, 2024)

MM-Ego: Towards Building Egocentric Multimodal LLMs. - Hanrong Ye; Haotian Zhang 005; Erik A. Daxberger; Lin Chen 010; Zongyu Lin; Yanghao Li; Bowen Zhang 002; Haoxuan You; Dan Xu 002; Zhe Gan; Jiasen Lu; Yinfei Yang (CoRR, 2024)

Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms. - Zhangheng Li; Keen You; Haotian Zhang 005; Di Feng; Harsh Agrawal; Xiujun Li; Mohana Prasad Sathya Moorthy; Jeff Nichols; Yinfei Yang; Zhe Gan (CoRR, 2024)

Multimodal Foundation Models: From Specialists to General-Purpose Assistants. - Chunyuan Li; Zhe Gan; Zhengyuan Yang; Jianwei Yang; Linjie Li; Lijuan Wang; Jianfeng Gao 001 (Found. Trends Comput. Graph. Vis., 2024)

Improve Vision Language Model Chain-of-thought Reasoning. - Ruohong Zhang; Bowen Zhang 002; Yanghao Li; Haotian Zhang 005; Zhiqing Sun; Zhe Gan; Yinfei Yang; Ruoming Pang; Yiming Yang (ACL (1), 2025)

Multimodal Autoregressive Pre-training of Large Vision Encoders. - Enrico Fini; Mustafa Shukor; Xiujun Li; Philipp Dufter; Michal Klein; David Haldimann; Sai Aitharaju; Victor G. Turrisi da Costa; Louis Béthune; Zhe Gan; Alexander Toshev; Marcin Eichner; et al. (CVPR, 2025)

From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessons. - Andrew Szot; Bogdan Mazoure; Omar Attia; Aleksei Timofeev; Harsh Agrawal; R. Devon Hjelm; Zhe Gan; Zsolt Kira; Alexander Toshev (CVPR, 2025)

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models. - Zhengfeng Lai; Vasileios Saveris; Chen Chen 005; Hong-You Chen; Haotian Zhang 005; Bowen Zhang 002; Wenze Hu; Juan Lao Tebar; Zhe Gan; Peter Grasch; Meng Cao; Yinfei Yang (ICLR, 2025)

Ferret-UI 2: Mastering Universal User Interface Understanding Across Platforms. - Zhangheng Li; Keen You; Haotian Zhang 005; Di Feng; Harsh Agrawal; Xiujun Li; Mohana Prasad Sathya Moorthy; Jeffrey Nichols 001; Yinfei Yang; Zhe Gan (ICLR, 2025)

MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs. - Yusu Qian; Hanrong Ye; Jean-Philippe Fauconnier; Peter Grasch; Yinfei Yang; Zhe Gan (ICLR, 2025)

MMEgo: Towards Building Egocentric Multimodal LLMs for Video QA. - Hanrong Ye; Haotian Zhang 005; Erik A. Daxberger; Lin Chen 010; Zongyu Lin; Yanghao Li; Bowen Zhang 002; Haoxuan You; Dan Xu 002; Zhe Gan; Jiasen Lu; Yinfei Yang (ICLR, 2025)

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning. - Haotian Zhang 005; Mingfei Gao; Zhe Gan; Philipp Dufter; Nina Wenzel; Forrest Huang; Dhruti Shah; Xianzhi Du; Bowen Zhang 002; Yanghao Li; Sam Dodge; Keen You; et al. (ICLR, 2025)

UniVG: A Generalist Diffusion Model for Unified Image Generation and Editing. - Tsu-Jui Fu; Yusu Qian; Chen Chen 005; Wenze Hu; Zhe Gan; Yinfei Yang (CoRR, 2025)

SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding. - Mingze Xu; Mingfei Gao; Shiyu Li; Jiasen Lu; Zhe Gan; Zhengfeng Lai; Meng Cao; Kai Kang; Yinfei Yang; Afshin Dehghan (CoRR, 2025)

GIE-Bench: Towards Grounded Evaluation for Text-Guided Image Editing. - Yusu Qian; Jiasen Lu; Tsu-Jui Fu; Xinze Wang; Chen Chen; Yinfei Yang; Wenze Hu; Zhe Gan (CoRR, 2025)