A Sparse Decomposition of Low Rank Symmetric Positive Semidefinite Matrices. - Thomas Y. Hou 001; Qin Li 007; Pengchuan Zhang (Multiscale Model. Simul., 2017)

Exploring the Locally Low Dimensional Structure in Solving Random Elliptic PDEs. - Thomas Y. Hou 001; Qin Li 007; Pengchuan Zhang (Multiscale Model. Simul., 2017)

AttnGAN: Fine-Grained Text to Image Generation With Attentional Generative Adversarial Networks. - Tao Xu; Pengchuan Zhang; Qiuyuan Huang; Han Zhang 010; Zhe Gan; Xiaolei Huang 001; Xiaodong He 001 (CVPR, 2018)

On the Discrimination-Generalization Tradeoff in GANs. - Pengchuan Zhang; Qiang Liu 001; Dengyong Zhou; Tao Xu; Xiaodong He 001 (ICLR (Poster), 2018)

Turbo Learning for CaptionBot and DrawingBot. - Qiuyuan Huang; Pengchuan Zhang; Dapeng Oliver Wu; Lei Zhang 001 (NeurIPS, 2018)

A bird's-eye view on coherence, and a worm's-eye view on cohesion. - Woon Sang Cho; Pengchuan Zhang; Yizhe Zhang 002; Xiujun Li; Michel Galley; Mengdi Wang; Jianfeng Gao 001 (CoRR, 2018)

An Adaptive Fast Solver for a General Class of Positive Definite Matrices Via Energy Decomposition. - Thomas Y. Hou 001; De Huang; Ka Chun Lam; Pengchuan Zhang (Multiscale Model. Simul., 2018)

RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications. - Huan Zhang 001; Pengchuan Zhang; Cho-Jui Hsieh (AAAI, 2019)

Object-Driven Text-To-Image Synthesis via Adversarial Training. - Wenbo Li 001; Pengchuan Zhang; Lei Zhang 001; Qiuyuan Huang; Xiaodong He 001; Siwei Lyu; Jianfeng Gao 001 (CVPR, 2019)

TIGEr: Text-to-Image Grounding for Image Caption Evaluation. - Ming Jiang 018; Qiuyuan Huang; Lei Zhang 001; Xin Wang 061; Pengchuan Zhang; Zhe Gan; Jana Diesner; Jianfeng Gao 001 (EMNLP/IJCNLP (1), 2019)

Understanding the Role of Momentum in Stochastic Gradient Methods. - Igor Gitman; Hunter Lang; Pengchuan Zhang; Lin Xiao (NeurIPS, 2019)

Using Statistics to Automate Stochastic Optimization. - Hunter Lang; Lin Xiao; Pengchuan Zhang (NeurIPS, 2019)

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers. - Hadi Salman; Jerry Li 001; Ilya P. Razenshteyn; Pengchuan Zhang; Huan Zhang; Sébastien Bubeck; Greg Yang (NeurIPS, 2019)

A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networks. - Hadi Salman; Greg Yang; Huan Zhang 001; Cho-Jui Hsieh; Pengchuan Zhang (NeurIPS, 2019)

MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network. - Yi Wei 006; Zhe Gan; Wenbo Li 001; Siwei Lyu; Ming-Ching Chang; Lei Zhang 001; Jianfeng Gao 001; Pengchuan Zhang (ACCV (4), 2020)

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. - Xiujun Li; Xi Yin 006; Chunyuan Li; Pengchuan Zhang; Xiaowei Hu 006; Lei Zhang 001; Lijuan Wang; Houdong Hu; Li Dong 004; Furu Wei; Yejin Choi 001; Jianfeng Gao 001 (ECCV (30), 2020)

Statistical Adaptive Stochastic Gradient Methods. - Pengchuan Zhang; Hunter Lang; Qiang Liu 001; Lin Xiao (CoRR, 2020)

Novel Human-Object Interaction Detection via Adversarial Domain Generalization. - Yuhang Song 003; Wenbo Li 001; Lei Zhang 001; Jianwei Yang; Emre Kiciman; Hamid Palangi; Jianfeng Gao 001; C.-C. Jay Kuo; Pengchuan Zhang (CoRR, 2020)

MiniVLM: A Smaller and Faster Vision-Language Model. - Jianfeng Wang; Xiaowei Hu 006; Pengchuan Zhang; Xiujun Li; Lijuan Wang; Lei Zhang 001; Jianfeng Gao 001; Zicheng Liu 001 (CoRR, 2020)

Object-Centric Image Generation from Layouts. - Tristan Sylvain; Pengchuan Zhang; Yoshua Bengio; R. Devon Hjelm; Shikhar Sharma 001 (AAAI, 2021)

VinVL: Revisiting Visual Representations in Vision-Language Models. - Pengchuan Zhang; Xiujun Li; Xiaowei Hu 006; Jianwei Yang; Lei Zhang 001; Lijuan Wang; Yejin Choi 001; Jianfeng Gao 001 (CVPR, 2021)

Dynamic DETR: End-to-End Object Detection with Dynamic Attention. - Xiyang Dai; Yinpeng Chen; Jianwei Yang; Pengchuan Zhang; Lu Yuan; Lei Zhang 001 (ICCV, 2021)

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding. - Pengchuan Zhang; Xiyang Dai; Jianwei Yang; Bin Xiao 004; Lu Yuan; Lei Zhang 001; Jianfeng Gao 001 (ICCV, 2021)

Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference. - Shumao Zhang; Pengchuan Zhang; Thomas Y. Hou 001 (ICML, 2021)

Focal Attention for Long-Range Interactions in Vision Transformers. - Jianwei Yang; Chunyuan Li; Pengchuan Zhang; Xiyang Dai; Bin Xiao 004; Lu Yuan; Jianfeng Gao 001 (NeurIPS, 2021)

VinVL: Making Visual Representations Matter in Vision-Language Models. - Pengchuan Zhang; Xiujun Li; Xiaowei Hu 006; Jianwei Yang; Lei Zhang 001; Lijuan Wang; Yejin Choi 001; Jianfeng Gao 001 (CoRR, 2021)

Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix. - Ruocheng Guo; Pengchuan Zhang; Hao Liu; Emre Kiciman (CoRR, 2021)

Focal Self-attention for Local-Global Interactions in Vision Transformers. - Jianwei Yang; Chunyuan Li; Pengchuan Zhang; Xiyang Dai; Bin Xiao 004; Lu Yuan; Jianfeng Gao 001 (CoRR, 2021)

Image Scene Graph Generation (SGG) Benchmark. - Xiaotian Han; Jianwei Yang; Houdong Hu; Lei Zhang 001; Jianfeng Gao 001; Pengchuan Zhang (CoRR, 2021)

Florence: A New Foundation Model for Computer Vision. - Lu Yuan; Dongdong Chen 001; Yi-Ling Chen; Noel Codella; Xiyang Dai; Jianfeng Gao 001; Houdong Hu; Xuedong Huang 001; Boxin Li; Chunyuan Li; Ce Liu 001; Mengchen Liu; et al. (CoRR, 2021)

An Empirical Study of Training End-to-End Vision-and-Language Transformers. - Zi-Yi Dou; Yichong Xu; Zhe Gan; Jianfeng Wang; Shuohang Wang; Lijuan Wang; Chenguang Zhu 001; Pengchuan Zhang; Lu Yuan; Nanyun Peng 001; Zicheng Liu 001; Michael Zeng 001 (CVPR, 2022)

Grounded Language-Image Pre-training. - Liunian Harold Li; Pengchuan Zhang; Haotian Zhang 005; Jianwei Yang; Chunyuan Li; Yiwu Zhong; Lijuan Wang; Lu Yuan; Lei Zhang 001; Jenq-Neng Hwang; Kai-Wei Chang; Jianfeng Gao 001 (CVPR, 2022)

Unified Contrastive Learning in Image-Text-Label Space. - Jianwei Yang; Chunyuan Li; Pengchuan Zhang; Bin Xiao 004; Ce Liu 001; Lu Yuan; Jianfeng Gao 001 (CVPR, 2022)

RegionCLIP: Region-based Language-Image Pretraining. - Yiwu Zhong; Jianwei Yang; Pengchuan Zhang; Chunyuan Li; Noel Codella; Liunian Harold Li; Luowei Zhou; Xiyang Dai; Lu Yuan; Yin Li 003; Jianfeng Gao 001 (CVPR, 2022)

Missingness Bias in Model Debugging. - Saachi Jain; Hadi Salman; Eric Wong 001; Pengchuan Zhang; Vibhav Vineet; Sai Vemprala; Aleksander Madry (ICLR, 2022)

Efficient Self-supervised Vision Transformers for Representation Learning. - Chunyuan Li; Jianwei Yang; Pengchuan Zhang; Mei Gao; Bin Xiao 004; Xiyang Dai; Lu Yuan; Jianfeng Gao 001 (ICLR, 2022)

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone. - Zi-Yi Dou; Aishwarya Kamath; Zhe Gan; Pengchuan Zhang; Jianfeng Wang; Linjie Li; Zicheng Liu 001; Ce Liu 001; Yann LeCun; Nanyun Peng 001; Jianfeng Gao 001; Lijuan Wang (NeurIPS, 2022)

3DB: A Framework for Debugging Computer Vision Models. - Guillaume Leclerc; Hadi Salman; Andrew Ilyas; Sai Vemprala; Logan Engstrom; Vibhav Vineet; Kai Yuanqing Xiao; Pengchuan Zhang; Shibani Santurkar; Greg Yang; Ashish Kapoor; Aleksander Madry (NeurIPS, 2022)

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models. - Chunyuan Li; Haotian Liu; Liunian Harold Li; Pengchuan Zhang; Jyoti Aneja; Jianwei Yang; Ping Jin; Houdong Hu; Zicheng Liu 001; Yong Jae Lee; Jianfeng Gao 001 (NeurIPS, 2022)

K-LITE: Learning Transferable Visual Models with External Knowledge. - Sheng Shen 001; Chunyuan Li; Xiaowei Hu 006; Yujia Xie; Jianwei Yang; Pengchuan Zhang; Zhe Gan; Lijuan Wang; Lu Yuan; Ce Liu 001; Kurt Keutzer; Trevor Darrell; et al. (NeurIPS, 2022)

GLIPv2: Unifying Localization and Vision-Language Understanding. - Haotian Zhang 005; Pengchuan Zhang; Xiaowei Hu 006; Yen-Chun Chen 001; Liunian Harold Li; Xiyang Dai; Lijuan Wang; Lu Yuan; Jenq-Neng Hwang; Jianfeng Gao 001 (NeurIPS, 2022)

Vision-Language Intelligence: Tasks, Representation Learning, and Large Models. - Feng Li 040; Hao Zhang 097; Yi-Fan Zhang; Shilong Liu; Jian Guo; Lionel M. Ni; Pengchuan Zhang; Lei Zhang 001 (CoRR, 2022)

Parameter-efficient Fine-tuning for Vision Transformers. - Xuehai He; Chunyuan Li; Pengchuan Zhang; Jianwei Yang; Xin Eric Wang (CoRR, 2022)

A Unified Model for Tracking and Image-Video Detection Has More Power. - Peirong Liu; Rui Wang; Pengchuan Zhang; Omid Poursaeed; Yipin Zhou; Xuefei Cao; Sreya Dutta Roy; Ashish Shah; Ser-Nam Lim (CoRR, 2022)

Parameter-Efficient Model Adaptation for Vision Transformers. - Xuehai He; Chunyuan Li; Pengchuan Zhang; Jianwei Yang; Xin Eric Wang (AAAI, 2023)

Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding. - Lingchen Meng; Xiyang Dai; Yinpeng Chen; Pengchuan Zhang; Dongdong Chen 001; Mengchen Liu; Jianfeng Wang; Zuxuan Wu; Lu Yuan; Yu-Gang Jiang 001 (CVPR, 2023)

Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality. - Harman Singh; Pengchuan Zhang; Qifan Wang 001; Mengjiao Wang; Wenhan Xiong; Jingfei Du; Yu Chen 022 (EMNLP, 2023)

UniVTG: Towards Unified Video-Language Temporal Grounding. - Kevin Qinghong Lin; Pengchuan Zhang; Joya Chen; Shraman Pramanick; Difei Gao; Alex Jinpeng Wang; Rui Yan 001; Mike Zheng Shou (ICCV, 2023)

EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone. - Shraman Pramanick; Yale Song; Sayan Nag; Kevin Qinghong Lin; Hardik Shah; Mike Zheng Shou; Rama Chellappa; Pengchuan Zhang (ICCV, 2023)

DIME-FM : DIstilling Multimodal and Efficient Foundation Models. - Ximeng Sun; Pengchuan Zhang; Peizhao Zhang; Hardik Shah; Kate Saenko; Xide Xia (ICCV, 2023)

Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding. - Mohamed Afham; Satya Narayan Shukla; Omid Poursaeed; Pengchuan Zhang; Ashish Shah; Sernam Lim (ICCV (Workshops), 2023)

VisualGPTScore: Visio-Linguistic Reasoning with Multimodal Generative Pre-Training Scores. - Zhiqiu Lin; Xinyue Chen; Deepak Pathak; Pengchuan Zhang; Deva Ramanan (CoRR, 2023)

MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning. - Jun Chen 021; Deyao Zhu; Xiaoqian Shen; Xiang Li; Zechun Liu; Pengchuan Zhang; Raghuraman Krishnamoorthi; Vikas Chandra; Yunyang Xiong; Mohamed Elhoseiny (CoRR, 2023)

The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task. - Yifan Wu; Pengchuan Zhang; Wenhan Xiong; Barlas Oguz; James C. Gee; Yixin Nie (CoRR, 2023)

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation. - Yunhao Ge; Yihe Tang; Jiashu Xu; Cem Gokmen; Chengshu Li 001; Wensi Ai; Benjamin Jose Martinez; Arman Aydin; Mona Anvari; Ayush K. Chakravarthy; Hong-Xing Yu; Josiah Wong; et al. (CVPR, 2024)

Evaluating and Improving Compositional Text-to-Visual Generation. - Baiqi Li; Zhiqiu Lin; Deepak Pathak; Jiayao Li; Yixin Fei; Kewen Wu 005; Xide Xia; Pengchuan Zhang; Graham Neubig; Deva Ramanan (CVPR Workshops, 2024)

Evaluating Text-to-Visual Generation with Image-to-Text Generation. - Zhiqiu Lin; Deepak Pathak; Baiqi Li; Jiayao Li; Xide Xia; Graham Neubig; Pengchuan Zhang; Deva Ramanan (ECCV (9), 2024)

Learning Video Context as Interleaved Multimodal Sequences. - Kevin Qinghong Lin; Pengchuan Zhang; Difei Gao; Xide Xia; Joya Chen; Ziteng Gao; Jinheng Xie; Xuhong Xiao; Mike Zheng Shou (ECCV (49), 2024)

Revisiting the Role of Language Priors in Vision-Language Models. - Zhiqiu Lin; Xinyue Chen; Deepak Pathak; Pengchuan Zhang; Deva Ramanan (ICML, 2024)

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation. - Yunhao Ge; Yihe Tang; Jiashu Xu; Cem Gokmen; Chengshu Li 002; Wensi Ai; Benjamin Jose Martinez; Arman Aydin; Mona Anvari; Ayush K. Chakravarthy; Hong-Xing Yu; Josiah Wong; et al. (CoRR, 2024)

GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation. - Baiqi Li; Zhiqiu Lin; Deepak Pathak; Jiayao Li; Yixin Fei; Kewen Wu 005; Tiffany Ling; Xide Xia; Pengchuan Zhang; Graham Neubig; Deva Ramanan (CoRR, 2024)

TLDR: Token-Level Detective Reward Model for Large Vision Language Models. - Deqing Fu; Tong Xiao; Rui Wang; Wang Zhu 001; Pengchuan Zhang; Guan Pang; Robin Jia; Lawrence Chen 002 (ICLR, 2025)