Pengchuan Zhang

According to our database, Pengchuan Zhang authored at least 62 papers between 2017 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

TLDR: Token-Level Detective Reward Model for Large Vision Language Models.

Deqing Fu, Tong Xiao, Rui Wang, Wang Zhu, Pengchuan Zhang, Guan Pang, Robin Jia, Lawrence Chen

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation.

Baiqi Li, Zhiqiu Lin, Deepak Pathak, Jiayao Li, Yixin Fei, Kewen Wu, Tiffany Ling, Xide Xia, Pengchuan Zhang, Graham Neubig, Deva Ramanan

CoRR, 2024

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation.

Yunhao Ge, Yihe Tang, Jiashu Xu, Cem Gokmen, Chengshu Li, Wensi Ai, Benjamin Jose Martinez, Arman Aydin, Mona Anvari, Ayush K. Chakravarthy, Hong-Xing Yu, Josiah Wong, Sanjana Srivastava, Sharon Lee, Shengxin Zha, Laurent Itti, Yunzhu Li, Roberto Martín-Martín, Miao Liu, Pengchuan Zhang, Ruohan Zhang, Li Fei-Fei, Jiajun Wu

CoRR, 2024

Revisiting the Role of Language Priors in Vision-Language Models.

Zhiqiu Lin, Xinyue Chen, Deepak Pathak, Pengchuan Zhang, Deva Ramanan

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Learning Video Context as Interleaved Multimodal Sequences.

Kevin Qinghong Lin, Pengchuan Zhang, Difei Gao, Xide Xia, Joya Chen, Ziteng Gao, Jinheng Xie, Xuhong Xiao, Mike Zheng Shou

Proceedings of the Computer Vision - ECCV 2024, 2024

Evaluating Text-to-Visual Generation with Image-to-Text Generation.

Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, Deva Ramanan

Proceedings of the Computer Vision - ECCV 2024, 2024

Evaluating and Improving Compositional Text-to-Visual Generation.

Baiqi Li, Zhiqiu Lin, Deepak Pathak, Jiayao Li, Yixin Fei, Kewen Wu, Xide Xia, Pengchuan Zhang, Graham Neubig, Deva Ramanan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation.

Yunhao Ge, Yihe Tang, Jiashu Xu, Cem Gokmen, Chengshu Li, Wensi Ai, Benjamin Jose Martinez, Arman Aydin, Mona Anvari, Ayush K. Chakravarthy, Hong-Xing Yu, Josiah Wong, Sanjana Srivastava, Sharon Lee, Shengxin Zha, Laurent Itti, Yunzhu Li, Roberto Martín-Martín, Miao Liu, Pengchuan Zhang, Ruohan Zhang, Li Fei-Fei, Jiajun Wu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task.

Yifan Wu, Pengchuan Zhang, Wenhan Xiong, Barlas Oguz, James C. Gee, Yixin Nie

CoRR, 2023

MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning.

Jun Chen, Deyao Zhu, Xiaoqian Shen, Xiang Li, Zechun Liu, Pengchuan Zhang, Raghuraman Krishnamoorthi, Vikas Chandra, Yunyang Xiong, Mohamed Elhoseiny

CoRR, 2023

VisualGPTScore: Visio-Linguistic Reasoning with Multimodal Generative Pre-Training Scores.

Zhiqiu Lin, Xinyue Chen, Deepak Pathak, Pengchuan Zhang, Deva Ramanan

CoRR, 2023

Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding.

Mohamed Afham, Satya Narayan Shukla, Omid Poursaeed, Pengchuan Zhang, Ashish Shah, Sernam Lim

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

DIME-FM : DIstilling Multimodal and Efficient Foundation Models.

Ximeng Sun, Pengchuan Zhang, Peizhao Zhang, Hardik Shah, Kate Saenko, Xide Xia

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone.

Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, Pengchuan Zhang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

UniVTG: Towards Unified Video-Language Temporal Grounding.

Kevin Qinghong Lin, Pengchuan Zhang, Joya Chen, Shraman Pramanick, Difei Gao, Alex Jinpeng Wang, Rui Yan, Mike Zheng Shou

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality.

Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding.

Lingchen Meng, Xiyang Dai, Yinpeng Chen, Pengchuan Zhang, Dongdong Chen, Mengchen Liu, Jianfeng Wang, Zuxuan Wu, Lu Yuan, Yu-Gang Jiang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Parameter-Efficient Model Adaptation for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

A Unified Model for Tracking and Image-Video Detection Has More Power.

Peirong Liu, Rui Wang, Pengchuan Zhang, Omid Poursaeed, Yipin Zhou, Xuefei Cao, Sreya Dutta Roy, Ashish Shah, Ser-Nam Lim

CoRR, 2022

Parameter-efficient Fine-tuning for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

CoRR, 2022

Vision-Language Intelligence: Tasks, Representation Learning, and Large Models.

Feng Li, Hao Zhang, Yi-Fan Zhang, Shilong Liu, Jian Guo, Lionel M. Ni, Pengchuan Zhang, Lei Zhang

CoRR, 2022

GLIPv2: Unifying Localization and Vision-Language Understanding.

Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

K-LITE: Learning Transferable Visual Models with External Knowledge.

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models.

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Houdong Hu, Zicheng Liu, Yong Jae Lee, Jianfeng Gao

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

3DB: A Framework for Debugging Computer Vision Models.

Guillaume Leclerc, Hadi Salman, Andrew Ilyas, Sai Vemprala, Logan Engstrom, Vibhav Vineet, Kai Yuanqing Xiao, Pengchuan Zhang, Shibani Santurkar, Greg Yang, Ashish Kapoor, Aleksander Madry

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone.

Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Efficient Self-supervised Vision Transformers for Representation Learning.

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

Proceedings of the Tenth International Conference on Learning Representations, 2022

Missingness Bias in Model Debugging.

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

Proceedings of the Tenth International Conference on Learning Representations, 2022

RegionCLIP: Region-based Language-Image Pretraining.

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Unified Contrastive Learning in Image-Text-Label Space.

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Grounded Language-Image Pre-training.

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

An Empirical Study of Training End-to-End Vision-and-Language Transformers.

Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, Zicheng Liu, Michael Zeng

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

Florence: A New Foundation Model for Computer Vision.

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

CoRR, 2021

Image Scene Graph Generation (SGG) Benchmark.

Xiaotian Han, Jianwei Yang, Houdong Hu, Lei Zhang, Jianfeng Gao, Pengchuan Zhang

CoRR, 2021

Focal Self-attention for Local-Global Interactions in Vision Transformers.

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao

CoRR, 2021

Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix.

Ruocheng Guo, Pengchuan Zhang, Hao Liu, Emre Kiciman

CoRR, 2021

VinVL: Making Visual Representations Matter in Vision-Language Models.

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CoRR, 2021

Focal Attention for Long-Range Interactions in Vision Transformers.

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference.

Shumao Zhang, Pengchuan Zhang, Thomas Y. Hou

Proceedings of the 38th International Conference on Machine Learning, 2021

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding.

Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Dynamic DETR: End-to-End Object Detection with Dynamic Attention.

Xiyang Dai, Yinpeng Chen, Jianwei Yang, Pengchuan Zhang, Lu Yuan, Lei Zhang

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

VinVL: Revisiting Visual Representations in Vision-Language Models.

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Object-Centric Image Generation from Layouts.

Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, R. Devon Hjelm, Shikhar Sharma

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

MiniVLM: A Smaller and Faster Vision-Language Model.

Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu

CoRR, 2020

Novel Human-Object Interaction Detection via Adversarial Domain Generalization.

Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang

CoRR, 2020

Statistical Adaptive Stochastic Gradient Methods.

Pengchuan Zhang, Hunter Lang, Qiang Liu, Lin Xiao

CoRR, 2020

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks.

Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao

Proceedings of the Computer Vision - ECCV 2020, 2020

MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network.

Yi Wei, Zhe Gan, Wenbo Li, Siwei Lyu, Ming-Ching Chang, Lei Zhang, Jianfeng Gao, Pengchuan Zhang

Proceedings of the Computer Vision - ACCV 2020 - 15th Asian Conference on Computer Vision, Kyoto, Japan, November 30, 2020

2019

A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networks.

Hadi Salman, Greg Yang, Huan Zhang, Cho-Jui Hsieh, Pengchuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers.

Hadi Salman, Jerry Li, Ilya P. Razenshteyn, Pengchuan Zhang, Huan Zhang, Sébastien Bubeck, Greg Yang

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Using Statistics to Automate Stochastic Optimization.

Hunter Lang, Lin Xiao, Pengchuan Zhang

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Understanding the Role of Momentum in Stochastic Gradient Methods.

Igor Gitman, Hunter Lang, Pengchuan Zhang, Lin Xiao

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

TIGEr: Text-to-Image Grounding for Image Caption Evaluation.

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Object-Driven Text-To-Image Synthesis via Adversarial Training.

Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications.

Huan Zhang, Pengchuan Zhang, Cho-Jui Hsieh

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

An Adaptive Fast Solver for a General Class of Positive Definite Matrices Via Energy Decomposition.

Thomas Y. Hou, De Huang, Ka Chun Lam, Pengchuan Zhang

Multiscale Model. Simul., 2018

A bird's-eye view on coherence, and a worm's-eye view on cohesion.

Woon Sang Cho, Pengchuan Zhang, Yizhe Zhang, Xiujun Li, Michel Galley, Mengdi Wang, Jianfeng Gao

CoRR, 2018

Turbo Learning for CaptionBot and DrawingBot.

Qiuyuan Huang, Pengchuan Zhang, Dapeng Oliver Wu, Lei Zhang

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

On the Discrimination-Generalization Tradeoff in GANs.

Pengchuan Zhang, Qiang Liu, Dengyong Zhou, Tao Xu, Xiaodong He

Proceedings of the 6th International Conference on Learning Representations, 2018

AttnGAN: Fine-Grained Text to Image Generation With Attentional Generative Adversarial Networks.

Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, Xiaodong He

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Exploring the Locally Low Dimensional Structure in Solving Random Elliptic PDEs.

Thomas Y. Hou, Qin Li, Pengchuan Zhang

Multiscale Model. Simul., 2017

A Sparse Decomposition of Low Rank Symmetric Positive Semidefinite Matrices.

Thomas Y. Hou, Qin Li, Pengchuan Zhang

Multiscale Model. Simul., 2017