Pengcheng He

According to our database, Pengcheng He authored at least 80 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Personalized Abstractive Summarization by Tri-agent Generation Pipeline.

Wen Xiao, Yujia Xie, Giuseppe Carenini, Pengcheng He

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, 2024

2023

A novel competitive constrained dual-archive dual-stage evolutionary algorithm for constrained multiobjective optimization.

Tianwei Zhou, Pengcheng He, Ben Niu, Guanghui Yue, Hong Wang

Swarm Evol. Comput., December, 2023

Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective.

Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He

CoRR, 2023

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models.

Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao

CoRR, 2023

Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling.

Huangjie Zheng, Zhendong Wang, Jianbo Yuan, Guanghan Ning, Pengcheng He, Quanzeng You, Hongxia Yang, Mingyuan Zhou

CoRR, 2023

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models.

Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He

CoRR, 2023

Deep Reinforcement Learning from Hierarchical Weak Preference Feedback.

Alexander Bukharin, Yixiao Li, Pengcheng He, Weizhu Chen, Tuo Zhao

CoRR, 2023

Do you really follow me? Adversarial Instructions for Evaluating the Robustness of Large Language Models.

Zekun Li, Baolin Peng, Pengcheng He, Xifeng Yan

CoRR, 2023

Summaries, Highlights, and Action items: Design, implementation and evaluation of an LLM-powered meeting recap system.

Sumit Asthana, Sagih Hilleli, Pengcheng He, Aaron Halfaker

CoRR, 2023

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

CoRR, 2023

Interactive Editing for Text Summarization.

Yujia Xie, Xun Wang, Si-Qing Chen, Wayne Xiong, Pengcheng He

CoRR, 2023

PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization.

Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan

CoRR, 2023

Summarization with Precise Length Control.

Lesly Miculicich, Yujia Xie, Song Wang, Pengcheng He

CoRR, 2023

ChatGPT-steered Editing Instructor for Customization of Abstractive Summarization.

Wen Xiao, Yujia Xie, Giuseppe Carenini, Pengcheng He

CoRR, 2023

Instruction Tuning with GPT-4.

Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao

CoRR, 2023

Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback.

Baolin Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao

CoRR, 2023

Guiding Large Language Models via Directional Stimulus Prompting.

Zekun Li, Baolin Peng, Pengcheng He, Michel Galley, Jianfeng Gao, Xifeng Yan

CoRR, 2023

A Prototype-Oriented Clustering for Domain Shift with Source Privacy.

Korawat Tanwisuth, Shujian Zhang, Pengcheng He, Mingyuan Zhou

CoRR, 2023

Cellular Network Optimization Using Unfolding-Based Graph Neural Networks.

Pengcheng He, Yijia Tang, Fan Xu, Qingjiang Shi

Proceedings of the 24th IEEE International Workshop on Signal Processing Advances in Wireless Communications, 2023

Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models.

Zhendong Wang, Yifan Jiang, Huangjie Zheng, Peihao Wang, Pengcheng He, Zhangyang Wang, Weizhu Chen, Mingyuan Zhou

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

In-Context Learning Unlocked for Diffusion Models.

Zhendong Wang, Yifan Jiang, Yadong Lu, Yelong Shen, Pengcheng He, Weizhu Chen, Zhangyang (Atlas) Wang, Mingyuan Zhou

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Guiding Large Language Models via Directional Stimulus Prompting.

Zekun Li, Baolin Peng, Pengcheng He, Michel Galley, Jianfeng Gao, Xifeng Yan

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

POUF: Prompt-Oriented Unsupervised Fine-tuning for Large Pre-trained Models.

Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng, Pengcheng He, Mingyuan Zhou

Proceedings of the International Conference on Machine Learning, 2023

HyperTuning: Toward Adapting Large Language Models without Back-propagation.

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

Proceedings of the International Conference on Machine Learning, 2023

Less is More: Task-aware Layer-wise Distillation for Language Model Compression.

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning.

Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Diffusion-GAN: Training GANs with Diffusion.

Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Eleventh International Conference on Learning Representations, 2023

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing.

Pengcheng He, Jianfeng Gao, Weizhu Chen

Proceedings of the Eleventh International Conference on Learning Representations, 2023

LMGQS: A Large-scale Dataset for Query-focused Summarization.

Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Pengcheng He, Chenguang Zhu, Michael Zeng

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Query Rewriting in Retrieval-Augmented Large Language Models.

Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, Nan Duan

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization.

Yu Li, Baolin Peng, Pengcheng He, Michel Galley, Zhou Yu, Jianfeng Gao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization.

Pengcheng He, Baolin Peng, Song Wang, Yang Liu, Ruochen Xu, Hany Hassan, Yu Shi, Chenguang Zhu, Wayne Xiong, Michael Zeng, Jianfeng Gao, Xuedong Huang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Attend to the Right Context: A Plug-and-Play Module for Content-Controllable Summarization.

Wen Xiao, Lesly Miculicich, Yang Liu, Pengcheng He, Giuseppe Carenini

CoRR, 2022

Momentum Calibration for Text Generation.

Xingxing Zhang, Yiran Liu, Xun Wang, Pengcheng He, Yang Yu, Si-Qing Chen, Wayne Xiong, Furu Wei

CoRR, 2022

Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization.

Pengcheng He, Baolin Peng, Liyang Lu, Song Wang, Jie Mei, Yang Liu, Ruochen Xu, Hany Hassan Awadalla, Yu Shi, Chenguang Zhu, Wayne Xiong, Michael Zeng, Jianfeng Gao, Xuedong Huang

CoRR, 2022

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog.

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

CoRR, 2022

Truncated Diffusion Probabilistic Models.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

CoRR, 2022

Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs.

Huangjie Zheng, Pengcheng He, Weizhu Chen, Mingyuan Zhou

CoRR, 2022

Experiences and Lessons Learned From DR Resources Participating in the US and UK Capacity Markets: Mechanisms, Status, Dilemmas and Recommendations.

Jin Sun, Jing Liu, Hao Chen, Pengcheng He, Huihong Yuan, Ze Yan

IEEE Access, 2022

Reinforced Event-Driven Evolutionary Algorithm Based on Double Deep Q-network.

Tianwei Zhou, Wenwen Zhang, Junrui Lu, Pengcheng He, Keqin Yao

Proceedings of the Advances in Swarm Intelligence - 13th International Conference, 2022

An Improved Particle Swarm Optimization Algorithm for Irregular Flight Recovery Problem.

Tianwei Zhou, Pengcheng He, Churong Zhang, Yichen Lai, Huifen Zhong, Xusheng Wu

Proceedings of the Advances in Swarm Intelligence - 13th International Conference, 2022

MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.

Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

ALLSH: Active Learning Guided by Local Sensitivity and Hardness.

Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, Mingyuan Zhou

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022

OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering.

Zhengbao Jiang, Yi Mao, Pengcheng He, Graham Neubig, Weizhu Chen

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

A Learned Multi-objective Bacterial Foraging Optimization Algorithm with Continuous Deep Q-Learning.

Tianwei Zhou, Wenwen Zhang, Pengcheng He, Guanghui Yue

Proceedings of the Machine Learning for Cyber Security - 4th International Conference, 2022

A Zeroth-Order Block Coordinate Gradient Descent Method For Cellular Network Optimization.

Pengcheng He, Siyuan Lu, Xin Guan, Yibin Kang, Qingjiang Shi

Proceedings of the 18th International Symposium on Wireless Communication Systems, 2022

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention.

Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.

Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2022

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models.

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the Tenth International Conference on Learning Representations, 2022

CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing.

Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

A Novel Image Encryption Algorithm Based on the Delayed Maps and Permutation-Confusion-Diffusion Architecture.

Pengcheng He, Kehui Sun, Congxu Zhu

Secur. Commun. Networks, 2021

Adversarial Training as Stackelberg Game: An Unrolled Optimization Approach.

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

CoRR, 2021

Greedy Multi-step Off-Policy Reinforcement Learning.

Yuhui Wang, Pengcheng He, Xiaoyang Tan

CoRR, 2021

Deberta: decoding-Enhanced Bert with Disentangled Attention.

Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen

Proceedings of the 9th International Conference on Learning Representations, 2021

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach.

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

ARCH: Efficient Adversarial Regularized Training with Caching.

Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Token-wise Curriculum Learning for Neural Machine Translation.

Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Tuo Zhao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Irregular Flight Timetable Recovery Under COVID-19: An Approach Based on Genetic Algorithm.

Tianwei Zhou, Junrui Lu, Wenwen Zhang, Pengcheng He, Ben Niu

Proceedings of the Data Mining and Big Data - 6th International Conference, 2021

Reader-Guided Passage Reranking for Open-Domain Question Answering.

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Generation-Augmented Retrieval for Open-Domain Question Answering.

Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization.

Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

UnitedQA: A Hybrid Approach for Open Domain Question Answering.

Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Adversarial Training for Large Neural Language Models.

Xiaodong Liu, Hao Cheng, Pengcheng He, Weizhu Chen, Yu Wang, Hoifung Poon, Jianfeng Gao

CoRR, 2020

Robust TOA-Based Source Self-Positioning With Clock Imperfection.

Pengcheng He, Xiaohu Jiang, Qingjiang Shi

Proceedings of the 2020 IEEE Wireless Communications and Networking Conference, 2020

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned.

Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick S. H. Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih

Proceedings of the NeurIPS 2020 Competition and Demonstration Track, 2020

On the Variance of the Adaptive Learning Rate and Beyond.

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Proceedings of the 8th International Conference on Learning Representations, 2020

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning.

Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, Weizhu Chen

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding.

Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2020

SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization.

Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

X-SQL: reinforce schema representation with context.

Pengcheng He, Yi Mao, Kaushik Chakrabarti, Weizhu Chen

CoRR, 2019

A Hybrid Neural Network Model for Commonsense Reasoning.

Pengcheng He, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

CoRR, 2019

Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding.

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

CoRR, 2019

A Bi-Attention Adversarial Network for Prostate Cancer Segmentation.

Guokai Zhang, Weigang Wang, Dinghao Yang, Jihao Luo, Pengcheng He, Yongtong Wang, Ye Luo, Binghui Zhao, Jianwei Lu

IEEE Access, 2019

Multi-Task Deep Neural Networks for Natural Language Understanding.

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

3D Spatial Pyramid Dilated Network for Pulmonary Nodule Classification.

Guokai Zhang, Xiao Liu, Dandan Zhu, Pengcheng He, Lipeng Liang, Ye Luo, Jianwei Lu

Symmetry, 2018

2017

Scalable Deep Document / Sequence Reasoning with Cognitive Toolkit.

Sayan Pathak, Pengcheng He, William Darling

Proceedings of the 26th International Conference on World Wide Web Companion, 2017

2014

Low illumination image Retinex enhancement algorithm based on guided filtering.

Jingcao Yin, Hongbo Li, Junping Du, Pengcheng He

Proceedings of the IEEE 3rd International Conference on Cloud Computing and Intelligence Systems, 2014

2012

The design and implementation of the 1911 revolution ontology search engine.

Junmin Ye, Pengcheng He, Shizi Li, Jingru Chen, Tong Tian

Proceedings of the 9th International Conference on Fuzzy Systems and Knowledge Discovery, 2012