Haiyang Xu

According to our database, Haiyang Xu authored at least 72 papers between 1998 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding.

Anwen Hu, Haiyang Xu, Jiabo Ye, Ming Yan, Liang Zhang, Bo Zhang, Chen Li, Ji Zhang, Qin Jin, Fei Huang, Jingren Zhou

CoRR, 2024

Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection.

Wei Ye, Chaoya Jiang, Haiyang Xu, Chenhao Ye, Chenliang Li, Ming Yan, Shikun Zhang, Songhang Huang, Fei Huang

CoRR, 2024

Bayesian Diffusion Models for 3D Shape Reconstruction.

Haiyang Xu, Yu Lei, Zeyuan Chen, Xiang Zhang, Yue Zhao, Yilin Wang, Zhuowen Tu

CoRR, 2024

Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training.

Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu

CoRR, 2024

Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval.

Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu

CoRR, 2024

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models.

Chaoya Jiang, Wei Ye, Mengfan Dong, Hongrui Jia, Haiyang Xu, Ming Yan, Ji Zhang, Shikun Zhang

CoRR, 2024

Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception.

Junyang Wang, Haiyang Xu, Jiabo Ye, Ming Yan, Weizhou Shen, Ji Zhang, Fei Huang, Jitao Sang

CoRR, 2024

Halflife: An Adaptive Flowlet-based Load Balancer with Fading Timeout in Data Center Networks.

Sen Liu, Yongbo Gao, Zixuan Chen, Jiarui Ye, Haiyang Xu, Furong Liang, Wei Yan, Zerui Tian, Quanwei Sun, Zehua Guo, Yang Xu

Proceedings of the Nineteenth European Conference on Computer Systems, 2024

TiMix: Text-Aware Image Mixing for Effective Vision-Language Pre-training.

Chaoya Jiang, Wei Ye, Haiyang Xu, Qinghao Ye, Ming Yan, Ji Zhang, Shikun Zhang

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Learning Video-Text Aligned Representations for Video Captioning.

Yaya Shi, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha

ACM Trans. Multim. Comput. Commun. Appl., 2023

Achieving Human Parity on Visual Question Answering.

Ming Yan, Haiyang Xu, Chenliang Li, Junfeng Tian, Bin Bi, Wei Wang, Xianzhe Xu, Ji Zhang, Songfang Huang, Fei Huang, Luo Si, Rong Jin

ACM Trans. Inf. Syst., 2023

Analysis and evaluation of hemiplegic gait based on wearable sensor network.

Hongyu Zhao, Haiyang Xu, Zhelong Wang, Litong Wang, Sen Qiu, Daoyong Peng, Jiaxi Li, Jiahao Jiang

Inf. Fusion, 2023

Hallucination Augmented Contrastive Learning for Multimodal Large Language Model.

Chaoya Jiang, Haiyang Xu, Mengfan Dong, Jiaxing Chen, Wei Ye, Ming Yan, Qinghao Ye, Ji Zhang, Fei Huang, Shikun Zhang

CoRR, 2023

mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model.

Anwen Hu, Yaya Shi, Haiyang Xu, Jiabo Ye, Qinghao Ye, Ming Yan, Chenliang Li, Qi Qian, Ji Zhang, Fei Huang

CoRR, 2023

mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration.

Qinghao Ye, Haiyang Xu, Jiabo Ye, Ming Yan, Anwen Hu, Haowei Liu, Qi Qian, Ji Zhang, Fei Huang, Jingren Zhou

CoRR, 2023

UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model.

Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Guohai Xu, Chenliang Li, Junfeng Tian, Qi Qian, Ji Zhang, Qin Jin, Liang He, Xin Alex Lin, Fei Huang

CoRR, 2023

ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models.

Chenliang Li, Hehong Chen, Ming Yan, Weizhou Shen, Haiyang Xu, Zhikai Wu, Zhicheng Zhang, Wenmeng Zhou, Yingda Chen, Chen Cheng, Hongzhu Shi, Ji Zhang, Fei Huang, Jingren Zhou

CoRR, 2023

Evaluation and Analysis of Hallucination in Large Vision-Language Models.

Junyang Wang, Yiyang Zhou, Guohai Xu, Pengcheng Shi, Chenlin Zhao, Haiyang Xu, Qinghao Ye, Ming Yan, Ji Zhang, Jihua Zhu, Jitao Sang, Haoyu Tang

CoRR, 2023

BUS: Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization.

Chaoya Jiang, Haiyang Xu, Wei Ye, Qinghao Ye, Chenliang Li, Ming Yan, Bin Bi, Shikun Zhang, Fei Huang, Songfang Huang

CoRR, 2023

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding.

Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Yuhao Dan, Chenlin Zhao, Guohai Xu, Chenliang Li, Junfeng Tian, Qian Qi, Ji Zhang, Fei Huang

CoRR, 2023

Vision Transformer with Attention Map Hallucination and FFN Compaction.

Haiyang Xu, Zhichao Zhou, Dongliang He, Fu Li, Jingdong Wang

CoRR, 2023

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks.

Haiyang Xu, Qinghao Ye, Xuan Wu, Ming Yan, Yuan Miao, Jiabo Ye, Guohai Xu, Anwen Hu, Yaya Shi, Guangwei Xu, Chenliang Li, Qi Qian, Maofei Que, Ji Zhang, Xiao Zeng, Fei Huang

CoRR, 2023

Vision Langauge Pre-training by Contrastive Learning with Cross-Modal Similarity Regulation.

Chaoya Jiang, Wei Ye, Haiyang Xu, Ming Yan, Shikun Zhang, Jie Zhang, Fei Huang

CoRR, 2023

Transforming Visual Scene Graphs to Image Captions.

Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Ming Yan, Fei Huang, Zhangzikang Li, Yu Zhang

CoRR, 2023

mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality.

Qinghao Ye, Haiyang Xu, Guohai Xu, Jiabo Ye, Ming Yan, Yiyang Zhou, Junyang Wang, Anwen Hu, Pengcheng Shi, Yaya Shi, Chenliang Li, Yuanhong Xu, Hehong Chen, Junfeng Tian, Qian Qi, Ji Zhang, Fei Huang

CoRR, 2023

ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human.

Junfeng Tian, Hehong Chen, Guohai Xu, Ming Yan, Xing Gao, Jianhai Zhang, Chenliang Li, Jiayi Liu, Wenshen Xu, Haiyang Xu, Qi Qian, Wei Wang, Qinghao Ye, Jiejing Zhang, Ji Zhang, Fei Huang, Jingren Zhou

CoRR, 2023

Adaptively Clustering Neighbor Elements for Image Captioning.

Zihua Wang, Xu Yang, Haiyang Xu, Hanwang Zhang, Chenliang Li, Songfang Huang, Fei Huang, Yu Zhang

CoRR, 2023

Learning Trajectory-Word Alignments for Video-Language Tasks.

Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang

CoRR, 2023

mPLUG-Octopus: The Versatile Assistant Empowered by A Modularized End-to-End Multimodal LLM.

Qinghao Ye, Haiyang Xu, Ming Yan, Chenlin Zhao, Junyang Wang, Xiaoshan Yang, Ji Zhang, Fei Huang, Jitao Sang, Changsheng Xu

Proceedings of the 31st ACM International Conference on Multimedia, 2023

Learning Semantics-Grounded Vocabulary Representation for Video-Text Retrieval.

Yaya Shi, Haowei Liu, Haiyang Xu, Zongyang Ma, Qinghao Ye, Anwen Hu, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha

Proceedings of the 31st ACM International Conference on Multimedia, 2023

COPA : Efficient Vision-Language Pre-training through Collaborative Object- and Patch-Text Alignment.

Chaoya Jiang, Haiyang Xu, Wei Ye, Qinghao Ye, Chenliang Li, Ming Yan, Bin Bi, Shikun Zhang, Fei Huang, Ji Zhang

Proceedings of the 31st ACM International Conference on Multimedia, 2023

Curriculum Multi-Level Learning for Imbalanced Live-Stream Recommendation.

Shuodian Yu, Junqi Jin, Li Ma, Xiaofeng Gao, Xiaopeng Wu, Haiyang Xu, Jian Xu

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video.

Haiyang Xu, Qinghao Ye, Ming Yan, Yaya Shi, Jiabo Ye, Yuanhong Xu, Chenliang Li, Bin Bi, Qi Qian, Wei Wang, Guohai Xu, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou

Proceedings of the International Conference on Machine Learning, 2023

HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training.

Qinghao Ye, Guohai Xu, Ming Yan, Haiyang Xu, Qi Qian, Ji Zhang, Fei Huang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Learning Trajectory-Word Alignments for Video-Language Tasks.

Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

BUS : Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization.

Chaoya Jiang, Haiyang Xu, Wei Ye, Qinghao Ye, Chenliang Li, Ming Yan, Bin Bi, Shikun Zhang, Fei Huang, Songfang Huang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model.

Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Guohai Xu, Chenliang Li, Junfeng Tian, Qi Qian, Ji Zhang, Qin Jin, Liang He, Xin Lin, Fei Huang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models.

Chenliang Li, He Chen, Ming Yan, Weizhou Shen, Haiyang Xu, Zhikai Wu, Zhicheng Zhang, Wenmeng Zhou, Yingda Chen, Chen Cheng, Hongzhu Shi, Ji Zhang, Fei Huang, Jingren Zhou

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning.

Zhenru Zhang, Chuanqi Tan, Haiyang Xu, Chengyu Wang, Jun Huang, Songfang Huang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

Transforming Visual Scene Graphs to Image Captions.

Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Songfang Huang, Fei Huang, Zhangzikang Li, Yu Zhang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Vision Language Pre-training by Contrastive Learning with Cross-Modal Similarity Regulation.

Chaoya Jiang, Wei Ye, Haiyang Xu, Songfang Huang, Fei Huang, Shikun Zhang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

A Bi-Objective Learn-and-Deploy Scheduling Method for Bursty and Stochastic Requests on Heterogeneous Cloud Servers.

Xinye Cai, Haiyang Xu, Xiaoping Li, Kang Wang, Long Chen, Rubén Ruiz García, Qingfu Zhang

IEEE Trans. Parallel Distributed Syst., 2022

Real-time numerical system convertor via two-dimensional WS2-based memristive device.

Xing Xin, Liyao Sun, Jiamei Chen, Youzhe Bao, Ye Tao, Ya Lin, Jingyao Bian, Zhongqiang Wang, Xiaoning Zhao, Haiyang Xu, Yichun Liu

Frontiers Comput. Neurosci., 2022

HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training.

Qinghao Ye, Guohai Xu, Ming Yan, Haiyang Xu, Qi Qian, Ji Zhang, Fei Huang

CoRR, 2022

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections.

Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si

CoRR, 2022

Image Captioning In the Transformer Age.

Yang Xu, Li Li, Haiyang Xu, Songfang Huang, Fei Huang, Jianfei Cai

CoRR, 2022

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections.

Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, He Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection.

Chaoya Jiang, Haiyang Xu, Chenliang Li, Ming Yan, Wei Ye, Shikun Zhang, Bin Bi, Songfang Huang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching.

Yaya Shi, Xu Yang, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Control-based Bidding for Mobile Livestreaming Ads with Exposure Guarantee.

Haoqi Zhang, Junqi Jin, Zhenzhe Zheng, Fan Wu, Haiyang Xu, Jian Xu

Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 2022

2021

Achieving Human Parity on Visual Question Answering.

Ming Yan, Haiyang Xu, Chenliang Li, Junfeng Tian, Bin Bi, Wei Wang, Weihua Chen, Xianzhe Xu, Fan Wang, Zheng Cao, Zhicheng Zhang, Qiyu Zhang, Ji Zhang, Songfang Huang, Fei Huang, Luo Si, Rong Jin

CoRR, 2021

Grid-VLP: Revisiting Grid Features for Vision-Language Pre-training.

Ming Yan, Haiyang Xu, Chenliang Li, Bin Bi, Junfeng Tian, Min Gui, Wei Wang

CoRR, 2021

SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels.

Chenliang Li, Ming Yan, Haiyang Xu, Fuli Luo, Wei Wang, Bin Bi, Songfang Huang

CoRR, 2021

We Know What You Want: An Advertising Strategy Recommender System for Online Advertising.

Liyi Guo, Junqi Jin, Haoqi Zhang, Zhenzhe Zheng, Zhiye Yang, Zhizhuang Xing, Fei Pan, Lvyin Niu, Fan Wu, Haiyang Xu, Chuan Yu, Yuning Jiang, Xiaoqiang Zhu

Proceedings of the KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2021

Multi-objective Dynamic Auction Mechanism for Online Advertising.

Yiqing Wang, Junqi Jin, Zhenzhe Zheng, Haiyang Xu, Fan Wu, Yuning Jiang, Guihai Chen

Proceedings of the IEEE International Performance, 2021

A Two-phase Constrained Multi-Objective Evolutionary Algorithm Based on the Constrained Decomposition Approach.

Haiyang Xu, Xinye Cai, Zhenhua Li, Zhun Fan

Proceedings of the 7th IEEE International Conference on Cloud Computing and Intelligent Systems, 2021

E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning.

Haiyang Xu, Ming Yan, Chenliang Li, Bin Bi, Songfang Huang, Wenming Xiao, Fei Huang

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Storyline extraction from news articles with dynamic dependency.

Linsen Guo, Deyu Zhou, Yulan He, Haiyang Xu

Intell. Data Anal., 2020

Adversarial Multi-Binary Neural Network for Multi-class Classification.

Haiyang Xu, Junwen Chen, Kun Han, Xiangang Li

CoRR, 2020

Selective Attention Encoders by Syntactic Graph Convolutional Networks for Document Summarization.

Haiyang Xu, Yun Wang, Kun Han, Baochang Ma, Junwen Chen, Xiangang Li

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Learning to Infer User Hidden States for Online Sequential Advertising.

Zhaoqing Peng, Junqi Jin, Lan Luo, Yaodong Yang, Rui Luo, Jun Wang, Weinan Zhang, Haiyang Xu, Miao Xu, Chuan Yu, Tiejian Luo, Han Li, Jian Xu, Kun Gai

Proceedings of the CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, 2020

A Deep Prediction Network for Understanding Advertiser Intent and Satisfaction.

Liyi Guo, Rui Lu, Haoqi Zhang, Junqi Jin, Zhenzhe Zheng, Fan Wu, Jin Li, Haiyang Xu, Han Li, Wenkai Lu, Jian Xu, Kun Gai

Proceedings of the CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, 2020

Neural Topic Modeling with Bidirectional Adversarial Training.

Rui Wang, Xuemeng Hu, Deyu Zhou, Yulan He, Yuxuan Xiong, Chenchen Ye, Haiyang Xu

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

DELTA: A DEep learning based Language Technology plAtform.

Kun Han, Junwen Chen, Hui Zhang, Haiyang Xu, Yiping Peng, Yun Wang, Ning Ding, Hui Deng, Yonghu Gao, Tingwei Guo, Yi Zhang, Yahao He, Baochang Ma, Yulong Zhou, Kangli Zhang, Chao Liu, Ying Lyu, Chenxi Wang, Cheng Gong, Yunbo Wang, Wei Zou, Hui Song, Xiangang Li

CoRR, 2019

Learning Alignment for Multimodal Emotion Recognition from Speech.

Haiyang Xu, Hui Zhang, Kun Han, Yun Wang, Yiping Peng, Xiangang Li

Proceedings of the Interspeech 2019, 2019

Learning Syntactic and Dynamic Selective Encoding for Document Summarization.

Haiyang Xu, Yahao He, Kun Han, Junwen Chen, Xiangang Li

Proceedings of the International Joint Conference on Neural Networks, 2019

NVSRN: A Neural Variational Scaling Reasoning Network for Initiative Response Generation.

Jinxin Chang, Ruifang He, Haiyang Xu, Kun Han, Longbiao Wang, Xiangang Li, Jianwu Dang

Proceedings of the 2019 IEEE International Conference on Data Mining, 2019

2016

Unsupervised Storyline Extraction from News Articles.

Deyu Zhou, Haiyang Xu, Xin-Yu Dai, Yulan He

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

2015

An Unsupervised Bayesian Modelling Approach for Storyline Detection on News Articles.

Deyu Zhou, Haiyang Xu, Yulan He

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

2014

A Formal Transformation Approach for Embedded Software Modeling.

Haiyang Xu, Yi Zhuang

J. Softw., 2014

2007

Probabilistic Logic Operator based on Zero-order N/T-Norms Complete Clusters.

Haiyang Xu, Wenshan Cui, Ping Wang

Proceedings of the 8th ACIS International Conference on Software Engineering, 2007

1998

Stochastic volatility in interest rates and nonlinearity in velocity.

William A. Barnett, Haiyang Xu

Int. J. Syst. Sci., 1998