Shitao Xiao

According to our database, Shitao Xiao authored at least 60 papers between 2021 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Task-Aware KV Compression For Cost-Effective Long Video Understanding.

Minghao Qin, Yan Shu, Peitian Zhang, Kun Lun, Huaying Yuan, Junjie Zhou, Shitao Xiao, Bo Zhao, Zheng Liu

CoRR, June, 2025

Video-XL-2: Towards Very Long-Video Understanding Through Task-Aware KV Sparsification.

Minghao Qin, Xiangrui Liu, Zhengyang Liang, Yan Shu, Huaying Yuan, Junjie Zhou, Shitao Xiao, Bo Zhao, Zheng Liu

CoRR, June, 2025

OmniGen2: Exploration to Advanced Multimodal Generation.

Chenyuan Wu, Pengfei Zheng, Ruiran Yan, Shitao Xiao, Xin Luo, Yueze Wang, Wanli Li, Xiyan Jiang, Yexin Liu, Junjie Zhou, Ze Liu, Ziyi Xia, Chaofan Li, Haoge Deng, Jiahao Wang, Kun Luo, Bo Zhang, Defu Lian, Xinlong Wang, Zhongyuan Wang, Tiejun Huang, Zheng Liu

CoRR, June, 2025

MMTEB: Massive Multilingual Text Embedding Benchmark.

Kenneth C. Enevoldsen, Isaac Chung, Imene Kerboua, Márton Kardos, Ashwin Mathur, David Stap, Jay Gala, Wissam Siblini, Dominik Krzeminski, Genta Indra Winata, Saba Sturua, Saiteja Utpala, Mathieu Ciancone, Marion Schaeffer, Gabriel Sequeira, Diganta Misra, Shreeya Dhakal, Jonathan Rystrøm, Roman Solomatin, Ömer Çagatan, Akash Kundu, Martin Bernstorff, Shitao Xiao, Akshita Sukhlecha, Bhavish Pahwa, Rafal Poswiata, Kranthi Kiran GV, Shawon Ashraf, Daniel Auras, Björn Plüster, Jan Philipp Harries, Loïc Magne, Isabelle Mohr, Mariya Hendriksen, Dawei Zhu, Hippolyte Gisserot-Boukhlef, Tom Aarsen, Jan Kostkan, Konrad Wojtasik, Taemin Lee, Marek Suppa, Crystina Zhang, Roberta Rocca, Mohammed Hamdy, Andrianos Michail, John Yang, Manuel Faysse, Aleksei Vatolin, Nandan Thakur, Manan Dey, Dipam Vasani, Pranjal A. Chitale, Simone Tedeschi, Nguyen Tai, Artem Snegirev, Michael Günther, Mengzhou Xia, Weijia Shi, Xing Han Lù, Jordan Clive, Gayatri Krishnakumar, Anna Maksimova, Silvan Wehrli, Maria Tikhonova, Henil Panchal, Aleksandr Abramov, Malte Ostendorff, Zheng Liu, Simon Clematide, Lester James V. Miranda, Alena Fenogenova, Guangyu Song, Ruqiya Bin Safi, Wen-Ding Li, Alessia Borghini, Federico Cassano, Hongjin Su, Jimmy Lin, Howard Yen, Lasse Hansen, Sara Hooker, Chenghao Xiao, Vaibhav Adlakha, Orion Weller, Siva Reddy, Niklas Muennighoff

CoRR, February, 2025

EfficientLLM: Scalable Pruning-Aware Pretraining for Architecture-Agnostic Edge Language Models.

Xingrun Xing, Zheng Liu, Shitao Xiao, Boyan Gao, Yiming Liang, Wanpeng Zhang, Haokun Lin, Guoqi Li, Jiajun Zhang

CoRR, February, 2025

Matryoshka Re-Ranker: A Flexible Re-Ranking Architecture With Configurable Depth and Width.

Zheng Liu, Chaofan Li, Shitao Xiao, Chaozhuo Li, Defu Lian, Yingxia Shao

CoRR, January, 2025

Fitting Into Any Shape: A Flexible LLM-Based Re-Ranker With Configurable Depth and Width.

Zheng Liu, Chaofan Li, Shitao Xiao, Chaozhuo Li, Chen Jason Zhang, Hao Liao, Defu Lian, Yingxia Shao

Proceedings of the ACM on Web Conference 2025, 2025

Lighter And Better: Towards Flexible Context Adaptation For Retrieval Augmented Generation.

Chenyuan Wu, Ninglu Shao, Zheng Liu, Shitao Xiao, Chaozhuo Li, Chen Zhang, Senzhang Wang, Defu Lian

Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining, 2025

Long Context Compression with Activation Beacon.

Peitian Zhang, Zheng Liu, Shitao Xiao, Ninglu Shao, Qiwei Ye, Zhicheng Dou

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking.

Xingrun Xing, Boyan Gao, Zheng Liu, David A. Clifton, Shitao Xiao, Wanpeng Zhang, Li Du, Zheng Zhang, Guoqi Li, Jiajun Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Making Text Embedders Few-Shot Learners.

Chaofan Li, Minghao Qin, Shitao Xiao, Jianlyu Chen, Kun Luo, Defu Lian, Yingxia Shao, Zheng Liu

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

OmniGen: Unified Image Generation.

Shitao Xiao, Yueze Wang, Junjie Zhou, Huaying Yuan, Xingrun Xing, Ruiran Yan, Chaofan Li, Shuting Wang, Tiejun Huang, Zheng Liu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

MLVU: Benchmarking Multi-task Long Video Understanding.

Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Zhengyang Liang, Shitao Xiao, Minghao Qin, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, Zheng Liu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

FineRAG: Fine-grained Retrieval-Augmented Text-to-Image Generation.

Huaying Yuan, Ziliang Zhao, Shuting Wang, Shitao Xiao, Minheng Ni, Zheng Liu, Zhicheng Dou

Proceedings of the 31st International Conference on Computational Linguistics, 2025

Any Information Is Just Worth One Single Screenshot: Unifying Search With Visualized Information Retrieval.

Zheng Liu, Ze Liu, Zhengyang Liang, Junjie Zhou, Shitao Xiao, Chao Gao, Chen Jason Zhang, Defu Lian

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark.

Jianlyu Chen, Nan Wang, Chaofan Li, Bo Wang, Shitao Xiao, Han Xiao, Hao Liao, Defu Lian, Zheng Liu

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval.

Junjie Zhou, Yongping Xiong, Zheng Liu, Ze Liu, Shitao Xiao, Yueze Wang, Bo Zhao, Chen Jason Zhang, Defu Lian

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Lighter And Better: Towards Flexible Context Adaptation For Retrieval Augmented Generation.

Zheng Liu, Chenyuan Wu, Ninglu Shao, Shitao Xiao, Chaozhuo Li, Defu Lian

CoRR, 2024

OmniGen: Unified Image Generation.

Shitao Xiao, Yueze Wang, Junjie Zhou, Huaying Yuan, Xingrun Xing, Ruiran Yan, Shuting Wang, Tiejun Huang, Zheng Liu

CoRR, 2024

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking.

Xingrun Xing, Boyan Gao, Zheng Zhang, David A. Clifton, Shitao Xiao, Li Du, Guoqi Li, Jiajun Zhang

CoRR, 2024

MLVU: A Comprehensive Benchmark for Multi-Task Long Video Understanding.

Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Shitao Xiao, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, Zheng Liu

CoRR, 2024

Extending Llama-3's Context Ten-Fold Overnight.

Peitian Zhang, Ninglu Shao, Zheng Liu, Shitao Xiao, Hongjin Qian, Qiwei Ye, Zhicheng Dou

CoRR, 2024

Extensible Embedding: A Flexible Multipler For LLM's Context Length.

Ninglu Shao, Shitao Xiao, Zheng Liu, Peitian Zhang

CoRR, 2024

BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models.

Kun Luo, Zheng Liu, Shitao Xiao, Kang Liu

CoRR, 2024

BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation.

Jianlv Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, Zheng Liu

CoRR, 2024

Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization.

Ninglu Shao, Shitao Xiao, Zheng Liu, Peitian Zhang

CoRR, 2024

Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon.

Peitian Zhang, Zheng Liu, Shitao Xiao, Ninglu Shao, Qiwei Ye, Zhicheng Dou

CoRR, 2024

C-Pack: Packed Resources For General Chinese Embeddings.

Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighoff, Defu Lian, Jian-Yun Nie

Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2024

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms.

Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment.

Kun Luo, Minghao Qin, Zheng Liu, Shitao Xiao, Jun Zhao, Kang Liu

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval.

Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

A Multi-Task Embedder For Retrieval Augmented LLMs.

Peitian Zhang, Zheng Liu, Shitao Xiao, Zhicheng Dou, Jian-Yun Nie

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

LM-Cocktail: Resilient Tuning of Language Models via Model Merging.

Shitao Xiao, Zheng Liu, Peitian Zhang, Xingrun Xing

Proceedings of the Findings of the Association for Computational Linguistics, 2024

Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models.

Kun Luo, Zheng Liu, Shitao Xiao, Tong Zhou, Yubo Chen, Jun Zhao, Kang Liu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval.

Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao, Defu Lian

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation.

Jianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, Zheng Liu

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Making Large Language Models A Better Foundation For Dense Retrieval.

Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao

CoRR, 2023

Retrieve Anything To Augment Large Language Models.

Peitian Zhang, Shitao Xiao, Zheng Liu, Zhicheng Dou, Jian-Yun Nie

CoRR, 2023

C-Pack: Packaged Resources To Advance General Chinese Embedding.

Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighoff

CoRR, 2023

LibVQ: A Toolkit for Optimizing Vector Quantization and Efficient Neural Retrieval.

Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao, Defu Lian, Zhao Cao

Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2023

Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval.

Peitian Zhang, Zheng Liu, Shitao Xiao, Zhicheng Dou, Jing Yao

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Diversity-aware Deep Ranking Network for Recommendation.

Zihong Wang, Yingxia Shao, Jiyuan He, Jinbao Liu, Shitao Xiao, Tao Feng, Ming Liu

Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023

RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models.

Zheng Liu, Shitao Xiao, Yingxia Shao, Zhao Cao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

An overview of brain-like computing: Architecture, applications, and future trends.

Wei Ou, Shitao Xiao, Chengyu Zhu, Wenbao Han, Qionglu Zhang

Frontiers Neurorobotics, 2022

RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models.

Shitao Xiao, Zheng Liu

CoRR, 2022

Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings.

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Denvy Deng, Qi Zhang, Xing Xie

CoRR, 2022

A Mutually Reinforced Framework for Pretrained Sentence Embeddings.

Junhan Yang, Zheng Liu, Shitao Xiao, Jianxun Lian, Lijun Wu, Defu Lian, Guangzhong Sun, Xing Xie

CoRR, 2022

Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search.

Jianjin Zhang, Zheng Liu, Weihao Han, Shitao Xiao, Ruicheng Zheng, Yingxia Shao, Hao Sun, Hanqing Zhu, Premkumar Srinivasan, Denvy Deng, Qi Zhang, Xing Xie

CoRR, 2022

LECF: recommendation via learnable edge collaborative filtering.

Shitao Xiao, Yingxia Shao, Yawen Li, Hongzhi Yin, Yanyan Shen, Bin Cui

Sci. China Inf. Sci., 2022

Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval.

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Yingxia Shao, Defu Lian, Chaozhuo Li, Hao Sun, Denvy Deng, Liangjie Zhang, Qi Zhang, Xing Xie

Proceedings of the WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25, 2022

MINDSim: User Simulator for News Recommenders.

Xufang Luo, Zheng Liu, Shitao Xiao, Xing Xie, Dongsheng Li

Proceedings of the WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25, 2022

Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings.

Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie

Proceedings of the SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11, 2022

Uni-Retriever: Towards Learning the Unified Embedding Based Retriever in Bing Sponsored Search.

Jianjin Zhang, Zheng Liu, Weihao Han, Shitao Xiao, Ruicheng Zheng, Yingxia Shao, Hao Sun, Hanqing Zhu, Premkumar Srinivasan, Weiwei Deng, Qi Zhang, Xing Xie

Proceedings of the KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, August 14, 2022

Training Large-Scale News Recommenders with Pretrained Language Models in the Loop.

Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Bhuvan Middha, Fangzhao Wu, Xing Xie

Proceedings of the KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, August 14, 2022

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder.

Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

GraphFormers: GNN-nested Language Models for Linked Text Representation.

Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Guangzhong Sun, Xing Xie

CoRR, 2021

Search-oriented Differentiable Product Quantization.

Shitao Xiao, Zheng Liu, Yingxia Shao, Defu Lian, Xing Xie

CoRR, 2021

Training Microsoft News Recommenders with Pretrained Language Models in the Loop.

Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Xing Xie

CoRR, 2021

GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graph.

Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Defu Lian, Sanjay Agrawal, Amit Singh, Guangzhong Sun, Xing Xie

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Matching-oriented Embedding Quantization For Ad-hoc Retrieval.

Shitao Xiao, Zheng Liu, Yingxia Shao, Defu Lian, Xing Xie

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021