Zhumin Chu

According to our database, Zhumin Chu authored at least 18 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Overview of the NTCIR-18 Automatic Evaluation of LLMs(AEOLLM) Task.

Junjie Chen, Haitao Li, Zhumin Chu, Yiqun Liu, Qingyao Ai

Proceedings of the 18th NTCIR Conference on Evaluation of Information Access Technologies, 2025

CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges.

Haitao Li, Junjie Chen, Qingyao Ai, Zhumin Chu, Yujia Zhou, Qian Dong, Yiqun Liu

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

On the Ordering of Pooled Web Pages, Gold Assessments, and Bronze Assessments.

Tetsuya Sakai, Sijie Tao, Nuo Chen, Yujing Li, Maria Maistro, Zhumin Chu, Nicola Ferro

ACM Trans. Inf. Syst., January, 2024

An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation.

Junjie Chen, Weihang Su, Zhumin Chu, Haitao Li, Qinyao Ai, Yiqun Liu, Min Zhang, Shaoping Ma

CoRR, 2024

PRE: A Peer Review Based Large Language Model Evaluator.

Zhumin Chu, Qingyao Ai, Yiteng Tu, Haitao Li, Yiqun Liu

CoRR, 2024

Automatic Large Language Model Evaluation via Peer Review.

Zhumin Chu, Qingyao Ai, Yiteng Tu, Haitao Li, Yiqun Liu

Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, 2024

2023

Chuweb21D: A Deduped English Document Collection for Web Search Tasks.

Zhumin Chu, Tetsuya Sakai, Qingyao Ai, Yiqun Liu

Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, 2023

THUIR at the NTCIR-17 FairWeb-1 Task: An Initial Exploration of the Relationship Between Relevance and Fairness.

Yiteng Tu, Haitao Li, Zhumin Chu, Qingyao Ai, Yiqun Liu

Proceedings of the 17th NTCIR Conference on Evaluation of Information Access Technologies, 2023

Overview of the NTCIR-17 FairWeb-1 Task.

Sijie Tao, Nuo Chen, Tetsuya Sakai, Zhumin Chu, Hiromi Arai, Ian Soboroff, Nicola Ferro, Maria Maistro

Proceedings of the 17th NTCIR Conference on Evaluation of Information Access Technologies, 2023

2022

Corrected Evaluation Results of the NTCIR WWW-2, WWW-3, and WWW-4 English Subtasks.

Tetsuya Sakai, Sijie Tao, Maria Maistro, Zhumin Chu, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, Yiqun Liu

CoRR, 2022

ConvSearch: A Open-Domain Conversational Search Behavior Dataset.

Zhumin Chu, Zhihong Wang, Yiqun Liu, Yingye Huang, Min Zhang, Shaoping Ma

CoRR, 2022

Overview of the NTCIR-16 We Want Web with CENTRE (WWW-4) Task.

Tetsuya Sakai, Sijie Tao, Zhumin Chu, Maria Maistro, Yujing Li, Nuo Chen, Nicola Ferro, Junjie Wang, Ian Soboroff, Yiqun Liu

Proceedings of the 16th NTCIR Conference on Evaluation of Information Access Technologies, 2022

THUIR at the NTCIR-16 WWW-4 Task.

Shenghao Yang, Haitao Li, Zhumin Chu, Jingtao Zhan, Yiqun Liu, Min Zhang, Shaoping Ma

Proceedings of the 16th NTCIR Conference on Evaluation of Information Access Technologies, 2022

2021

Evaluating Relevance Judgments with Pairwise Discriminative Power.

Zhumin Chu, Jiaxin Mao, Fan Zhang, Yiqun Liu, Tetsuya Sakai, Min Zhang, Shaoping Ma

Proceedings of the CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1, 2021

2020

Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task.

Tetsuya Sakai, Sijie Tao, Zhaohao Zeng, Yukun Zheng, Jiaxin Mao, Zhumin Chu, Yiqun Liu, Maria Maistro, Zhicheng Dou, Nicola Ferro, Ian Soboroff

Proceedings of the 15th NTCIR Conference on Evaluation of Information Access Technologies, 2020

THUIR at the NTCIR-15 WWW-3 Task.

Zhumin Chu, Jingtao Zhan, Xiangsheng Li, Jiaxin Mao, Yiqun Liu, Min Zhang, Shaoping Ma

Proceedings of the 15th NTCIR Conference on Evaluation of Information Access Technologies, 2020

2019

THUIR at the NTCIR-14 WWW-2 Task.

Yukun Zheng, Zhumin Chu, Xiangsheng Li, Jiaxin Mao, Yiqun Liu, Min Zhang, Shaoping Ma

Proceedings of the 14th NTCIR Conference on Evaluation of Information Access Technologies, 2019

Investigating the Reliability of Click Models.

Jiaxin Mao, Zhumin Chu, Yiqun Liu, Min Zhang, Shaoping Ma

Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, 2019