Damai Dai

According to our database, Damai Dai authored at least 41 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Large Language Models Are Unconscious of Unreasonability in Math Problems.

Jingyuan Ma, Damai Dai, Zhifang Sui

CoRR, 2024

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization.

Xiangdi Meng, Damai Dai, Weiyao Luo, Zhe Yang, Shaoxiang Wu, Xiaochen Wang, Peiyi Wang, Qingxiu Dong, Liang Chen, Zhifang Sui

CoRR, 2024

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models.

Damai Dai, Chengqi Deng, Chenggang Zhao, R. X. Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Y. Wu, Zhenda Xie, Y. K. Li, Panpan Huang, Fuli Luo, Chong Ruan, Zhifang Sui, Wenfeng Liang

CoRR, 2024

Language Models Understand Numbers, at Least Partially.

Fangwei Zhu, Damai Dai, Zhifang Sui

CoRR, 2024

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Xiao Bi, Deli Chen, Guanting Chen, Shanhuang Chen, Damai Dai, Chengqi Deng, Honghui Ding, Kai Dong, Qiushi Du, Zhe Fu, Huazuo Gao, Kaige Gao, Wenjun Gao, Ruiqi Ge, Kang Guan, Daya Guo, Jianzhong Guo, Guangbo Hao, Zhewen Hao, Ying He, Wenjie Hu, Panpan Huang, Erhang Li, Guowei Li, Jiashi Li, Yao Li, Y. K. Li, Wenfeng Liang, Fangyun Lin, Alex X. Liu, Bo Liu, Wen Liu, Xiaodong Liu, Xin Liu, Yiyuan Liu, Haoyu Lu, Shanghao Lu, Fuli Luo, Shirong Ma, Xiaotao Nie, Tian Pei, Yishi Piao, Junjie Qiu, Hui Qu, Tongzheng Ren, Zehui Ren, Chong Ruan, Zhangli Sha, Zhihong Shao, Junxiao Song, Xuecheng Su, Jingxiang Sun, Yaofeng Sun, Minghui Tang, Bingxuan Wang, Peiyi Wang, Shiyu Wang, Yaohui Wang, Yongji Wang, Tong Wu, Y. Wu, Xin Xie, Zhenda Xie, Ziwei Xie, Yiliang Xiong, Hanwei Xu, R. X. Xu, Yanhong Xu, Dejian Yang, Yuxiang You, Shuiping Yu, Xingkai Yu, B. Zhang, Haowei Zhang, Lecong Zhang, Liyue Zhang, Mingchuan Zhang, Minghua Zhang, Wentao Zhang, Yichao Zhang, Chenggang Zhao, Yao Zhao, Shangyan Zhou, Shunfeng Zhou, Qihao Zhu, Yuheng Zou

CoRR, 2024

2023

Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations.

Peiyi Wang, Lei Li, Zhihong Shao, R. X. Xu, Damai Dai, Yifei Li, Deli Chen, Y. Wu, Zhifang Sui

CoRR, 2023

Bi-Drop: Generalizable Fine-tuning for Pre-trained Language Models via Adaptive Subnetwork Optimization.

Shoujie Tong, Heming Xia, Damai Dai, Tianyu Liu, Binghuai Lin, Yunbo Cao, Zhifang Sui

CoRR, 2023

A Survey for In-context Learning.

Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, Lei Li, Zhifang Sui

CoRR, 2023

Coarse-to-Fine Entity Representations for Document-Level Relation Extraction.

Damai Dai, Jing Ren, Shuang Zeng, Baobao Chang, Zhifang Sui

Proceedings of the Natural Language Processing and Chinese Computing, 2023

Mixture-of-Experts for Biomedical Question Answering.

Damai Dai, Wenbin Jiang, Jiyuan Zhang, Yajuan Lyu, Zhifang Sui, Baobao Chang

Proceedings of the Natural Language Processing and Chinese Computing, 2023

Neural Knowledge Bank for Pretrained Transformers.

Damai Dai, Wenbin Jiang, Qingxiu Dong, Yajuan Lyu, Zhifang Sui

Proceedings of the Natural Language Processing and Chinese Computing, 2023

Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning.

Zhe Yang, Damai Dai, Peiyi Wang, Zhifang Sui

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning.

Lean Wang, Lei Li, Damai Dai, Deli Chen, Hao Zhou, Fandong Meng, Jie Zhou, Xu Sun

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization.

Shoujie Tong, Heming Xia, Damai Dai, Runxin Xu, Tianyu Liu, Binghuai Lin, Yunbo Cao, Zhifang Sui

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion.

Shaoxiang Wu, Damai Dai, Ziwei Qin, Tianyu Liu, Binghuai Lin, Yunbo Cao, Zhifang Sui

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers.

Damai Dai, Yutao Sun, Li Dong, Yaru Hao, Shuming Ma, Zhifang Sui, Furu Wei

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers.

Damai Dai, Yutao Sun, Li Dong, Yaru Hao, Zhifang Sui, Furu Wei

CoRR, 2022

Calibrating Factual Knowledge in Pretrained Language Models.

Qingxiu Dong, Damai Dai, Yifan Song, Jingjing Xu, Zhifang Sui, Lei Li

CoRR, 2022

Neural Knowledge Bank for Pretrained Transformers.

Damai Dai, Wenbin Jiang, Qingxiu Dong, Yajuan Lyu, Qiaoqiao She, Zhifang Sui

CoRR, 2022

On the Representation Collapse of Sparse Mixture of Experts.

Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei

CoRR, 2022

Mixture of Experts for Biomedical Question Answering.

Damai Dai, Wenbin Jiang, Jiyuan Zhang, Weihua Peng, Yajuan Lyu, Zhifang Sui, Baobao Chang, Yong Zhu

CoRR, 2022

Plug-and-Play Module for Commonsense Reasoning in Machine Reading Comprehension.

Damai Dai, Hua Zheng, Zhifang Sui, Baobao Chang

Proceedings of the Natural Language Processing and Chinese Computing, 2022

On the Representation Collapse of Sparse Mixture of Experts.

Zewen Chi, Li Dong, Shaohan Huang, Damai Dai, Shuming Ma, Barun Patra, Saksham Singhal, Payal Bajaj, Xia Song, Xian-Ling Mao, Heyan Huang, Furu Wei

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances.

Shoujie Tong, Qingxiu Dong, Damai Dai, Yifan Song, Tianyu Liu, Baobao Chang, Zhifang Sui

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

Calibrating Factual Knowledge in Pretrained Language Models.

Qingxiu Dong, Damai Dai, Yifan Song, Jingjing Xu, Zhifang Sui, Lei Li

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Hierarchical Curriculum Learning for AMR Parsing.

Peiyi Wang, Liang Chen, Tianyu Liu, Damai Dai, Yunbo Cao, Baobao Chang, Zhifang Sui

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022

Knowledge Neurons in Pretrained Transformers.

Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Baobao Chang, Furu Wei

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

StableMoE: Stable Routing Strategy for Mixture of Experts.

Damai Dai, Li Dong, Shuming Ma, Bo Zheng, Zhifang Sui, Baobao Chang, Furu Wei

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Explicit Interaction Network for Aspect Sentiment Triplet Extraction.

Peiyi Wang, Lianzhe Huang, Tianyu Liu, Damai Dai, Runxin Xu, Houfeng Wang, Baobao Chang, Zhifang Sui

CoRR, 2021

Knowledge Neurons in Pretrained Transformers.

Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Furu Wei

CoRR, 2021

Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension.

Damai Dai, Hua Zheng, Zhifang Sui, Baobao Chang

CoRR, 2021

Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions.

Damai Dai, Hua Zheng, Fuli Luo, Pengcheng Yang, Tianyu Liu, Zhifang Sui, Baobao Chang

Proceedings of the 6th Workshop on Representation Learning for NLP, 2021

Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation.

Hua Zheng, Damai Dai, Lei Li, Tianyu Liu, Zhifang Sui, Baobao Chang, Yang Liu

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation.

Hua Zheng, Lei Li, Damai Dai, Deli Chen, Tianyu Liu, Xu Sun, Yang Liu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification.

Peiyi Wang, Runxin Xu, Tianyu Liu, Damai Dai, Baobao Chang, Zhifang Sui

Proceedings of the CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1, 2021

2020

Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions.

Damai Dai, Hua Zheng, Fuli Luo, Pengcheng Yang, Baobao Chang, Zhifang Sui

CoRR, 2020

2019

Learning to Control the Fine-grained Sentiment for Story Ending Generation.

Fuli Luo, Damai Dai, Pengcheng Yang, Tianyu Liu, Baobao Chang, Zhifang Sui, Xu Sun

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts.

Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions.

Wei Li, Xuancheng Ren, Damai Dai, Yunfang Wu, Houfeng Wang, Xu Sun

CoRR, 2018

Live Video Comment Generation Based on Surrounding Frames and Live Comments.

Damai Dai

CoRR, 2018

2017

FISF: Better User Experience using Smaller Bandwidth for Panoramic Virtual Reality Video.

Lun Wang, Damai Dai, Jie Jiang, Tong Yang, Xiaoke Jiang, Zekun Cai, Yang Li, Xiaoming Li

CoRR, 2017