Tianxiang Sun

According to our database, Tianxiang Sun authored at least 36 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance.

Jiasheng Ye, Peiju Liu, Tianxiang Sun, Yunhua Zhou, Jun Zhan, Xipeng Qiu

CoRR, 2024

In-Memory Learning: A Declarative Learning Framework for Large Language Models.

Bo Wang, Tianxiang Sun, Hang Yan, Siyin Wang, Qingyuan Cheng, Xipeng Qiu

CoRR, 2024

Turn Waste into Worth: Rectifying Top-k Router of MoE.

Zhiyuan Zeng, Qipeng Guo, Zhaoye Fei, Zhangyue Yin, Yunhua Zhou, Linyang Li, Tianxiang Sun, Hang Yan, Dahua Lin, Xipeng Qiu

CoRR, 2024

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling.

Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yugang Jiang, Xipeng Qiu

CoRR, 2024

Dictionary Learning Improves Patch-Free Circuit Discovery in Mechanistic Interpretability: A Case Study on Othello-GPT.

Zhengfu He, Xuyang Ge, Qiong Tang, Tianxiang Sun, Qinyuan Cheng, Xipeng Qiu

CoRR, 2024

LLM can Achieve Self-Regulation via Hyperparameter Aware Generation.

Siyin Wang, Shimin Li, Tianxiang Sun, Jinlan Fu, Qinyuan Cheng, Jiasheng Ye, Junjie Ye, Xipeng Qiu, Xuanjing Huang

CoRR, 2024

Can AI Assistants Know What They Don't Know?

Qinyuan Cheng, Tianxiang Sun, Xiangyang Liu, Wenwei Zhang, Zhangyue Yin, Shimin Li, Linyang Li, Zhengfu He, Kai Chen, Xipeng Qiu

CoRR, 2024

Agent Alignment in Evolving Social Norms.

Shimin Li, Tianxiang Sun, Xipeng Qiu

CoRR, 2024

DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning.

Xinghao Wang, Junliang He, Pengyu Wang, Yunhua Zhou, Tianxiang Sun, Xipeng Qiu

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

LLatrieval: LLM-Verified Retrieval for Verifiable Generation.

Xiaonan Li, Changtai Zhu, Linyang Li, Zhangyue Yin, Tianxiang Sun, Xipeng Qiu

CoRR, 2023

Flames: Benchmarking Value Alignment of Chinese Large Language Models.

Kexin Huang, Xiangyang Liu, Qianyu Guo, Tianxiang Sun, Jiawei Sun, Yaru Wang, Zeyang Zhou, Yixu Wang, Yan Teng, Xipeng Qiu, Yingchun Wang, Dahua Lin

CoRR, 2023

Evaluating Hallucinations in Chinese Large Language Models.

Qinyuan Cheng, Tianxiang Sun, Wenwei Zhang, Siyin Wang, Xiangyang Liu, Mozhi Zhang, Junliang He, Mianqiu Huang, Zhangyue Yin, Kai Chen, Xipeng Qiu

CoRR, 2023

Secrets of RLHF in Large Language Models Part I: PPO.

Rui Zheng, Shihan Dou, Songyang Gao, Yuan Hua, Wei Shen, Binghai Wang, Yan Liu, Senjie Jin, Qin Liu, Yuhao Zhou, Limao Xiong, Lu Chen, Zhiheng Xi, Nuo Xu, Wenbin Lai, Minghao Zhu, Cheng Chang, Zhangyue Yin, Rongxiang Weng, Wensen Cheng, Haoran Huang, Tianxiang Sun, Hang Yan, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang

CoRR, 2023

Origin Tracing and Detecting of LLMs.

Linyang Li, Pengyu Wang, Ke Ren, Tianxiang Sun, Xipeng Qiu

CoRR, 2023

Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning.

Tianxiang Sun, Zhengfu He, Qin Zhu, Xipeng Qiu, Xuanjing Huang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors.

Peng Li, Tianxiang Sun, Qiong Tang, Hang Yan, Yuanbin Wu, Xuanjing Huang, Xipeng Qiu

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models.

Zhengfu He, Tianxiang Sun, Qiong Tang, Kuanning Wang, Xuanjing Huang, Xipeng Qiu

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Improving Contrastive Learning of Sentence Embeddings from AI Feedback.

Qinyuan Cheng, Xiaogui Yang, Tianxiang Sun, Linyang Li, Xipeng Qiu

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Paradigm Shift in Natural Language Processing.

Tianxiang Sun, Xiangyang Liu, Xipeng Qiu, Xuanjing Huang

Int. J. Autom. Comput., 2022

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models.

Zhengfu He, Tianxiang Sun, Kuanning Wang, Xuanjing Huang, Xipeng Qiu

CoRR, 2022

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning.

Tianxiang Sun, Zhengfu He, Qin Zhu, Xipeng Qiu, Xuanjing Huang

CoRR, 2022

BBTv2: Pure Black-Box Optimization Can Be Comparable to Gradient Descent for Few-Shot Learning.

Tianxiang Sun, Zhengfu He, Hong Qian, Xuanjing Huang, Xipeng Qiu

CoRR, 2022

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline.

Xiangyang Liu, Tianxiang Sun, Junliang He, Jiawen Wu, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Black-Box Tuning for Language-Model-as-a-Service.

Tianxiang Sun, Yunfan Shao, Hong Qian, Xuanjing Huang, Xipeng Qiu

Proceedings of the International Conference on Machine Learning, 2022

BBTv2: Towards a Gradient-Free Future with Large Language Models.

Tianxiang Sun, Zhengfu He, Hong Qian, Yunhua Zhou, Xuanjing Huang, Xipeng Qiu

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation.

Tianxiang Sun, Junliang He, Xipeng Qiu, Xuanjing Huang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts.

Xiangyang Liu, Tianxiang Sun, Xuanjing Huang, Xipeng Qiu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation.

Tianxiang Sun, Xiangyang Liu, Wei Zhu, Zhichao Geng, Lingling Wu, Yilong He, Yuan Ni, Guotong Xie, Xuanjing Huang, Xipeng Qiu

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

2021

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline.

Xiangyang Liu, Tianxiang Sun, Junliang He, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu

CoRR, 2021

Learning to Teach with Student Feedback.

Yitao Liu, Tianxiang Sun, Xipeng Qiu, Xuanjing Huang

CoRR, 2021

Early Exiting with Ensemble Internal Classifiers.

Tianxiang Sun, Yunhua Zhou, Xiangyang Liu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu

CoRR, 2021

Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa.

Junqi Dai, Hang Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Accelerating BERT Inference for Sequence Labeling via Early-Exit.

Xiaonan Li, Yunfan Shao, Tianxiang Sun, Hang Yan, Xipeng Qiu, Xuanjing Huang

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Pre-trained Models for Natural Language Processing: A Survey.

Xipeng Qiu, Tianxiang Sun, Yige Xu, Yunfan Shao, Ning Dai, Xuanjing Huang

CoRR, 2020

CoLAKE: Contextualized Language and Knowledge Embedding.

Tianxiang Sun, Yunfan Shao, Xipeng Qiu, Qipeng Guo, Yaru Hu, Xuanjing Huang, Zheng Zhang

Proceedings of the 28th International Conference on Computational Linguistics, 2020

Learning Sparse Sharing Architectures for Multiple Tasks.

Tianxiang Sun, Yunfan Shao, Xiaonan Li, Pengfei Liu, Hang Yan, Xipeng Qiu, Xuanjing Huang

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020