Revisit network anomaly ranking in datacenter network using re-ranking. - Shaohan Huang; Carol J. Fung; Kui Wang; Yaqi Yang; Zhongzhi Luan; Depei Qian (CloudNet, 2015)

A methodology for root-cause analysis in component based systems. - Kui Wang; Carol J. Fung; Chao Ding; Polo Pei; Shaohan Huang; Zhongzhi Luan; Depei Qian (IWQoS, 2015)

Using recurrent neural networks toward black-box system anomaly prediction. - Shaohan Huang; Carol J. Fung; Kui Wang; Polo Pei; Zhongzhi Luan; Depei Qian (IWQoS, 2016)

SuperAgent: A Customer Service Chatbot for E-commerce Websites. - Lei Cui 001; Shaohan Huang; Furu Wei; Chuanqi Tan; Chaoqun Duan; Ming Zhou 001 (ACL (System Demonstrations), 2017)

Arena: Adaptive real-time update anomaly prediction in cloud systems. - Shaohan Huang; Carol J. Fung; Chang Liu; Shupeng Zhang; Guang Wei; Zhongzhi Luan; Depei Qian (CNSM, 2017)

Learning to Generate Product Reviews from Attributes. - Li Dong 004; Shaohan Huang; Furu Wei; Mirella Lapata; Ming Zhou 001; Ke Xu 001 (EACL (1), 2017)

PSOM: Periodic Self-Organizing Maps for unsupervised anomaly detection in periodic time series. - Shupeng Zhang; Carol J. Fung; Shaohan Huang; Zhongzhi Luan; Depei Qian (IWQoS, 2017)

Neural Document Summarization by Jointly Learning to Score and Select Sentences. - Qingyu Zhou; Nan Yang 002; Furu Wei; Shaohan Huang; Ming Zhou 001; Tiejun Zhao (ACL (1), 2018)

Response Generation by Context-aware Prototype Editing. - Yu Wu 012; Furu Wei; Shaohan Huang; Zhoujun Li 001; Ming Zhou 001 (CoRR, 2018)

Dictionary-Guided Editing Networks for Paraphrase Generation. - Shaohan Huang; Yu Wu 012; Furu Wei; Ming Zhou 001 (CoRR, 2018)

Text Morphing. - Shaohan Huang; Yu Wu 012; Furu Wei; Ming Zhou 001 (CoRR, 2018)

Response Generation by Context-Aware Prototype Editing. - Yu Wu 012; Furu Wei; Shaohan Huang; Yunli Wang; Zhoujun Li 001; Ming Zhou 001 (AAAI, 2019)

Dictionary-Guided Editing Networks for Paraphrase Generation. - Shaohan Huang; Yu Wu 012; Furu Wei; Zhongzhi Luan (AAAI, 2019)

Neural Melody Composition from Lyrics. - Hangbo Bao; Shaohan Huang; Furu Wei; Lei Cui 001; Yu Wu 012; Chuanqi Tan; Songhao Piao; Ming Zhou 001 (NLPCC (1), 2019)

Transfer Log-based Anomaly Detection with Pseudo Labels. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Rong He; Yining Zhao; Hailong Yang 002; Zhongzhi Luan (CNSM, 2020)

Unsupervised Fine-tuning for Text Clustering. - Shaohan Huang; Furu Wei; Lei Cui 001; Xingxing Zhang 002; Ming Zhou 001 (COLING, 2020)

DocBank: A Benchmark Dataset for Document Layout Analysis. - Minghao Li 004; Yiheng Xu; Lei Cui 001; Shaohan Huang; Furu Wei; Zhoujun Li 001; Ming Zhou 001 (COLING, 2020)

Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph. - Haozhe Ji; Pei Ke; Shaohan Huang; Furu Wei; Xiaoyan Zhu 001; Minlie Huang (EMNLP (1), 2020)

A Gated Few-shot Learning Model For Anomaly Detection. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Wanhe An; Rong He; Yining Zhao; Hailong Yang 002; Zhongzhi Luan (ICOIN, 2020)

Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths. - Haozhe Ji; Pei Ke; Shaohan Huang; Furu Wei; Minlie Huang (AACL/IJCNLP, 2020)

LayoutLM: Pre-training of Text and Layout for Document Image Understanding. - Yiheng Xu; Minghao Li 004; Lei Cui 001; Shaohan Huang; Furu Wei; Ming Zhou 001 (KDD, 2020)

TableBank: Table Benchmark for Image-based Table Detection and Recognition. - Minghao Li 004; Lei Cui 001; Shaohan Huang; Furu Wei; Ming Zhou 001; Zhoujun Li 001 (LREC, 2020)

Paddy: An Event Log Parsing Approach using Dynamic Dictionary. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Rong He; Yining Zhao; Hailong Yang 002; Zhongzhi Luan (NOMS, 2020)

A Joint Sentence Scoring and Selection Framework for Neural Extractive Document Summarization. - Qingyu Zhou; Nan Yang 002; Furu Wei; Shaohan Huang; Ming Zhou 001; Tiejun Zhao (IEEE ACM Trans. Audio Speech Lang. Process., 2020)

HitAnomaly: Hierarchical Transformers for Anomaly Detection in System Log. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Rong He; Yining Zhao; Hailong Yang 002; Zhongzhi Luan (IEEE Trans. Netw. Serv. Manag., 2020)

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. - Zewen Chi; Li Dong 004; Bo Zheng 010; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL/IJCNLP (1), 2021)

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. - Wenhui Wang 003; Hangbo Bao; Shaohan Huang; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. - Yunzhi Yao; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

PriPro: Towards Effective Privacy Protection on Edge-Cloud System running DNN Inference. - Ruiyuan Gao 001; Hailong Yang 002; Shaohan Huang; Ming Dun; Mingzhen Li 001; Zerong Luan; Zhongzhi Luan; Depei Qian (CCGRID, 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Saksham Singhal; Xian-Ling Mao; Heyan Huang; Xia Song; Furu Wei (EMNLP (1), 2021)

Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (EMNLP (1), 2021)

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. - Jian Yang 030; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Li Dong 004; Shaohan Huang; Alexandre Muzio; Saksham Singhal; Hany Hassan; Xia Song; Furu Wei (WMT@EMNLP, 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (CoRR, 2021)

DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. - Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Alexandre Muzio; Saksham Singhal; Hany Hassan Awadalla; Xia Song; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2021)

Improving Non-autoregressive Generation with Mixup Training. - Ting Jiang; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Liangjie Zhang; Qi Zhang 066 (CoRR, 2021)

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. - Tianyu Chen; Hangbo Bao; Shaohan Huang; Li Dong 004; Binxing Jiao; Daxin Jiang; Haoyi Zhou; Jianxin Li 002; Furu Wei (ACL (Findings), 2022)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Bo Zheng 010; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL (1), 2022)

Black-box Attacks to Log-based Anomaly Detection. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Hailong Yang 002; Zhongzhi Luan (CNSM, 2022)

Snapshot-Guided Domain Adaptation for ELECTRA. - Daixuan Cheng; Shaohan Huang; Jianfeng Liu; Yuefeng Zhan; Hao Sun 015; Furu Wei; Denvy Deng; Qi Zhang 066 (EMNLP (Findings), 2022)

PromptBERT: Improving BERT Sentence Embeddings with Prompts. - Ting Jiang; Jian Jiao 007; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Denvy Deng; Qi Zhang 066 (EMNLP, 2022)

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. - Jian Yang 030; Shaohan Huang; Shuming Ma; Yuwei Yin; Li Dong 004; Dongdong Zhang 001; Hongcheng Guo; Zhoujun Li 001; Furu Wei (EMNLP (Findings), 2022)

Learning Music Sequence Representation From Text Supervision. - Tianyu Chen; Yuan Xie; Shuai Zhang 026; Shaohan Huang; Haoyi Zhou; Jianxin Li 002 (ICASSP, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

Kformer: Knowledge Injection in Transformer Feed-Forward Layers. - Yunzhi Yao; Shaohan Huang; Li Dong 004; Furu Wei; Huajun Chen; Ningyu Zhang 001 (NLPCC (1), 2022)

Adanomaly: Adaptive Anomaly Detection for System Logs with Adversarial Learning. - Jiaxing Qi; Zhongzhi Luan; Shaohan Huang; Yukun Wang; Carol J. Fung; Hailong Yang 002; Depei Qian (NOMS, 2022)

Impacts of COVID-19 on the Return and Volatility Nexus among Cryptocurrency Market. - Xin Sui; Guifen Shi; Guanchong Hou; Shaohan Huang; Yanshuang Li (Complex., 2022)

PromptBERT: Improving BERT Sentence Embeddings with Prompts. - Ting Jiang; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Liangjie Zhang; Qi Zhang 066 (CoRR, 2022)

DeepNet: Scaling Transformers to 1, 000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (CoRR, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Task-Specific Expert Pruning for Sparse Mixture-of-Experts. - Tianyu Chen; Shaohan Huang; Yuan Xie; Binxing Jiao; Daxin Jiang; Haoyi Zhou; Jianxin Li 002; Furu Wei (CoRR, 2022)

Language Models are General-Purpose Interfaces. - Yaru Hao; Haoyu Song 002; Li Dong 004; Shaohan Huang; Zewen Chi; Wenhui Wang 003; Shuming Ma; Furu Wei (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

REVAL: Recommend Which Variables to Log With Pretrained Model and Graph Neural Network. - Shaozhi Dai; Zhongzhi Luan; Shaohan Huang; Carol J. Fung; He Wang; Hailong Yang 002; Depei Qian (IEEE Trans. Netw. Serv. Manag., 2022)

MoEC: Mixture of Expert Clusters. - Yuan Xie; Shaohan Huang; Tianyu Chen; Furu Wei (AAAI, 2023)

Pre-training Language Model as a Multi-perspective Course Learner. - Beiduo Chen; Shaohan Huang; Zihan Zhang; Wu Guo; Zhenhua Ling; Haizhen Huang; Furu Wei; Weiwei Deng; Qi Zhang 066 (ACL (Findings), 2023)

Dual-Alignment Pre-training for Cross-lingual Sentence Embedding. - Ziheng Li; Shaohan Huang; Zihan Zhang; Zhi-Hong Deng 001; Qiang Lou; Haizhen Huang; Jian Jiao 007; Furu Wei; Weiwei Deng; Qi Zhang 066 (ACL (1), 2023)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

A Length-Extrapolatable Transformer. - Yutao Sun; Li Dong 004; Barun Patra; Shuming Ma; Shaohan Huang; Alon Benhaim; Vishrav Chaudhary; Xia Song; Furu Wei (ACL (1), 2023)

GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. - Jian Yang 030; Shuming Ma; Li Dong 004; Shaohan Huang; Haoyang Huang; Yuwei Yin; Dongdong Zhang 001; Liqun Yang; Furu Wei; Zhoujun Li 001 (ACL (1), 2023)

UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. - Daixuan Cheng; Shaohan Huang; Junyu Bi; Yuefeng Zhan; Jianfeng Liu; Yujing Wang; Hao Sun 015; Furu Wei; Weiwei Deng; Qi Zhang 066 (EMNLP, 2023)

Democratizing Reasoning Ability: Tailored Learning from Large Language Model. - Zhaoyang Wang; Shaohan Huang; Yuxuan Liu 011; Jiahai Wang; Minghui Song; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (EMNLP, 2023)

LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection. - Jiaxing Qi; Shaohan Huang; Zhongzhi Luan; Shu Yang; Carol J. Fung; Hailong Yang 002; Depei Qian; Jing Shang; Zhiwen Xiao; Zhihui Wu (HPCC/DSS/SmartCity/DependSys, 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. - Daixuan Cheng; Shaohan Huang; Junyu Bi; Yuefeng Zhan; Jianfeng Liu; Yujing Wang; Hao Sun 015; Furu Wei; Denvy Deng; Qi Zhang 066 (CoRR, 2023)

LogQA: Question Answering in Unstructured Logs. - Shaohan Huang; Yi Liu 013; Carol J. Fung; Jiaxing Qi; Hailong Yang 002; Zhongzhi Luan (CoRR, 2023)

Kosmos-2: Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Furu Wei (CoRR, 2023)

LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. - Jiayu Ding; Shuming Ma; Li Dong 004; Xingxing Zhang 002; Shaohan Huang; Wenhui Wang 003; Nanning Zheng 001; Furu Wei (CoRR, 2023)

Retentive Network: A Successor to Transformer for Large Language Models. - Yutao Sun; Li Dong 004; Shaohan Huang; Shuming Ma; Yuqing Xia; Jilong Xue; Jianyong Wang 001; Furu Wei (CoRR, 2023)

LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection. - Jiaxing Qi; Shaohan Huang; Zhongzhi Luan; Carol J. Fung; Hailong Yang 002; Depei Qian (CoRR, 2023)

Kosmos-2.5: A Multimodal Literate Model. - Tengchao Lv; Yupan Huang; Jingye Chen; Lei Cui 001; Shuming Ma; Yaoyao Chang; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Weiyao Luo; Shaoxiang Wu; Guoxin Wang; et al. (CoRR, 2023)

BitNet: Scaling 1-bit Transformers for Large Language Models. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Huaijie Wang; Lingxiao Ma; Fan Yang 024; Ruiping Wang; Yi Wu 013; Furu Wei (CoRR, 2023)

LogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection. - Jiaxing Qi; Zhongzhi Luan; Shaohan Huang; Carol J. Fung; Hailong Yang 002; Hanlu Li; Danfeng Zhu; Depei Qian (IEEE Trans. Netw. Serv. Manag., 2023)

Improving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers. - Shaohan Huang; Yi Liu 013; Carol J. Fung; He Wang; Hailong Yang 002; Zhongzhi Luan (IEEE Trans. Computers, 2023)

Text Diffusion with Reinforced Conditioning. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (AAAI, 2024)

Se²: Sequential Example Selection for In-Context Learning. - Haoyu Liu; Jianfeng Liu; Shaohan Huang; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Furu Wei; Qi Zhang 066 (ACL (Findings), 2024)

HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (ACL (1), 2024)

ResLoRA: Identity Residual Mapping in Low-Rank Adaption. - Shuhua Shi; Shaohan Huang; Minghui Song; Zhoujun Li; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (ACL (Findings), 2024)

Calibrating LLM-Based Evaluator. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (LREC/COLING, 2024)

Instruction Pre-Training: Language Models are Supervised Multitask Learners. - Daixuan Cheng; Yuxian Gu; Shaohan Huang; Junyu Bi; Minlie Huang; Furu Wei (EMNLP, 2024)

Scaling Sentence Embeddings with Large Language Models. - Ting Jiang; Shaohan Huang; Zhongzhi Luan; Deqing Wang; Fuzhen Zhuang (EMNLP (Findings), 2024)

Semantic-Aware Log Understanding and Analysis. - Shaohan Huang; Zhongzhi Luan (HPDC, 2024)

Adapting Large Language Models via Reading Comprehension. - Daixuan Cheng; Shaohan Huang; Furu Wei (ICLR, 2024)

Kosmos-G: Generating Images in Context with Multimodal Large Language Models. - Xichen Pan; Li Dong 004; Shaohan Huang; Zhiliang Peng; Wenhu Chen; Furu Wei (ICLR, 2024)

Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Qixiang Ye; Furu Wei (ICLR, 2024)

Mixture of LoRA Experts. - Xun Wu; Shaohan Huang; Furu Wei (ICLR, 2024)

KOSMOS-E : Learning to Follow Instruction for Robotic Grasping. - Zhi Wang; Xun Wu; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Shuming Ma; Furu Wei (IROS, 2024)

You Only Cache Once: Decoder-Decoder Architectures for Language Models. - Yutao Sun; Li Dong 004; Yi Zhu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Quanlu Zhang; Jianyong Wang 001; Furu Wei (NeurIPS, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Li Dong 004; Furu Wei (NeurIPS, 2024)

Multimodal Large Language Models Make Text-to-Image Generative Models Align Better. - Xun Wu; Shaohan Huang; Guolong Wang 001; Jing Xiong; Furu Wei (NeurIPS, 2024)

Boosting Text-to-Video Generative Model with MLLMs Feedback. - Xun Wu; Shaohan Huang; Guolong Wang 001; Jing Xiong; Furu Wei (NeurIPS, 2024)

Gloss: Guiding Large Language Models to Answer Questions from System Logs. - Shaohan Huang; Yi Liu 013; Jiaxing Qi; Jing Shang; Zhiwen Xiao; Carol J. Fung; Zhihui Wu; Hailong Yang 002; Zhongzhi Luan; Depei Qian (SANER, 2024)

Improving Domain Adaptation through Extended-Text Reading Comprehension. - Ting Jiang; Shaohan Huang; Shengyue Luo; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066; Deqing Wang; Fuzhen Zhuang (CoRR, 2024)

Se2: Sequential Example Selection for In-Context Learning. - Haoyu Liu; Jianfeng Liu; Shaohan Huang; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Furu Wei; Qi Zhang 066 (CoRR, 2024)

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. - Shuming Ma; Hongyu Wang 009; Lingxiao Ma; Lei Wang 222; Wenhui Wang 003; Shaohan Huang; Li Dong 004; Ruiping Wang; Jilong Xue; Furu Wei (CoRR, 2024)

Exploring the Comprehension of ChatGPT in Traditional Chinese Medicine Knowledge. - Yizhen Li; Shaohan Huang; Jiaxing Qi; Lei Quan; Dongran Han; Zhongzhi Luan (CoRR, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Furu Wei (CoRR, 2024)

Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation. - Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2024)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning. - Ting Jiang; Shaohan Huang; Shengyue Luo; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066; Deqing Wang; Fuzhen Zhuang (CoRR, 2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning. - Jiaxing Qi; Zhongzhi Luan; Shaohan Huang; Carol J. Fung; Hailong Yang 002; Depei Qian (CoRR, 2024)

Textual Aesthetics in Large Language Models. - Lingjie Jiang; Shaohan Huang; Xun Wu; Furu Wei (CoRR, 2024)

MH-MoE: Multi-Head Mixture-of-Experts. - Shaohan Huang; Xun Wu; Shuming Ma; Furu Wei (CoRR, 2024)

On Domain-Specific Post-Training for Multimodal Large Language Models. - Daixuan Cheng; Shaohan Huang; Ziyu Zhu; Xintong Zhang; Wayne Xin Zhao; Zhongzhi Luan; Bo Dai 026; Zhenliang Zhang (CoRR, 2024)

RedStone: Curating General, Code, Math, and QA Data for Large Language Models. - Yaoyao Chang; Lei Cui 001; Li Dong 004; Shaohan Huang; Yangyu Huang; Yupan Huang; Scarlett Li; Tengchao Lv; Shuming Ma; Qinzheng Sun; Wenhui Wang 003; Furu Wei; et al. (CoRR, 2024)

Multimodal Latent Language Modeling with Next-Token Diffusion. - Yutao Sun; Hangbo Bao; Wenhui Wang 003; Zhiliang Peng; Li Dong 004; Shaohan Huang; Jianyong Wang 001; Furu Wei (CoRR, 2024)

Quantum Machine Learning in Log-based Anomaly Detection: Challenges and Opportunities. - Jiaxing Qi; Chang Zeng; Zhongzhi Luan; Shaohan Huang; Shu Yang; Yao Lu; Bin Han; Hailong Yang 002; Depei Qian (CoRR, 2024)

LogSay: An Efficient Comprehension System for Log Numerical Reasoning. - Jiaxing Qi; Zhongzhi Luan; Shaohan Huang; Carol J. Fung; Hailong Yang 002 (IEEE Trans. Computers, 2024)

DeepNet: Scaling Transformers to 1,000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

SpikeLog: Log-Based Anomaly Detection via Potential-Assisted Spiking Neuron Network. - Jiaxing Qi; Zhongzhi Luan; Shaohan Huang; Carol J. Fung; Hailong Yang 002; Depei Qian (IEEE Trans. Knowl. Data Eng., 2024)

Context-DPO: Aligning Language Models for Context-Faithfulness. - Baolong Bi; Shaohan Huang; Yiwei Wang 001; Tianchi Yang; Zihan Zhang; Haizhen Huang; Lingrui Mei; Junfeng Fang; Zehao Li; Furu Wei; Weiwei Deng; Feng Sun 008; et al. (ACL (Findings), 2025)

GeAR: Generation Augmented Retrieval. - Haoyu Liu; Shaohan Huang; Jianfeng Liu; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Feng Sun 008; Furu Wei; Qi Zhang 066 (ACL (Findings), 2025)

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models. - Haoran Li; Qingxiu Dong; Zhengyang Tang; Chaojun Wang; Xingxing Zhang 002; Haoyang Huang; Shaohan Huang; Xiaolong Huang; Zeqiang Huang; Dongdong Zhang 001; Yuxian Gu; Xin Cheng 002; et al. (Trans. Mach. Learn. Res., 2025)

Beyond Window-Based Detection: A Graph-Centric Framework for Discrete Log Anomaly Detection. - Jiaxing Qi; Chang Zeng; Zhongzhi Luan; Shaohan Huang; Shu Yang; Yao Lu; Hailong Yang 002; Depei Qian (CoRR, 2025)

BitNet b1.58 2B4T Technical Report. - Shuming Ma; Hongyu Wang; Shaohan Huang; Xingxing Zhang 002; Ying Hu; Ting Song; Yan Xia 005; Furu Wei (CoRR, 2025)

Efficient RL Training for Reasoning Models via Length-Aware Optimization. - Danlong Yuan; Tian Xie; Shaohan Huang; Zhuocheng Gong; Huishuai Zhang; Chong Luo; Furu Wei; Dongyan Zhao 001 (CoRR, 2025)

Think Only When You Need with Large Hybrid-Reasoning Models. - Lingjie Jiang; Xun Wu; Shaohan Huang; Qingxiu Dong; Zewen Chi; Li Dong 004; Xingxing Zhang 002; Tengchao Lv; Lei Cui 001; Furu Wei (CoRR, 2025)

Reward Reasoning Model. - Jiaxin Guo; Zewen Chi; Li Dong 004; Qingxiu Dong; Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2025)

On-Policy RL with Optimal Reward Baseline. - Yaru Hao; Li Dong 004; Xun Wu; Shaohan Huang; Zewen Chi; Furu Wei (CoRR, 2025)

Reasoning with Exploration: An Entropy Perspective. - Daixuan Cheng; Shaohan Huang; Xuekai Zhu; Bo Dai 026; Wayne Xin Zhao; Zhenliang Zhang; Furu Wei (CoRR, 2025)

Geometric-Mean Policy Optimization. - Yuzhong Zhao; Yue Liu; Junpeng Liu; Jingye Chen; Xun Wu; Yaru Hao; Tengchao Lv; Shaohan Huang; Lei Cui 001; Qixiang Ye; Fang Wan 001; Furu Wei (CoRR, 2025)

VisCodex: Unified Multimodal Code Generation via Merging Vision and Coding Models. - Lingjie Jiang; Shaohan Huang; Xun Wu; Yixia Li; Dongdong Zhang; Furu Wei (CoRR, 2025)