Lingxiao Ma

According to our database, Lingxiao Ma authored at least 24 papers between 2005 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2024

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits.

Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei

CoRR, 2024

ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores.

Yuetao Chen, Kun Li, Yuhao Wang, Donglin Bai, Lei Wang, Lingxiao Ma, Liang Yuan, Yunquan Zhang, Ting Cao, Mao Yang

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

2023

FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement.

Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui

Proc. ACM Manag. Data, 2023

BitNet: Scaling 1-bit Transformers for Large Language Models.

Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei

CoRR, 2023

SparDA: Accelerating Dynamic Sparse Deep Neural Networks via Sparse-Dense Transformation.

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Yuqing Yang, Lingxiao Ma, Fan Yang, Lili Qiu, Mao Yang, Lidong Zhou

CoRR, 2023

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation.

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

Proceedings of the 29th Symposium on Operating Systems Principles, 2023

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning.

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

Proceedings of the 17th USENIX Symposium on Operating Systems Design and Implementation, 2023

Optimizing Dynamic Neural Networks with Brainstorm.

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

Proceedings of the 17th USENIX Symposium on Operating Systems Design and Implementation, 2023

Welder: Scheduling Deep Learning Memory Access via Tile-graph.

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

Proceedings of the 17th USENIX Symposium on Operating Systems Design and Implementation, 2023

2022

CuWide: Towards Efficient Flow-Based Training for Sparse Wide Models on GPUs.

Xupeng Miao, Lingxiao Ma, Zhi Yang, Yingxia Shao, Bin Cui, Lele Yu, Jiawei Jiang

IEEE Trans. Knowl. Data Eng., 2022

ROLLER: Fast and Efficient Tensor Compilation for Deep Learning.

Hongyu Zhu, Ruofan Wu, Yijia Diao, Shanbin Ke, Haoyu Li, Chen Zhang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon, Gennady Pekhimenko

Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation, 2022

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute.

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation, 2022

2021

Dense-to-Sparse Gate for Mixture-of-Experts.

Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin Cui

CoRR, 2021

Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce.

Xupeng Miao, Xiaonan Nie, Yingxia Shao, Zhi Yang, Jiawei Jiang, Lingxiao Ma, Bin Cui

Proceedings of the SIGMOD '21: International Conference on Management of Data, 2021

CuWide: Towards Efficient Flow-based Training for Sparse Wide Models on GPUs (Extended Abstract).

Xupeng Miao, Lingxiao Ma, Zhi Yang, Yingxia Shao, Bin Cui, Lele Yu, Jiawei Jiang

Proceedings of the 37th IEEE International Conference on Data Engineering, 2021

Accelerating GNN training with locality-aware partial execution.

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

Proceedings of the APSys '21: 12th ACM SIGOPS Asia-Pacific Workshop on Systems, 2021

2020

Architectural Implications of Graph Neural Networks.

Zhihui Zhang, Jingwen Leng, Lingxiao Ma, Youshan Miao, Chao Li, Minyi Guo

IEEE Comput. Archit. Lett., 2020

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks.

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

Proceedings of the 14th USENIX Symposium on Operating Systems Design and Implementation, 2020

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network.

Chao Tian, Lingxiao Ma, Zhi Yang, Yafei Dai

Proceedings of the 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2020

2019

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs.

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

Proceedings of the 2019 USENIX Annual Technical Conference, 2019

SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization.

Shijie Cao, Lingxiao Ma, Wencong Xiao, Chen Zhang, Yunxin Liu, Lintao Zhang, Lanshun Nie, Zhi Yang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Towards Efficient Large-Scale Graph Neural Network Computing.

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

CoRR, 2018

2017

Garaph: Efficient GPU-accelerated Graph Processing on a Single Machine with Balanced Replication.

Lingxiao Ma, Zhi Yang, Han Chen, Jilong Xue, Yafei Dai

Proceedings of the 2017 USENIX Annual Technical Conference, 2017

2005

CoopStreaming: A Novel Peer-to-Peer System for Fast Live Media Streaming.

Jianwei Yin, Weipeng Yao, Lingxiao Ma, Jinxiang Dong

Proceedings of the Advances in Web-Age Information Management, 2005