Saleh Ashkboos

According to our database, Saleh Ashkboos authored at least 20 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

SliceGPT: Compress Large Language Models by Deleting Rows and Columns.

Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman

CoRR, 2024

Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication.

Lukas Gianinazzi, Alexandros Nikolaos Ziogas, Langwen Huang, Piotr Luczynski, Saleh Ashkboosh, Florian Scheidl, Armon Carigiet, Chio Ge, Nabil Abubaker, Maciej Besta, Tal Ben-Nun, Torsten Hoefler

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

2023

Towards End-to-end 4-Bit Inference on Generative Large Language Models.

Saleh Ashkboos, Ilia Markov, Elias Frantar, Tingxuan Zhong, Xincheng Wang, Jie Ren, Torsten Hoefler, Dan Alistarh

CoRR, 2023

SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression.

Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh

CoRR, 2023

STen: Productive and Efficient Sparsity in PyTorch.

Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Saleh Ashkboos, Torsten Hoefler

CoRR, 2023

OPTQ: Accurate Quantization for Generative Pre-trained Transformers.

Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers.

Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh

CoRR, 2022

ENS-10: A Dataset For Post-Processing Ensemble Weather Forecast.

Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler

CoRR, 2022

The spatial computer: A model for energy-efficient parallel computation.

Lukas Gianinazzi, Tal Ben-Nun, Saleh Ashkboos, Yves Baumann, Piotr Luczynski, Torsten Hoefler

CoRR, 2022

ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations.

Maciej Besta, Cesare Miglioli, Paolo Sylos Labini, Jakub Tetek, Patrick Iff, Raghavendra Kanakagiri, Saleh Ashkboos, Kacper Janda, Michal Podstawski, Grzegorz Kwasniewski, Niels Gleinig, Flavio Vella, Onur Mutlu, Torsten Hoefler

Proceedings of the SC22: International Conference for High Performance Computing, 2022

ENS-10: A Dataset For Post-Processing Ensemble Weather Forecasts.

Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Motif Prediction with Graph Neural Networks.

Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler

Proceedings of the KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, August 14, 2022

2021

Multi-way sparsest cut problem on trees with a control on the number of parts and outliers.

Ramin Javadi, Saleh Ashkboos

Discret. Appl. Math., 2021

Flare: flexible in-network allreduce.

Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler

Proceedings of the International Conference for High Performance Computing, 2021

New Bounds For Distributed Mean Estimation and Variance Reduction.

Peter Davies, Vijaykrishna Gurunanthan, Niusha Moshrefi, Saleh Ashkboos, Dan Alistarh

Proceedings of the 9th International Conference on Learning Representations, 2021

Degree-based Feature Is All You Need: Science4Cast Report.

Milad Aghajohari, Mohammad Sadegh Akhondzadeh, Saleh Ashkboos, Kamran Chitsaz

Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), 2021

2020

Distributed Mean Estimation with Optimal Error Bounds.

Dan Alistarh, Saleh Ashkboos, Peter Davies

CoRR, 2020

2019

SparCML: high-performance sparse communication for machine learning.

Cédric Renggli, Saleh Ashkboos, Mehdi Aghagolzadeh, Dan Alistarh, Torsten Hoefler

Proceedings of the International Conference for High Performance Computing, 2019

2017

An Efficient Parallel Data Clustering Algorithm Using Isoperimetric Number of Trees.

Ramin Javadi, Saleh Ashkboos

CoRR, 2017

Minimum Cuts of Distance-Regular Digraphs.

Saleh Ashkboos, Gholam Reza Omidi, Fateme Shafiei, Khosro Tajbakhsh

Electron. J. Comb., 2017