Reza Yazdani

According to our database, Reza Yazdani authored at least 25 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference.

Connor Holmes, Masahiro Tanaka, Michael Wyatt, Ammar Ahmad Awan, Jeff Rasley, Samyam Rajbhandari, Reza Yazdani Aminabadi, Heyang Qin, Arash Bakhtiari, Lev Kurilenko, Yuxiong He

CoRR, 2024

2023

SHARP: An Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks.

Reza Yazdani Aminabadi, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González

ACM Trans. Embed. Comput. Syst., March, 2023

The hybrid DHP method for evaluation, ranking and selection of green suppliers in the supply chain.

Elham Shadkam, Reza Yazdani, Mirpouya Mirmozaffari, Fatemeh Adineh

Int. J. Math. Oper. Res., 2023

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks.

Xiaoxia Wu, Haojun Xia, Stephen Youn, Zhen Zheng, Shiyang Chen, Arash Bakhtiari, Michael Wyatt, Reza Yazdani Aminabadi, Yuxiong He, Olatunji Ruwase, Leon Song, Zhewei Yao

CoRR, 2023

ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Training Quantization Framework for W8A8 Transformers.

Zhewei Yao, Reza Yazdani Aminabadi, Stephen Youn, Xiaoxia Wu, Elton Zheng, Yuxiong He

CoRR, 2023

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.

Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He

CoRR, 2023

Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases.

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

CoRR, 2023

Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases.

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

Proceedings of the International Conference on Machine Learning, 2023

2022

A lion optimization algorithm for an integrating maintenance planning and production scheduling problem with a total absolute deviation of completion times objective.

Reza Yazdani, Mohammad Alipour-Vaezi, Kamyar Kabirifar, Azim Salahi Kojour, Faezeh Soleimani

Soft Comput., December, 2022

Exploring the impacts of COVID-19 pandemic on risks faced by infrastructure projects in Pakistan.

Gohar Azeem, Mirpouya Mirmozaffari, Reza Yazdani, Rao Aamir Khan

Int. J. Appl. Decis. Sci., 2022

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro

CoRR, 2022

DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale.

Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Olatunji Ruwase, Shaden Smith, Minjia Zhang, Jeff Rasley, Yuxiong He

Proceedings of the SC22: International Conference for High Performance Computing, 2022

ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers.

Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale.

Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He

Proceedings of the International Conference on Machine Learning, 2022

2021

ZeRO-Offload: Democratizing Billion-Scale Model Training.

Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase, Shuangyan Yang, Minjia Zhang, Dong Li, Yuxiong He

Proceedings of the 2021 USENIX Annual Technical Conference, 2021

2020

LAWS: Locality-AWare Scheme for Automatic Speech Recognition.

Reza Yazdani, José-María Arnau, Antonio González

IEEE Trans. Computers, 2020

2019

Ultra low-power, high-performance accelerator for speech recognition.

Reza Yazdani

PhD thesis, 2019

A Low-Power, High-Performance Speech Recognition Accelerator.

Reza Yazdani, José-María Arnau, Antonio González

IEEE Trans. Computers, 2019

LSTM-Sharp: An Adaptable, Energy-Efficient Hardware Accelerator for Long Short-Term Memory.

Reza Yazdani, Olatunji Ruwase, Minjia Zhang, Yuxiong He, José-María Arnau, Antonio González

CoRR, 2019

POSTER: Leveraging Run-Time Feedback for Efficient ASR Acceleration.

Reza Yazdani, José-María Arnau, Antonio González

Proceedings of the 28th International Conference on Parallel Architectures and Compilation Techniques, 2019

2018

The Dark Side of DNN Pruning.

Reza Yazdani, Marc Riera, José-María Arnau, Antonio González

Proceedings of the 45th ACM/IEEE Annual International Symposium on Computer Architecture, 2018

2017

Low-Power Automatic Speech Recognition Through a Mobile GPU and a Viterbi Accelerator.

Reza Yazdani, Albert Segura, José-María Arnau, Antonio González

IEEE Micro, 2017

UNFOLD: a memory-efficient speech recognizer using on-the-fly WFST composition.

Reza Yazdani, José-María Arnau, Antonio González

Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture, 2017

2016

An ultra low-power hardware accelerator for automatic speech recognition.

Reza Yazdani, Albert Segura, José-María Arnau, Antonio González

Proceedings of the 49th Annual IEEE/ACM International Symposium on Microarchitecture, 2016

Fault-tolerant 3-D network-on-chip design using dynamic link sharing.

Seyyed Hossein Seyyedaghaei Rezaei, Mehdi Modarressi, Reza Yazdani Aminabadi, Masoud Daneshtalab

Proceedings of the 2016 Design, Automation & Test in Europe Conference & Exhibition, 2016