Nonlinear Unsupervised Feature Learning: How Local Similarities Lead to Global Coding. - Amirreza Shaban; Hamid R. Rabiee; Marzieh S. Tahaei; Erfan Salavati (ICDM Workshops, 2012)

KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation. - Marzieh S. Tahaei; Ella Charlaix; Vahid Partovi Nia; Ali Ghodsi 001; Mehdi Rezagholizadeh (CoRR, 2021)

Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition. - Marawan Gamal Abdel Hameed; Marzieh S. Tahaei; Ali Mosleh 003; Vahid Partovi Nia (AAAI, 2022)

Kronecker Decomposition for GPT Compression. - Ali Edalati; Marzieh S. Tahaei; Ahmad Rashid; Vahid Partovi Nia; James J. Clark; Mehdi Rezagholizadeh (ACL (2), 2022)

KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation. - Marzieh S. Tahaei; Ella Charlaix; Vahid Partovi Nia; Ali Ghodsi 001; Mehdi Rezagholizadeh (NAACL-HLT, 2022)

Is Integer Arithmetic Enough for Deep Learning Training? - Alireza Ghaffari; Marzieh S. Tahaei; Mohammadreza Tayaranian; Masoud Asgharian; Vahid Partovi Nia (NeurIPS, 2022)

Integer Fine-tuning of Transformer-based Models. - Mohammadreza Tayaranian; Alireza Ghaffari; Marzieh S. Tahaei; Mehdi Rezagholizadeh; Masoud Asgharian; Vahid Partovi Nia (CoRR, 2022)

SeKron: A Decomposition Method Supporting Many Factorization Structures. - Marawan Gamal Abdel Hameed; Ali Mosleh 003; Marzieh S. Tahaei; Vahid Partovi Nia (CoRR, 2022)

KronA: Parameter Efficient Tuning with Kronecker Adapter. - Ali Edalati; Marzieh S. Tahaei; Ivan Kobyzev; Vahid Partovi Nia; James J. Clark; Mehdi Rezagholizadeh (CoRR, 2022)

Towards Low-Cost Learning-based Camera ISP via Unrolled Optimization. - Ali Mosleh 003; Marzieh S. Tahaei; James J. Clark; Vahid Partovi Nia (CRV, 2023)

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation. - Mohammadreza Tayaranian; Alireza Ghaffari; Marzieh S. Tahaei; Mehdi Rezagholizadeh; Masoud Asgharian; Vahid Partovi Nia (EACL (Findings), 2023)

On the Transferability of Whisper-based Representations for "In-the-Wild" Cross-Task Downstream Speech Applications. - Vamsikrishna Chemudupati; Marzieh S. Tahaei; Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Boxing Chen; Tiago H. Falk (CoRR, 2023)

SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks. - Mojtaba Valipour; Mehdi Rezagholizadeh; Hossein Rajabzadeh; Marzieh S. Tahaei; Boxing Chen; Ali Ghodsi 001 (CoRR, 2023)

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT). - Parsa Kavehzadeh; Mojtaba Valipour; Marzieh S. Tahaei; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (CoRR, 2023)

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference. - Parsa Kavehzadeh; Mojtaba Valipour; Marzieh S. Tahaei; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (EACL (Findings), 2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning. - Hossein Rajabzadeh; Mojtaba Valipour; Tianshu Zhu; Marzieh S. Tahaei; Hyock Ju Kwon; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (EMNLP (Industry Track), 2024)

Efficient Citer: Tuning Large Language Models for Enhanced Answer Quality and Verification. - Marzieh S. Tahaei; Aref Jafari; Ahmad Rashid; David Alfonso-Hermelo; Khalil Bibi; Yimeng Wu; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (NAACL-HLT (Findings), 2024)

Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models. - Benyamin Jamialahmadi 001; Parsa Kavehzadeh; Mehdi Rezagholizadeh; Parsa Farinneya; Hossein Rajabzadeh; Aref Jafari; Boxing Chen; Marzieh S. Tahaei (CoRR, 2025)