Edge-Based and Efficient Chromaticity Spatio-spectral Models for Color Constancy. - Mehdi Rezagholizadeh; James J. Clark (CRV, 2013)

Maximum Entropy Spectral Modeling Approach to Mesopic Tone Mapping. - Mehdi Rezagholizadeh; James J. Clark (CIC, 2013)

Photon Detection and Color Perception at Low Light Levels. - Mehdi Rezagholizadeh; James J. Clark (CRV, 2014)

Image Sensor Modeling: Color Measurement at Low Light Levels. - Mehdi Rezagholizadeh; James J. Clark (CIC, 2014)

Image Sensor Modeling: Noise and Linear Transformation Impacts on the Color Gamut. - Mehdi Rezagholizadeh; James J. Clark (CRV, 2015)

A Retargeting Approach for Mesopic Vision: Simulation and Compensation. - Mehdi Rezagholizadeh; Tara Akhavan; Afsoon Soudi; Hannes Kaufmann; James J. Clark (Color Imaging: Displaying, Processing, Hardcopy, and Applications, 2016)

Reg-Gan: Semi-Supervised Learning Based on Generative Adversarial Networks for Regression. - Mehdi Rezagholizadeh; Md. Akmal Haidar (ICASSP, 2018)

EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing. - Yue Dong 002; Zichao Li 003; Mehdi Rezagholizadeh; Jackie Chi Kit Cheung (ACL (1), 2019)

SALSA-TEXT: Self Attentive Latent Space Based Adversarial Text Generation. - Jules Gagnon-Marchand; Hamed Sadeghi; Md. Akmal Haidar; Mehdi Rezagholizadeh (Canadian AI, 2019)

TextKD-GAN: Text Generation Using Knowledge Distillation and Generative Adversarial Networks. - Md. Akmal Haidar; Mehdi Rezagholizadeh (Canadian AI, 2019)

Latent Code and Text-based Generative Adversarial Networks for Soft-text Generation. - Md. Akmal Haidar; Mehdi Rezagholizadeh; Alan Do-Omri; Ahmad Rashid (NAACL-HLT (1), 2019)

Bilingual-GAN: A Step Towards Parallel Text Generation. - Ahmad Rashid; Alan Do-Omri; Md. Akmal Haidar; Qun Liu 001; Mehdi Rezagholizadeh (CoRR, 2019)

TextKD-GAN: Text Generation using KnowledgeDistillation and Generative Adversarial Networks. - Md. Akmal Haidar; Mehdi Rezagholizadeh (CoRR, 2019)

Distilled embedding: non-linear embedding factorization using knowledge distillation. - Vasileios Lioutas; Ahmad Rashid; Krtin Kumar; Md. Akmal Haidar; Mehdi Rezagholizadeh (CoRR, 2019)

Fully Quantized Transformer for Improved Translation. - Gabriele Prato 001; Ella Charlaix; Mehdi Rezagholizadeh (CoRR, 2019)

Fully Quantizing a Simplified Transformer for End-to-end Speech Recognition. - Alex Bie; Bharat Venkitesh; Joao Monteiro; Md. Akmal Haidar; Mehdi Rezagholizadeh (CoRR, 2019)

Improving Word Embedding Factorization for Compression using Distilled Nonlinear Neural Decomposition. - Vasileios Lioutas; Ahmad Rashid; Krtin Kumar; Md. Akmal Haidar; Mehdi Rezagholizadeh (EMNLP (Findings), 2020)

Fully Quantized Transformer for Machine Translation. - Gabriele Prato 001; Ella Charlaix; Mehdi Rezagholizadeh (EMNLP (Findings), 2020)

Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers. - Yimeng Wu; Peyman Passban; Mehdi Rezagholizadeh; Qun Liu 001 (EMNLP (1), 2020)

From Unsupervised Machine Translation to Adversarial Text Generation. - Ahmad Rashid; Alan Do-Omri; Md. Akmal Haidar; Qun Liu 001; Mehdi Rezagholizadeh (ICASSP, 2020)

ALP-KD: Attention-Based Layer Projection for Knowledge Distillation. - Peyman Passban; Yimeng Wu; Mehdi Rezagholizadeh; Qun Liu 001 (AAAI, 2021)

End-to-End Self-Debiasing Framework for Robust NLU Training. - Abbas Ghaddar; Philippe Langlais; Mehdi Rezagholizadeh; Ahmad Rashid (ACL/IJCNLP (Findings), 2021)

Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax. - Ehsan Kamalloo; Mehdi Rezagholizadeh; Peyman Passban; Ali Ghodsi 001 (ACL/IJCNLP (Findings), 2021)

MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation. - Ahmad Rashid; Vasileios Lioutas; Mehdi Rezagholizadeh (ACL/IJCNLP (1), 2021)

Knowledge Distillation with Noisy Labels for Natural Language Understanding. - Shivendra Bhardwaj; Abbas Ghaddar; Ahmad Rashid; Khalil Bibi; Chengyang Li; Ali Ghodsi 001; Philippe Langlais; Mehdi Rezagholizadeh (W-NUT, 2021)

Annealing Knowledge Distillation. - Aref Jafari; Mehdi Rezagholizadeh; Pranav Sharma; Ali Ghodsi 001 (EACL, 2021)

How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding. - Tianda Li; Ahmad Rashid; Aref Jafari; Pranav Sharma; Ali Ghodsi 001; Mehdi Rezagholizadeh (EMNLP (Findings), 2021)

RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation. - Peng Lu; Abbas Ghaddar; Ahmad Rashid; Mehdi Rezagholizadeh; Ali Ghodsi 001; Philippe Langlais (EMNLP (Findings), 2021)

Towards Zero-Shot Knowledge Distillation for Natural Language Processing. - Ahmad Rashid; Vasileios Lioutas; Abbas Ghaddar; Mehdi Rezagholizadeh (EMNLP (1), 2021)

Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation. - Yimeng Wu; Mehdi Rezagholizadeh; Abbas Ghaddar; Md. Akmal Haidar; Ali Ghodsi 001 (EMNLP (1), 2021)

Fine-Tuning of Pre-Trained End-to-End Speech Recognition with Generative Adversarial Networks. - Md. Akmal Haidar; Mehdi Rezagholizadeh (ICASSP, 2021)

Transformer-Based ASR Incorporating Time-Reduction Layer and Fine-Tuning with Self-Knowledge Distillation. - Md. Akmal Haidar; Chao Xing; Mehdi Rezagholizadeh (Interspeech, 2021)

NATURE: Natural Auxiliary Text Utterances for Realistic Spoken Language Evaluation. - David Alfonso-Hermelo; Ahmad Rashid; Abbas Ghaddar; Philippe Langlais; Mehdi Rezagholizadeh (NeurIPS Datasets and Benchmarks, 2021)

Robust Embeddings Via Distributions. - Kira A. Selby; Yinong Wang; Ruizhe Wang; Peyman Passban; Ahmad Rashid; Mehdi Rezagholizadeh; Pascal Poupart (CoRR, 2021)

Improving Neural Machine Translation with Compact Word Embedding Tables. - Krtin Kumar; Mehdi Rezagholizadeh; Yiu Sing Lau; Qun Liu 001 (CoRR, 2021)

How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding. - Tianda Li; Ahmad Rashid; Aref Jafari; Pranav Sharma; Ali Ghodsi 001; Mehdi Rezagholizadeh (CoRR, 2021)

KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation. - Marzieh S. Tahaei; Ella Charlaix; Vahid Partovi Nia; Ali Ghodsi 001; Mehdi Rezagholizadeh (CoRR, 2021)

A Short Study on Compressing Decoder-Based Language Models. - Tianda Li; Yassir El Mesbahi; Ivan Kobyzev; Ahmad Rashid; Atif Mahmud; Nithin Anchuri; Habib Hajimolahoseini; Yang Liu; Mehdi Rezagholizadeh (CoRR, 2021)

Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher. - Mehdi Rezagholizadeh; Aref Jafari; Puneeth Salad; Pranav Sharma; Ali Saheb Pasand; Ali Ghodsi 001 (CoRR, 2021)

JABER: Junior Arabic BERt. - Abbas Ghaddar; Yimeng Wu; Ahmad Rashid; Khalil Bibi; Mehdi Rezagholizadeh; Chao Xing; Yasheng Wang; Duan Xinyu; Zhefeng Wang 001; Baoxing Huai; Xin Jiang 002; Qun Liu 001; et al. (CoRR, 2021)

Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition. - Abbas Ghaddar; Philippe Langlais; Ahmad Rashid; Mehdi Rezagholizadeh (Trans. Assoc. Comput. Linguistics, 2021)

From Fully Trained to Fully Random Embeddings: Improving Neural Machine Translation with Compact Word Embedding Tables. - Krtin Kumar; Peyman Passban; Mehdi Rezagholizadeh; Yiu Sing Lau; Qun Liu 001 (AAAI, 2022)

Kronecker Decomposition for GPT Compression. - Ali Edalati; Marzieh S. Tahaei; Ahmad Rashid; Vahid Partovi Nia; James J. Clark; Mehdi Rezagholizadeh (ACL (2), 2022)

When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation. - Ehsan Kamalloo; Mehdi Rezagholizadeh; Ali Ghodsi 001 (ACL (Findings), 2022)

CILDA: Contrastive Data Augmentation Using Intermediate Layer Knowledge Distillation. - Md. Akmal Haidar; Mehdi Rezagholizadeh; Abbas Ghaddar; Khalil Bibi; Philippe Langlais; Pascal Poupart (COLING, 2022)

Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher. - Mehdi Rezagholizadeh; Aref Jafari; Puneeth S. M. Saladi; Pranav Sharma; Ali Saheb Pasand; Ali Ghodsi 001 (COLING, 2022)

Dynamic Position Encoding for Transformers. - Joyce Zheng; Mehdi Rezagholizadeh; Peyman Passban (COLING, 2022)

Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Processing. - Abbas Ghaddar; Yimeng Wu; Sunyam Bagga; Ahmad Rashid; Khalil Bibi; Mehdi Rezagholizadeh; Chao Xing; Yasheng Wang; Xinyu Duan; Zhefeng Wang 001; Baoxing Huai; Xin Jiang 002; et al. (EMNLP, 2022)

Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization. - Aref Jafari; Ivan Kobyzev; Mehdi Rezagholizadeh; Pascal Poupart; Ali Ghodsi 001 (EMNLP (Findings), 2022)

Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging. - Peng Lu; Ivan Kobyzev; Mehdi Rezagholizadeh; Ahmad Rashid; Ali Ghodsi 001; Philippe Langlais (EMNLP (Findings), 2022)

RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation. - Md. Akmal Haidar; Nithin Anchuri; Mehdi Rezagholizadeh; Abbas Ghaddar; Philippe Langlais; Pascal Poupart (NAACL-HLT (Findings), 2022)

KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation. - Marzieh S. Tahaei; Ella Charlaix; Vahid Partovi Nia; Ali Ghodsi 001; Mehdi Rezagholizadeh (NAACL-HLT, 2022)

Huawei Noah's Ark Lab at TREC NeuCLIR 2022. - Ehsan Kamalloo; David Alfonso-Hermelo; Mehdi Rezagholizadeh (TREC, 2022)

Simple Yet Effective Neural Ranking and Reranking Baselines for Cross-Lingual Information Retrieval. - Jimmy Lin; David Alfonso-Hermelo; Vitor Jeronymo; Ehsan Kamalloo; Carlos Lassance; Rodrigo Nogueira 001; Odunayo Ogundepo; Mehdi Rezagholizadeh; Nandan Thakur; Jheng-Hong Yang; Xinyu Zhang 018 (TREC, 2022)

Learning functions on multiple sets using multi-set transformers. - Kira A. Selby; Ahmad Rashid; Ivan Kobyzev; Mehdi Rezagholizadeh; Pascal Poupart (UAI, 2022)

Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding. - Abbas Ghaddar; Yimeng Wu; Sunyam Bagga; Ahmad Rashid; Khalil Bibi; Mehdi Rezagholizadeh; Chao Xing; Yasheng Wang; Duan Xinyu; Zhefeng Wang 001; Baoxing Huai; Xin Jiang 002; et al. (CoRR, 2022)

Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models. - Ivan Kobyzev; Aref Jafari; Mehdi Rezagholizadeh; Tianda Li; Alan Do-Omri; Peng Lu; Ali Ghodsi 001; Pascal Poupart (CoRR, 2022)

Integer Fine-tuning of Transformer-based Models. - Mohammadreza Tayaranian; Alireza Ghaffari; Marzieh S. Tahaei; Mehdi Rezagholizadeh; Masoud Asgharian; Vahid Partovi Nia (CoRR, 2022)

Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages. - Xinyu Zhang 018; Nandan Thakur; Odunayo Ogundepo; Ehsan Kamalloo; David Alfonso-Hermelo; Xiaoguang Li; Qun Liu 001; Mehdi Rezagholizadeh; Jimmy Lin (CoRR, 2022)

Improving the Robustness of DistilHuBERT to Unseen Noisy Conditions via Data Augmentation, Curriculum Learning, and Multi-Task Enhancement. - Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Tiago H. Falk (CoRR, 2022)

KronA: Parameter Efficient Tuning with Kronecker Adapter. - Ali Edalati; Marzieh S. Tahaei; Ivan Kobyzev; Vahid Partovi Nia; James J. Clark; Mehdi Rezagholizadeh (CoRR, 2022)

AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing. - Asaad Alghamdi; Xinyu Duan; Wei Jiang; Zhenhai Wang; Yimeng Wu; Qingrong Xia; Zhefeng Wang 001; Yi Zheng; Mehdi Rezagholizadeh; Baoxing Huai; Peilun Cheng; Abbas Ghaddar (ACL (Findings), 2023)

Evaluating Embedding APIs for Information Retrieval. - Ehsan Kamalloo; Xinyu Zhang 018; Odunayo Ogundepo; Nandan Thakur; David Alfonso-Hermelo; Mehdi Rezagholizadeh; Jimmy Lin (ACL (industry), 2023)

Attribute Controlled Dialogue Prompting. - Runcheng Liu; Ahmad Rashid; Ivan Kobyzev; Mehdi Rezagholizadeh; Pascal Poupart (ACL (Findings), 2023)

LABO: Towards Learning Optimal Label Regularization via Bi-level Optimization. - Peng Lu; Ahmad Rashid; Ivan Kobyzev; Mehdi Rezagholizadeh; Philippe Langlais (ACL (Findings), 2023)

On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining. - Yassir El Mesbahi; Atif Mahmud; Abbas Ghaddar; Mehdi Rezagholizadeh; Philippe Langlais; Prasanna Parthasarathi (CoNLL, 2023)

Practical Takes on Federated Learning with Pretrained Language Models. - Ankur Agarwal; Mehdi Rezagholizadeh; Prasanna Parthasarathi (EACL (Findings), 2023)

Do we need Label Regularization to Fine-tune Pre-trained Language Models? - Ivan Kobyzev; Aref Jafari; Mehdi Rezagholizadeh; Tianda Li; Alan Do-Omri; Peng Lu; Pascal Poupart; Ali Ghodsi 001 (EACL, 2023)

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation. - Mohammadreza Tayaranian; Alireza Ghaffari; Marzieh S. Tahaei; Mehdi Rezagholizadeh; Masoud Asgharian; Vahid Partovi Nia (EACL (Findings), 2023)

DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation. - Mojtaba Valipour; Mehdi Rezagholizadeh; Ivan Kobyzev; Ali Ghodsi 001 (EACL, 2023)

Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models. - Amirhossein Kazemnejad; Mehdi Rezagholizadeh; Prasanna Parthasarathi; Sarath Chandar (EMNLP (Findings), 2023)

Efficient Classification of Long Documents via State-Space Models. - Peng Lu; Suyuchen Wang; Mehdi Rezagholizadeh; Bang Liu; Ivan Kobyzev (EMNLP, 2023)

CIRAL at FIRE 2023: Cross-Lingual Information Retrieval for African Languages. - Mofetoluwa Adeyemi; Akintunde Oladipo; Xinyu Zhang 018; David Alfonso-Hermelo; Mehdi Rezagholizadeh; Boxing Chen; Jimmy Lin (FIRE, 2023)

Overview of the CIRAL Track at FIRE 2023: Cross-lingual Information Retrieval for African Languages. - Mofetoluwa Adeyemi; Akintunde Oladipo; Xinyu Crystina Zhang; David Alfonso-Hermelo; Mehdi Rezagholizadeh; Boxing Chen; Jimmy Lin (FIRE (Working Notes), 2023)

Robustdistiller: Compressing Universal Speech Representations for Enhanced Environment Robustness. - Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Boxing Chen; Tiago H. Falk (ICASSP, 2023)

Improved knowledge distillation by utilizing backward pass knowledge in neural networks. - Aref Jafari; Mehdi Rezagholizadeh; Ali Ghodsi 001 (CoRR, 2023)

An Exploration into the Performance of Unsupervised Cross-Task Speech Representations for "In the Wild" Edge Applications. - Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Tiago H. Falk (CoRR, 2023)

On the Transferability of Whisper-based Representations for "In-the-Wild" Cross-Task Downstream Speech Applications. - Vamsikrishna Chemudupati; Marzieh S. Tahaei; Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Boxing Chen; Tiago H. Falk (CoRR, 2023)

Multimodal Audio-textual Architecture for Robust Spoken Language Understanding. - Anderson R. Avila; Mehdi Rezagholizadeh; Chao Xing (CoRR, 2023)

SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks. - Mojtaba Valipour; Mehdi Rezagholizadeh; Hossein Rajabzadeh; Marzieh S. Tahaei; Boxing Chen; Ali Ghodsi 001 (CoRR, 2023)

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT). - Parsa Kavehzadeh; Mojtaba Valipour; Marzieh S. Tahaei; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (CoRR, 2023)

On the Impact of Quantization and Pruning of Self-Supervised Speech Models for Downstream Speech Recognition Tasks "In-the-Wild". - Arthur Pimentel; Heitor R. Guimarães; Anderson R. Avila; Mehdi Rezagholizadeh; Tiago H. Falk (CoRR, 2023)

NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation. - Nandan Thakur; Luiz Bonifacio; Xinyu Zhang 018; Odunayo Ogundepo; Ehsan Kamalloo; David Alfonso-Hermelo; Xiaoguang Li; Qun Liu 001; Boxing Chen; Mehdi Rezagholizadeh; Jimmy Lin (CoRR, 2023)

MIRACL: A Multilingual Retrieval Dataset Covering 18 Diverse Languages. - Xinyu Zhang 018; Nandan Thakur; Odunayo Ogundepo; Ehsan Kamalloo; David Alfonso-Hermelo; Xiaoguang Li; Qun Liu 001; Mehdi Rezagholizadeh; Jimmy Lin (Trans. Assoc. Comput. Linguistics, 2023)

OTTAWA: Optimal TransporT Adaptive Word Aligner for Hallucination and Omission Translation Errors Detection. - Chenyang Huang 001; Abbas Ghaddar; Ivan Kobyzev; Mehdi Rezagholizadeh; Osmar Zaïane; Boxing Chen (ACL (Findings), 2024)

EWEK-QA : Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems. - Mohammad Dehghan; Mohammad Ali Alomrani; Sunyam Bagga; David Alfonso-Hermelo; Khalil Bibi; Abbas Ghaddar; Yingxue Zhang 001; Xiaoguang Li; Jianye Hao; Qun Liu 001; Jimmy Lin; Boxing Chen; et al. (ACL (1), 2024)

CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems. - Abbas Ghaddar; David Alfonso-Hermelo; Philippe Langlais; Mehdi Rezagholizadeh; Boxing Chen; Prasanna Parthasarathi (ACL (Findings), 2024)

Resonance RoPE: Improving Context Length Generalization of Large Language Models. - Suyuchen Wang; Ivan Kobyzev; Peng Lu; Mehdi Rezagholizadeh; Bang Liu (ACL (Findings), 2024)

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference. - Parsa Kavehzadeh; Mojtaba Valipour; Marzieh S. Tahaei; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (EACL (Findings), 2024)

Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models. - Jerry Huang; Prasanna Parthasarathi; Mehdi Rezagholizadeh; Sarath Chandar (EMNLP, 2024)

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity. - Michael R. Metel; Peng Lu; Boxing Chen; Mehdi Rezagholizadeh; Ivan Kobyzev (EMNLP (Findings), 2024)

CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search. - Fengran Mo; Abbas Ghaddar; Kelong Mao; Mehdi Rezagholizadeh; Boxing Chen; Qun Liu 001; Jian-Yun Nie (EMNLP, 2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning. - Hossein Rajabzadeh; Mojtaba Valipour; Tianshu Zhu; Marzieh S. Tahaei; Hyock Ju Kwon; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (EMNLP (Industry Track), 2024)

"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation. - Nandan Thakur; Luiz Bonifacio; Xinyu Zhang 018; Odunayo Ogundepo; Ehsan Kamalloo; David Alfonso-Hermelo; Xiaoguang Li; Qun Liu 001; Boxing Chen; Mehdi Rezagholizadeh; Jimmy Lin (EMNLP (Findings), 2024)

EchoAtt: Attend, Copy, then Adjust for More Efficient Large Language Models. - Hossein Rajabzadeh; Aref Jafari; Aman Sharma; Benyamin Jami 001; Hyock Ju Kwon; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (ENLSP, 2024)

Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models. - Xindi Wang; Mahsa Salmani; Parsa Omidi; Xiangyu Ren; Mehdi Rezagholizadeh; Armaghan Eshaghi (IJCAI, 2024)

Efficient Citer: Tuning Large Language Models for Enhanced Answer Quality and Verification. - Marzieh S. Tahaei; Aref Jafari; Ahmad Rashid; David Alfonso-Hermelo; Khalil Bibi; Yimeng Wu; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (NAACL-HLT (Findings), 2024)

CIRAL: A Test Collection for CLIR Evaluations in African Languages. - Mofetoluwa Adeyemi; Akintunde Oladipo; Xinyu Zhang 018; David Alfonso-Hermelo; Mehdi Rezagholizadeh; Boxing Chen; Abdul-Hakeem Omotayo; Idris Abdulmumin; Naome A. Etori; Toyib Babatunde Musa; Samuel Fanijo; Oluwabusayo Olufunke Awoyomi; et al. (SIGIR, 2024)

On the importance of Data Scale in Pretraining Arabic Language Models. - Abbas Ghaddar; Philippe Langlais; Mehdi Rezagholizadeh; Boxing Chen (CoRR, 2024)

An Efficient End-to-End Approach to Noise Invariant Speech Features via Multi-Task Learning. - Heitor R. Guimarães; Arthur Pimentel; Anderson R. Avila; Mehdi Rezagholizadeh; Boxing Chen; Tiago H. Falk (CoRR, 2024)

Towards Practical Tool Usage for Continually Learning LLMs. - Jerry Huang; Prasanna Parthasarathi; Mehdi Rezagholizadeh; Sarath Chandar (CoRR, 2024)

S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models. - Parsa Kavehzadeh; Mohammadreza Pourreza; Mojtaba Valipour; Tinashu Zhu; Haoli Bai; Ali Ghodsi 001; Boxing Chen; Mehdi Rezagholizadeh (CoRR, 2024)

Batch-Max: Higher LLM Throughput using Larger Batch Sizes and KV Cache Compression. - Michael R. Metel; Boxing Chen; Mehdi Rezagholizadeh (CoRR, 2024)

Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination. - Jerry Huang; Prasanna Parthasarathi; Mehdi Rezagholizadeh; Boxing Chen; Sarath Chandar (ACL (Findings), 2025)

ReGLA: Refining Gated Linear Attention. - Peng Lu; Ivan Kobyzev; Mehdi Rezagholizadeh; Boxing Chen; Philippe Langlais (NAACL (Long Papers), 2025)

The Order Effect: Investigating Prompt Sensitivity in Closed-Source LLMs. - Bryan Guan; Tanya G. Roosta; Peyman Passban; Mehdi Rezagholizadeh (CoRR, 2025)

Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models. - Benyamin Jamialahmadi 001; Parsa Kavehzadeh; Mehdi Rezagholizadeh; Parsa Farinneya; Hossein Rajabzadeh; Aref Jafari; Boxing Chen; Marzieh S. Tahaei (CoRR, 2025)

X-EcoMLA: Upcycling Pre-Trained Attention into MLA for Efficient and Extreme KV Compression. - Guihong Li; Mehdi Rezagholizadeh; Mingyu Yang; Vikram Appia; Emad Barsoum (CoRR, 2025)

Zebra-Llama: Towards Extremely Efficient Hybrid Models. - Mingyu Yang; Mehdi Rezagholizadeh; Guihong Li; Vikram Appia; Emad Barsoum (CoRR, 2025)