Duo-LLM: A Framework for Studying Adaptive Computation in Large Language Models. - Keivan Alizadeh-Vahid; Seyed-Iman Mirzadeh; Hooman Shahrkokhi; Dmitry Belenko; Frank Sun; Minsik Cho; Mohammad Hossein Sekhavat; Moin Nabi; Mehrdad Farajtabar (ENLSP, 2024)

Computational Bottlenecks of Training Small-scale Large Language Models. - Saleh Ashkboos; Seyed Iman Mirzadeh; Keivan Alizadeh-Vahid; Mohammad Hossein Sekhavat; Moin Nabi; Mehrdad Farajtabar; Fartash Faghri (ENLSP, 2024)

OpenELM: An Efficient Language Model Family with Open Training and Inference Framework. - Sachin Mehta; Mohammad Hossein Sekhavat; Qingqing Cao; Maxwell Horton; Yanzi Jin; Chenfan Sun; Iman Mirzadeh; Mahyar Najibi; Dmitry Belenko; Peter Zatloukal; Mohammad Rastegari (CoRR, 2024)

CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data. - Sachin Mehta; Maxwell Horton; Fartash Faghri; Mohammad Hossein Sekhavat; Mahyar Najibi; Mehrdad Farajtabar; Oncel Tuzel; Mohammad Rastegari (CoRR, 2024)

Duo-LLM: A Framework for Studying Adaptive Computation in Large Language Models. - Keivan Alizadeh; Iman Mirzadeh; Hooman Shahrokhi; Dmitry Belenko; Frank Sun; Minsik Cho; Mohammad Hossein Sekhavat; Moin Nabi; Mehrdad Farajtabar (CoRR, 2024)

Computational Bottlenecks of Training Small-scale Large Language Models. - Saleh Ashkboos; Iman Mirzadeh; Keivan Alizadeh; Mohammad Hossein Sekhavat; Moin Nabi; Mehrdad Farajtabar; Fartash Faghri (CoRR, 2024)

An Efficient and Streaming Audio Visual Active Speaker Detection System. - Arnav Kundu; Yanzi Jin; Mohammad Hossein Sekhavat; Maxwell Horton; Danny Tormoen; Devang Naik (ICASSP, 2025)