How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers. - Michael Hassid; Hao Peng 009; Daniel Rotem; Jungo Kasai; Ivan Montero; Noah A. Smith; Roy Schwartz 001 (EMNLP (Findings), 2022)

Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings. - Daniel Rotem; Michael Hassid; Jonathan Mamou; Roy Schwartz 001 (ACL (1), 2023)