While recognizing actions, LMMs struggle to detect core interaction events. - Daniel Harari; Michael Sidorov; Liel David; Chen Shterental; Abrham Kahsay Gebreselasie; Muhammad Haris Khan (CoRR, 2025)