Language Model Beats Diffusion - Tokenizer is key to visual generation. - Lijun Yu; José Lezama; Nitesh Bharadwaj Gundavarapu; Luca Versari; Kihyuk Sohn; David Minnen; Yong Cheng; Agrim Gupta; Xiuye Gu; Alexander G. Hauptmann; Boqing Gong; Ming-Hsuan Yang 001; et al. (ICLR, 2024)

VideoPrism: A Foundational Visual Encoder for Video Understanding. - Long Zhao 003; Nitesh Bharadwaj Gundavarapu; Liangzhe Yuan; Hao Zhou 014; Shen Yan; Jennifer J. Sun; Luke Friedman; Rui Qian 003; Tobias Weyand; Yue Zhao 006; Rachel Hornung; Florian Schroff; et al. (ICML, 2024)

Extending Video Masked Autoencoders to 128 frames. - Nitesh Bharadwaj Gundavarapu; Luke Friedman; Raghav Goyal; Chaitra Hegde; Eirikur Agustsson; Sagar Waghmare; Mikhail Sirotenko; Ming-Hsuan Yang 001; Tobias Weyand; Boqing Gong; Leonid Sigal (NeurIPS, 2024)

Neptune: The Long Orbit to Benchmarking Long Video Understanding. - Arsha Nagrani; Mingda Zhang; Ramin Mehran; Rachel Hornung; Nitesh Bharadwaj Gundavarapu; Nilpa Jha; Austin Myers; Xingyi Zhou; Boqing Gong; Cordelia Schmid; Mikhail Sirotenko; Yukun Zhu; et al. (CoRR, 2024)

VideoGLUE: Video General Understanding Evaluation of Foundation Models. - Liangzhe Yuan; Nitesh Bharadwaj Gundavarapu; Long Zhao 003; Hao Zhou 014; Yin Cui; Lu Jiang 004; Xuan Yang; Menglin Jia; Tobias Weyand; Luke Friedman; Mikhail Sirotenko; Huisheng Wang; et al. (Trans. Mach. Learn. Res., 2024)