Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task. - Nan Ding 002; Sebastian Goodman; Fei Sha; Radu Soricut (CoRR, 2016)

Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image Captioning. - Piyush Sharma; Nan Ding 002; Sebastian Goodman; Radu Soricut (ACL (1), 2018)

Multi-stage Pretraining for Abstractive Summarization. - Sebastian Goodman; Zhenzhong Lan; Radu Soricut (CoRR, 2019)

TeaForN: Teacher-Forcing with N-grams. - Sebastian Goodman; Nan Ding 002; Radu Soricut (EMNLP (1), 2020)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. - Zhenzhong Lan; Mingda Chen; Sebastian Goodman; Kevin Gimpel; Piyush Sharma; Radu Soricut (ICLR, 2020)

Multi-Image Summarization: Textual Summary from a Set of Cohesive Images. - Nicholas Trieu; Sebastian Goodman; Pradyumna Narayana; Kazoo Sone; Radu Soricut (CoRR, 2020)

Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning. - Nan Ding 002; Xi Chen 071; Tomer Levinboim; Sebastian Goodman; Radu Soricut (NeurIPS, 2021)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Anselm Levskaya; Gaurav Mishra; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (CoRR, 2022)

PaLI: A Jointly-Scaled Multilingual Language-Image Model. - Xi Chen 071; Xiao Wang 038; Soravit Changpinyo; A. J. Piergiovanni; Piotr Padlewski; Daniel Salz; Sebastian Goodman; Adam Grycner; Basil Mustafa; Lucas Beyer; Alexander Kolesnikov 003; Joan Puigcerver; et al. (CoRR, 2022)

PreSTU: Pre-Training for Scene-Text Understanding. - Jihyung Kil; Soravit Changpinyo; Xi Chen 071; Hexiang Hu; Sebastian Goodman; Wei-Lun Chao; Radu Soricut (ICCV, 2023)

PaLI: A Jointly-Scaled Multilingual Language-Image Model. - Xi Chen 071; Xiao Wang 038; Soravit Changpinyo; A. J. Piergiovanni; Piotr Padlewski; Daniel Salz; Sebastian Goodman; Adam Grycner; Basil Mustafa; Lucas Beyer; Alexander Kolesnikov 003; Joan Puigcerver; et al. (ICLR, 2023)

PaLI-X: On Scaling up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CoRR, 2023)

PaLI-3 Vision Language Models: Smaller, Faster, Stronger. - Xi Chen 071; Xiao Wang 038; Lucas Beyer; Alexander Kolesnikov 003; Jialin Wu; Paul Voigtlaender; Basil Mustafa; Sebastian Goodman; Ibrahim Alabdulmohsin; Piotr Padlewski; Daniel Salz; Xi Xiong; et al. (CoRR, 2023)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Gaurav Mishra; Anselm Levskaya; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (J. Mach. Learn. Res., 2023)

On Scaling Up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CVPR, 2024)

CausalLM is not optimal for in-context learning. - Nan Ding 002; Tomer Levinboim; Jialin Wu; Sebastian Goodman; Radu Soricut (ICLR, 2024)