Hexiang Hu

According to our database, Hexiang Hu authored at least 47 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions.

Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang

CoRR, 2024

Instruct-Imagen: Image Generation with Multi-modal Instruction.

Hexiang Hu, Kelvin C. K. Chan, Yu-Chuan Su, Wenhu Chen, Yandong Li, Kihyuk Sohn, Yang Zhao, Xue Ben, Boqing Gong, William W. Cohen, Ming-Wei Chang, Xuhui Jia

CoRR, 2024

2023

Drinking From a Firehose: Continual Learning With Web-Scale Natural Language.

Hexiang Hu, Ozan Sener, Fei Sha, Vladlen Koltun

IEEE Trans. Pattern Anal. Mach. Intell., May, 2023

UniIR: Training and Benchmarking Universal Multimodal Information Retrievers.

Cong Wei, Yang Chen, Haonan Chen, Hexiang Hu, Ge Zhang, Jie Fu, Alan Ritter, Wenhu Chen

CoRR, 2023

PaLI-X: On Scaling up a Multilingual Vision and Language Model.

Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut

CoRR, 2023

From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.

Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Subject-driven Text-to-Image Generation via Apprenticeship Learning.

Wenhu Chen, Hexiang Hu, Yandong Li, Nataniel Ruiz, Xuhui Jia, Ming-Wei Chang, William W. Cohen

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding.

Kenton Lee, Mandar Joshi, Iulia Raluca Turc, Hexiang Hu, Fangyu Liu, Julian Martin Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova

Proceedings of the International Conference on Machine Learning, 2023

Re-Imagen: Retrieval-Augmented Text-to-Image Generator.

Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen

Proceedings of the Eleventh International Conference on Learning Representations, 2023

PreSTU: Pre-Training for Scene-Text Understanding.

Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities.

Hexiang Hu, Yi Luan, Yang Chen, Urvashi Khandelwal, Mandar Joshi, Kenton Lee, Kristina Toutanova, Ming-Wei Chang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?

Yang Chen, Hexiang Hu, Yi Luan, Haitian Sun, Soravit Changpinyo, Alan Ritter, Ming-Wei Chang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text.

Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Learning Adaptive Classifiers Synthesis for Generalized Few-Shot Learning.

Han-Jia Ye, Hexiang Hu, De-Chuan Zhan

Int. J. Comput. Vis., 2021

A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection.

Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao

CoRR, 2021

On Model Calibration for Long-Tailed Object Detection and Instance Segmentation.

Tai-Yu Pan, Cheng Zhang, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection.

Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?

Linlu Qiu, Hexiang Hu, Bowen Zhang, Peter Shaw, Fei Sha

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Visually Grounded Concept Composition.

Bowen Zhang, Hexiang Hu, Linlu Qiu, Peter Shaw, Fei Sha

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Learning the Best Pooling Strategy for Visual Semantic Embedding.

Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Structured Label Inference for Visual Understanding.

Nelson Nauata, Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori

IEEE Trans. Pattern Anal. Mach. Intell., 2020

A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus.

Bowen Zhang, Hexiang Hu, Joonseok Lee, Ming Zhao, Sheide Chammas, Vihan Jain, Eugene Ie, Fei Sha

CoRR, 2020

Visual Storytelling via Predicting Anchor Word Embeddings in the Stories.

Bowen Zhang, Hexiang Hu, Fei Sha

CoRR, 2020

Learning to Represent Image and Text with Denotation Graph.

Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions.

Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps.

Wang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng, Vihan Jain, Eugene Ie, Fei Sha

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Learning Classifier Synthesis for Generalized Few-Shot Learning.

Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha

CoRR, 2019

Synthesized Policies for Transfer and Adaptation across Tasks and Environments.

Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha

CoRR, 2019

Binary Image Selection (BISON): Interpretable Evaluation of Visual Grounding.

Hexiang Hu, Ishan Misra, Laurens van der Maaten

CoRR, 2019

Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Evaluating Text-to-Image Matching using Binary Image Selection (BISON).

Hexiang Hu, Ishan Misra, Laurens van der Maaten

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshops, 2019

Engaging Image Captioning via Personality.

Kurt Shuster, Samuel Humeau, Hexiang Hu, Antoine Bordes, Jason Weston

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Toward Multimodal Model-Agnostic Meta-Learning.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

CoRR, 2018

Learning Embedding Adaptation for Few-Shot Learning.

Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha

CoRR, 2018

Synthesize Policies for Transfer and Adaptation across Tasks and Environments.

Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets.

Wei-Lun Chao, Hexiang Hu, Fei Sha

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Cross-Modal and Hierarchical Modeling of Video and Text.

Bowen Zhang, Hexiang Hu, Fei Sha

Proceedings of the Computer Vision - ECCV 2018, 2018

Compressed Video Action Recognition.

Chao-Yuan Wu, Manzil Zaheer, Hexiang Hu, R. Manmatha, Alexander J. Smola, Philipp Krähenbühl

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Learning Answer Embeddings for Visual Question Answering.

Hexiang Hu, Wei-Lun Chao, Fei Sha

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Cross-Dataset Adaptation for Visual Question Answering.

Wei-Lun Chao, Hexiang Hu, Fei Sha

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Multi-Task Learning for Sequence Tagging: An Empirical Study.

Soravit Changpinyo, Hexiang Hu, Fei Sha

Proceedings of the 27th International Conference on Computational Linguistics, 2018

2017

LabelBank: Revisiting Global Perspectives for Semantic Segmentation.

Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori

CoRR, 2017

FastMask: Segment Multi-scale Object Candidates in One Shot.

Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

FastMask: Segment Object Multi-scale Candidates in One Shot.

Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha

CoRR, 2016

Recalling Holistic Information for Semantic Segmentation.

Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori

CoRR, 2016

Learning Structured Inference Neural Networks with Label Relations.

Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori

Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016

Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition.

Zhiwei Deng, Arash Vahdat, Hexiang Hu, Greg Mori

Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016