A Comparison on Free Interaction Models for Mobile Layout System. - Zhiwei Guan; Yang Li 058; Hongan Wang; Guozhong Dai (HUC, 2000)

Beyond Pinch and Flick: Enriching Mobile Gesture Interaction. - Yang Li 058 (Computer, 2009)

Protractor: a fast and accurate gesture recognizer. - Yang Li 058 (CHI, 2010)

Gesture search: a tool for fast mobile data access. - Yang Li 058 (UIST, 2010)

Experimental analysis of touch-screen gesture designs in mobile environments. - Andrew Bragdon; Eugene Nelson; Yang Li 058; Ken Hinckley (CHI, 2011)

Deep shot: a framework for migrating tasks across devices using mobile phone cameras. - Tsung-Hsiang Chang; Yang Li 058 (CHI, 2011)

Gesture avatar: a technique for operating mobile user interfaces using gestures. - Hao Lü; Yang Li 058 (CHI, 2011)

DoubleFlip: a motion gesture delimiter for mobile interaction. - Jaime Ruiz; Yang Li 058 (CHI, 2011)

User-defined motion gestures for mobile interaction. - Jaime Ruiz; Yang Li 058; Edward Lank (CHI, 2011)

Gesture-based interaction: a new dimension for mobile user interfaces. - Yang Li 058 (AVI, 2012)

Tap, swipe, or move: attentional demands for distracted smartphone input. - Matei Negulescu; Jaime Ruiz; Yang Li 058; Edward Lank (AVI, 2012)

Gesture coder: a tool for programming multi-touch gestures by demonstration. - Hao Lü; Yang Li 058 (CHI, 2012)

Bootstrapping personal gesture shortcuts with the wisdom of the crowd and handwriting recognition. - Tom Ouyang; Yang Li 058 (CHI, 2012)

Gesture Search: Random Access to Smartphone Content. - Yang Li 058 (IEEE Pervasive Comput., 2012)

FFitts law: modeling finger touch with fitts' law. - Xiaojun Bi 001; Yang Li 058; Shumin Zhai (CHI, 2013)

Gesture studio: authoring multi-touch interactions through demonstration and declaration. - Hao Lü; Yang Li 058 (CHI, 2013)

CrowdLearner: rapidly creating mobile recognizers using crowdsourcing. - Shahriyar Amini; Yang Li 058 (UIST, 2013)

Open project: a lightweight framework for remote sharing of mobile applications. - Matei Negulescu; Yang Li 058 (UIST, 2013)

Gesturemote: interacting with remote displays through touch gestures. - Hao Lü; Matei Negulescu; Yang Li 058 (AVI, 2014)

Gesture script: recognizing gestures and their structure using rendering scripts and interactively trained parts. - Hao Lü; James Fogarty; Yang Li 058 (CHI, 2014)

InkAnchor: enhancing informal ink-based note taking on touchscreen mobile phones. - Yi Ren; Yang Li 058; Edward Lank (CHI, 2014)

GestKeyboard: enabling gesture-based interaction on ordinary physical keyboard. - Haimo Zhang; Yang Li 058 (CHI, 2014)

Teaching motion gestures via recognizer feedback. - Ankit Kamal; Yang Li 058; Edward Lank (IUI, 2014)

Hierarchical route maps for efficient navigation. - Fangzhou Wang; Yang Li 058; Daisuke Sakamoto; Takeo Igarashi (IUI, 2014)

HOBS: head orientation-based selection in physical spaces. - Ben Zhang 003; Yu-Hsiang Chen; Claire Tuna; Achal Dave; Yang Li 058; Edward A. Lee; Björn Hartmann (SUI, 2014)

Reflection: enabling event prediction as an on-device service for mobile interaction. - Yang Li 058 (UIST, 2014)

Detecting tapping motion on the side of mobile devices by probabilistically combining hand postures. - William McGrath; Yang Li 058 (UIST, 2014)

Optimistic Programming of Touch Interaction. - Yang Li 058; Hao Lü; Haimo Zhang (ACM Trans. Comput. Hum. Interact., 2014)

Weave: Scripting Cross-Device Wearable Interaction. - Pei-Yu (Peggy) Chi; Yang Li 058 (CHI, 2015)

Gesture On: Enabling Always-On Touch Gestures for Fast Mobile Access from the Device Standby Mode. - Hao Lü; Yang Li 058 (CHI, 2015)

3D model-based continuous emotion recognition. - Hui Chen 020; Jiangdong Li; Fengjun Zhang; Yang Li 058; Hongan Wang (CVPR, 2015)

Emotional Tone-Based Audio Continuous Emotion Recognition. - Mengmeng Liu; Hui Chen 020; Yang Li 058; Fengjun Zhang (MMM (2), 2015)

The Making of Cross-Device Experiences: A Hands-on Workshop. - Tao Dong; Michael Nebeling; Daniel Afergan; Elizabeth F. Churchill; Jeffrey Nichols 001; Elizabeth S. Goodman; Pei-Yu (Peggy) Chi; Yang Li 058; Daniel Wigdor (Conference on Designing Interactive Systems (Companion Volume), 2016)

Enhancing Cross-Device Interaction Scripting with Interactive Illustrations. - Pei-Yu (Peggy) Chi; Yang Li 058; Björn Hartmann (CHI, 2016)

End-user development of cross-device user interfaces. - Michael Nebeling; Thomas Kubitza; Fabio Paternò; Tao Dong; Yang Li 058; Jeffrey Nichols 001 (EICS, 2016)

Mogeste: mobile tool for in-situ motion gesture design. - Aman Parnami; Apurva Gupta; Gabriel Reyes; Ramik Sadana; Yang Li 058; Gregory D. Abowd (UbiComp Adjunct, 2016)

Gesture morpher: video-based retargeting of multi-touch interactions. - Ramik Sadana; Yang Li 058 (MobileHCI, 2016)

Bootstrapping User-Defined Body Tapping Recognition with Offline-Learned Probabilistic Representation. - Xiang 'Anthony' Chen; Yang Li 058 (UIST, 2016)

Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices. - Sarah Morrison-Smith; Megan Hofmann; Yang Li 058; Jaime Ruiz (ACM Trans. Appl. Percept., 2016)

Beyond the Touchscreen: An Exploration of Extending Interactions on Commodity Smartphones. - Cheng Zhang 011; Anhong Guo; Dingtian Zhang; Yang Li 058; Caleb Southern; Rosa I. Arriaga; Gregory D. Abowd (ACM Trans. Interact. Intell. Syst., 2016)

Rico: A Mobile App Dataset for Building Data-Driven Design Applications. - Biplab Deka; Zifeng Huang; Chad Franzen; Joshua Hibschman; Daniel Afergan; Yang Li 058; Jeffrey Nichols 001; Ranjitha Kumar (UIST, 2017)

ZIPT: Zero-Integration Performance Testing of Mobile App Designs. - Biplab Deka; Zifeng Huang; Chad Franzen; Jeffrey Nichols 001; Yang Li 058; Ranjitha Kumar (UIST, 2017)

Improv: An Input Framework for Improvising Cross-Device Interaction by Demonstration. - Xiang 'Anthony' Chen; Yang Li 058 (ACM Trans. Comput. Hum. Interact., 2017)

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World. - Anhong Guo; Saige McVea; Xu Wang 016; Patrick Clary; Ken Goldman 001; Yang Li 058; Yu Zhong; Jeffrey P. Bigham (ASSETS, 2018)

Doppio: Tracking UI Flows and Code Changes for App Development. - Pei-Yu (Peggy) Chi; Sen-Po Hu; Yang Li 058 (CHI, 2018)

Predicting Human Performance in Vertical Menu Selection Using Deep Learning. - Yang Li 058; Samy Bengio; Gilles Bailly (CHI, 2018)

Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices. - Ken Pfeuffer; Yang Li 058 (CHI, 2018)

M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction. - Jingjie Zheng; Xiaojun Bi 001; Kun Li; Yang Li 058; Shumin Zhai (CHI, 2018)

Time-Dependent Representation for Neural Event Sequence Prediction. - Yang Li 058; Nan Du; Samy Bengio (ICLR (Workshop), 2018)

GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking. - Patrick H. Chen; Si Si; Yang Li 058; Ciprian Chelba; Cho-Jui Hsieh (NeurIPS, 2018)

Nonlinear Online Learning with Adaptive Nyström Approximation. - Si Si; Sanjiv Kumar; Yang Li 058 (CoRR, 2018)

GaterNet: Dynamic Filter Selection in Convolutional Neural Network via a Dedicated Global Gating Network. - Zhourong Chen; Yang Li 058; Samy Bengio; Si Si (CoRR, 2018)

What is That in Your Hand?: Recognizing Grasped Objects via Forearm Electromyography Sensing. - Junjun Fan; Xiangmin Fan; Feng Tian 001; Yang Li 058; Zitao Liu 001; Wei Sun; Hongan Wang (Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2018)

Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning. - Amanda Swearngin; Yang Li 058 (CHI, 2019)

You Look Twice: GaterNet for Dynamic Filter Selection in CNNs. - Zhourong Chen; Yang Li 058; Samy Bengio; Si Si (CVPR, 2019)

Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks. - Patrick H. Chen; Si Si; Sanjiv Kumar; Yang Li 058; Cho-Jui Hsieh (ICLR (Poster), 2019)

Area Attention. - Yang Li 058; Lukasz Kaiser; Samy Bengio; Si Si (ICML, 2019)

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. - Wei-Lin Chiang; Xuanqing Liu; Si Si; Yang Li 058; Samy Bengio; Cho-Jui Hsieh (KDD, 2019)

Robustness Verification of Tree-based Models. - Hongge Chen; Huan Zhang 001; Si Si; Yang Li 058; Duane S. Boning; Cho-Jui Hsieh (NeurIPS, 2019)

A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning. - Xuanqing Liu; Si Si; Jerry Zhu; Yang Li 058; Cho-Jui Hsieh (NeurIPS, 2019)

Minuet: Multimodal Interaction with an Internet of Things. - Runchang Kang; Anhong Guo; Gierad Laput; Yang Li 058; Xiang 'Anthony' Chen (SUI, 2019)

A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning. - Xuanqing Liu; Si Si; Xiaojin Zhu 001; Yang Li 058; Cho-Jui Hsieh (CoRR, 2019)

Gesture interaction in virtual reality. - Yang Li 058; Jin Huang 009; Feng Tian 001; Hongan Wang; Guozhong Dai (Virtual Real. Intell. Hardw., 2019)

Influence of multi-modality on moving target selection in virtual reality. - Yang Li 058; Dong Wu; Jin Huang 009; Feng Tian 001; Hongan Wang; Guozhong Dai (Virtual Real. Intell. Hardw., 2019)

Mapping Natural Language Instructions to Mobile UI Action Sequences. - Yang Li 058; Jiacong He; Xin Zhou 018; Yuan Zhang 001; Jason Baldridge (ACL, 2020)

Artificial Intelligence for HCI: A Modern Approach. - Yang Li 058; Ranjitha Kumar; Walter S. Lasecki; Otmar Hilliges (CHI Extended Abstracts, 2020)

Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods. - Arianna Yuan; Yang Li 058 (CHI, 2020)

Personalized Flight Itinerary Ranking at Fliggy. - Jinhong Huang; Yang Li 058; Shan Sun; Bufeng Zhang; Jin Huang 009 (CIKM, 2020)

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. - Yang Li 058; Gang Li 021; Luheng He; Jingjie Zheng; Hong Li; Zhiwei Guan (EMNLP (1), 2020)

Multi-Stage Influence Function. - Hongge Chen; Si Si; Yang Li 058; Ciprian Chelba; Sanjiv Kumar; Duane S. Boning; Cho-Jui Hsieh (NeurIPS, 2020)

Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders. - Yang Li 058; Julien Amelot; Xin Zhou 018; Samy Bengio; Si Si (CoRR, 2020)

Deep Learning Methods for Lung Cancer Segmentation in Whole-slide Histopathology Images - the ACDC@LungHP Challenge 2019. - Zhang Li; Jiehua Zhang; Tao Tan 002; Xichao Teng; Xiaoliang Sun; Yang Li 058; Lihong Liu; Yang Xiao; Byungjae Lee; Yilong Li; Qianni Zhang; Shujiao Sun; et al. (CoRR, 2020)

Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming. - Mingyuan Zhong 001; Gang Li 021; Yang Li 058 (CHI, 2021)

TapNet: The Design, Training, Implementation, and Applications of a Multi-Task Learning CNN for Off-Screen Mobile Input. - Michael Xuelin Huang; Yang Li 058; Nazneen Nazneen; Alexander Chao; Shumin Zhai (CHI, 2021)

Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding. - Yang Li 058; Si Si; Gang Li 021; Cho-Jui Hsieh; Samy Bengio (NeurIPS, 2021)

Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning. - Xin Zhou 018; Yang Li 058 (RecSys, 2021)

HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions. - Mingyuan Zhong 001; Gang Li 021; Peggy Chi; Yang Li 058 (UIST, 2021)

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning. - Bryan Wang; Gang Li 021; Xin Zhou 018; Zhourong Chen; Tovi Grossman; Yang Li 058 (UIST, 2021)

HelpViz: Automatic Generation of Contextual Visual MobileTutorials from Text-Based Instructions. - Mingyuan Zhong 001; Gang Li 021; Peggy Chi; Yang Li 058 (CoRR, 2021)

Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models. - Forrest Huang; Gang Li 021; Xin Zhou 018; John F. Canny; Yang Li 058 (CoRR, 2021)

VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling. - Yang Li 058; Gang Li 021; Xin Zhou 018; Mostafa Dehghani 001; Alexey A. Gritsenko (CoRR, 2021)

Computational Approaches for Understanding, Generating, and Adapting User Interfaces. - Yue Jiang 002; Yuwen Lu; Jeffrey Nichols 001; Wolfgang Stuerzlinger; Chun Yu; Christof Lutteroth; Yang Li 058; Ranjitha Kumar; Toby Jia-Jun Li (CHI Extended Abstracts, 2022)

Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale. - Gang Li 021; Gilles Baechler; Manuel Tragut; Yang Li 058 (CHI, 2022)

Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis. - Eldon Schoop; Xin Zhou 018; Gang Li 021; Zhourong Chen; Bjoern Hartmann; Yang Li 058 (CHI, 2022)

Enabling Conversational Interaction with Mobile UI using Large Language Models. - Bryan Wang; Gang Li 021; Yang Li 058 (CHI, 2023)

A Zero-Shot Language Agent for Computer Control with Structured Reflection. - Tao Li; Gang Li 021; Zhiwei Deng; Bryan Wang; Yang Li 058 (EMNLP (Findings), 2023)

Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus. - Gang Li 021; Yang Li 058 (ICLR, 2023)

PLay: Parametrically Conditioned Layout Generation using Latent Diffusion. - Chin-Yi Cheng; Forrest Huang; Gang Li 021; Yang Li 058 (ICML, 2023)

PaLI-X: On Scaling up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CoRR, 2023)

Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in Pathology. - Hongyan Gu; Yuan Liang 001; Yifan Xu; Christopher Kazu Williams; Shino Magaki; Negar Khanlou; Harry Vinters; Zesheng Chen; Shuo Ni; Chunxu Yang; Wenzhong Yan; Xinhai Robert Zhang; et al. (ACM Trans. Comput. Hum. Interact., 2023)

Generating Automatic Feedback on UI Mockups with Large Language Models. - Peitong Duan; Jeremy Warner; Yang Li 058; Bjoern Hartmann (CHI, 2024)

Automatic Macro Mining from Interaction Traces at Scale. - Forrest Huang; Gang Li 021; Tao Li; Yang Li 058 (CHI, 2024)

On Scaling Up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CVPR, 2024)

MUG: Interactive Multimodal Grounding on User Interfaces. - Tao Li; Gang Li 021; Jingjie Zheng; Purple Wang; Yang Li 058 (EACL (Findings), 2024)

UICrit: Enhancing Automated Design Evaluation with a UI Critique Dataset. - Peitong Duan; Chin-Yi Cheng; Gang Li 021; Bjoern Hartmann; Yang Li 058 (UIST, 2024)

CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion. - Chin-Yi Cheng; Ruiqi Gao; Forrest Huang; Yang Li 058 (CoRR, 2024)

Revision Matters: Generative Design Guided by Revision Edits. - Tao Li; Chin-Yi Cheng; Amber Xie; Gang Li 021; Yang Li 058 (CoRR, 2024)

UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset. - Peitong Duan; Chin-Yi Chen; Gang Li 021; Bjoern Hartmann; Yang Li 058 (CoRR, 2024)

Visual Prompting with Iterative Refinement for Design Critique Generation. - Peitong Duan; Chin-Yi Chen; Bjoern Hartmann; Yang Li 058 (CoRR, 2024)

Evaluating the effects of user motion and viewing mode on target selection in augmented reality. - Yang Li 058; Juan Liu 008; Jin Huang 009; Yang Zhang 116; Xiaolan Peng; Yulong Bian; Feng Tian 001 (Int. J. Hum. Comput. Stud., 2024)

The GenUI Study: Exploring the Design of Generative UI Tools to Support UX Practitioners and Beyond. - Xiang 'Anthony Chen; Tiffany Knearem; Yang Li 058 (Conference on Designing Interactive Systems, 2025)

Bidirectional Human-AI Alignment: Emerging Challenges and Opportunities. - Hua Shen 005; Tiffany Knearem; Reshmi Ghosh; Michael Xieyang Liu; Andrés Monroy-Hernández; Tongshuang Wu; Diyi Yang; Yun Huang; Tanushree Mitra; Yang Li 058; Marti Hearst (CHI Extended Abstracts, 2025)

A Formative Study to Explore the Design of Generative UI Tools to Support UX Practitioners and Beyond. - Xiang 'Anthony' Chen; Tiffany Knearem; Yang Li 058 (CoRR, 2025)