Toby Jia-Jun Li

Orcid: 0000-0001-7902-7625

Affiliations:
  • University of Notre Dame, USA


According to our database1, Toby Jia-Jun Li authored at least 55 papers between 2014 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
"I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices.
CoRR, 2024

EyeTrans: Merging Human and Machine Attention for Neural Code Summarization.
CoRR, 2024

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers.
CoRR, 2024

AI Assistance for UX: A Literature Review Through Human-Centered AI.
CoRR, 2024

2023
Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks.
CoRR, 2023

From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX.
CoRR, 2023

UI Layout Generation with LLMs Guided by UI Grammar.
CoRR, 2023

Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation.
CoRR, 2023

An Empathy-Based Sandbox Approach to Bridge Attitudes, Goals, Knowledge, and Behaviors in the Privacy Paradox.
CoRR, 2023

Impact of Human-AI Interaction on User Trust and Reliance in AI-Assisted Qualitative Coding.
CoRR, 2023

Empowering LLM to use Smartphone for Intelligent Task Automation.
CoRR, 2023

Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations.
CoRR, 2023

CollabCoder: A GPT-Powered Workflow for Collaborative Qualitative Analysis.
CoRR, 2023

PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data.
Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping.
Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

Modeling Programmer Attention as Scanpath Prediction.
Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering, 2023

An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries.
Proceedings of the 28th International Conference on Intelligent User Interfaces, 2023

SHAI 2023: Workshop on Designing for Safety in Human-AI Interactions.
Proceedings of the Companion Proceedings of the 28th International Conference on Intelligent User Interfaces, 2023

Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations.
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Shaping the Emerging Norms of Using Large Language Models in Social Computing Research.
Proceedings of the Computer Supported Cooperative Work and Social Computing, 2023

Designing for AI-Powered Social Computing Systems.
Proceedings of the Computer Supported Cooperative Work and Social Computing, 2023

CollabCoder: A GPT-Powered WorkFlow for Collaborative Qualitative Analysis.
Proceedings of the Computer Supported Cooperative Work and Social Computing, 2023

PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis.
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

The Future of Computational Approaches for Understanding and Adapting User Interfaces.
Proceedings of the Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, 2023

2022
KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction.
CoRR, 2022

AI as an Active Writer: Interaction Strategies with Generated Text in Human-AI Collaborative Fiction Writing 56-65.
Proceedings of the Joint Proceedings of the IUI 2022 Workshops: APEx-UI, 2022

A Bottom-Up End-User Intelligent Assistant Approach to Empower Gig Workers against AI Inequality.
Proceedings of the CHIWORK 2022: Symposium on Human-Computer Interaction for Work, Durham, NH, USA, June 8, 2022

StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Bridging the Gap Between UX Practitioners' Work Practices and AI-Enabled Design Support Tools.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Computational Approaches for Understanding, Generating, and Adapting User Interfaces.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books.
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Fantastic Questions and Where to Find Them: FairytaleQA - An Authentic Dataset for Narrative Comprehension.
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021
It is AI's Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset.
CoRR, 2021

A Need-finding Study for Understanding Text Entry in SmartphoneApp Usage.
CoRR, 2021

Screen2Vec: Semantic Embedding of GUI Screens and GUI Components.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

2020
Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems.
Proc. ACM Hum. Comput. Interact., 2020

Towards Effective Human-AI Collaboration in GUI-Based Interactive Task Learning Agents.
CoRR, 2020

Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications.
Proceedings of the UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs.
Proceedings of the UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

Multi-Modal Interactive Task Learning from Demonstrations and Natural Language Instructions.
Proceedings of the UIST '20 Adjunct: The 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2020

2019
PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations.
Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019

End user programing of intelligent agents using demonstrations and natural language instructions.
Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion, 2019

2018
Teaching Agents When They Fail: End User Development in Goal-Oriented Conversational Agents.
Proceedings of the Studies in Conversational UX Design, 2018

How End Users Express Conditionals in Programming by Demonstration for Mobile Apps.
Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing, 2018

APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions.
Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing, 2018

Kite: Building Conversational Bots from Mobile Apps.
Proceedings of the 16th Annual International Conference on Mobile Systems, 2018

2017
PrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2017

End user mobile task automation using multimodal programming by demonstration.
Proceedings of the 2017 IEEE Symposium on Visual Languages and Human-Centric Computing, 2017

Programming IoT Devices by Demonstration Using Mobile Apps.
Proceedings of the End-User Development - 6th International Symposium, 2017

SUGILITE: Creating Multimodal Smartphone Automation by Demonstration.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017

Making End User Development More Natural.
Proceedings of the New Perspectives in End-User Development., 2017

2016
Not at Home on the Range: Peer Production and the Urban/Rural Divide.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

2014
WikiBrain: Democratizing computation on Wikipedia.
Proceedings of The International Symposium on Open Collaboration, 2014

Leveraging advances in natural language processing to better understand Tobler's first law of geography.
Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, 2014


  Loading...