Toby Jia-Jun Li

Toby Jia-Jun Li

Carnegie Mellon University

H-index: 19

North America-United States

About Toby Jia-Jun Li

Toby Jia-Jun Li, With an exceptional h-index of 19 and a recent h-index of 18 (since 2020), a distinguished researcher at Carnegie Mellon University, specializes in the field of Human-Computer Interaction, Human-AI Collaboration, End User Programming, Programming by Demonstration, Future of Work.

His recent articles reflect a diverse array of research interests and contributions to the field:

A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration

AI Assistance for UX: A Literature Review Through Human-Centered AI

" I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices

CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models

CodeGRITS: A Research Toolkit for Developer Behavior and Eye Tracking in IDE

Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

EyeTrans: Merging Human and Machine Attention for Neural Code Summarization

Empowering LLM to use Smartphone for Intelligent Task Automation

Toby Jia-Jun Li Information

University

Position

Ph.D. Student

Citations(all)

1207

Citations(since 2020)

1088

Cited By

387

hIndex(all)

19

hIndex(since 2020)

18

i10Index(all)

26

i10Index(since 2020)

26

Email

University Profile Page

Carnegie Mellon University

Google Scholar

View Google Scholar Profile

Toby Jia-Jun Li Skills & Research Interests

Human-Computer Interaction

Human-AI Collaboration

End User Programming

Programming by Demonstration

Future of Work

Top articles of Toby Jia-Jun Li

Title

Journal

Author(s)

Publication Date

A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration

arXiv preprint arXiv:2404.00405

Jie Gao

Simret Araya Gebreegziabher

Kenny Tsu Wei Choo

Toby Jia-Jun Li

Simon Tangi Perrault

...

2024/3/30

AI Assistance for UX: A Literature Review Through Human-Centered AI

Yuwen Lu

Yuewen Yang

Qinyi Zhao

Chengzhi Zhang

Toby Jia-Jun Li

2024/2/8

" I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices

arXiv preprint arXiv:2403.19876

Shivani Kapania

Ruiyi Wang

Toby Jia-Jun Li

Tianshi Li

Hong Shen

2024/3/28

CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models

Jie Gao

Yuchen Guo

Gionnieve Lim

Tianqin Zhang

Zheng Zhang

...

2024

CodeGRITS: A Research Toolkit for Developer Behavior and Eye Tracking in IDE

International Conference on Software Engineering 2024 - Tool Demonstration Track

Ningzhi Tang

Junwen An

Meng Chen

Aakash Bansal

Yu Huang

...

2024

Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Sangho Suh

Meng Chen

Bryan Min

Toby Jia-Jun Li

Haijun Xia

2024/5

EyeTrans: Merging Human and Machine Attention for Neural Code Summarization

arXiv preprint arXiv:2402.14096

Yifan Zhang

Jiliang Li

Zachary Karas

Aakash Bansal

Toby Jia-Jun Li

...

2024/2/21

Empowering LLM to use Smartphone for Intelligent Task Automation

MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking

Hao Wen

Yuanchun Li

Guohong Liu

Shanhui Zhao

Tao Yu

...

2024

An Empathy-Based Sandbox Approach to Bridge Attitudes, Goals, Knowledge, and Behaviors in the Privacy Paradox

Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Chaoran Chen

Weijun Li

Wenxin Song

Yanfang Ye

Yaxing Yao

...

2024/5

Insights into Natural Language Database Query Errors: From Attention Misalignment to User Handling Strategies

ACM Transactions on Interactive Intelligent Systems

Zheng Ning

Yuan Tian

Zheng Zhang

Tianyi Zhang

Toby Jia-Jun Li

2024/2/11

MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos

arXiv preprint arXiv:2404.15107

Zheng Ning

Zheng Zhang

Jerrick Ban

Kaiwen Jiang

Ruohong Gan

...

2024/4/23

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

arXiv preprint arXiv:2402.07300

Zheng Ning

Brianna Wimer

Kaiwen Jiang

Keyi Chen

Jerrick Ban

...

2024/2/11

Impact of Human-AI Interaction on User Trust and Reliance in AI-Assisted Qualitative Coding

arXiv preprint arXiv:2309.13858

Jie Gao

Junming Cao

ShunYi Yeo

Kenny Tsu Wei Choo

Zheng Zhang

...

2023/9/25

PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data

Zheng Zhang

Zheng Ning

Chenliang Xu

Yapeng Tian

Toby Jia-Jun Li

2023/10/29

SHAI 2023: Workshop on Designing for Safety in Human-AI Interactions

Nitesh Goyal

Sungsoo Ray Hong

Regan L Mandryk

Toby Jia-Jun Li

Kurt Luther

...

2023/3/27

From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX

arXiv preprint arXiv:2310.17846

Yuwen Lu

Chao Zhang

Yuewen Yang

Yaxing Yao

Toby Jia-Jun Li

2023/10/27

Modeling Programmer Attention as Scanpath Prediction

In Proceedings of The 38th IEEE/ACM International Conference on Automated Software Engineering ASE 2023 - NIER track

Aakash Bansal

Chia-Yi Su

Zachary Karas

Yifan Zhang

Yu Huang

...

2023/9/14

An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries

Zheng Ning

Zheng Zhang

Tianyi Sun

Yuan Tian

Tianyi Zhang

...

2023/3/27

Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations

Yuan Tian

Toby Jia-Jun Li

Jonathan K Kummerfeld

Tianyi Zhang

2023/12

UI Layout Generation with LLMs Guided by UI Grammar

ICML 2023 Workshop on AI & HCI

Yuwen Lu

Ziang Tong

Qinyi Zhao

Chengzhi Zhang

Toby Jia-Jun Li

2023/10/24

See List of Professors in Toby Jia-Jun Li University(Carnegie Mellon University)

Co-Authors

H-index: 99
Tom Mitchell

Tom Mitchell

Carnegie Mellon University

H-index: 96
Brad A. Myers

Brad A. Myers

Carnegie Mellon University

H-index: 46
Diyi Yang

Diyi Yang

Georgia Institute of Technology

H-index: 45
Johannes Schöning

Johannes Schöning

Universität Bremen

H-index: 43
Brent Hecht

Brent Hecht

Northwestern University

academic-engine