Kenneth Holstein

Kenneth Holstein

Carnegie Mellon University

H-index: 22

North America-United States

About Kenneth Holstein

Kenneth Holstein, With an exceptional h-index of 22 and a recent h-index of 21 (since 2020), a distinguished researcher at Carnegie Mellon University, specializes in the field of Human-Computer Interaction, Augmented Intelligence, Worker-Centered Design, Responsible AI.

His recent articles reflect a diverse array of research interests and contributions to the field:

Trust and Reliance in Evolving Human-AI Workflows, at CHI 2024

Predictive Performance Comparison of Decision Policies Under Confounding

The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposals

Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia

Scrutable AIED

A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms

Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making

Kenneth Holstein Information

University

Position

___

Citations(all)

2779

Citations(since 2020)

2674

Cited By

657

hIndex(all)

22

hIndex(since 2020)

21

i10Index(all)

38

i10Index(since 2020)

37

Email

University Profile Page

Carnegie Mellon University

Google Scholar

View Google Scholar Profile

Kenneth Holstein Skills & Research Interests

Human-Computer Interaction

Augmented Intelligence

Worker-Centered Design

Responsible AI

Top articles of Kenneth Holstein

Title

Journal

Author(s)

Publication Date

Trust and Reliance in Evolving Human-AI Workflows, at CHI 2024

Zahra Ashktorab

Gagan Bansal

Zana Bucinca

Ken Holstein

Jessica Hullman

...

2024/5/11

Predictive Performance Comparison of Decision Policies Under Confounding

arXiv preprint arXiv:2404.00848

Luke Guerdan

Amanda Coston

Kenneth Holstein

Zhiwei Steven Wu

2024/4/1

The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposals

arXiv preprint arXiv:2402.18774

Anna Kawakami

Amanda Coston

Haiyi Zhu

Hoda Heidari

Kenneth Holstein

2024/2/29

Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia

arXiv preprint arXiv:2402.14147

Tzu-Sheng Kuo

Aaron Halfaker

Zirui Cheng

Jiwoo Kim

Meng-Hsin Wu

...

2024/2/21

Scrutable AIED

Judy Kay

Bob Kummerfeld

Cristina Conati

Kaśka Porayska-Pomsta

Ken Holstein

2023/1

A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms

Amanda Coston

Anna Kawakami

Haiyi Zhu

Ken Holstein

Hoda Heidari

2023/2/8

Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

Frederic Gmeiner

Humphrey Yang

Lining Yao

Kenneth Holstein

Nikolas Martelaro

2023/4/19

Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making

Proceedings of the 2023 Conference on Fairness, Accountability, and Transparency (FAccT'23)

Luke Guerdan

Amanda Coston

Zhiwei Steven Wu

Kenneth Holstein

2023/4/26

Training towards critical use: Learning to situate AI predictions relative to human knowledge

Anna Kawakami

Luke Guerdan

Yanghuidi Cheng

Kate Glazko

Matthew Lee

...

2023/11/6

Human-AI co-orchestration: the role of artificial intelligence in orchestration

Ken Holstein

Jennifer K Olsen

2023/1

Towards" Anytime, Anywhere" Community Learning and Engagement around the Design of Public Sector AI

arXiv preprint arXiv:2304.00167

Wesley Hanwen Deng

Motahhare Eslami

Kenneth Holstein

2023/3/31

Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

Wesley Hanwen Deng

Bill Boyuan Guo

Alicia Devos

Hong Shen

Motahhare Eslami

...

2023/2/10

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

Proceedings of the 2023 Conference on Fairness, Accountability, and Transparency (FAccT'23)

Wesley Hanwen Deng

Nur Yildirim

Monica Chang

Motahhare Eslami

Kenneth Holstein

...

2023/6/12

A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing

Charvi Rastogi

Liu Leqi

Kenneth Holstein

Hoda Heidari

2023/11/3

Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables

Proceedings of the ACM on Human-Computer Interaction (CSCW'23)

Kenneth Holstein

Maria De-Arteaga

Lakshmi Tumati

Yanghuidi Cheng

2023

Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning

Ángel Alexander Cabrera

Erica Fu

Donald Bertucci

Kenneth Holstein

Ameet Talwalkar

...

2023/4/19

Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Design

arXiv preprint arXiv:2303.14602

Anna Kawakami

Amanda Coston

Haiyi Zhu

Hoda Heidari

Kenneth Holstein

2023/3/26

Counterfactual Prediction Under Outcome Measurement Error

Luke Guerdan

Amanda Coston

Kenneth Holstein

Zhiwei Steven Wu

2023/6/12

Community-driven AI: Empowering people through responsible data-driven decision-making

Ruyuan Wan

Adriana Alvarado Garcia

Devansh Saxena

Catalina Vajiac

Anna Kawakami

...

2023/10/14

Pair-Up: Prototyping Human-AI Co-orchestration of Dynamic Transitions between Individual and Collaborative Learning in the Classroom

Kexin Bella Yang

Vanessa Echeverria

Zijing Lu

Hongyu Mao

Kenneth Holstein

...

2023/4/19

See List of Professors in Kenneth Holstein University(Carnegie Mellon University)

Co-Authors

H-index: 83
Jason Hong

Jason Hong

Carnegie Mellon University

H-index: 71
Hal Daumé III

Hal Daumé III

University of Maryland, Baltimore

H-index: 43
Zhiwei Steven Wu

Zhiwei Steven Wu

Carnegie Mellon University

H-index: 39
Adam Perer

Adam Perer

Carnegie Mellon University

H-index: 29
Haiyi Zhu

Haiyi Zhu

Carnegie Mellon University

academic-engine