Human-AI Interaction and Collaboration

Conversational Tactile Data Interfaces: Co-Designing Accessible Data Experiences with Blind Users Using Refreshable Tactile Displays and Conversational AI
  • Samuel Reinders, Munazza Zaib, Bongshin Lee, Ingrid Zukerman, Matthew Butler, Thien Autran, Sascha Cowley, Sascha Cowley, Lizhen Qu, Kim Marriott
  • IEEE Transactions on Visualization and Computer Graphics (VIS 2026), in press

Do MLLMs Capture How Interfaces Guide User Behavior? A Benchmark for Multimodal UI/UX Design Understanding
  • Jaehyun Jeon, Min Soo Kim, Janghan Yoon, Sumin Shim, Yejin Choi, Hanbin Kim, Dae Hyun Kim, Youngjae Yu
  • Annual Meeting of the Association for Computational Linguistics (ACL 2026)

Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
  • Lujain Ibrahim, Canfer Akbulut, Rasmi Elasmar, Charvi Rastogi, Minsuk Kahng, Meredith Ringel Morris, Kevin R McKee, Verena Rieser, Murray Shanahan, Laura Weidinger
  • International Conference on Learning Representations (ICLR 2026)

Best Paper Award
Supporting Multimodal Data Interaction on Refreshable Tactile Displays: An Architecture to Combine Touch and Conversational AI
  • Samuel Reinders, Munazza Zaib, Matthew Butler, Bongshin Lee, Ingrid Zukerman, Lizhen Qu, Kim Marriott
  • IEEE Pacific Visualization Conference (PacificVis 2026)

Challenges in Synchronous & Remote Collaboration Around Visualization
  • Matthew Brehmer, Maxime Cordeil, Christophe Hurter, Takayuki Itoh, Wolfgang Büschel, Mahmood Jasim, Arnaud Prouzeau, David Saffo, Lyn Bartram, Sheelagh Carpendale, Chen Zhu-Tian, Andrew Cunningham, Tim Dwyer, Samuel Huron, Masahiko Itoh, Alark Joshi, Kiyoshi Kiyokawa, Hideaki Kuzuoka, Bongshin Lee, Gabriela Molina León, Harald Reiterer, Bektur Ryskeldiev, Jonathan Schwabish, Brian A. Smith, Yasuyuki Sumi, Ryo Suzuki, Anthony Tang, Yalong Yang, Jian Zhao
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2026)

Data-Prompt Co-Evolution: Growing Test Sets to Refine LLM Behavior
DiaryPlay: AI-Assisted Creation of Interactive Story Vignettes for Everyday Storytelling
  • Jiangnan Xu, Haeseul Cha, Gosu Choi, Gyu-cheol Lee, Yeo-Jin Yoon, Zucheul Lee, Konstantinos Papangelis, Dae Hyun Kim, Juho Kim
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2026)

Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation
  • Aeree Cho, Grace C. Kim, Alexander Karpekov, Seongmin Lee, Alec Helbling, Benjamin Hoover, Zijie J. Wang, Minsuk Kahng, Duen Horng Chau
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2026)

Understanding Spatiotemporal-Aware Multimodal Conversational Search in the Outdoor Urban Space
  • Jiangnan Xu, Suyeon Seo, Joni Salminen, Michael Saker, Joongi Shin, Alan Chamberlain, Konstantinos Papangelis, Dae Hyun Kim
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2026)

CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Designs
  • Daeheon Jeong, Seoyeon Byun, Kihoon Son, Dae Hyun Kim, Juho Kim
  • AAAI Conference on Artificial Intelligence (AAAI 2026)

Understanding Over-the-Counter Medication Decision-Making Among Older Adults and Caregivers
  • Mengying Li, Harshitha Kommaraju, Jarrett G.W. Lee, Seongjae Bae, Siqiao Austin Ao, Bongshin Lee, Eun Kyoung Choe
  • Proceedings of AMIA, accepted for publication

COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs
  • Dasol Choi, DongGeon Lee, Brigitta Jesica Kartono, Helena Berndt, Taeyoun Kwon, Joonwon Jang, Haon Park, Hwanjo Yu, Minsuk Kahng
  • arXiv

Generative AI Personas Considered Harmful? Putting Forth Twenty Challenges of Algorithmic User Representation in Human-Computer Interaction
  • Danial Amin, Joni Salminen, Bernard J. Jansen, Joongi Shin, Dae Hyun Kim
  • International Journal of Human-Computer Studies (IJHCS)

From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models
  • Jessica Quaye, Charvi Rastogi, Alicia Parrish, Oana Inel, Minsuk Kahng, Lora Aroyo, Vijay Janapa Reddi
  • arXiv

Oral
C²: Scalable Auto-Feedback for LLM-based Chart Generation
  • Woosung Koh, Janghan Yoon, MinHyung Lee, Youngjin Song, Jaegwan Cho, Jaehyun Kang, Taehyeon Kim, Se-Young Yun, Youngjae Yu, Bongshin Lee
  • Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2025)

LLM Adoption in Data Curation Workflows: Industry Practices and Insights
  • Crystal Qian, Michael Xieyang Liu, Emily Reif, Grady Simon, Nada Hussein, Nathan Clement, James Wexler, Carrie J. Cai, Michael Terry, Minsuk Kahng
  • Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '25)

LLM Attributor: Interactive Visual Attribution for LLM Generation
  • Seongmin Lee, Zijie J Wang, Aishwarya Chakravarthy, Alec Helbling, ShengYun Peng, Mansi Phute, Duen Horng Chau, Minsuk Kahng
  • Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2025)

LLM Comparator: Interactive Analysis of Side-by-Side Evaluation of Large Language Models
  • Minsuk Kahng, Ian Tenney, Mahima Pushkarna, Michael Xieyang Liu, James Wexler, Emily Reif, Krystal Kallarackal, Minsuk Chang, Michael Terry, Lucas Dixon
  • IEEE Transactions on Visualization and Computer Graphics (VIS 2024)

A Context-Aware Onboarding Agent for Metaverse Powered by Large Language Models
  • Jihyeong Hong, Yokyung Lee, Dae Hyun Kim, DaEun Choi, Yeo-Jin Yoon, Gyu-cheol Lee, Zucheul Lee, Juho Kim
  • ACM Designing Interactive Systems Conference (DIS '24)

AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients
  • Dae Hyun Kim, Hyungyu Shin, Shakhnozakhon Yadgarova, Jinho Son, Hariharan Subramonyam, Juho Kim
  • ACM Designing Interactive Systems Conference (DIS '24)

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation
  • Jessica Quaye, Alicia Parrish, Oana Inel, Charvi Rastogi, Hannah Rose Kirk, Minsuk Kahng, Erin van Liemt, Max Bartolo, Jess Tsang, Justin White, Nathan Clement, Rafael Mosquera, Juan Ciro, Vijay Janapa Reddi, Lora Aroyo
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT 2024)

Redefining Activity Tracking Through Older Adults' Reflections on Meaningful Activities
  • Yiwen Wang, Mengying Li, Young-Ho Kim, Bongshin Lee, Margaret Danilovich, Amanda Lazar, David E. Conroy, Hernisa Kacorri, Eun Kyoung Choe
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2024)

Visual Cues for Data Analysis Features Amplify Challenges for Blind Spreadsheet Users
Automatic Histograms: Leveraging Language Models for Text Dataset Exploration
  • Emily Reif, Crystal Qian, James Wexler, Minsuk Kahng
  • Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '24)

LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models
  • Minsuk Kahng, Ian Tenney, Mahima Pushkarna, Michael Xieyang Liu, James Wexler, Emily Reif, Krystal Kallarackal, Minsuk Chang, Michael Terry, Lucas Dixon
  • Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '24)

Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models
  • Hyung-Kwon Ko, Hyeon Jeon, Gwanmo Park, Dae Hyun Kim, Nam Wook Kim, Juho Kim, Jinwook Seo
  • ACM CHI Conference on Human Factors in Computing Systems (CHI 2024)

Opportunistic Nudges for Task Migration Between Personal Devices
  • Nikhita Joshi, Richard Li, Jiannan Li, Leonardo Pavanatto, Michel Pahud, Jatin Sharma, Bongshin Lee, Hugo Romat, William Buxton, Nicolai Marquardt, Ken Hinckley, Nathalie Henry Riche
  • Extended Abstracts of the CHI Conference on Human Factors In Computing Systems (CHI EA '24)

Understanding the Dataset Practitioners Behind Large Language Models
  • Crystal Qian, Emily Reif, Minsuk Kahng
  • Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA '24)

Interactive Prompt Debugging with Sequence Salience
  • Ian Tenney, Ryan Mullins, Bin Du, Shree Pandya, Minsuk Kahng, Lucas Dixon
  • arXiv

Honorable Mention Award
Data Formulator: AI-powered Concept-driven Visualization Authoring
  • Chenglong Wang, John R. Thompson, Bongshin Lee
  • IEEE Transactions on Visualization and Computer Graphics (VIS 2023)