All publications

LLM/Generative AI

Work that applies large language models or generative AI to interactive systems.

AgentHands: Generating Interactive Hand Gestures for Spatially Grounded Agent Conversations in XR

Ziyi Liu, David Li, Zhongyi Zhou, David Kim, Ruofei Du, Xun Qian
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI 2026) · 2026
View publication →

DialogLab: Authoring, Simulating, and Testing Dynamic Human-AI Group Conversations

Erzhen Hu, Yanhe Chen, Mingyi Li, Vrushank Phadnis, Pingmei Xu, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →
Best Paper Honorable Mention

InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMs

Zhongyi Zhou, Jing Jin, Vrushank Phadnis, Xiuxiu Yuan, Jun Jiang, Xun Qian, Kristen Wright, Mark Sherwood, Jason Mayes, Jingtao Zhou, Yiyi Huang, Zheng Xu, Yinda Zhang, Johnny Lee, Alex Olwal, David Kim, Ram Iyengar, Na Li, Ruofei Du
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI 2025) · 2025
View publication →

NoteIt: A System Converting Instructional Videos to Interactable Notes Through Multimodal Video Understanding

Running Zhao, Zhihan Jiang, Xinchen Zhang, Chirui Chang, Handi Chen, Weipeng Deng, Luyao Jin, Xiaojuan Qi, Edith C.H. Ngai, Xun Qian
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →

Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents

Geonsun Lee, Min Xia, Nels Numan, Xun Qian, David Li, Yanhe Chen, Achin Kulshrestha, Ishan Chatterjee, Yinda Zhang, Dinesh Manocha, David Kim, Ruofei Du
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →

Thing2Reality: Enabling Spontaneous Creation of 3D Objects from 2D Content using Generative AI in XR Meetings

Erzhen Hu, Mingyi Li, Jungtaek Hong, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du
Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST 2025) · 2025
View publication →