Survey of User Interface Design and Interaction Techniques in Generative
  AI Applications
Authors: name: Reuben Luera; name: Ryan A. Rossi; name: Alexa Siu; name: Franck Dernoncourt; name: Tong Yu; name: Sungchul Kim; name: Ruiyi Zhang; name: Xiang Chen; name: Hanieh Salehy; name: Jian Zhao; name: Samyadeep Basu; name: Puneet Mathur; name: Nedim Lipka
Published: 2024-10-28 23:10:06

Abstract: The applications of generative AI have become extremely impressive, and the
interplay between users and AI is even more so. Current human-AI interaction
literature has taken a broad look at how humans interact with generative AI,
but it lacks specificity regarding the user interface designs and patterns used
to create these applications. Therefore, we present a survey that
comprehensively presents taxonomies of how a human interacts with AI and the
user interaction patterns designed to meet the needs of a variety of relevant
use cases. We focus primarily on user-guided interactions, surveying
interactions that are initiated by the user and do not include any implicit
signals given by the user. With this survey, we aim to create a compendium of
different user-interaction patterns that can be used as a reference for
designers and developers alike. In doing so, we also strive to lower the entry
barrier for those attempting to learn more about the design of generative AI
applications.