We gratefully acknowledge support from
the Simons Foundation and member institutions.

Human-Computer Interaction

New submissions

[ total of 7 entries: 1-7 ]
[ showing up to 500 entries per page: fewer | more ]

New submissions for Mon, 8 Aug 22

[1]  arXiv:2208.02939 [pdf]
Title: Drive Right: Shaping Public's Trust, Understanding, and Preference Towards Autonomous Vehicles Using a Virtual Reality Driving Simulator
Comments: This paper was part of the Greater DriveRight Effort sponsored by Mobility 21 at Carnegie Mellon University
Subjects: Human-Computer Interaction (cs.HC)

While autonomous vehicles are being increasingly introduced into our lives, people's misunderstanding and mistrust have become the key factors hindering the acceptance of these technologies. In response to this problem, proper work must be done to increase public's understanding and awareness of self-driving and help them rationally evaluate the system. The method proposed in this paper is a virtual reality driving simulator which serves as a low-cost and reliable platform for autonomous vehicle demonstration and education. To test its validity, we recruited 36 participants and conducted a test drive using three different scenarios. The results have shown that our simulator successfully increased participants' understanding and awareness of the autonomous system and changed their attitude to be more positive. The methodology and findings presented in this paper can be further explored by policy makers, driving schools, and auto manufacturers to improve the legislative and technical process in the field of autonomous driving.

[2]  arXiv:2208.03175 [pdf, other]
Title: MEDLEY: Intent-based Recommendations to Support Dashboard Composition
Comments: 11 pages, 8 figures, 2 tables, accepted to IEEE Transaction on Visualization and Graphics (also appearing in the proceedings of IEEE VIS 2022)
Subjects: Human-Computer Interaction (cs.HC)

Despite the ever-growing popularity of dashboards across a wide range of domains, their authoring still remains a tedious and complex process. Current tools offer considerable support for creating individual visualizations but provide limited support for discovering groups of visualizations that can be collectively useful for composing analytic dashboards. To address this problem, we present MEDLEY, a mixed-initiative interface that assists in dashboard composition by recommending dashboard collections (i.e., a logically grouped set of views and filtering widgets) that map to specific analytical intents. Users can specify dashboard intents (namely, measure analysis, change analysis, category analysis, or distribution analysis) explicitly through an input panel in the interface or implicitly by selecting data attributes and views of interest. The system recommends collections based on these analytic intents, and views and widgets can be selected to compose a variety of dashboards. MEDLEY also provides a lightweight direct manipulation interface to configure interactions between views in a dashboard. Based on a study with 13 participants performing both targeted and open-ended tasks, we discuss how MEDLEY's recommendations guide dashboard composition and facilitate different user workflows. Observations from the study identify potential directions for future work, including combining manual view specification with dashboard recommendations and designing natural language interfaces for dashboard authoring.

[3]  arXiv:2208.03261 [pdf, other]
Title: Remote Assistance with Mixed Reality for Procedural Tasks
Comments: Published in: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Journal-ref: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2021, pp. 653-654
Subjects: Human-Computer Interaction (cs.HC)

We present a volumetric communication system that is designed for remote assistance of procedural tasks. The system allows a remote expert to visually guide a local operator. The two parties share a view that is spatially identical, but for the local operator it is of the object on which they operate, while for the remote expert, the object is presented as a mixed reality "hologram". Guidance is provided by voice, gestures, and annotations performed directly on the object of interest or its hologram. At each end of the communication, spatial is visualized using mixed-reality glasses.

Cross-lists for Mon, 8 Aug 22

[4]  arXiv:2208.02886 (cross-list from cs.AI) [pdf, other]
Title: Creative Wand: A System to Study Effects of Communications in Co-Creative Settings
Comments: 8 pages, 4 figures, to appear at AIIDE 2022
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more. However, most neural generation algorithms are "uncontrolled" in the sense that the user has little say in creative decisions beyond the initial prompt specification. Co-creative, mixed-initiative systems require user-centric means of influencing the algorithm, especially when users are unlikely to have machine learning expertise. The key to co-creative systems is the ability to communicate ideas and intent from the user to the agent, as well as from the agent to the user. Key questions in co-creative AI include: How can users express their creative intentions? How can creative AI systems communicate their beliefs, explain their moves, or instruct users to act on their behalf? When should creative AI systems take initiative? The answer to such questions and more will enable us to develop better co-creative systems that make humans more capable of expressing their creative intents. We introduce CREATIVE-WAND, a customizable framework for investigating co-creative mixed-initiative generation. CREATIVE-WAND enables plug-and-play injection of generative models and human-agent communication channels into a chat-based interface. It provides a number of dimensions along which an AI generator and humans can communicate during the co-creative process. We illustrate the CREATIVE-WAND framework by using it to study one dimension of co-creative communication-global versus local creative intent specification by the user-in the context of storytelling.

[5]  arXiv:2208.02932 (cross-list from cs.AI) [pdf, other]
Title: Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment
Comments: 6 pages, 7 figures
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

Human-centered AI considers human experiences with AI performance. While abundant research has been helping AI achieve superhuman performance either by fully automatic or weak supervision learning, fewer endeavors are experimenting with how AI can tailor to humans' preferred skill level given fine-grained input. In this work, we guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process. To achieve this, we developed a portable, interactive platform that enables the user to interact with agents online via manipulating the task difficulty, observing performance, and providing curriculum feedback. Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications that require millions of samples without a server. The result demonstrates the effectiveness of an interactive curriculum for reinforcement learning involving human-in-the-loop. It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level. We believe this research will open new doors for achieving flow and personalized adaptive difficulties.

[6]  arXiv:2208.03091 (cross-list from cs.LO) [pdf, other]
Title: On Model Reconciliation: How to Reconcile When Robot Does not Know Human's Model?
Authors: Ho Tuan Dung (Department of Computer Science, New Mexico State University, Las Cruces, USA), Tran Cao Son (Department of Computer Science, New Mexico State University, Las Cruces, USA)
Comments: In Proceedings ICLP 2022, arXiv:2208.02685
Journal-ref: EPTCS 364, 2022, pp. 27-48
Subjects: Logic in Computer Science (cs.LO); Artificial Intelligence (cs.AI); Discrete Mathematics (cs.DM); Human-Computer Interaction (cs.HC)

The Model Reconciliation Problem (MRP) was introduced to address issues in explainable AI planning. A solution to a MRP is an explanation for the differences between the models of the human and the planning agent (robot). Most approaches to solving MRPs assume that the robot, who needs to provide explanations, knows the human model. This assumption is not always realistic in several situations (e.g., the human might decide to update her model and the robot is unaware of the updates).
In this paper, we propose a dialog-based approach for computing explanations of MRPs under the assumptions that (i) the robot does not know the human model; (ii) the human and the robot share the set of predicates of the planning domain and their exchanges are about action descriptions and fluents' values; (iii) communication between the parties is perfect; and (iv) the parties are truthful. A solution of a MRP is computed through a dialog, defined as a sequence of rounds of exchanges, between the robot and the human. In each round, the robot sends a potential explanation, called proposal, to the human who replies with her evaluation of the proposal, called response. We develop algorithms for computing proposals by the robot and responses by the human and implement these algorithms in a system that combines imperative means with answer set programming using the multi-shot feature of clingo.

Replacements for Mon, 8 Aug 22

[7]  arXiv:2208.00109 (replaced) [pdf, other]
Title: Traveler: Navigating Task Parallel Traces for Performance Analysis
Comments: IEEE VIS 2022
Subjects: Human-Computer Interaction (cs.HC)
[ total of 7 entries: 1-7 ]
[ showing up to 500 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2208, contact, help  (Access key information)