We gratefully acknowledge support from
the Simons Foundation and member institutions.

Human-Computer Interaction

New submissions

[ total of 8 entries: 1-8 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Wed, 30 Nov 22

[1]  arXiv:2211.15810 [pdf, other]
Title: Practical Challenges in Indoor Mobile Recommendation
Comments: 10 pages, 3 figures, 2 tables
Subjects: Human-Computer Interaction (cs.HC)

Recommendation systems are present in multiple contexts as e-commerce, websites, and media streaming services. As scenarios get more complex, techniques and tools have to consider a number of variables. When recommending services/products to mobile users while they are in indoor environments next to the object of the recommendation, variables as location, interests, route, and interaction logs also need to be taken into account. In this context, this work discusses the practical challenges inherent to the context of indoor mobile recommendation (e.g., mall, parking lot, museum, among others) grounded on a case and a systematic review. With the presented results, one expects to support practitioners in the task of defining the proper approach, technology, and notification method when recommending services/products to mobile users in indoor environments.

[2]  arXiv:2211.16465 [pdf, other]
Title: "I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual Impairments
Comments: To appear in the Proceedings of the ACM on Human-Computer Interaction, CSCW1, April 2023 issue. To be presented at CSCW 2023
Subjects: Human-Computer Interaction (cs.HC)

Navigation assistance systems (NASs) aim to help visually impaired people (VIPs) navigate unfamiliar environments. Most of today's NASs support VIPs via turn-by-turn navigation, but a growing body of work highlights the importance of exploration as well. It is unclear, however, how NASs should be designed to help VIPs explore unfamiliar environments. In this paper, we perform a qualitative study to understand VIPs' information needs and challenges with respect to exploring unfamiliar environments, with the aim of informing the design of NASs that support exploration. Our findings reveal the types of spatial information that VIPs need as well as factors that affect VIPs' information preferences. We also discover specific challenges that VIPs face that future NASs can address such as orientation and mobility education and collaborating effectively with others. We present design implications for NASs that support exploration, and we identify specific research opportunities and discuss open socio-technical challenges for making such NASs possible. We conclude by reflecting on our study procedure to inform future approaches in research on ethical considerations that may be adopted while interacting with the broader VIP community.

Cross-lists for Wed, 30 Nov 22

[3]  arXiv:2211.15871 (cross-list from cs.RO) [pdf, other]
Title: Simultaneous Estimation of Hand Configurations and Finger Joint Angles using Forearm Ultrasound
Comments: Manuscript ACCEPTED for publication in IEEE Transactions on Medical Robotics and Bionics (TMRB). 13 pages, 11 figures, and 5 tables. arXiv admin note: text overlap with arXiv:2109.11093
Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

With the advancement in computing and robotics, it is necessary to develop fluent and intuitive methods for interacting with digital systems, augmented/virtual reality (AR/VR) interfaces, and physical robotic systems. Hand motion recognition is widely used to enable these interactions. Hand configuration classification and MCP joint angle detection is important for a comprehensive reconstruction of hand motion. sEMG and other technologies have been used for the detection of hand motions. Forearm ultrasound images provide a musculoskeletal visualization that can be used to understand hand motion. Recent work has shown that these ultrasound images can be classified using machine learning to estimate discrete hand configurations. Estimating both hand configuration and MCP joint angles based on forearm ultrasound has not been addressed in the literature. In this paper, we propose a CNN based deep learning pipeline for predicting the MCP joint angles. The results for the hand configuration classification were compared by using different machine learning algorithms. SVC with different kernels, MLP, and the proposed CNN have been used to classify the ultrasound images into 11 hand configurations based on activities of daily living. Forearm ultrasound images were acquired from 6 subjects instructed to move their hands according to predefined hand configurations. Motion capture data was acquired to get the finger angles corresponding to the hand movements at different speeds. Average classification accuracy of 82.7% for the proposed CNN and over 80% for SVC for different kernels was observed on a subset of the dataset. An average RMSE of 7.35 degrees was obtained between the predicted and the true MCP joint angles. A low latency (6.25 - 9.1 Hz) pipeline has been proposed for estimating both MCP joint angles and hand configuration aimed at real-time control of human-machine interfaces.

[4]  arXiv:2211.16274 (cross-list from cs.LG) [pdf, other]
Title: NCTV: Neural Clamping Toolkit and Visualization for Neural Network Calibration
Comments: AAAI 2023 Demo Track; The demonstration is at this https URL
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

With the advancement of deep learning technology, neural networks have demonstrated their excellent ability to provide accurate predictions in many tasks. However, a lack of consideration for neural network calibration will not gain trust from humans, even for high-accuracy models. In this regard, the gap between the confidence of the model's predictions and the actual correctness likelihood must be bridged to derive a well-calibrated model. In this paper, we introduce the Neural Clamping Toolkit, the first open-source framework designed to help developers employ state-of-the-art model-agnostic calibrated models. Furthermore, we provide animations and interactive sections in the demonstration to familiarize researchers with calibration in neural networks. A Colab tutorial on utilizing our toolkit is also introduced.

[5]  arXiv:2211.16277 (cross-list from cs.LG) [pdf, other]
Title: Differentiable User Models
Authors: Alex Hämäläinen (1), Mustafa Mert Çelikok (1), Samuel Kaski (1, 2) ((1) Department of Computer Science, Aalto University, (2) Department of Computer Science, University of Manchester)
Comments: This is an extended abstract accepted for presentation in NeurIPS 2022 HILL workshop
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

Probabilistic user modeling is essential for building collaborative AI systems within probabilistic frameworks. However, modern advanced user models, often designed as cognitive behavior simulators, are computationally prohibitive for interactive use in cooperative AI assistants. In this extended abstract, we address this problem by introducing widely-applicable differentiable surrogates for bypassing this computational bottleneck; the surrogates enable using modern behavioral models with online computational cost which is independent of their original computational cost. We show experimentally that modeling capabilities comparable to likelihood-free inference methods are achievable, with over eight orders of magnitude reduction in computational time. Finally, we demonstrate how AI-assistants can computationally feasibly use cognitive models in a previously studied menu-search task.

[6]  arXiv:2211.16444 (cross-list from cs.AI) [pdf]
Title: Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare
Comments: 35 pages, 5 figures
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

The need for AI systems to provide explanations for their behaviour is now widely recognised as key to their adoption. In this paper, we examine the problem of trustworthy AI and explore what delivering this means in practice, with a focus on healthcare applications. Work in this area typically treats trustworthy AI as a problem of Human-Computer Interaction involving the individual user and an AI system. However, we argue here that this overlooks the important part played by organisational accountability in how people reason about and trust AI in socio-technical settings. To illustrate the importance of organisational accountability, we present findings from ethnographic studies of breast cancer screening and cancer treatment planning in multidisciplinary team meetings to show how participants made themselves accountable both to each other and to the organisations of which they are members. We use these findings to enrich existing understandings of the requirements for trustworthy AI and to outline some candidate solutions to the problems of making AI accountable both to individual users and organisationally. We conclude by outlining the implications of this for future work on the development of trustworthy AI, including ways in which our proposed solutions may be re-used in different application settings.

Replacements for Wed, 30 Nov 22

[7]  arXiv:2209.14292 (replaced) [html]
Title: Proceedings of the AI-HRI Symposium at AAAI-FSS 2022
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
[8]  arXiv:2211.14228 (replaced) [pdf, other]
Title: GPT-3-driven pedagogical agents for training children's curious question-asking skills
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
[ total of 8 entries: 1-8 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2211, contact, help  (Access key information)