We gratefully acknowledge support from
the Simons Foundation and member institutions.

Human-Computer Interaction

New submissions

[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Fri, 20 May 22

[1]  arXiv:2205.09151 [pdf]
Title: An Approach to Investigate Public Opinion, Views, and Perspectives Towards Exoskeleton Technology
Comments: Proceedings of the 7th International Conference on Human Interaction & Emerging Technologies: Artificial Intelligence & Future Applications (IHIET-AI 2022), Lausanne, Switzerland, April 21-23, 2022
Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Robotics (cs.RO); Social and Information Networks (cs.SI)

Over the last decade, exoskeletons have had an extensive impact on different disciplines and application domains such as assisted living, military, healthcare, firefighting, and industries, on account of their diverse and dynamic functionalities to augment human abilities, stamina, potential, and performance in a multitude of ways. In view of this wide-scale applicability and use-cases of exoskeletons, it is crucial to investigate and analyze the public opinion, views, and perspectives towards exoskeletons which would help to interpret the effectiveness of the underlining human-robot, human-machine, and human-technology interactions. The Internet of Everything era of today's living, characterized by people spending more time on the internet than ever before, holds the potential for the investigation of the same by mining and analyzing relevant web behavior, specifically from social media, that can be interpreted to understand public opinion, views, and perspectives towards a topic or set of topics. Therefore, this paper aims to address this research challenge related to exoskeletons by utilizing the potential of web behavior-based Big Data mining in the modern-day Internet of Everything era. As Twitter is one of the most popular social media platforms on a global scale - characterized by both the number of users and the amount of time spent by its users on the platform - this work focused on investigating web behavior on Twitter to interpret the public opinion, views, and perspectives towards exoskeleton technology. A total of approximately 20,000 tweets related to exoskeletons were used to evaluate the effectiveness of the proposed approach. The results presented and discussed uphold the efficacy of the proposed approach to interpret and analyze the public opinion, views, and perspectives towards exoskeletons from the associated tweets.

[2]  arXiv:2205.09257 [pdf]
Title: Mining Observation and Cognitive Behavior Process Patterns of Bridge Inspector
Subjects: Human-Computer Interaction (cs.HC)

In bridge inspection, engineers should diagnose the observed bridge defects by identifying the factors underlying those defects. Traditionally, engineers search and organize structural condition-related information based on visual inspections. Even following the same qualitative inspection standards, experienced engineers tend to find the critical defects and predict the underlying reasons more reliably than less experienced ones. Unique bridge and site conditions, quality of available data, and personal skills and knowledge collectively influence such a subjective nature of data-driven bridge diagnosis. Unfortunately, the lack of detailed data about how experienced engineers observe bridge defects and identify failure modes makes it hard to comprehend what engineers' behaviors form the best practice of producing reliable bridge inspection. Besides, even experienced engineers could sometimes fail to notice critical defects, thereby producing inconsistent, conflicting condition assessments. Therefore, a detailed cognitive behavior analysis of bridge inspectors is critical for enabling a proactive inspector coaching system that uses inspectors' behavior histories to complement personal limitations. This paper presents a computational framework for revealing engineers' observation and cognitive-behavioral processes to identify bridge defects and produce diagnosis conclusions. The authors designed a bridge inspection game consisting of FEM simulation data and inspection reports to capture and analyze experienced and inexperienced engineers' diagnosis behaviors. Mining these behavioral logs have revealed reusable behavioral process patterns that map critical bridge defects and diagnosis conclusions. The results indicate that the proposed method can proactively share inspection experiences and improve inspection processes' explainability and reliability.

[3]  arXiv:2205.09416 [pdf, other]
Title: A Weakly-Supervised Iterative Graph-Based Approach to Retrieve COVID-19 Misinformation Topics
Comments: accepted at CySoc2022
Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

The COVID-19 pandemic has been accompanied by an `infodemic' -- of accurate and inaccurate health information across social media. Detecting misinformation amidst dynamically changing information landscape is challenging; identifying relevant keywords and posts is arduous due to the large amount of human effort required to inspect the content and sources of posts. We aim to reduce the resource cost of this process by introducing a weakly-supervised iterative graph-based approach to detect keywords, topics, and themes related to misinformation, with a focus on COVID-19. Our approach can successfully detect specific topics from general misinformation-related seed words in a few seed texts. Our approach utilizes the BERT-based Word Graph Search (BWGS) algorithm that builds on context-based neural network embeddings for retrieving misinformation-related posts. We utilize Latent Dirichlet Allocation (LDA) topic modeling for obtaining misinformation-related themes from the texts returned by BWGS. Furthermore, we propose the BERT-based Multi-directional Word Graph Search (BMDWGS) algorithm that utilizes greater starting context information for misinformation extraction. In addition to a qualitative analysis of our approach, our quantitative analyses show that BWGS and BMDWGS are effective in extracting misinformation-related content compared to common baselines in low data resource settings. Extracting such content is useful for uncovering prevalent misconceptions and concerns and for facilitating precision public health messaging campaigns to improve health behaviors.

[4]  arXiv:2205.09534 [pdf]
Title: IFTT-PIN: A PIN-Entry Method Leveraging the Self-Calibration Paradigm
Authors: Jonathan Grizou
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

IFTT-PIN is a self-calibrating version of the PIN-entry method introduced in Roth et al. (2004) [1]. In [1], digits are split into two sets and assigned a color respectively. To communicate their digit, users press the button with the same color that is assigned to their digit, which can thus be identified by elimination after a few iterations. IFTT-PIN uses the same principle but does not pre-assign colors to each button. Instead, users are free to choose which button to use for each color. The button-to-color mapping only exists in the user's mind and is never directly communicated to the interface. In other words, IFTT-PIN infers both the user's PIN and their preferred button-to-color mapping at the same time, a process called self-calibration. In this paper, we present online interactive demonstrations of IFTT-PIN (available at https://github.com/jgrizou/IFTT-PIN), with and without self-calibration, and introduce the key concepts and assumptions making self-calibration possible. We review related work in the field of brain-computer interface and further propose self-calibration as a novel approach to protect users against shoulder surfing attacks. Finally, we introduce a vault cracking challenge as a test of usability and security that was informally tested at our institute. With IFTT-PIN, we wish to demonstrate a new interactive experience where users can decide actively and on-the-fly how to use an interface. The self-calibration paradigm might lead to novel opportunities for interaction in other applications or domains. We hope this work will inspire the community to invent them.

[5]  arXiv:2205.09693 [pdf, other]
Title: Individual and Collective Performance Deteriorate in a New Team: A Case Study of CS:GO Tournaments
Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY)

How does the team formation relates to team performance in professional video game playing? This study examined one aspect of group dynamics - team switching - and aims to answer how changing a team affects individual and collective performance in eSports tournaments. In this study we test the hypothesis that switching teams can be detrimental to individual and team performance both in short term and in a long run. We collected data from professional tournaments of a popular first-person shooter game {\itshape Counter-Strike: Global Offensive (CS:GO)} and perform two natural experiments. We found that the player's performance was inversely correlated with the number of teams a player had joined. After a player switched to a new team, both the individual and the collective performance dropped initially, and then slowly recovered. The findings in this study can provide insights for understanding group dynamics in eSports team play and eventually emphasize the importance of team cohesion in facilitating team collaboration, coordination, and knowledge sharing in teamwork in general.

[6]  arXiv:2205.09696 [pdf, other]
Title: Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imaging
Comments: Accepted at ACM Conference on Fairness, Accountability, and Transparency (FAccT), 2022
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

Details of the designs and mechanisms in support of human-AI collaboration must be considered in the real-world fielding of AI technologies. A critical aspect of interaction design for AI-assisted human decision making are policies about the display and sequencing of AI inferences within larger decision-making workflows. We have a poor understanding of the influences of making AI inferences available before versus after human review of a diagnostic task at hand. We explore the effects of providing AI assistance at the start of a diagnostic session in radiology versus after the radiologist has made a provisional decision. We conducted a user study where 19 veterinary radiologists identified radiographic findings present in patients' X-ray images, with the aid of an AI tool. We employed two workflow configurations to analyze (i) anchoring effects, (ii) human-AI team diagnostic performance and agreement, (iii) time spent and confidence in decision making, and (iv) perceived usefulness of the AI. We found that participants who are asked to register provisional responses in advance of reviewing AI inferences are less likely to agree with the AI regardless of whether the advice is accurate and, in instances of disagreement with the AI, are less likely to seek the second opinion of a colleague. These participants also reported the AI advice to be less useful. Surprisingly, requiring provisional decisions on cases in advance of the display of AI inferences did not lengthen the time participants spent on the task. The study provides generalizable and actionable insights for the deployment of clinical AI tools in human-in-the-loop systems and introduces a methodology for studying alternative designs for human-AI collaboration. We make our experimental platform available as open source to facilitate future research on the influence of alternate designs on human-AI workflows.

[7]  arXiv:2205.09701 [pdf, other]
Title: Homophily and Incentive Effects in Use of Algorithms
Comments: Accepted at CogSci, 2022
Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY)

As algorithmic tools increasingly aid experts in making consequential decisions, the need to understand the precise factors that mediate their influence has grown commensurately. In this paper, we present a crowdsourcing vignette study designed to assess the impacts of two plausible factors on AI-informed decision-making. First, we examine homophily -- do people defer more to models that tend to agree with them? -- by manipulating the agreement during training between participants and the algorithmic tool. Second, we considered incentives -- how do people incorporate a (known) cost structure in the hybrid decision-making setting? -- by varying rewards associated with true positives vs. true negatives. Surprisingly, we found limited influence of either homophily and no evidence of incentive effects, despite participants performing similarly to previous studies. Higher levels of agreement between the participant and the AI tool yielded more confident predictions, but only when outcome feedback was absent. These results highlight the complexity of characterizing human-algorithm interactions, and suggest that findings from social psychology may require re-examination when humans interact with algorithms.

Cross-lists for Fri, 20 May 22

[8]  arXiv:2205.09269 (cross-list from cs.LG) [pdf, other]
Title: Threshold Designer Adaptation: Improved Adaptation for Designers in Co-creative Systems
Comments: 6 pages, 2 figures, International Joint Conference on Artificial Intelligence (IJCAI), Special Topic on AI, the Arts, and Creativity
Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC)

To best assist human designers with different styles, Machine Learning (ML) systems need to be able to adapt to them. However, there has been relatively little prior work on how and when to best adapt an ML system to a co-designer. In this paper we present threshold designer adaptation: a novel method for adapting a creative ML model to an individual designer. We evaluate our approach with a human subject study using a co-creative rhythm game design tool. We find that designers prefer our proposed method and produce higher quality content in comparison to an existing baseline.

[9]  arXiv:2205.09462 (cross-list from cs.SI) [pdf, other]
Title: Personalized Interventions for Online Moderation
Comments: The 33rd ACM Conference on Hypertext and Social Media (HT '22)
Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

Current online moderation follows a one-size-fits-all approach, where each intervention is applied in the same way to all users. This naive approach is challenged by established socio-behavioral theories and by recent empirical results that showed the limited effectiveness of such interventions. We propose a paradigm-shift in online moderation by moving towards a personalized and user-centered approach. Our multidisciplinary vision combines state-of-the-art theories and practices in diverse fields such as computer science, sociology and psychology, to design personalized moderation interventions (PMIs). In outlining the path leading to the next-generation of moderation interventions, we also discuss the most prominent challenges introduced by such a disruptive change.

[10]  arXiv:2205.09511 (cross-list from cs.SI) [pdf, other]
Title: The Impact of COVID-19 Pandemic on LGBTQ Online Communitie
Comments: 11 pages, 9 figures
Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

The COVID-19 pandemic has disproportionately impacted the lives of minorities, such as members of the LGBTQ community (lesbian, gay, bisexual, transgender, and queer) due to pre-existing social disadvantages and health disparities. Although extensive research has been carried out on the impact of the COVID-19 pandemic on different aspects of the general population's lives, few studies are focused on the LGBTQ population. In this paper, we identify a group of Twitter users who self-disclose to belong to the LGBTQ community. We develop and evaluate two sets of machine learning classifiers using a pre-pandemic and a during pandemic dataset to identify Twitter posts exhibiting minority stress, which is a unique pressure faced by the members of the LGBTQ population due to their sexual and gender identities. For this task, we collect a set of 20,593,823 posts by 7,241 self-disclosed LGBTQ users and annotate a randomly selected subset of 2800 posts. We demonstrate that our best pre-pandemic and during pandemic models show strong and stable performance for detecting posts that contain minority stress. We investigate the linguistic differences in minority stress posts across pre- and during-pandemic periods. We find that anger words are strongly associated with minority stress during the COVID-19 pandemic. We explore the impact of the pandemic on the emotional states of the LGBTQ population by conducting controlled comparisons with the general population. We adopt propensity score-based matching to perform a causal analysis. The results show that the LBGTQ population have a greater increase in the usage of cognitive words and worsened observable attribute in the usage of positive emotion words than the group of the general population with similar pre-pandemic behavioral attributes.

[11]  arXiv:2205.09549 (cross-list from cs.RO) [pdf]
Title: Politeness Counts: Perceptions of Peacekeeping Robots
Journal-ref: IEEE Transactions on Human-Machine Systems, 49 (3), 232-240 (2019)
Subjects: Robotics (cs.RO); Human-Computer Interaction (cs.HC)

The 'intuitive' trust people feel when encountering robots in public spaces is a key determinant of their willingness to cooperate with these robots. We conducted four experiments to study this topic in the context of peacekeeping robots. Participants viewed scenarios, presented as static images or animations, involving a robot or a human guard performing an access-control task. The guards interacted more or less politely with younger and older male and female people. Our results show strong effects of the guard's politeness. Age and sex of the people interacting with the guard had no significant effect on participants' impressions of its attributes. There were no differences between responses to robot and human guards. This study advances the notion that politeness is a crucial determinant of people's perception of peacekeeping robots.

[12]  arXiv:2205.09584 (cross-list from cs.AI) [pdf, ps, other]
Title: Multi-Armed Bandits in Brain-Computer Interfaces
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Systems and Control (eess.SY)

The multi-armed bandit (MAB) problem models a decision-maker that optimizes its actions based on current and acquired new knowledge to maximize its reward. This type of online decision is prominent in many procedures of Brain-Computer Interfaces (BCIs) and MAB has previously been used to investigate, e.g., what mental commands to use to optimize BCI performance. However, MAB optimization in the context of BCI is still relatively unexplored, even though it has the potential to improve BCI performance during both calibration and real-time implementation. Therefore, this review aims to further introduce MABs to the BCI community. The review includes a background on MAB problems and standard solution methods, and interpretations related to BCI systems. Moreover, it includes state-of-the-art concepts of MAB in BCI and suggestions for future research.

Replacements for Fri, 20 May 22

[13]  arXiv:2204.08383 (replaced) [pdf, other]
Title: 'I think I discovered a military base in the middle of the ocean' -- Null Island, the most real of fictional places
Comments: IEEE Access. \c{opyright}2022 IEEE. Personal use of this material is permitted. Permission from must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY); Databases (cs.DB)
[14]  arXiv:2202.10842 (replaced) [pdf, other]
Title: KuaiRec: A Fully-observed Dataset for Recommender Systems
Comments: 11 pages, 7 figures
Subjects: Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)
[15]  arXiv:2205.09036 (replaced) [pdf, other]
Title: Stop the Spread: A Contextual Integrity Perspective on the Appropriateness of COVID-19 Vaccination Certificates
Journal-ref: ACM Conference on Fairness, Accountability, and Transparency, 2022
Subjects: Computers and Society (cs.CY); Cryptography and Security (cs.CR); Human-Computer Interaction (cs.HC)
[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2205, contact, help  (Access key information)