We gratefully acknowledge support from
the Simons Foundation and member institutions.

Human-Computer Interaction

New submissions

[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

New submissions for Mon, 27 Jun 22

[1]  arXiv:2206.11899 [pdf]
Title: Navigating Incommensurability Between Ethnomethodology, Conversation Analysis, and Artificial Intelligence
Authors: Stuart Reeves
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)

Like many research communities, ethnomethodologists and conversation analysts have begun to get caught up -- yet again -- in the pervasive spectacle of surging interests in Artificial Intelligence (AI). Inspired by discussions amongst a growing network of researchers in ethnomethodology (EM) and conversation analysis (CA) traditions who nurse such interests, I started thinking about what things EM and the more EM end of conversation analysis might be doing about, for, or even with, fields of AI research. So, this piece is about the disciplinary and conceptual questions that might be encountered, and -- in my view -- may need addressing for engagements with AI research and its affiliates. Although I'm mostly concerned with things to be aware of as well as outright dangers, later on we can think about some opportunities. And throughout I will keep using 'we' to talk about EM&CA researchers; but this really is for convenience only -- I don't wish to ventriloquise for our complex research communities. All of the following should be read as emanating from my particular research history, standpoint etc., and treated (hopefully) as an invitation for further discussion amongst EM and CA researchers turning to technology and AI specifically.

[2]  arXiv:2206.12118 [pdf, other]
Title: How Does Automation Shape the Process of Narrative Visualization: A Survey on Tools
Subjects: Human-Computer Interaction (cs.HC)

In recent years, narrative visualization has gained a lot of attention. Researchers have proposed different design spaces for various narrative visualization types and scenarios to facilitate the creation process. As users' needs grow and automation technologies advance, more and more tools have been designed and developed. In this paper, we surveyed 122 papers and tools to study how automation can progressively engage in the visualization design and narrative process. By investigating the narrative strengths and the drawing efforts of various visualizations, we created a two-dimensional coordinate to map different visualization types. Our resulting taxonomy is organized by the seven types of narrative visualization on the +x-axis of the coordinate and the four automation levels (i.e., design space, authoring tool, AI-supported tool, and AI-generator tool) we identified from the collected work. The taxonomy aims to provide an overview of current research and development in the automation involvement of narrative visualization tools. We discuss key research problems in each category and suggest new opportunities to encourage further research in the related domain.

[3]  arXiv:2206.12340 [pdf]
Title: How to hide your voice: Noise-cancelling bird photography blind
Authors: C. Baydur (1), B. Pu (2), X. Xu (2) ((1) Institute of Acoustics, School of Physics Science and Engineering, Tongji University, Shanghai, China, (2) Department of Landscape, School of Architecture and Urban Planning, Tongji University, Shanghai, China)
Comments: 22 pages, 11 figures
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Getting close to birds is a great challenge in wildlife photography. Bird photography blinds may be the most effective and least intrusive way. These essential structures can allow to visually and audibly conceal photographers from the habitat if properly designed. However, the acoustic design of the blinds has been overlooked. Herein, we present noise-cancelling blinds which allow photographing birds at close range. Firstly, we conduct a questionnaire in the eco-tourism centre located in Yunnan, China. Thus, we determine the birders' expectations of the indoor sound environment. We then identify four variables to examine the impact of architectural and acoustic decisions on noise propagation. The numerical simulations are performed in the acoustic module of Comsol MultiPhysics. Minimizing the structural size and planning the building with closed windows is a proper decision to reduce noise in the architectural design process. Sound-absorbing materials reduce the acoustic energy indoors, thus decreasing the outdoor noise. Sound-proofing materials help to cancel the acoustic transmission indoors to outdoors. Using sound-absorbing and proofing materials together is the best way to minimize noise both indoors and outdoors. Our study demonstrated that photography blinds require a strong and thorough acoustic design for both human and bird well-being.

[4]  arXiv:2206.12390 [pdf, other]
Title: A Test for Evaluating Performance in Human-Computer Systems
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

The Turing test for comparing computer performance to that of humans is well known, but, surprisingly, there is no widely used test for comparing how much better human-computer systems perform relative to humans alone, computers alone, or other baselines. Here, we show how to perform such a test using the ratio of means as a measure of effect size. Then we demonstrate the use of this test in three ways. First, in an analysis of 79 recently published experimental results, we find that, surprisingly, over half of the studies find a decrease in performance, the mean and median ratios of performance improvement are both approximately 1 (corresponding to no improvement at all), and the maximum ratio is 1.36 (a 36% improvement). Second, we experimentally investigate whether a higher performance improvement ratio is obtained when 100 human programmers generate software using GPT-3, a massive, state-of-the-art AI system. In this case, we find a speed improvement ratio of 1.27 (a 27% improvement). Finally, we find that 50 human non-programmers using GPT-3 can perform the task about as well as--and less expensively than--the human programmers. In this case, neither the non-programmers nor the computer would have been able to perform the task alone, so this is an example of a very strong form of human-computer synergy.

Cross-lists for Mon, 27 Jun 22

[5]  arXiv:2206.09532 (cross-list from eess.SP) [pdf, other]
Title: Hands-on Wireless Sensing with Wi-Fi: A Tutorial
Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Networking and Internet Architecture (cs.NI)

With the rapid development of wireless communication technology, wireless access points (AP) and internet of things (IoT) devices have been widely deployed in our surroundings. Various types of wireless signals (e.g., Wi-Fi, LoRa, LTE) are filling out our living and working spaces. Previous researches reveal the fact that radio waves are modulated by the spatial structure during the propagation process (e.g., reflection, diffraction, and scattering) and superimposed on the receiver. This observation allows us to reconstruct the surrounding environment based on received wireless signals, called "wireless sensing". Wireless sensing is an emerging technology that enables a wide range of applications, such as gesture recognition for human-computer interaction, vital signs monitoring for health care, and intrusion detection for security management. Compared with other sensing paradigms, such as vision-based and IMU-based sensing, wireless sensing solutions have unique advantages such as high coverage, pervasiveness, low cost, and robustness under adverse light and texture scenarios. Besides, wireless sensing solutions are generally lightweight in terms of both computation overhead and device size. This tutorial takes Wi-Fi sensing as an example. It introduces both the theoretical principles and the code implementation of data collection, signal processing, features extraction, and model design. In addition, this tutorial highlights state-of-the-art deep learning models (e.g., CNN, RNN, and adversarial learning models) and their applications in wireless sensing systems. We hope this tutorial will help people in other research fields to break into wireless sensing research and learn more about its theories, designs, and implementation skills, promoting prosperity in the wireless sensing research field.

[6]  arXiv:2206.11987 (cross-list from cs.CY) [pdf]
Title: Businesses in high-income zip codes saw sharper foot-traffic reductions during the COVID-19 pandemic
Comments: 15 pages, 6 figures, 3 tables
Subjects: Computers and Society (cs.CY); Databases (cs.DB); Human-Computer Interaction (cs.HC)

As the COVID-19 pandemic unfolded, the mobility patterns of people worldwide changed drastically. While travel time, the cost of the service, and trip convenience had always influenced mobility, the risk of infection and policy action such as lockdowns and stay-at-home orders emerged as new factors to consider in the mobility calculus. Using SafeGraph mobility data from Minnesota, USA, we demonstrate that businesses and point-of-interest locations in the more affluent zip codes witnessed much sharper reductions in foot traffic than their poorer counterparts. We contend post-pandemic recovery efforts should prioritize relief funding accordingly.

[7]  arXiv:2206.12041 (cross-list from math.ST) [pdf, other]
Title: How many labelers do you have? A closer look at gold-standard labels
Comments: 51 pages, 4 figures
Subjects: Statistics Theory (math.ST); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

The construction of most supervised learning datasets revolves around collecting multiple labels for each instance, then aggregating the labels to form a type of ``gold-standard.''. We question the wisdom of this pipeline by developing a (stylized) theoretical model of this process and analyzing its statistical consequences, showing how access to non-aggregated label information can make training well-calibrated models easier or -- in some cases -- even feasible, whereas it is impossible with only gold-standard labels. The entire story, however, is subtle, and the contrasts between aggregated and fuller label information depend on the particulars of the problem, where estimators that use aggregated information exhibit robust but slower rates of convergence, while estimators that can effectively leverage all labels converge more quickly if they have fidelity to (or can learn) the true labeling process. The theory we develop in the stylized model makes several predictions for real-world datasets, including when non-aggregate labels should improve learning performance, which we test to corroborate the validity of our predictions.

[8]  arXiv:2206.12368 (cross-list from cs.CL) [pdf, other]
Title: Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users
Comments: 5 pages, 3 tables, 1 figure
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

Deaf and hard of hearing individuals regularly rely on captioning while watching live TV. Live TV captioning is evaluated by regulatory agencies using various caption evaluation metrics. However, caption evaluation metrics are often not informed by preferences of DHH users or how meaningful the captions are. There is a need to construct caption evaluation metrics that take the relative importance of words in a transcript into account. We conducted correlation analysis between two types of word embeddings and human-annotated labeled word-importance scores in existing corpus. We found that normalized contextualized word embeddings generated using BERT correlated better with manually annotated importance scores than word2vec-based word embeddings. We make available a pairing of word embeddings and their human-annotated importance scores. We also provide proof-of-concept utility by training word importance models, achieving an F1-score of 0.57 in the 6-class word importance classification task.

Replacements for Mon, 27 Jun 22

[9]  arXiv:2107.09008 (replaced) [pdf, other]
Title: Harmonizing the Cacophony with MIC: An Affordance-aware Framework for Platform Moderation
Comments: 21 pages, 5 figures
Subjects: Human-Computer Interaction (cs.HC); Social and Information Networks (cs.SI)
[10]  arXiv:2108.02299 (replaced) [pdf, other]
Title: Exploring D3 Implementation Challenges on Stack Overflow
Comments: Accepted as a short paper to IEEE VIS 2022
Subjects: Human-Computer Interaction (cs.HC)
[11]  arXiv:2111.06172 (replaced) [pdf, other]
Title: What was Hybrid? A Systematic Review of Hybrid Collaboration and Meetings Research
Subjects: Human-Computer Interaction (cs.HC)
[12]  arXiv:2204.08471 (replaced) [pdf, other]
Title: AI for human assessment: What do professional assessors need?
Comments: For the 2022 ACM CHI Workshop on Trust and Reliance in AI-Human Teams
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
[13]  arXiv:2205.04357 (replaced) [pdf, other]
Title: Unified framework for Identity and Imagined Action Recognition from EEG patterns
Subjects: Human-Computer Interaction (cs.HC)
[14]  arXiv:2110.13290 (replaced) [pdf]
Title: Exploring System Performance of Continual Learning for Mobile and Embedded Sensing Applications
Comments: Accepted for publication at SEC 2021
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Performance (cs.PF)
[15]  arXiv:2206.10254 (replaced) [pdf, other]
Title: Towards Optimizing OCR for Accessibility
Journal-ref: Extended Abstract for Poster Session at Accessibility, Vision, and Autonomy Meet (CVPR 2022 Workshop)
Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
[ total of 15 entries: 1-15 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, cs, recent, 2206, contact, help  (Access key information)