We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.OH

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Other Computer Science

Title: Hypothesis Formalization: Empirical Findings, Software Limitations, and Design Implications

Abstract: Data analysis requires translating higher level questions and hypotheses into computable statistical models. We present a mixed-methods study aimed at identifying the steps, considerations, and challenges involved in operationalizing hypotheses into statistical models, a process we refer to as hypothesis formalization. In a formative content analysis of research papers, we find that researchers highlight decomposing a hypothesis into sub-hypotheses, selecting proxy variables, and formulating statistical models based on data collection design as key steps. In a lab study, we find that analysts fixated on implementation and shaped their analysis to fit familiar approaches, even if sub-optimal. In an analysis of software tools, we find that tools provide inconsistent, low-level abstractions that may limit the statistical models analysts use to formalize hypotheses. Based on these observations, we characterize hypothesis formalization as a dual-search process balancing conceptual and statistical considerations constrained by data and computation, and discuss implications for future tools.
Subjects: Other Computer Science (cs.OH); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)
Cite as: arXiv:2104.02712 [cs.OH]
  (or arXiv:2104.02712v1 [cs.OH] for this version)

Submission history

From: Eunice Jun [view email]
[v1] Tue, 6 Apr 2021 21:11:28 GMT (6427kb,D)

Link back to: arXiv, form interface, contact.