We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: A Deep Learning Approach to Analyzing Continuous-Time Systems

Abstract: Scientists often use observational time series data to study complex natural processes, from climate change to civil conflict to brain activity. But regression analyses of these data often assume simplistic dynamics. Recent advances in deep learning have yielded startling improvements to the performance of models of complex processes, from speech comprehension to nuclear physics to competitive gaming. But deep learning is generally not used for scientific analysis. Here, we bridge this gap by showing that deep learning can be used, not just to imitate, but to analyze complex processes, providing flexible function approximation while preserving interpretability. Our approach -- the continuous-time deconvolutional regressive neural network (CDRNN) -- relaxes standard simplifying assumptions (e.g., linearity, stationarity, and homoscedasticity) that are implausible for many natural systems and may critically affect the interpretation of data. We evaluate CDRNNs on incremental human language processing, a domain with complex continuous dynamics. We demonstrate dramatic improvements to predictive likelihood in behavioral and neuroimaging data, and we show that CDRNNs enable flexible discovery of novel patterns in exploratory analyses, provide robust control of possible confounds in confirmatory analyses, and open up research questions that are otherwise hard to study using observational data.
Comments: Main article: 11 pages, 1 table, 3 figures; Supplementary Information: 51 pages, 11 tables, 28 figures
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2209.12128 [cs.LG]
  (or arXiv:2209.12128v1 [cs.LG] for this version)

Submission history

From: Cory Shain [view email]
[v1] Sun, 25 Sep 2022 03:02:31 GMT (34912kb,D)

Link back to: arXiv, form interface, contact.