We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling

Abstract: The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditional calibration is highly inefficient and results in non-unique solutions. Here we propose a novel differentiable parameter learning (dPL) framework that efficiently learns a global mapping between inputs (and optionally responses) and parameters. Crucially, dPL exhibits beneficial scaling curves not previously demonstrated to geoscientists: as training data increases, dPL achieves better performance, more physical coherence, and better generalizability (across space and uncalibrated variables), all with orders-of-magnitude lower computational cost. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods, or required only ~12.5% of the training data to achieve similar performance. The generic scheme promotes the integration of deep learning and process-based models, without mandating reimplementation.
Subjects: Machine Learning (cs.LG); Computational Physics (physics.comp-ph)
DOI: 10.1038/s41467-021-26107-z
Cite as: arXiv:2007.15751 [cs.LG]
  (or arXiv:2007.15751v6 [cs.LG] for this version)

Submission history

From: Chaopeng Shen [view email]
[v1] Thu, 30 Jul 2020 21:38:56 GMT (4458kb)
[v2] Tue, 18 Aug 2020 12:51:58 GMT (4395kb)
[v3] Sat, 12 Sep 2020 11:22:19 GMT (2361kb)
[v4] Thu, 6 May 2021 20:22:38 GMT (3949kb)
[v5] Wed, 12 May 2021 21:15:31 GMT (3949kb)
[v6] Wed, 23 Mar 2022 00:54:33 GMT (3952kb)

Link back to: arXiv, form interface, contact.