References & Citations
Computer Science > Distributed, Parallel, and Cluster Computing
Title: Seven Principles for Effective Scientific Big-DataSystems
(Submitted on 9 Aug 2019 (v1), last revised 25 Jun 2020 (this version, v2))
Abstract: We should be in a golden age of scientific discovery, given that we have more data and more compute power available than ever before, plus a new generation of algorithms that can learn effectively from data. But paradoxically, in many data-driven fields, the eureka moments are becoming increasingly rare. Scientists are struggling to keep pace with the explosion in the volume and complexity of scientific data. We describe here a few simple architectural principles that we believe are essential in order to create effective, robust, and flexible platforms that make the best use of emerging technology to deal with the exponential growth of scientific data.
Submission history
From: Niall Robinson PhD [view email][v1] Fri, 9 Aug 2019 08:12:54 GMT (82kb,D)
[v2] Thu, 25 Jun 2020 16:14:43 GMT (161kb,D)
Link back to: arXiv, form interface, contact.