We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Dynamic Time Warping as a New Evaluation for Dst Forecast with Machine Learning

Abstract: Models based on neural networks and machine learning are seeing a rise in popularity in space physics. In particular, the forecasting of geomagnetic indices with neural network models is becoming a popular field of study. These models are evaluated with metrics such as the root-mean-square error (RMSE) and Pearson correlation coefficient. However, these classical metrics sometimes fail to capture crucial behavior. To show where the classical metrics are lacking, we trained a neural network, using a long short-term memory network, to make a forecast of the disturbance storm time index at origin time $t$ with a forecasting horizon of 1 up to 6 hours, trained on OMNIWeb data. Inspection of the model's results with the correlation coefficient and RMSE indicated a performance comparable to the latest publications. However, visual inspection showed that the predictions made by the neural network were behaving similarly to the persistence model. In this work, a new method is proposed to measure whether two time series are shifted in time with respect to each other, such as the persistence model output versus the observation. The new measure, based on Dynamical Time Warping, is capable of identifying results made by the persistence model and shows promising results in confirming the visual observations of the neural network's output. Finally, different methodologies for training the neural network are explored in order to remove the persistence behavior from the results.
Comments: Accepted for publication in Frontiers in Astronomy and Space Sciences, section Space Physics
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Journal reference: Frontiers in Astronomy and Space Sciences, Vol. 7, 2020
DOI: 10.3389/fspas.2020.00039
Cite as: arXiv:2006.04667 [cs.LG]
  (or arXiv:2006.04667v1 [cs.LG] for this version)

Submission history

From: Brecht Laperre [view email]
[v1] Mon, 8 Jun 2020 15:14:13 GMT (620kb,D)

Link back to: arXiv, form interface, contact.