We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computational Engineering, Finance, and Science

Title: Online Learning with Radial Basis Function Networks

Abstract: We experiment with the log-returns of financial time series, providing multi-horizon forecasts with a selection of robust supervised learners. We devise an external input selection algorithm that aims to maximise regression R^2 whilst minimising feature correlations and can operate efficiently in a high-dimensional setting. We improve upon the earlier work on radial basis function networks (rbfnets), which applies feature representation transfer from clustering algorithms to supervised learners. Rather than using a randomised, scalar standard deviation for each hidden processing unit (hpu)'s radial basis function, we use a covariance matrix estimated via a Bayesian map approach. If many (few) training data points are assigned to the j'th cluster, the j'th covariance matrix will resemble the maximum likelihood (diagonalised variance prior) estimate. More precisely, we operate with and adapt the precision (inverse covariance) matrices; this leads to a test time fitting time-complexity of O(kd^2), where k is the number of hpus and d is the external input dimensionality. Our approach leads to a reduction from O(kd^3) when inverting covariance matrices. Furthermore, we sequentially optimise the hpu parameters with an exponential decay to facilitate regime changes or concept drifts. Our experiments demonstrate that our online rbfnet outperforms a random-walk baseline and several powerful batch learners. The outperformance is not purely down to sequential updating in the test set. Instead, a competitor ewrls model is updated similarly and performs less well than several batch-learners. Finally, our online rbfnet has hpus that retain greater similarity between training and test vectors, ensuring that it obtains the smallest prediction mean squared errors.
Subjects: Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG); Trading and Market Microstructure (q-fin.TR)
Cite as: arXiv:2103.08414 [cs.CE]
  (or arXiv:2103.08414v7 [cs.CE] for this version)

Submission history

From: Gabriel Borrageiro Mr [view email]
[v1] Mon, 15 Mar 2021 14:39:40 GMT (194kb,D)
[v2] Wed, 23 Jun 2021 08:26:21 GMT (1096kb,D)
[v3] Mon, 8 Nov 2021 07:14:08 GMT (1095kb,D)
[v4] Mon, 15 Nov 2021 09:57:33 GMT (2081kb,D)
[v5] Sat, 20 Nov 2021 10:37:35 GMT (1513kb,D)
[v6] Fri, 24 Dec 2021 11:41:31 GMT (1511kb,D)
[v7] Sat, 21 May 2022 12:29:19 GMT (1544kb,D)

Link back to: arXiv, form interface, contact.