We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

physics

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Distributed, Parallel, and Cluster Computing

Title: Collection and harmonization of system logs and prototypal Analytics services with the Elastic (ELK) suite at the INFN-CNAF computing centre

Abstract: The distributed Grid infrastructure for High Energy Physics experiments at the Large Hadron Collider (LHC) in Geneva comprises a set of computing centres, spread all over the world, as part of the Worldwide LHC Computing Grid (WLCG). In Italy, the Tier-1 functionalities are served by the INFN-CNAF data center, which provides also computing and storage resources to more than twenty non-LHC experiments. For this reason, a high amount of logs are collected each day from various sources, which are highly heterogeneous and difficult to harmonize. In this contribution, a working implementation of a system that collects, parses and displays the log information from CNAF data sources and the investigation of a Machine Learning based predictive maintenance system, is presented.
Comments: Submitted to proceedings of International Symposium on Grids & Clouds 2019 (ISGC2019)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Computational Physics (physics.comp-ph)
Journal reference: PoS(ISGC2019)027
DOI: 10.22323/1.351.0027
Cite as: arXiv:2106.02612 [cs.DC]
  (or arXiv:2106.02612v1 [cs.DC] for this version)

Submission history

From: Tommaso Diotalevi [view email]
[v1] Thu, 13 May 2021 10:21:55 GMT (4395kb,D)

Link back to: arXiv, form interface, contact.