We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.AP

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Applications

Title: Statistical Evaluation of Spectral Methods for Anomaly Detection in Networks

Abstract: Monitoring of networks for anomaly detection has attracted a lot of attention in recent years especially with the rise of connected devices and social networks. This is of importance as anomaly detection could span a wide range of application, from detecting terrorist cells in counter-terrorism efforts to phishing attacks in social network circles. For this reason, numerous techniques for anomaly detection have been introduced. However, application of these techniques to more complex network models is hindered by various challenges such as the size of the network being investigated, how much apriori information is needed, the size of the anomalous graph, among others. A recent technique introduced by Miller et al, which relies on a spectral framework for anomaly detection, has the potential to address many of these challenges. In their discussion of the spectral framework, three algorithms were proposed that relied on the eigenvalues and eigenvectors of the residual matrix of a binary network. The authors demonstrated the ability to detect anomalous subgraphs that were less than 1% of the network size. However, to date, there is little work that has been done to evaluate the statistical performance of these algorithms. This study investigates the statistical properties of the spectral methods, specifically the Chi-square and L1 norm algorithm proposed by Miller. We will analyze the performance of the algorithm using simulated networks and also extend the method's application to count networks. Finally we will make some methodological improvements and recommendations to both algorithms.
Comments: 39 pages, 17 figures
Subjects: Applications (stat.AP)
Cite as: arXiv:1711.01378 [stat.AP]
  (or arXiv:1711.01378v4 [stat.AP] for this version)

Submission history

From: Tomilayo Komolafe [view email]
[v1] Sat, 4 Nov 2017 01:28:34 GMT (4026kb,D)
[v2] Sun, 10 Jun 2018 08:45:31 GMT (1711kb,D)
[v3] Thu, 4 Oct 2018 19:58:27 GMT (5725kb,D)
[v4] Mon, 6 May 2019 21:19:33 GMT (2022kb,D)

Link back to: arXiv, form interface, contact.