We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: A Deep Learning Anomaly Detection Method in Textual Data

Authors: Amir Jafari
Abstract: In this article, we propose using deep learning and transformer architectures combined with classical machine learning algorithms to detect and identify text anomalies in texts. Deep learning model provides a very crucial context information about the textual data which all textual context are converted to a numerical representation. We used multiple machine learning methods such as Sentence Transformers, Auto Encoders, Logistic Regression and Distance calculation methods to predict anomalies. The method are tested on the texts data and we used syntactic data from different source injected into the original text as anomalies or use them as target. Different methods and algorithm are explained in the field of outlier detection and the results of the best technique is presented. These results suggest that our algorithm could potentially reduce false positive rates compared with other anomaly detection methods that we are testing.
Comments: 8 Pages, 4 Figures
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2211.13900 [cs.CL]
  (or arXiv:2211.13900v1 [cs.CL] for this version)

Submission history

From: Amir Jafari [view email]
[v1] Fri, 25 Nov 2022 05:18:13 GMT (1975kb)

Link back to: arXiv, form interface, contact.