We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: An Online Multilingual Hate speech Recognition System

Abstract: The exponential increase in the use of the Internet and social media over the last two decades has changed human interaction. This has led to many positive outcomes, but at the same time it has brought risks and harms. While the volume of harmful content online, such as hate speech, is not manageable by humans, interest in the academic community to investigate automated means for hate speech detection has increased. In this study, we analyse six publicly available datasets by combining them into a single homogeneous dataset and classify them into three classes, abusive, hateful or neither. We create a baseline model and we improve model performance scores using various optimisation techniques. After attaining a competitive performance score, we create a tool which identifies and scores a page with effective metric in near-real time and uses the same as feedback to re-train our model. We prove the competitive performance of our multilingual model on two langauges, English and Hindi, leading to comparable or superior performance to most monolingual models.
Comments: 11 pages, 5 figures, appear in Special Issue "Natural Language Processing for Social Media" on MDPI Information 2021, 12(1), 5
Subjects: Computation and Language (cs.CL)
Journal reference: Information 12, no. 1: 5 (2021)
DOI: 10.3390/info12010005
Cite as: arXiv:2011.11523 [cs.CL]
  (or arXiv:2011.11523v3 [cs.CL] for this version)

Submission history

From: Neeraj Vashistha [view email]
[v1] Mon, 23 Nov 2020 16:33:48 GMT (202kb,D)
[v2] Tue, 24 Nov 2020 04:29:29 GMT (202kb,D)
[v3] Tue, 22 Dec 2020 18:08:11 GMT (313kb,D)

Link back to: arXiv, form interface, contact.