We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.SI

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Social and Information Networks

Title: TwiBot-20: A Comprehensive Twitter Bot Detection Benchmark

Abstract: Twitter has become a vital social media platform while an ample amount of malicious Twitter bots exist and induce undesirable social effects. Successful Twitter bot detection proposals are generally supervised, which rely heavily on large-scale datasets. However, existing benchmarks generally suffer from low levels of user diversity, limited user information and data scarcity. Therefore, these datasets are not sufficient to train and stably benchmark bot detection measures. To alleviate these problems, we present TwiBot-20, a massive Twitter bot detection benchmark, which contains 229,573 users, 33,488,192 tweets, 8,723,736 user property items and 455,958 follow relationships. TwiBot-20 covers diversified bots and genuine users to better represent the real-world Twittersphere. TwiBot-20 also includes three modals of user information to support both binary classification of single users and community-aware approaches. To the best of our knowledge, TwiBot-20 is the largest Twitter bot detection benchmark to date. We reproduce competitive bot detection methods and conduct a thorough evaluation on TwiBot-20 and two other public datasets. Experiment results demonstrate that existing bot detection measures fail to match their previously claimed performance on TwiBot-20, which suggests that Twitter bot detection remains a challenging task and requires further research efforts.
Comments: accepted at CIKM 2021
Subjects: Social and Information Networks (cs.SI)
DOI: 10.1145/3459637.3482019
Cite as: arXiv:2106.13088 [cs.SI]
  (or arXiv:2106.13088v4 [cs.SI] for this version)

Submission history

From: Shangbin Feng [view email]
[v1] Thu, 24 Jun 2021 15:15:10 GMT (8317kb,D)
[v2] Tue, 10 Aug 2021 06:57:52 GMT (8317kb,D)
[v3] Sun, 22 Aug 2021 17:35:09 GMT (8106kb,D)
[v4] Fri, 27 Aug 2021 09:43:49 GMT (8106kb,D)

Link back to: arXiv, form interface, contact.