We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Study

Abstract: Cross-topic stance detection is the task to automatically detect stances (pro, against, or neutral) on unseen topics. We successfully reproduce state-of-the-art cross-topic stance detection work (Reimers et. al., 2019), and systematically analyze its reproducibility. Our attention then turns to the cross-topic aspect of this work, and the specificity of topics in terms of vocabulary and socio-cultural context. We ask: To what extent is stance detection topic-independent and generalizable across topics? We compare the model's performance on various unseen topics, and find topic (e.g. abortion, cloning), class (e.g. pro, con), and their interaction affecting the model's performance. We conclude that investigating performance on different topics, and addressing topic-specific vocabulary and context, is a future avenue for cross-topic stance detection.
Comments: Accepted at the 8th Workshop on Argument Mining, 2021 co-located with EMNLP 2021. Cite the published version
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2110.07693 [cs.CL]
  (or arXiv:2110.07693v1 [cs.CL] for this version)

Submission history

From: Myrthe Reuver [view email]
[v1] Thu, 14 Oct 2021 20:03:36 GMT (5702kb,D)

Link back to: arXiv, form interface, contact.