We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: DEEM: Dynamic Experienced Expert Modeling for Stance Detection

Abstract: Recent work has made a preliminary attempt to use large language models (LLMs) to solve the stance detection task, showing promising results. However, considering that stance detection usually requires detailed background knowledge, the vanilla reasoning method may neglect the domain knowledge to make a professional and accurate analysis. Thus, there is still room for improvement of LLMs reasoning, especially in leveraging the generation capability of LLMs to simulate specific experts (i.e., multi-agents) to detect the stance. In this paper, different from existing multi-agent works that require detailed descriptions and use fixed experts, we propose a Dynamic Experienced Expert Modeling (DEEM) method which can leverage the generated experienced experts and let LLMs reason in a semi-parametric way, making the experts more generalizable and reliable. Experimental results demonstrate that DEEM consistently achieves the best results on three standard benchmarks, outperforms methods with self-consistency reasoning, and reduces the bias of LLMs.
Comments: Accepted by LREC-COLING 2024, Oral presentation
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2402.15264 [cs.CL]
  (or arXiv:2402.15264v3 [cs.CL] for this version)

Submission history

From: Yile Wang [view email]
[v1] Fri, 23 Feb 2024 11:24:00 GMT (5978kb,D)
[v2] Thu, 25 Apr 2024 05:32:49 GMT (5979kb,D)
[v3] Fri, 26 Apr 2024 01:06:31 GMT (5978kb,D)

Link back to: arXiv, form interface, contact.