We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Emotions are Subtle: Learning Sentiment Based Text Representations Using Contrastive Learning

Abstract: Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate that fine-tuning on these embeddings provides an improvement over fine-tuning on BERT-based embeddings to achieve higher benchmarks on the task of sentiment analysis when evaluated on the DynaSent dataset. We also explore how our fine-tuned models perform on cross-domain benchmark datasets. Additionally, we explore upsampling techniques to achieve a more balanced class distribution to make further improvements on our benchmark tasks.
Comments: 9 pages, 5 figures
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2112.01054 [cs.CL]
  (or arXiv:2112.01054v1 [cs.CL] for this version)

Submission history

From: Ipsita Mohanty [view email]
[v1] Thu, 2 Dec 2021 08:29:26 GMT (10418kb,D)

Link back to: arXiv, form interface, contact.