References & Citations
Computer Science > Machine Learning
Title: Tweet2Vec: Character-Based Distributed Representations for Social Media
(Submitted on 11 May 2016 (v1), last revised 17 May 2016 (this version, v2))
Abstract: Text from social media provides a set of challenges that can cause traditional NLP approaches to fail. Informal language, spelling errors, abbreviations, and special characters are all commonplace in these posts, leading to a prohibitively large vocabulary size for word-level approaches. We propose a character composition model, tweet2vec, which finds vector-space representations of whole tweets by learning complex, non-local dependencies in character sequences. The proposed model outperforms a word-level baseline at predicting user-annotated hashtags associated with the posts, doing significantly better when the input contains many out-of-vocabulary words or unusual character sequences. Our tweet2vec encoder is publicly available.
Submission history
From: Bhuwan Dhingra [view email][v1] Wed, 11 May 2016 15:30:09 GMT (559kb,D)
[v2] Tue, 17 May 2016 15:00:38 GMT (559kb,D)
Link back to: arXiv, form interface, contact.