We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Disordered Systems and Neural Networks

Title: Core Lexicon and Contagious Words

Abstract: We present the new empirical parameter $f_c$, the most probable usage frequency of a word in a language, computed via the distribution of documents over frequency $x$ of the word. This parameter allows for filtering the core lexicon of a language from the content words, which tend to be extremely frequent in some texts written in specific genres or by certain authors. Distributions of documents over frequencies for such words display long tails as $x>f_c$ representing a bunch of documents in which such words are used in abundance. Collections of such documents exhibit a percolation like phase transition as the coarse grain of frequency $\Delta f$ (flattening out the strongly irregular frequency data series) approaches the critical value $f_c$.
Comments: RevTex, 4 pages, 2 figures
Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn)
Cite as: arXiv:cond-mat/0303454 [cond-mat.dis-nn]
  (or arXiv:cond-mat/0303454v1 [cond-mat.dis-nn] for this version)

Submission history

From: Dmitri Volchenkov [view email]
[v1] Fri, 21 Mar 2003 09:38:56 GMT (55kb)

Link back to: arXiv, form interface, contact.