A stochastic model based on insights of Mandelbrot (1953) and Simon (1955) is discussed against the background of new criteria of adequacy that have become available recently as a result of studies of the similarity relations between words as found in large computerized text corpora. Various models for word frequency distributions have been developed since Zipf (1935) applied the zeta distribution to describe a wide range of lexical data. Mandelbrot (1953 Mandelbrot ( , 1962 )extended Zipf's distribution 'law'
Baayen REF studied similarity relations between words and word frequency distribution.
A Stochastic Process For Word Frequency Distributions
Annual Meeting Of The Association For Computational Linguistics
Computer Science