HackerPapers

arXiv:1208.6109cs.CL

Average word length dynamics as indicator of cultural changes in society

Vladimir V. Bochkarev, Anna V. Shevlyakova, Valery D. Solovyev

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

Dynamics of average length of words in Russian and English is analysed in the article. Words belonging to the diachronic text corpus Google Books Ngram and dated back to the last two centuries are studied. It was found out that average word length slightly increased in the 19th century, and then it was growing rapidly most of the 20th century and started decreasing over the period from the end of the 20th - to the beginning of the 21th century. Words which contributed mostly to increase or decrease of word average length were identified. At that, content words and functional words are analysed separately. Long content words contribute mostly to word average length of word. As it was shown, these words reflect the main tendencies of social development and thus, are used frequently. Change of frequency of personal pronouns also contributes significantly to change of average word length. The other parameters connected with average length of word were also analysed.

arXiv comments
16 pages, 9 figures
Journal reference
Social Evolution & History. Volume 14, number 2, p. 153-175 (2015)
DOI
Subjects
cs.CLComputation and Language

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Jan 2017 to Jan 2017.

Comments linking this paper, per year.

Discussed in comments1 thread

    • Somehow the article fails to mention that the speed will depend heavily on the input string: both its size and distribution of whitespace characters. Even assuming the question is for the limit of very long strings, the distribution makes a huge difference. Natural English has…

      dzdtView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.