11 votes
Accepted

How can I find the frequency for the Russian word "чем-нибудь"?

Asking the Leipzig Wortschatz Projekt gives the answer: Word: чем-нибудь Number of occurrences: 5,018 Rank: 33,962 Frequency class: 14 Information on the corpus: Information on corpus: Russian Mixed ...
Sir Cornflakes's user avatar
9 votes

How can I find the frequency for the Russian word "чем-нибудь"?

Using the Araneum Russicum III corpus (I am linking to the readily available 125Mtokens subcorpus; after a (free) registration you get access to the whole huge 19Gtokens one; the results are from the ...
Radovan Garabík's user avatar
9 votes
Accepted

What happened to *kweþana?

First, just to note, *kweþaną didn't completely die out: English "quoth" is archaic but still recognizable, and Icelandic kveða is still in active use. But you're absolutely right about the general ...
Draconis's user avatar
  • 63.8k
6 votes
Accepted

Why is the passive voice more prevalent in English than in other Indo-European languages?

I am not sure whether your initial assumption is statistically correct, but let us take it as a working hypothesis. French and German (to mention only these) very commonly use "on" and "man" with an ...
fdb's user avatar
  • 23.7k
5 votes

How can I find the frequency for the Russian word "чем-нибудь"?

The online version of Russian Nation Corpus (in Russian) offers frequency statistics of word forms, broken down by year: https://processing.ruscorpora.ru/graphic.xml?env=alpha&mode=graphic_main&...
Quassnoi's user avatar
  • 699
5 votes

Why is the passive voice more prevalent in English than in other Indo-European languages?

It is a matter of linguistic pragmatics. A typical statement has a topic, also known as theme or given (what is being talked about) and a comment or rheme (the new information about the topic). In ...
Ned's user avatar
  • 586
5 votes

Are there any good theories explaining the language aspect of the Zipf Mystery?

One research group at our university is particularly interested in the statistical properties of language. One professor, Michael Ramscar, is teaching us some classes this semester on related topics. ...
xji's user avatar
  • 593
5 votes

Word length as a function of word frequency?

Whoops, didn't know I was allowed to answer my own question. Zipf wrote about exactly this! I knew that he'd formulated Zipf's Law (the relative frequency of a word in a language is inversely ...
Khove's user avatar
  • 754
5 votes
Accepted

Are Word Frequencies Cross-Lingual?

No, it isn't. Just to take a few examples: The most frequent word in English is the definite article the, but there are languages (e.g., Russian or Chinese) with no definite article at all, and other ...
Sir Cornflakes's user avatar
4 votes
Accepted

Which free resource to find word frequency?

Word frequency is only a proxy for word knowledge. For the English language, there are data available on word prevalence, i.e., on how many people know a certain word. You can find Measures of word ...
Sir Cornflakes's user avatar
4 votes

Do more closely related languages, have more similar Zipfian distributions?

There is definitely a correlation, but it is not absolute. If we imagine a spectrum of values of s (the value of the exponent characterizing the distribution), different language families overlap on ...
Adam Bittlingmayer's user avatar
4 votes

Why don't certain antonym pairs get rearranged often?

Presumably because those pairs of synonyms -- little/small, strong/tough etc. -- actually differ somewhat in semantics and usage. This is easy to see with the second example: not everything strong is ...
TKR's user avatar
  • 10.8k
4 votes

Are linguistic corpora under threat from AI-generated text?

There is a high probability that AI-generated text already exists in web-based corpora (and will increase over time), and a very low probability that such text will appear in e.g. The Corpus of ...
user6726's user avatar
  • 81.9k
3 votes
Accepted

What is the frequency of Devanagari signs in Sanskrit?

Fortunately, the very same source (Whitney's grammar) used in your conjunct consonants link also gives the frequencies of individual phonemes, which I will take to be an acceptable proxy for non-...
legatrix's user avatar
  • 707
3 votes

Where to find frequency list of English words from newspapers, books and magazines?

Expanding on Otavio Macedo's answer, if you just want plain txt files containing English words sorted by frequency without having to analyze Google Ngram Viewer's dataset yourself, Natural Language ...
Flux's user avatar
  • 131
3 votes

Where to find frequency list of English words from newspapers, books and magazines?

This question hasn't been updated in a while. Google also released a 1 Billion Word Benchmark Corpus: https://github.com/tensorflow/models/tree/master/research/lm_1b. It has a vocabulary size of about ...
Adam_G's user avatar
  • 576
3 votes

most frequent syllables

The token frequency data you need is vanishingly rare. I think you could add Dutch, and perhaps you can add in a couple more languages like French and Spanish (although you could get pilot estimates ...
user6726's user avatar
  • 81.9k
2 votes

What's a good technique to understand the differences between the time and frequency domains?

There are two "domains", time and frequency. If you are using seconds as the units of measurement, the analysis is in the time domain. If the unit or measurement if Hz, the analysis is in the ...
user6726's user avatar
  • 81.9k
2 votes

Which free resource to find word frequency?

If what you really want is Wiktionary's frequency list, you can get that by taking the various Wiktionary pages linked from the overview page and splicing them together. However, be careful which ...
Draconis's user avatar
  • 63.8k
2 votes
Accepted

How much more often is a definite article used with a noun than an indefinite article in the English language?

The Leipzig Wortschatz Portal is a good place to get answers for this kind of questions. The definite article is more than twice as frequent as the indefinite one (158M vs 67M + 10M). Unfortunately, ...
Sir Cornflakes's user avatar
2 votes

Why is the passive voice more prevalent in English than in other Indo-European languages?

Frequent use of the passive in English is not a breach of any "recommended" proportion. Rather, it is a function of register, i.e. it depends on the formality of the situation and the ...
yutu's user avatar
  • 186
2 votes
Accepted

Is there a list of common English verbs with all of the inflectional "principal parts"?

I have no idea of the frequency, but here is a downloadable list of 1,000 verbs with each of the five forms from the Bangladesh University of Business and Technology
Araucaria - him's user avatar
1 vote

What is the frequency of color words in English compared to German?

For frequency information on German, I highly recommend the Leipzig Wortschatz portal (here already querying for rot "red". It is based on contemporary newspaper texts and also has corpora ...
Sir Cornflakes's user avatar
1 vote

Frequency of phonemes in Indian languages

There is no practical currently-implementable method. For a moment, consider English phoneme frequency. One attempt at coming up with such a list is described here: get raw word frequencies from some ...
user6726's user avatar
  • 81.9k
1 vote

How can I search a corpus for easy sentences?

Ranking sentences by the commonness of their constituent words is not a feature I've seen in corpus search tools like CQPweb or AntConc. You'll probably have to get your hands on a copy of the corpus ...
Luke G's user avatar
  • 101
1 vote

Are Word Frequencies Cross-Lingual?

Another reason why this would not work is because if you take any fixed number X and learn the X most common words in each language, the % of words you would recognize (by frequency) vary dramatically....
Nickolas Cavagnaro's user avatar
1 vote

Words with the hightest frequency that are not Collocates of each other (inside a text corpora)

There is an answer to your question find the pair of words that never appear together, and have the highest individual frequency (the sum of them): Using the Penn Treebank as a text corpus, the top ...
user12075's user avatar
  • 111
1 vote

How common is onomatopoeia in English?

Some English words seem to be onomatopoeic. The word "purr" is like the sound made by a contented cat, and "spank" resembles the sound made by my girlfriend's hand impacting on my ...
Neandertal's user avatar
1 vote

Collocations frequency dictionary of English

Here is one that looks well-researched (starting on p. 214 with the appendix): The high frequency collocations of spoken and written English This one is only for spoken English: Beyond single words - ...
Natalie Clarius's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible