11 votes
Accepted

How can I find the frequency for the Russian word "чем-нибудь"?

Asking the Leipzig Wortschatz Projekt gives the answer: Word: чем-нибудь Number of occurrences: 5,018 Rank: 33,962 Frequency class: 14 Information on the corpus: Information on corpus: Russian Mixed ...
9 votes
Accepted

What happened to *kweþana?

First, just to note, *kweþaną didn't completely die out: English "quoth" is archaic but still recognizable, and Icelandic kveða is still in active use. But you're absolutely right about the general ...
  • 54.2k
9 votes

How can I find the frequency for the Russian word "чем-нибудь"?

Using the Araneum Russicum III corpus (I am linking to the readily available 125Mtokens subcorpus; after a (free) registration you get access to the whole huge 19Gtokens one; the results are from the ...
6 votes
Accepted

Why is the passive voice more prevalent in English than in other Indo-European languages?

I am not sure whether your initial assumption is statistically correct, but let us take it as a working hypothesis. French and German (to mention only these) very commonly use "on" and "man" with an ...
  • 22.8k
5 votes

Why is the passive voice more prevalent in English than in other Indo-European languages?

It is a matter of linguistic pragmatics. A typical statement has a topic, also known as theme or given (what is being talked about) and a comment or rheme (the new information about the topic). In ...
  • 558
5 votes

Word length as a function of word frequency?

Whoops, didn't know I was allowed to answer my own question. Zipf wrote about exactly this! I knew that he'd formulated Zipf's Law (the relative frequency of a word in a language is inversely ...
  • 734
5 votes
Accepted

Are Word Frequencies Cross-Lingual?

No, it isn't. Just to take a few examples: The most frequent word in English is the definite article the, but there are languages (e.g., Russian or Chinese) with no definite article at all, and other ...
5 votes

How can I find the frequency for the Russian word "чем-нибудь"?

The online version of Russian Nation Corpus (in Russian) offers frequency statistics of word forms, broken down by year: https://processing.ruscorpora.ru/graphic.xml?env=alpha&mode=graphic_main&...
  • 689
4 votes
Accepted

Which free resource to find word frequency?

Word frequency is only a proxy for word knowledge. For the English language, there are data available on word prevalence, i.e., on how many people know a certain word. You can find Measures of word ...
4 votes

Do more closely related languages, have more similar Zipfian distributions?

There is definitely a correlation, but it is not absolute. If we imagine a spectrum of values of s (the value of the exponent characterizing the distribution), different language families overlap on ...
4 votes

Why don't certain antonym pairs get rearranged often?

Presumably because those pairs of synonyms -- little/small, strong/tough etc. -- actually differ somewhat in semantics and usage. This is easy to see with the second example: not everything strong is ...
  • 10.5k
3 votes

Where to find frequency list of English words from newspapers, books and magazines?

This question hasn't been updated in a while. Google also released a 1 Billion Word Benchmark Corpus: https://github.com/tensorflow/models/tree/master/research/lm_1b. It has a vocabulary size of about ...
  • 576
3 votes

Are there any good theories explaining the language aspect of the Zipf Mystery?

One research group at our university is particularly interested in the statistical properties of language. One professor, Michael Ramscar, is teaching us some classes this semester on related topics. ...
  • 573
3 votes

most frequent syllables

The token frequency data you need is vanishingly rare. I think you could add Dutch, and perhaps you can add in a couple more languages like French and Spanish (although you could get pilot estimates ...
  • 70.3k
2 votes

Special Characters and Uppercase Frequency?

Regarding corpus size: If you need meaningful results for the less frequent characters, you'll need a larger corpus, such as the ones at http://corpus.byu.edu. Their web interface accepts queries ...
  • 121
2 votes

Expected Frequency

The paper you linked to describes how the researchers compiled their Academic Vocabulary List (AVL). They first identified a corpus of academic texts, which they extracted from a larger and more ...
2 votes

How to determine difficulty of a word if its frequency in a corpus is known?

This really depends on what you want to do with that information. I'm just in the middle of a project where we're trying to come up with measures of difficulty to give people some automatic help ...
2 votes
Accepted

What is considered the smallest possible sample size for word frequency lists used in FL instruction?

What is considered a large enough sample size when being used to guide the creation of pedagogical resources such as foreign language courses and why? How large your corpus should be depends on what ...
  • 4,229
2 votes

Which free resource to find word frequency?

If what you really want is Wiktionary's frequency list, you can get that by taking the various Wiktionary pages linked from the overview page and splicing them together. However, be careful which ...
  • 54.2k
2 votes

What's a good technique to understand the differences between the time and frequency domains?

There are two "domains", time and frequency. If you are using seconds as the units of measurement, the analysis is in the time domain. If the unit or measurement if Hz, the analysis is in the ...
  • 70.3k
2 votes

Why is the passive voice more prevalent in English than in other Indo-European languages?

Frequent use of the passive in English is not a breach of any "recommended" proportion. Rather, it is a function of register, i.e. it depends on the formality of the situation and the ...
  • 186
2 votes
Accepted

What is the frequency of Devanagari signs in Sanskrit?

Fortunately, the very same source (Whitney's grammar) used in your conjunct consonants link also gives the frequencies of individual phonemes, which I will take to be an acceptable proxy for non-...
  • 707
2 votes
Accepted

How much more often is a definite article used with a noun than an indefinite article in the English language?

The Leipzig Wortschatz Portal is a good place to get answers for this kind of questions. The definite article is more than twice as frequent as the indefinite one (158M vs 67M + 10M). Unfortunately, ...
2 votes
Accepted

Is there a list of common English verbs with all of the inflectional "principal parts"?

I have no idea of the frequency, but here is a downloadable list of 1,000 verbs with each of the five forms from the Bangladesh University of Business and Technology
1 vote

How can I search a corpus for easy sentences?

Ranking sentences by the commonness of their constituent words is not a feature I've seen in corpus search tools like CQPweb or AntConc. You'll probably have to get your hands on a copy of the corpus ...
  • 101
1 vote

Are Word Frequencies Cross-Lingual?

Another reason why this would not work is because if you take any fixed number X and learn the X most common words in each language, the % of words you would recognize (by frequency) vary dramatically....
1 vote

Words with the hightest frequency that are not Collocates of each other (inside a text corpora)

There is an answer to your question find the pair of words that never appear together, and have the highest individual frequency (the sum of them): Using the Penn Treebank as a text corpus, the top ...
  • 111
1 vote

What's a good technique to understand the differences between the time and frequency domains?

To understand this in a non-mathematical way: Think of "sapmle", whether read or heard. You are likely to understand its meaning from context, because the order of the symbols doesn't matter much as ...
  • 1,369
1 vote

Collocations frequency dictionary of English

Here is one that looks well-researched (starting on p. 214 with the appendix): The high frequency collocations of spoken and written English This one is only for spoken English: Beyond single words - ...
  • 6,075

Only top scored, non community-wiki answers of a minimum length are eligible