Questions tagged [entropy]
For questions about entropy in language.
9
questions
-1
votes
1
answer
289
views
Does deep orthography decrease the collision entropy of a written language?
EDIT: For those of you who think this question is off-topic, I asked it on a forum about linguistics because I expected the answer to come from historical linguistics. I expected the answer to be ...
- 648
-3
votes
1
answer
128
views
Perfect Language [closed]
In linguistics, what's the definition of a perfect language?
Off the top of my hat, given the primary purpose of language is communication, a perfect language must be able to convey 100% of the ...
- 107
0
votes
0
answers
102
views
How is collision entropy of German syntax higher than of English one?
As I explained in the draft of my latest paper about linguistics, I have measured the collision entropies of English, German and Croatian syntax. The entropy of consonants in a long English text was ...
- 648
2
votes
0
answers
33
views
Database of Words and their Semantic Entropies?
I'm reading up on semantic entropies and it seems as though there aren't any actual databases of words and their associated semantic entropies for any given methodology. For instance, this study has a ...
- 53
3
votes
2
answers
136
views
How to quantify the semantic depth of a sentence?
I'm looking for a robust way to roughly quantify the amount of information conveyed in a sentence, specifically in English. For instance "He went to the place" conveys less information than &...
- 53
3
votes
0
answers
75
views
Computational linguist's estimate of minimum hours of speech needed to train a neural net to recognize speech
From a computational linguist's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 hours ...
- 131
7
votes
3
answers
491
views
Speech rate measured in bit/sec
Are there references giving the speech rate measured in bit/sec?
I easily found references on speech rate giving measurement in phones/sec, syllables/sec or words/sec. Are there references giving the ...
- 29.8k
5
votes
1
answer
657
views
Shannon's entropy as a measure of vocabulary richness
The Entropy formula for lexical richness is
The probability p-ith is calculated by dividing V-ith by N, where N is the total number of tokens in the text and V is the number of types. However, I can'...
- 111
12
votes
2
answers
3k
views
What is the entropy per word of random yet grammatical text?
It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem.
The answerer made an estimation of the entropy ...
user4812