Questions tagged [entropy]

For questions about entropy in language.

Filter by
Sorted by
Tagged with
3
votes
0answers
63 views

Computational linguist's estimate of minimum hours of speech needed to train a neural net to recognize speech

From a computational linguist's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 hours ...
6
votes
3answers
260 views

Speech rate measured in bit/sec

Are there references giving the speech rate measured in bit/sec? I easily found references on speech rate giving measurement in phones/sec, syllables/sec or words/sec. Are there references giving the ...
5
votes
1answer
521 views

Shannon's entropy as a measure of vocabulary richness

The Entropy formula for lexical richness is The probability p-ith is calculated by dividing V-ith by N, where N is the total number of tokens in the text and V is the number of types. However, I can'...
10
votes
2answers
2k views

What is the entropy per word of random yet grammatical text?

It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem. The answerer made an estimation of the entropy ...