Skip to main content
5 votes
Accepted

Perfect Language

There is no such thing, because the communication channel between the speaker and the listener is always a noisy channel, with a lot of variation in the amount and quality of the noise. Rational ...
Sir Cornflakes's user avatar
4 votes
Accepted

Does deep orthography decrease the collision entropy of a written language?

I'm not aware of any studies on this. If there are any, I expect them to be related to old-school cryptanalysis. Intuitively, the collision entropy depends on the frequency distribution of different ...
Draconis's user avatar
  • 67.2k
4 votes

Speech rate measured in bit/sec

It looks like Pierce & Karlin 1957 might be a good starting point. It came out almost a decade after the original Shannon (1948) entropy paper and a decade before Kolmogorov's 1968 paper on ...
Shannon Scott Schupbach's user avatar
3 votes
Accepted

Speech rate measured in bit/sec

I finally came across a paper where the authors state a speech rate in bit/s. The paper is Christophe Coupé, Yoon Oh, Dan Dediu, and François Pellegrino, Different languages, similar encoding ...
Sir Cornflakes's user avatar
2 votes

Speech rate measured in bit/sec

I can't pretend to really understand this article, but the authors have an algorithm for encoding speech at 800 bps (as they say, using split vector quantization). They have tested it using male and ...
user6726's user avatar
  • 83.2k
1 vote

Do Natural Languages have about 50% Information per Syllable as would be Optimal

To get a better intuition: To get at the optimal entropy value, the syllable probability distribution must equal the uniform distribution. Natural languages don't behave like that, instead the ...
Sir Cornflakes's user avatar
1 vote
Accepted

How to quantify the semantic depth of a sentence?

First, the term depth is highly misleading here. Hearing the word depth will invoke the picture of a syntax tree in the mind of a trained linguist, and the depth of a tree is easily measured in terms ...
Sir Cornflakes's user avatar
1 vote

Shannon's entropy as a measure of vocabulary richness

The entropy formula as quoted has some ideosyncrasies making it different from standard Shannon entropy There is a (not really relevant) factor of 100 (probably to produce more beautiful numbers) The ...
Sir Cornflakes's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible