I have been listening to Linguistics & Philosophy lecture by Noam Chomsky and he mentions around 1h:08m that it is posited that language productions are actually the most economical way to convey information. I guess this is some more widely known language theory but I am relatively new to the field. I am wondering, in what way exactly these productions are deemed optimal?
There is a whole strain of research (represented, e.g., by Florian Jaeger) that regards the communication channel as a Noisy Channel in the sense of Shannon. The uniform information density hypothesis postulates that this Noisy Channel is always optimally used with respect to information, and that speakers adjust their utterances to the channel capacity.