I would like to know the relative frequency of phonemes in Indian languages whose sript is basically very close to Devanagiri. We need this data to make a pronunciation based keyboard layout for Indian languages (and we would prefer to keep almost same layout for different languages).

Most data available from surveys deal with printed characters (and often ignore vowel symbols like ), making it really difficult to get the frequency of phonemes. To make it clear, both frequency of इ and frequency of ी are counted together as frequency of 'phoneme इ'. The most difficult part of this task is counting frequency of (example: the word कली contributes 1 to frequency of क्, 1 to अ, 1 to ल्,and 1 to इ).

My guess is that is the most frequent phoneme across Indian languages (that essentially use Devanagiri sript). To the best of my knowledge, the second most frequent phoneme varies. For example, it could be in Telugu and in Bengali.

Are there good sources to get information on frequency of phonemes in Indian languages (or corpus that could be used to obtain such information)?

(Online) resources known to us are given below.
Hindi: https://www.sttmedia.com/characterfrequency-hindi
Telugu: https://foaum.org/mjo/sarala/Telugu/SaralaTelugu-2.2/DocumentationSarala%20Ergonomic%20Keyboards%20-%20Telugu%20-%20Research%20Paper.pdf
Bengali: https://www.researchgate.net/publication/220485524_Smart_Bengali_Cell_Phone_Keypad_Layout (?)
Malayalam: https://sites.google.com/site/personaltesting1211/scoring-matrices-for-complete-malayalam-characters

Other than checking frequency of each language, is there a better way?
Is there a way to find relative frequency of phonemes across Indian languages (that basically use Devnagiri script)?

  • 1
    Just to be sure, are you interested in linguistic phonemes or devanagari characters?
    – Draconis
    Mar 6 '20 at 6:03
  • 1
    @Draconis Linguistic phonemes Mar 6 '20 at 6:04
  • The link given for Malayalam is questionable (there are a lot of inconsistencies) Mar 6 '20 at 6:52
  • Why not parse a large corpus (like Wikipedia) to derive this information? IMO, analyzing phonemes would be the wrong way of trying to solve the problem: Indian writers do not think of phonemes when writing by hand either.
    – prash
    Mar 6 '20 at 8:14
  • @prash Wikipedia seems to be a wrong corpus for this. This page claim to show letters in the order of their frequency. But, the ordering given doesn't make much sense (may be because of small population size). Mar 6 '20 at 9:12

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.