I've actually found one called "textstat", but it doesn't recognize different word forms of one word.
So are there programs that do detect comía, come, cómelo, comiera as forms of comer?
-
2This is called "lemmatizing" or "lemmatization" and is often confused with "stemming", which is similar but aims for efficiency at the cost of linguistic accuracy.– hippietrailDec 16, 2013 at 3:56
-
Thanks. Any help on specific apps, that include both lemmatization and frequency list builder features?– user2881Dec 17, 2013 at 12:28
Add a comment
|
2 Answers
You can try the Spanish stemming algorithm found at http://snowball.tartarus.org/algorithms/spanish/stemmer.html.
Have you had a look at ISpell or, better yet, HunSpell (for it supports Unicode)?
These are more intended for spelling-correction. However, since they also try to grok the conjugations and flexions for languages with them, they could be helpful. These programs expose an interface so you can call them from other programs (such as a word processor or a browser), you could create a script that reads your text file and calls it continuously not for the sake of spelling but to get the "base" word ("comer" in your example)
