Linguistics Stack Exchange is a question and answer site for professional linguists and others with an interest in linguistic research and theory. It only takes a minute to sign up.
Sign up to join this community
I want to write a simple program in Java, which being fed with English texts will be able to generate word usage statisitcs (e.g. topmost frequently used words in English).
For that purpose I need a database, which can provide me with [word to lemma] entries. Like:
went -> to go
me -> I
slowed -> to slow
and so on. Where can I get such a database?
Denis, you might want to have a look at the perseus project database: http://www.perseus.tufts.edu/hopper/opensource/download
There are opens source tools that do that. They are called lemmatisers - Stanford Core NLP includes one.
