I am looking for an extensive list of english words[including American and British... just an exhaustive list]. This list of english words should contain an exhaustive collection of all forms of all words. And I am looking for just the english words not the sentences.
I have checked out a few sources but could find complete list of words. I can see the root word but not the derived or forms of that that word.
I have mentioned examples:
Currently i have checked out:
- nltk.corpus.word.words() -------------couldn't find word "vendors"[found "vendor"]
- gcide : http://gcide.gnu.org.ua/ -----couldn't find word "vendors"[found "vendor"]
- BNC http://www.natcorp.ox.ac.uk/ ------Its a collection of sentences broked into forms. I'll have to parse and collect words. Still that doesn't guarantees a collection of exhaustive words.
- COCA https://www.english-corpora.org/coca/ -----couldn't even understand the data. But it sure wasn't it. I am looking further into it.
Any sort of help is much appreciated.
Currently I am using...
s0 = set(corrected_sp_ch_wrd)-set( list([ a.lower() for a in nltk.corpus.words.words()]) +\
list([ a.lower() for a in nltk.corpus.brown.words()]) +\
list([ a.lower() for a in nltk.corpus.gutenberg.words()]) +\
list([ a.lower() for a in nltk.corpus.webtext.words()]) +\
list([ a.lower() for a in nltk.corpus.gazetteers.words()]) +\
list([ a.lower() for a in nltk.corpus.inaugural.words()]) +\
list([ a.lower() for a in nltk.corpus.abc.words()]) +\
combined_global_list is collection of all external corpora i parsed.
But this is not enough. There are words i am missing.