Am curious as to the number of homographs (sets of word meanings that share a common spelling) that occur in the English language. Also what the current state of the art would be for automatically differentiating senses.
The GloVe project makes available a word vector model with a 2.2 million vocabulary based on 840 billion tokens (taken from the Common Crawl dataset] - unfortunately from my understanding there model takes no account of homographs and I'm firstly trying to get a feel for how much of an effect that would have, and secondly thinking of how to go about recreating a similar model using word senses instead of words.