2

I need a corpus of modern English, with part-of-speech tags, in order to train language models, specifically a part-of-speech tagger. The domain I am doing this in is the Hansard, the transcript of speeches in British Parliament. I have tried training using corpora of American English, with unimpressive results. Are there any open-access coropora for this domain that I could use, or at least corpora of modern educated British English? I am aware of the existence of the Hansard Corpus, and several other similar corpora, but I would like to download the corpus for use with the Python NLTK library.

1

That I am aware of, most corpora of British English are not freely available. There are, however, corpora of British English, including POS-tags and formal language, which can be downloaded by individuals, although I am not aware of any which are open source. These include:

  • the British National Corpus, which can be downloaded in its XML version from the Oxford Text Archive (http://ota.ox.ac.uk/desc/2554), free in the UK (via Shibboleth).

  • various corpora, downloadable in various formats including a 'linear text' format, which can be purchased from the Brigham Young University corpus interface (http://corpus.byu.edu/full-text/).

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy