2

I found a paper http://www.cs.jhu.edu/~anni/papers/alnc_lrec14.pdf that has made this epic text corpus of over 1 billion words available somewhere, but I can't find it anywhere online.

The paper says

Version 1.0 is available for research use

Does anyone have a working link?

  • Is it possible to contact the authors of the paper? – jknappen May 17 at 8:31
  • 1
    @jknappen I've contacted them yesterday and got a reply! If I get a link, I'll see if I can post it here too – Joe B May 17 at 16:25
3

I contacted a couple of the authors and got some links!

The primary author said:

You can download the raw corpus here: www.cs.jhu.edu/~anni/ALNC/030314corpus.cleaned.tgz

And the preprocessed corpus here: www.cs.jhu.edu/~anni/ALNC/030314corpus.splittoklc.tgz

Note that these files contain version 1.1 of sorts; slightly more data than reported in the LREC paper. Each file is about 8GB.

I will update when I have the complete uncompressed sizes.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.