12

I was going to use the Edinburgh Twitter Corpus that is referenced in this paper: The Edinburgh Twitter Corpus. But apparently Twitter has changed their Terms and the corpus is no longer available. Every other Twitter dataset I can find is likewise no longer available. I am willing to start aggregating the data for myself, but it would be nice to have a set already compiled.

This is a personal, non-commercial project.

4
  • Have you come across this discussion: groups.google.com/forum/#!topic/twitter-development-talk/… ? I don't know the status now, after Twitter changed their T&C.
    – prash
    Oct 3 '11 at 21:45
  • In light of what we did with this question, should we close this question? I am concerned that it doesn't meet the "one clear answer" guideline that we try to promote.
    – Aaron
    Oct 3 '11 at 23:04
  • I think it's a pretty straightforward rewording into a narrower question. Unfortunately, I don't have edit privileges.
    – Alek Storm
    Oct 4 '11 at 3:54
  • I think it does have one clear answer and that is the answer that Alek has provided. Basically "there are no such resources because it's not allowed". Oct 4 '11 at 8:43
11

According to Twitter's new Terms of Service (see paragraph (I)(4)(A)), you may not export any data retrieved from Twitter, whether through its public API or by scraping. So you will probably never find a readily-available corpus of tweets - and if you do, it's in violation. Twitter has already taken a lot of flak for essentially shutting down academic research into a whole new frontier of linguistic data.

However, if you'd like to publish your results after analysis, you may provide a database of tweet IDs and usernames, which other researchers can cross-reference with the official Twitter archive. I'd recommend the Streaming API to start aggregating data.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.