12

I was going to use the Edinburgh Twitter Corpus that is referenced in this paper: The Edinburgh Twitter Corpus. But apparently Twitter has changed their Terms and the corpus is no longer available. Every other Twitter dataset I can find is likewise no longer available. I am willing to start aggregating the data for myself, but it would be nice to have a set already compiled.

This is a personal, non-commercial project.

Improve this question
4
  • Have you come across this discussion: groups.google.com/forum/#!topic/twitter-development-talk/… ? I don't know the status now, after Twitter changed their T&C.
    – prash ♦
    Commented Oct 3, 2011 at 21:45
  • In light of what we did with this question, should we close this question? I am concerned that it doesn't meet the "one clear answer" guideline that we try to promote.
    – Aaron
    Commented Oct 3, 2011 at 23:04
  • I think it's a pretty straightforward rewording into a narrower question. Unfortunately, I don't have edit privileges.
    – Alek Storm
    Commented Oct 4, 2011 at 3:54
  • I think it does have one clear answer and that is the answer that Alek has provided. Basically "there are no such resources because it's not allowed".
    – hippietrail
    Commented Oct 4, 2011 at 8:43

1 Answer 1

Reset to default
11

According to Twitter's new Terms of Service (see paragraph (I)(4)(A)), you may not export any data retrieved from Twitter, whether through its public API or by scraping. So you will probably never find a readily-available corpus of tweets - and if you do, it's in violation. Twitter has already taken a lot of flak for essentially shutting down academic research into a whole new frontier of linguistic data.

However, if you'd like to publish your results after analysis, you may provide a database of tweet IDs and usernames, which other researchers can cross-reference with the official Twitter archive. I'd recommend the Streaming API to start aggregating data.

Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.