A list of tools that I have used to capture data from Twitter and which worked:
Twython at: https://github.com/ryanmcgrath/twython
with the Palladian Extension (obtained via the app). Instructions on set up here: http://tech.knime.org/wiki/how-to-get-twitter-data-into-knime . Using the Twitter nodes from the extension menu provided by KNIME is much better. The instructions on setting this up are here : http://www.knime.org/blog/knime-twitter-nodes I could not figure out a way to extract the tweets.
NodeXL at: http://nodexl.codeplex.com/
Visibrain (Commercial): http://www.visibrain.com/en/
Nvivo/Ncapture at: http://www.qsrinternational.com/products_nvivo_add-ons.aspx
TweetMapper at: http://tweetmapper.us
Twitonomy at: http://www.twitonomy.com
Webometrics at: http://lexiurl.wlv.ac.uk/index.html
Follow the Hashtag at: http://analytics.followthehashtag.com/#/
iScience Maps at: http://tweetminer.eu
More tools (require programming knowledge) from Deen Freelon’s curated Google Sheets template at: https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit it is a great list and I make sure to add to it:
DMI-TCAT at: https://github.com/digitalmethodsinitiative/dmi-tcat
yourTwapperKeeper at: https://github.com/540co/yourTwapperKeeper
140dev at: http://140dev.com/
Hosebird at: https://github.com/twitter/hbc
Pattern at: http://www.clips.ua.ac.be/pattern
poll.emic at: https://github.com/sbenthall/poll.emic
Social Feed Manager at: http://gwu-libraries.github.io/social-feed-manager/
SocialMediaMineR at: http://cran.r-project.org/web/packages/SocialMediaMineR/
streamR at: http://cran.r-project.org/web/packages/streamR/index.html
tStreamingArchiver at: https://github.com/brendam/tStreamingArchiver
twarc at: https://github.com/edsu/twarc
tweepy at: https://github.com/tweepy/tweepy
twitteR at: http://cran.r-project.org/web/packages/twitteR/index.html
Twitter-Tap at: https://github.com/janezkranjc/twitter-tap
Twitter Stream Downloader at: https://github.com/mdredze/twitter_stream_downloader
TWurl at: https://github.com/twitter/twurl
Be sure to check out my other list: ‘A list of tools to capture Twitter data’ at: https://wasimahmed1.wordpress.com/2015/01/30/a-list-of-tools-to-capture-twitter-data/
Also be sure to check out via Dr Deen Freelon’s curated list at: https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit You can catch me on Twitter @was3210
2 thoughts on “A list of tools to capture Twitter data”
This is incredibly interesting…are there any of these tools that you particularly recommend (from a usability/interface perspective, as well as the capabilities of the tool)? And you would recommend to someone doing a historical analysis using tweets as a primary source?
LikeLiked by 1 person
Great question Shauna. It has given me an idea for a follow up blog post. To look at tools from a usability perspective and an overview of their features. Keep a look out for that.
From a usability and interface perspective I would recommend either Mozdeh, Chorus or TAGS. I’m currently collecting Ebola tweets using all three of these tools. They compliment each other well.
In terms of features and documentation; Mozdeh is great. This is a useful guide by Mike: http://tinyurl.com/nsozkt8 .
For historical data ( it is only possible to go back the last 7 days) Chorus is good as it uses the Streaming API. And pulls in tweets from the last 7 days. If you want to go further back you may have to purchase the data from a licensed re-seller of Twitter data such as: https://discovertext.com/. They offer discounts to researchers. Hope that helps. And let me know if you have any more questions.