A list of tools to capture Twitter data

Posted on by Wasim

A list of tools that I have used to capture data from Twitter and which worked:

TAGS:

Mozdeh:

Chorus:

Netlytic: https://netlytic.org

Facepager: http://www.ls1.ifkw.uni-muenchen.de/personen/wiss_ma/keyling_till/software.html

Twython at: https://github.com/ryanmcgrath/twython

KNIME: https://www.knime.org/ with the Palladian Extension (obtained via the app). Instructions on set up here: http://tech.knime.org/wiki/how-to-get-twitter-data-into-knime .  Using the Twitter nodes from the extension menu provided by KNIME is much better. The instructions on setting this up are here : http://www.knime.org/blog/knime-twitter-nodes I could not figure out a way to extract the tweets.

NodeXL at: http://nodexl.codeplex.com/

Visibrain (Commercial): http://www.visibrain.com/en/

More tools:

Nvivo/Ncapture at: http://www.qsrinternational.com/products_nvivo_add-ons.aspx

TweetMapper at: http://tweetmapper.us

Twitonomy at: http://www.twitonomy.com

Webometrics at: http://lexiurl.wlv.ac.uk/index.html

Follow the Hashtag at: http://analytics.followthehashtag.com/#/

iScience Maps at: http://tweetminer.eu

More tools (require programming knowledge) from Deen Freelon’s curated Google Sheets template at: https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit it is a great list and I make sure to add to it:

DMI-TCAT at: https://github.com/digitalmethodsinitiative/dmi-tcat

yourTwapperKeeper at: https://github.com/540co/yourTwapperKeeper

140dev at: http://140dev.com/

Hosebird at: https://github.com/twitter/hbc

Pattern at: http://www.clips.ua.ac.be/pattern

poll.emic at: https://github.com/sbenthall/poll.emic

Social Feed Manager at: http://gwu-libraries.github.io/social-feed-manager/

SocialMediaMineR at: http://cran.r-project.org/web/packages/SocialMediaMineR/

streamR at: http://cran.r-project.org/web/packages/streamR/index.html

tStreamingArchiver at: https://github.com/brendam/tStreamingArchiver

twarc at: https://github.com/edsu/twarc

tweepy at: https://github.com/tweepy/tweepy

twitteR at: http://cran.r-project.org/web/packages/twitteR/index.html

Twitter-Tap at: https://github.com/janezkranjc/twitter-tap

Twitter Stream Downloader at: https://github.com/mdredze/twitter_stream_downloader

TWurl at: https://github.com/twitter/twurl

Be sure to check out my other list: ‘A list of tools to capture Twitter data’ at: https://wasimahmed1.wordpress.com/2015/01/30/a-list-of-tools-to-capture-twitter-data/

Also be sure to check out via Dr Deen Freelon’s curated list at: https://docs.google.com/document/d/1UaERzROI986HqcwrBDLaqGG8X_lYwctj6ek6ryqDOiQ/edit You can catch me on Twitter @was3210 

Published by Wasim

2 thoughts on “A list of tools to capture Twitter data”

  1. This is incredibly interesting…are there any of these tools that you particularly recommend (from a usability/interface perspective, as well as the capabilities of the tool)? And you would recommend to someone doing a historical analysis using tweets as a primary source?

    Liked by 1 person

    Reply

    1. Great question Shauna. It has given me an idea for a follow up blog post. To look at tools from a usability perspective and an overview of their features. Keep a look out for that.

      From a usability and interface perspective I would recommend either Mozdeh, Chorus or TAGS. I’m currently collecting Ebola tweets using all three of these tools. They compliment each other well.
      In terms of features and documentation; Mozdeh is great. This is a useful guide by Mike: http://tinyurl.com/nsozkt8 .

      For historical data ( it is only possible to go back the last 7 days) Chorus is good as it uses the Streaming API. And pulls in tweets from the last 7 days. If you want to go further back you may have to purchase the data from a licensed re-seller of Twitter data such as: https://discovertext.com/. They offer discounts to researchers. Hope that helps. And let me know if you have any more questions.

      Like

      Reply

Leave a comment