added lookup when even expanded_url is a shortened url
updated scraper to use new scroll_cursor param. fixes #7
removed dead comment
Merge pull request #6 from pbinkley/realurl

added lookup when even expanded_url is a shortened url
renamed to unshorten.py and have it read in and write out each tweet json with an additional "unshortened_url" key for each url
added exception handling and logging
typo
typo
rely on requests to do the url shortening, since a short url can point at a short url, etc
retweet utility
Merge branch 'master' of github.com:edsu/twarc
fixed little bug
need to force rate limit variables to integers to do math with them ; not sure how it ever worked without them
Merge branch 'master' of http://github.com/edsu/twarc
check no longer recursive, and always waits; better logging
simple utility to extract ids
now does concurrent lookups with multiprocessing
added timeout to hopefully avoid random hanging requests to twitter api
utility for printing out details for json files
number of results configurable