Initial check-in of async fetcher.
Added reference status-related classes and reference implementations.
Added Apache License. Renamed twitter-corpus-tools.
Added program to verify downloaded blocks; tweaked retry error handling on BlockFetcher; added simple test case.
Added README
Refactoring/cleanup of fetcher. Added to README.
More work on VerifyStatusBlock.
Refactored VerifyStatusBlock... seems like a reasonable implementation for now.
Initial implementation of crawler that fetches HTML pages for screenscraping.
Created StatusHtml object. Fixed Ivy issues.
Two parallel types of classes: to deal with HTML statuses and JSON statuses.
Updated README.
For generate JUnit reports.
Verified that the crawler and the verification program both work correctly.
Made sure indexing works. Minor tweaks to JSON verification.
Repair statuses only when asked.
Merge branch 'webcrawler'
Local indexer changes, to add a day field and analyze tweet text
a little more robustly.
Merge branch 'master' into nist

Conflicts:
	src/main/java/com/twitter/corpus/data/Status.java
Re-fix the merge conflicts.