Hadoop InputFormats for ARC and WARC files + simple demos.
Tweaked browser; added MR programs for simple content analysis.
Improved error checking for dates.
Added simple Pig Loader for Arc files, returns (url, time, mime) currently.
Loader now materializes actual text, added ExtractLinks UDF.
added a pig unit test
Added ExtractRawText UDF, tweaked ExtractLinks.
added a pig unit test
Added WarcLoader
Merge branch 'pig' of https://github.com/graemon/warcbase into pig-integration
Cleaned up Pig test cases, added JWAT test case.
use tika for language detection
Added unit test for the language detection UDF.
use tika for mime type detection
Merge pull request #1 from perdalum/pig-integration

Added unit test for the language detection UDF.
force maven to use Java 1.7
Added .idea
Added .iml files
First version of a magic lib UDF
Enable the ArcLoader to load all types of files