Added simple Pig Loader for Arc files, returns (url, time, mime) currently.
Loader now materializes actual text, added ExtractLinks UDF.
added a pig unit test
Added ExtractRawText UDF, tweaked ExtractLinks.
added a pig unit test
Added WarcLoader
Merge branch 'pig' of https://github.com/graemon/warcbase into pig-integration
Cleaned up Pig test cases, added JWAT test case.
use tika for language detection
Added unit test for the language detection UDF.
use tika for mime type detection
Merge pull request #1 from perdalum/pig-integration

Added unit test for the language detection UDF.
force maven to use Java 1.7
Added .idea
Added .iml files
First version of a magic lib UDF
Enable the ArcLoader to load all types of files
Add the magic lib UDF to the Pig script
Add identification engine as a parameter to the DetectMimeType UDF
Improving the unit test of the DetectMimeType by using the two identification engines