Added JSoup-based link-extraction to the indexer.
Outlinks replaced with host/public-suffix fields.
Merge branch 'master' into adda-enhancements
Added utility code to turn RGB colours into English language labels.
Added field for the first four bytes.
Permissions issues.
Merge branch 'adda-enhancements' of https://github.com/ukwa/warc-discovery into adda-enhancements
Added code to pull out the first four bytes, and fixed naming error in
the fields.
Merge branch 'adda-enhancements' of https://github.com/ukwa/warc-discovery into adda-enhancements
Moved the first-four-byte extractor ahead of the link extractor, in case
the latter runs long and exceeds the InputStream buffer.
Bumped minor version number on this branch, to reflect different
development streams and make it easier to use both binary
versions.
Updated all pom version references appropriately.
Enabled CLI version again, as a profile.
Merge branch 'adda-enhancements' of https://github.com/ukwa/warc-discovery into adda-enhancements
Lost of new fields, including basic sentiment analysis.
Many more small features detected, including publication date, language
and prototype colour extraction.
Cleaned up to remove warnings.
Added postcode district geomapping for geosearch.
Removed Reducer speculative execution.
Merge branch 'adda-enhancements' of https://github.com/ukwa/warc-discovery into adda-enhancements