Delete some obsolete files.
Add S3 Multipart Upload support to enable a more robust S3N
implementation.
Add SSL support to existing async HTTP class.
SSL is implmeneted inside of the Layer 7 HttpConnection class, so both
http and https now use the same underlying Layer 4 TCP class.
Remove unnecessary printf.
Split apart S3BulkUploader and S3Uploader
Add support for more header fields in canonicalization / signing code.
Increase S3InputStream default buffer size and remove unnecessary
printf.
Support metadata optimization (part files are parts) which eliminates
unnecessary file system metadata operations when used in an S3N context.
Cleanup some code.
Content length needs to be a long. Add API support for ETAG and Content
Length.
Make TextBytes a NOT final to accommodate some special case uses.
Make SessionIdNormalizer a public data member.
Fix Paths

Make crawler paths more configurable. Set a user-agent default. Add new
NUM_CRAWLER variable.
Implement Closeable
Constants for crawldb metadata JSON properties
Final Merge Support

Add merge support and enhance command line parameters.
Support a SpillWriter that writes to a plaintext file.
Add SSL_MAX_PACKET_SIZE constant.
Add protocol support for new CrawlMaster server.
New CrawlMaster Server.