Factor out adding files to s3 by content/mimetype
Add include support for global index

Also use \n's for delimiters because kad hates unix