Make the -listdir.json file aware of filters

It always bothers me that the listdir json file gets built before
filters are applied. This consequently makes tableslurp WARN when
restoring a backup set and not finding the files (tableslurp does not go
critical on missing files, but still.)
Add global index option to tablesnap
Factor out adding files to s3 by content/mimetype
Add include support for global index

Also use \n's for delimiters because kad hates unix