add SAUCE and fulltext storing
add recursive method for directory indexing so we can have archive-as-directory indexing