fix handling of storage wrappers
dont commit the index on every write when indexing a large number of files
dont skip files just because we cant index their body