Cleans up the block file mess from s3backer