Adds metadata to index.db and restructures warcs