use pickle for serialization of all data and add INDEX file

pyyaml performance was way too bad for medium sized datasets.