adding option to ignore cache
sorting the df by index as divdata does not return everything in sequence