Fix missing infos from concurrent dataset loading
This should fix issue #2131 

When calling `load_dataset` at the same time from 2 workers, one of the worker could have missing split infos when reloading the dataset from the cache.
