organize files and load full dataset