data loading from homogenised directory trees, organising data into a "database"