fixes to LoadIndex to conform to new taxonomy structure and to ignore nulls on directories