filter dir names better and dont process if field_of_interest doesnt exist