remove directory specific values from the map