When a polyline is removed from the map, remove it from the internal polyline list.