Fix detour removal that could trigger a new location

While a geocoder reverse geocoding is active, when clicking on
a detour to remove it, a new location was found and set.  This fix
fixes this bug.