Add the Consul KV watch. Make sure it's removed too.