Make sure service requires confi setup in cases where we don't notify
the service on config change