Disable metrics service by default

And clean up in `#stop()` if it is running.