Remove the watcher thread