Try to fix race condition in watcher test

The listen watcher version of this test seems to hiccup from time to
time, perhaps this will help.