Do not watch the same directory more than once.

Should help a little with #974, but is a good idea to limit the wasted effort anyways.