Catch InvalidDirectoryErrors when watching directories.

After the first request, subsequent requests might involve monitoring directories which do not exist. Do not disrupt the entire stack when this happens.