refdb: catch a directory disappearing

If a directory disappears between the time we look up the entries of its
parent and the time when we go to look at it, we should ignore the error
and move forward.

This fixes #2046.

---

Unfortunately I don't know of any way we can reliably test this, as it's an issue that happens at at time when we cannot stop execution.