Try rmdir before readdir

Only readdir and remove children on ENOTEMPTY
v2.1.2