Make sure neighboring files/dirs aren't mistaken as children