Let's check for !inside first, since that would make us return false right away without having to check for holes.