When you're in 2D, you should check the `x` and `y` values of the current position and destination and then compare the destination `z` with the frustum.