Only invalidate velocity in the direction that we're colliding.
Only jump when we have no vertical velocity (i.e. we're not jumping)