Facing the wall during handstand push-ups will increase the need for hand balancing and upper body strength, as you cannot lean backwards and use the wall as a support.
If you are a beginner, facing away from the wall may be easier, however be careful not to overly depend on the wall for balance and strength.