Prevent `Inf` points from getting too far and crashing.

Fixes quicksilver/Quicksilver#1674