tweaked search tolerances to reflect new, more effective numerical search