Don't display warning when not searching upward

Fixes #104