Remove pointless columns check in reverseISearch

The fast-path "avoid full refresh" was copied from the main loop. It is
not a fast path in reverseISearch because reverseISearch always has to
do a full refresh.

Simplify the code slightly by removing the unnecessary if{} block.