Don't continue trying to do work if there isn't any in LRU thread

Signed-off-by: Adam C. Emerson <aemerson@linuxbox.com>