Safely unref entries on no queue.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>