time: don't do comparison twice

Signed-off-by: Anthony G. Basile <blueness@gentoo.org>