Make sure we're comparing just times