Make time fragile test more robust