If the time value is smaller than a second, use milliseconds as minimal
unit for formatting