Use time(2) to get the time

We didn't use the added precision in `gettimeofday`, so remove it.
This prevents us from having an unnecessary reimplementation on
win32.