Remove dependency on librt.

librt is used for clock_gettime(), which can be emulated by gettimeofday()
without any percieved downside. librt dependency is not cross-platform.