server: Add handling of server vs client timestamps

The server is always right.