Prefer server timeouts to client timeouts

This means the exceptions we see will match what is to be
expected by assert_unavailable