Test that the client doesn't switch to the new keys too early