Fix a bug where after the 65535nd ping, you would get only timeouts