Add more asserts for ping stats, with some slack