Use pong receive time rather than processing time

Perhaps this fixes @gmaxwell's observation mentioned in #4468.