Use pong receive time rather than processing time

Perhaps this fixes @gmaxwell's concern raised in #4470.