nghttp: Fix port checking to share connection