Use connection's hostport when propagating NetworkError

Fixes #23.