Handle connection refused and error events.  Fixes client wait on setup failure.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>