iprelayd: Properly close connections

This is to not leave stale connections in CLOSE_WAIT state indefinitely.