A reference must be held on that `net.Listener` inside of `brog`.  This is true in both `tcp` and `unix` cases.  Then in `Close`, you call `close` on the listener.