Wait in server.Shutdown for listener goroutine to exit

@benbjohnson Please review

Ensures listener goroutine exits before leaving server.Shutdown.