Don't log that the server is listening too soon

Fix #62