Use log.Fatal(err) instead of panic(err)

When failing to start the server. This prevents the stacktrace of goroutines
from being printed, which isn't very helpful in this use case and makes the
actual error message harder to spot.