Allow for not setting default hostnames

Please check first, I am not sure if I understood it correctly.
But even with a site with a server_name, the default config was used and returned 502s 
So I added this condition to avoid defaults.