Honor port setting also when using SSL