vhost: treat ssl_port as integer when comparing

Actual fix for test failure for code introduced in abe4b49