Don't force port 22 if the port is not set.

In this way ~/.ssh/config can take effect