Yes, if the Windows computer is running software that supports acting as a host for SSH or another protocol that the client supports. This software is separate, and two computers running the client cannot connect to each other by default. Some remote desktop software may allow for remote connection via SSH.