Yes, you can limit access to your FTP site by configuring Windows Server's user accounts or using IP restrictions.