Yes, it is recommended to limit remote access only to accounts that require it. Remove administrative access via RDP and allow only user accounts that specifically need RDP service.