If you are using an Outlook account, you need to remove your account from the Mail app in order to sign out of this client on Windows 10/11. However, Gmail users can use the Security panel to sign out their email accounts on a particular device.