Yes, you can lose your Twitch Affiliate status. The most common reason this happens is because of account inactivity.