Clearing the cache should not affect your follower count or account settings. However, some preferences and settings may need to be set again.