Because of hidden groups, we need to have a specific update_term_count function