Refresh counter when refused a talk