Update speaker counts