Don't update the counters as often, should help with shared cache lines.