Add cpu affinity for peers