Don't thrash primary affinity

primary affinity does not exist in dumpling.

Fixes: #8726
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>