genirq: Always force thread affinity