SMP CPU: Clean up and switch the core less often