Task switching during CI delays can lead to decreased productivity and efficiency. Developers lose their working context when switching between tasks, leading to less task completion and potential delays in project timelines.