Having multiple physical cores in a CPU allows for parallel processing, which can significantly improve performance by enabling the CPU to handle multiple tasks simultaneously.