Challenges and limitations associated with performance units include resistance to change, inaccurate or incomplete measurements, and balancing individual and team objectives. Addressing these challenges is crucial for successful performance management and continuous improvement.