Experts blame falling consumer confidence on problems in the credit and stock markets that have hurt the investments that many people had hoped would pay for their retirements .