The stock price declined due to concerns raised by Ally's CFO regarding borrower struggles amid high inflation and rising living costs, leading investors to re-evaluate their holdings.