Different cooks have different opinions about this, and some of them have very strong opinions! But in general, you should chill banana pudding for around two hours to soften the cookies. I think it's even better if you chill it overnight.