You can, but for the best results, I recommend chilling the trifle in the fridge for at least 30 minutes. Even at 30 minutes, the cookies will still have a lot of crunch to them. The longer it's allowed to sit the softer the cookies will be, and it gives time to let the pudding flavors meld and set.