The longer the bread sits in the custard, the better the casserole will taste. However, it will still taste delicious without the chill time. I recommend using fresh bread if you don’t have time to let the casserole sit and would like to bake it right after mixing the ingredients together.