You do not have to soak the bread crumbs, but your pumpkin French toast casserole will taste 100x better if you do.