I personally only let it soak for 30 minutes to 1 hour as I tend to find overnight brioche french toast casserole to have a more soggy texture. Note that dipping each individual bread slices in the custard first is essential to only soak the dish for a short period. This allows for the bread to be evenly covered before chilling the casserole.