We don't recommend it. The flavoring added to pudding mix can change the flavor of the bread and, as Chrissy says, make it taste fake. Stick with the vanilla.