Yes, you do! You can either turn on your oven when you start mixing together all of the ingredients or set a timer for 15 minutes and then put them in right away (this is what I did). Just make sure that the oven is fully preheated by the time you put the brownies in so they cook evenly!