You can if you want to! I would recommend only filling regular size muffin cups halfway, and the baking time may be a little bit longer. Keep an eye on them.