If baby carrots are all you have on hand then you definitely can use them. However I would strongly encourage using larger carrots since the carrots will shrink when baking.