Yes, you can use baby carrots for glazed carrots. Keep in mind that the cooking time may vary slightly, so check for tenderness as you cook them or split them in half length wise before cooking.