Yes, you can use frozen carrots, and you don’t need to thaw them before cooking. They may require an additional few minutes to cook.