Yes, you can. I prefer fresh baby carrots but frozen is fine. Check them halfway through cooking time as the frozen carrots are proabbly not the same exact size as the fresh baby carrots.