Yes, for many dishes like soups, stews, or casseroles, frozen potatoes can be added directly. However, for some dishes like roasts or fries, it's better to thaw the potatoes first to achieve the best texture and flavor.