Leftover baked fingerling potatoes are just as delicious (sometimes better!) so be sure to save any you may have. Place them back in an oven-safe dish and warm for 10 to 15 minutes at 400°F. When kept in an airtight container, these roasted rosemary fingerling potatoes will keep in the refrigerator for up to 4 days.