You want the potatoes to be crispy on the outside but tender on the inside. Use a fork to pierce one of the potatoes to see if it's soft and tender on the inside.