Baby potatoes are cooked when they are easily pierced with a knife or fork through to the middle. They should be tender, but still somewhat firm.