When sweet potato pie is done, the center should be set and should not jiggle. The pie will also be slightly puffy but will go down after it is taken out of the oven. If a toothpick inserted into the center comes out clean, your pie can be taken out of the oven.