Yes, you do! You don't want the potato to build up pressure and burst open. Piercing the potato helps with cooking and the potato from growing angry. (Ha, ha)