Technically, you don't have to, but I highly recommend you do. Leaving the seeds in will interfere with drinking/eating whatever beverages or dishes you make with it. Having to stop and remove the seeds from your mouth isn't a fun experience.