Technically, no, you don't have to remove the seeds. But you won't have room to stuff them. You can cook everything separately and just serve it altogether if you don't feel like removing the seeds.