Yes, it is recommended to remove the seeds and membranes as they can be bitter. Simply cut the top off the pepper, remove the core, and rinse out any remaining seeds and membranes.