That comes down to preference. We wanted our chilli sauce to be spicy, so we kept them in. Plus, we are lazy! If you want it to be milder, then remove the seeds before chopping them up. The seeds and the white flesh are the spiciest bit of the chillies.