Capers can tend to be a bit salty and briny, so you can omit them if you don't like the taste. They pair well with this dish but are not a necessary component. If you remove them, be sure to add ½ teaspoon salt.