Yes, you can omit olives if you're not a fan. Replace them with extra tomatoes. If you still want some briny flavor, experiment with other ingredients like capers.