Capers may have a slightly salty and tangy flavor, while others may find them to be more bitter. In general, however, most people would describe the taste of capers as similar to that of olives. Additionally, the texture of capers is often described as crunchy or firm.