Anchovies are slightly fishy, but the most significant flavor is umami, salty, tangy, and briny. Kalamata olives are probably the closest thing you've tried.