Kalamata olives, capers, soy sauce, and umeboshi paste are all excellent vegetarian and vegan alternatives to anchovies.