You can use vegetable broth or mushroom broth to make vegetarian gravy. You can also use vegetarian bouillon cubes or seasonings like soy sauce or miso paste to add flavor.