You sure can. However, since neither soy or almond plant-based milk doesn't have a high fat content, you will need to increase the amount of agar powder to approximately 3/4 teaspoons.