Homemade oat milk will stay good in the refrigerator for up to 5 to 7 days. Homemade oat milk should be stored in an airtight container, like a large mason jar or sealable pitcher. You'll know it's gone bad when it starts to smell strange.