Personally I have only ever made homemade vanilla extract with alcohol, however some sources indicate that it can be made using food-grade vegetable glycerin. You may find this article on making non-alcoholic vanilla to be a good guide if you are searching for non-alcoholic options.