The term comes from the traditional standard flavor of ice cream, vanilla. According to Eric S. Raymond's The New Hacker's Dictionary, "vanilla" means more "default" than "ordinary".