Yeast produces alcohol as well as carbon dioxide and other compounds. Especially when wholegrain flours are used, fruity, wine-like flavours can be produced. If you don’t like the taste, try fermenting your dough a little less.