All these mustard varieties come from different plants and vary in flavor intensity. Black mustard seeds have an intense nutty and slightly higher spicy flavor. Yellow mustard seeds have the mildest flavor, while brown ones fall in between.