While baking with unpeeled hazelnuts is perfectly safe, hazelnut skin does have a slightly bitter taste. It is recommended to peel the hazelnuts before baking.