If you like, you can, hazelnut skin is very nutritious (it contains the highest concentration of anti-oxidants.) The only downside is that it has a bitter flavor. If you like that, go for it!