This bitterness often comes from the thin, dark skin on the walnut. Some people prefer to remove this skin for a sweeter taste.