It may be because the walnuts have too much skin. The skin is full of tannins, an antioxidant that is naturally bitter. You can buy pre-peeled walnuts with minimal skin, just keep an eye out for any extra skin.