Yes, you can leave out the walnuts if you have an allergy or you can substitute with another nut. Sliced almonds are nice and sunflower seeds work well for people with nut allergies.