Yes, you certainly can omit the walnuts and pecans without hurting the recipe. If you don't have an allergy or sensitivity, you should try it with the chopped nuts. It gives the bread a deeper flavor profile and adds more texture to each bite. Of course you can try a different add in like chocolate chips or cranberries if you like.