Yes, you can simply leave out the walnuts and raisins if you prefer. The bread will still have a delicious flavor from the grated carrots and lemon peel.