Yes! Traditionally, carrot cake is made with walnuts, but you can leave them out if you are allergic. It will not ruin the texture of the cake. You can add shredded coconut or raisins if you want to make the texture a little more interesting. I know that some people with walnut allergies can eat pecans so you can add those as well.