Yes, you can leave out the chopped pistachios if you like. They add texture to the cake but will not alter the cake itself if you leave them out.