You can certainly omit that layer, if you prefer, or try toasted slivered almonds instead.