I also have an almond intolerance. I am able to tolerate almond extract but not the actual nuts. If you’re the same, you can definitely leave the almonds off the top of the cake. If you need to exclude the almond extract as well, then I’d suggest replacing it with vanilla.