If you really don't feel like a nut :) then yes, you can leave out the almonds. You'll probably end up with a few fewer macaroons without them, but they'll still be tasty.