The caution given when peeling the almonds in the video is to peel fast and be cautious because the almonds are hot.