Pregnant women, especially in the later stages, should avoid Vajrasana to prevent pressure on the abdomen and ensure comfort and safety.