If your zodiac sign is Aries, Pisces or Scorpio, you should not wear the diamond because according to astrology, diamonds can bring disharmony to your life. Diamond is the gemstone for those who are born under Virgo and Libra as it bestows good luck and prosperity.