No, if you invested the minimum required (€500,000), you should not lose your Golden Visa, regardless of the price fluctuations on shares during and at the end of the fund term. What matters is how much you invested initially.