Excess vitamin C is excreted from the body through urine in the form of oxalate, which is an organic acid. High amounts of oxalate can build up in your kidneys, which can increase the risk of kidney stone formation. For this reason, people who are prone to kidney stones are advised not to take high dose vitamin C supplements.