Never stop taking Topiramate suddenly, even if you start feeling better.  Make sure to set up an appointment with your doctor to discuss coming off the medication. Coming off Topiramate all of a sudden can cause serious side effects. Topiramate needs to be gradually lowered over time to ensure that you don’t experience serious side effects. Suddenly stopping Topiramate can cause serious seizures, even if you’ve never experienced seizures before.