You will not experience any withdrawal symptoms. Stopping atorvastatin, on the other hand, may cause your cholesterol to rise. This increases your chances of having a heart attack or having a stroke. If you want to stop taking your medication, you must find another way to reduce your cholesterol.