Although not recommended, you won’t experience much side effects from suddenly stopping a short term Dexamethasone use.
Suddenly stopping Dexamethasone after long term use can cause withdrawal symptoms such as cold sweat, nausea, tremors, muscle pain, and fever.