Do not stop taking Atenolol without consulting a physician. Abrupt discontinuation can worsen the condition you are dealing with and can lead to adverse effects. Approaching your physician can help you decide the safest way to stop taking Atenolol, mainly by reducing the dosage strength over time. Newer beta-blockers can replace Atenolol.