No, you should not stop taking Furosemide 40mg Tablet even if your blood pressure is controlled. Sudden discontinuation of medicine may increase your blood pressure again and the chances of getting a heart attack and stroke may also increase.