You only need to click the green switch link displayed in the `status` column next to your website. It will then change to red switch and the monitoring is stopped.