To get rid of an alarm in Windows 10 you have two options. Either you delete that alarm or turn it off. To delete an alarm, go to Alarms & Clock app, head over to the Alarm section. Now right-click on the alarm and click delete. To turn an alarm off simply switch the toggle off the alarm.