Clean up all the change notification handles on shutdown