Make sure datepicker disappears after navigating

When navigating away we want to remove the datepicker elements to make
sure there's no old HTML sitting around