Clear the note when clearing a day too.