Remove the observer after it's done.