Remove from local storage if exists