Yes, the author of the reference can edit or remove the reference at any time. Recipients can hide any references from public view, although this is rare.