We can only do the relinking if there is a prev object to move before.