I spoke too soon.

It IS in fact possible to stop doubleclicking from losing your target
entirely.