Fix issue where associations weren't correct if backup takes control and
new associations were added since it was started.