Merging records on collision works when the smaller network comes last

Making this work if the larger network comes last could be _much_ more
difficult given the way the system currently works.