Fix up a race where two threads could update the oldest referenced xid
in a different order than they began, and blow up a bad assert.