Fix merges in column stores: don't look inside ref->u.key.