Make sure gems can only match when the columns that the matching gems are in are settled