No you do not have to agree. Just because your “ex” has primary custody of the children does not mean that they have the only and final say in the matter. If your “ex” wants to move – for a new job or even marriage – you do have the right to object.