Make Set not set child context configs if they have already been set