add cm model when the number of workers are different across layers