Yes, you can. But in that case, you have to apply a strong mortar on the cement board. You can also comb the layer of the mortar so that the surface gets uneven and it can hold the stone tightly.