It could have to do with the temperature of the chocolate when it you are adding it. It could also be due to the percentage of cacao in your chocolate, the lower the percentage, the smoother the mousse will turn out.