Yes! Cocoa powder contains starch and will thicken the ganache. The more you add, the thicker the ganache will be (and the more bitter it will become).