Just add more of the thickener! Rather than go right for the powdered sugar, use a little bit of each ingredient so that it doesn’t become too sweet.  And it’s easier to fix too-wet balls than those that are too dry, so just add a little bit at a time!