To make peanut butter balls less sticky, add more oats or other less sticky add ins. Refrigerating the peanut butter balls can also help reduce their stickiness.