Yes, you can. However, I recommend using this recipe for chicken breast with potatoes. Chicken drumsticks will work for this recipe, but the liquid they will exude will not be as clear as chicken thighs. Your potatoes won't look as pretty, to put it nicely.