Absolutely! It's perfectly safe to cook chicken and potatoes together, as long as they are all well cooked.