Yes, it is okay to cook raw chicken with potatoes. You just want to ensure that when you are done cooking, the chicken is fully cooked.