In some parts of Southern Africa, it is safe to drink tap water, however, it is highly recommended to stick to bottled water (mostly supplied) during your trip as even drinkable African water is completely different in taste and consistency from European, American or Asian water.  In East Africa, specifically Kenya, however, water pathogens are a huge problem. So it is advised to always stick to bottled water.