It is generally recommended to drink bottled or filtered water while in Zambia to avoid any potential stomach issues.