Yes, tap water in Israel is safe to drink. The Ministry of Health even recommends drinking tap water.