Deputy Finance Minister David Chapfika warned Wednesday the government would punish those behind the vandalism .