It is recommended that you drink water before, during, and after exercise. For most exercise, plain water will do. Some people recommend drinking an electrolyte drink after doing any vigorous exercise for an hour or more to replace lost electrolytes.
One other note, drinking too much water too fast during exercise can cause cramps and stomach pain. It is best to sip slowly while working out in most cases.