Yes, the majority of office chairs with massage will need to be plugged into an outlet. While they provide a long cord, it can still be challenging to maneuver the chair around without running over the cable or getting tangled. So keep this in mind.
Some manufacturers provide a charging option for wire-free use, but it can run out of power in the middle of a massage.