An endoscope operation system comprising: an endoscope comprising an image pickup unit at its tip; a holding arm unit that supports the tip of the endoscope in such a manner that the tip of the endoscope can be moved in up/down, left/right, and front/back directions, and can be rotated on its own axis; a display unit that displays an image based on an image signal supplied from the image pickup unit of the endoscope; a first posture detection unit configured to be attached to a head of an operator, the first posture detection unit being configured to detect an angular speed based on a postural displacement of the head of the operator; and characterized by a second posture detection unit configured to be attached to a torso of the operator, the second posture detection unit being configured to detect an angular speed based on an inclinational displacement of an upper body of the operator; and a control unit that calculates a target speed vector at the tip of the endoscope and controls a moving direction and a speed of the tip of the endoscope so that the tip of the endoscope follows the calculated target speed vector, wherein the control unit calculates a translational speed of a neck position of the operator in the front/back direction based on an inclinational angular speed component of the upper body in the front/back direction of the angular speed calculated based on the inclinational displacement of the upper body of the operator detected by the second posture detection unit, and calculates the target speed vector based on the calculated translational speed of the neck position of the operator in the front/back direction and information of a movement of a posture of the head of the operator detected by the first posture detection unit. an endoscope comprising an image pickup unit at its tip; a holding arm unit that supports the tip of the endoscope in such a manner that the tip of the endoscope can be moved in up/down, left/right, and front/back directions, and can be rotated on its own axis; a display unit that displays an image based on an image signal supplied from the image pickup unit of the endoscope; a first posture detection unit configured to be attached to a head of an operator, the first posture detection unit being configured to detect an angular speed based on a postural displacement of the head of the operator; and characterized by a second posture detection unit configured to be attached to a torso of the operator, the second posture detection unit being configured to detect an angular speed based on an inclinational displacement of an upper body of the operator; and a control unit that calculates a target speed vector at the tip of the endoscope and controls a moving direction and a speed of the tip of the endoscope so that the tip of the endoscope follows the calculated target speed vector, wherein the control unit calculates a translational speed of a neck position of the operator in the front/back direction based on an inclinational angular speed component of the upper body in the front/back direction of the angular speed calculated based on the inclinational displacement of the upper body of the operator detected by the second posture detection unit, and calculates the target speed vector based on the calculated translational speed of the neck position of the operator in the front/back direction and information of a movement of a posture of the head of the operator detected by the first posture detection unit.