The poet wants us not to move our arms so much because physical activity leads to stopping our introspection. Not moving our arms also suggests stopping all kinds of violence.