Properly detect hand vertical and horizontal movement, rotate them accordingly.