Yes you can. The swivel is below the ball joint
However when stitching vertical photos in portrait mode on a ball joint tripod they sometimes don’t come together right because the way ball joint tripods tilt your camera, it moves the focal point of your camera sensor off of the center rotational axis of the tripod. It works sometimes and others not so much. Depends on the post processing software and what you are photographing.