Unlike CJ's standard swimming controls, heading underwater requires the use of two buttons. Once in a body of water deep enough to dive in, press the Circle / B / Left Mouse Button to go beneath the surface and then hold X / A / Space to propel CJ forwards.