If the fish are off in the distance, cast as far as you can to get to them. But in many cases, especially when yo-yoing, casting is not important. Drop the jig staraight down and have at it. This can be the case when fishing kelp paddies. As the boat drifts away from the paddie, the boat actually becomes the paddie.
Fish get under the boat just as they get under a paddie.
Casting in this case is contrary to what you should be doing. If the fish are under the boat, drop that jig straight down.