A bad will not stop you from driving your car. However, this solely depends on the severity of the damage. It is, however, not advisable for you to continue driving when you know the ball joints in your car are bad. Continuing to do so can damage and break the ball joint as well as other parts of your car. You could also lose control of the car while driving it in such a bad condition.