No, you cannot drive with a messed up ball joint. If your ball joint is damaged, it needs to be repaired or replaced as soon as possible. A damaged ball joint can cause your vehicle to lose control, and it is a safety hazard.