With the best battery chargers, it’s definitely OK to charge a car battery overnight. Most high-end battery chargers include overcharge protection, but also can automatically turn off when they sense the battery has been fully charged.