This one can be tricky to figure out on your own. Oddly enough, neither item should be in your inventory if you want this to work. Place the car battery on the ground. Then place the battery charger on the ground next to it. Right-click on the charger and you'll see an option to "connect to battery." Doing so will hook up the charger to the battery and allow you to charge it as much as you like.