You must first connect your multimeter’s red probe to the +ve terminal of the lithium battery and then connect the black probe to your battery's –ve terminal. When you are done attaching these multimeter probes correctly, watch the multimeter’s display. On the display screen, the voltage signal will reflect the voltage of your battery.