To test the oxygen sensor using a digital voltmeter, first disengage the sensor and use the voltmeter to measure the output. Subject the sensor to a heat source like a propane torch to inspect its reaction. A steady voltage pattern implies functionality, while erratic voltage indicates a defective sensor.