It should be safe if your DMM has a low-current port designed for measuring Resistance while the power is on. However, if your DMM does not have this feature, it is strongly recommended that you turn off the power before attempting any measurements.