NO, ADB debugging should always be kept OFF until not in use. With ADB debugging turned ON, the intruder just needs to be on the same network and know the device's IP address to infiltrate it.