Certainly, you can use water to cool a drill bit. Just make sure to wipe the bit out after using it to cool the drill.