No, you should not use just water as a coolant. Water can cause corrosion and rust in the engine. It can also lead to overheating and seizing. Coolant is specifically designed to protect engines and using just water puts your engine at risk. However, if you are in a pinch, you can use water, but you will want to make sure to replace it with coolant as soon as you are able.