You can, but it is not necessary. No evidence suggests a need to drink water after consuming olive oil. This is a matter of preference.