Yes, you can, but it is not the best way. Anyhow if you go for this option, avoid using tap water at any cost as it contains dozens of impurities and can damage the vinyl records. Using a purpose-built fluid or solution is only recommendable.