Yes, you can use tap water, but if your tap water contains high levels of chlorine or other chemicals, it's better to use filtered or boiled water. Let the water cool before mixing with sugar.