If you're the one who shut it off in the first place, then yes. It's possible that you can turn the water back on even if you weren't, but it depends on the reason it was shut off in the first place. You may want to contact a plumber or your city's water department first.