The main water may come through the concrete floor or through the wall. The valve is typically within three to five feet of where the main water enters. In some cases, the main water may enter in a different area, like a mechanical room, up through the floor, near the water heater or furnace.