A tankless water heater should be mounted to a wall. Otherwise, it can be in the same general area as your older water heater.