Supporting Statement for:

Willingness To Pay

Survey for Santa Cruz River Management Options in Southern Arizona

1. **Identification of the Information Collection**

. 1(a) Title of the Information Collection Willingness To Pay

Survey for Santa Cruz River Management Options in Southern Arizona (New), EPA #2484.01, OMB #2080

-NEW 1(b) Short Characterization/Abstract The USEPA Office o f Research and Development is investigating public values for scenarios of change for per ennial reaches of the effluent

- dominated Santa Cruz River, Arizona. These values will be estimated via a willingness to pay mail survey instrument. There are two effluent

dominated perennial reaches considered in the survey

. A “South” reach which starts at an outfall in Rio Rico, AZ, flowing northward through Tumacácori National Historical Park. A “North” reach, fed b y two outfalls in northwest Tucson, Arizona , flows northwest through Marana, AZ. In other locations north of where the c hannel crosses the border with Mexic o about 5 miles east of Nogales the Santa Cruz River is ephemeral . For each of the South and North reaches, two different scenarios of change are considered. The first is a reduction in flow length, and associated decrea ses in cottonwood

- willow riparian forest, a rare forest type in the region. The second is an increase in water quality to allow full contact recreation, such as sub mersion, at normal flow levels. The baseline flow length and forest acreages, as well as the acreages of forest that would be associated with reduced flow lengths, are derived from natural scientists

. A choice experiment framework is used with statistically designed tradeoff questions, where options to maintain flow length and forest, or increase effluent water quality, are posed as increases in a ye arl y household tax. Each choice question allows a zero cost “opt out” option. The choice experiment is designed to allow isolation of the value of marginal change for each reach

. A few a dditional questions to further understand the motivations for respondent choices, as well as their river

- related recreation behavior, are also included. Several pages of background introduce the issue to respondents. Li mited s ociodemographic questions are included to gauge how well the sample respondents represent the target population. Samples of the two major metropolitan areas in southern Arizona, Phoenix and Tucson, will receive the survey

. 2. **Need for and use of the Collection** 2(a) Need/Authority for the Collection Current ORD research revolves around the theme of sustainability (USEPA, 2013a). An overarching goal cited on the EPA website for sustainability research is:

“ EPA Sustainable communities research is providing decision tools and data fo r communities to make strategic decisions for a prosperous and environmentallysustainable future, and providing the foundation to better understand the balance between

the three pillars of sustainability

- environment, society and economy” (USEPA, 2013b ). As part of in cluding public input for finding the “ balance” of sustainability, this survey research will estimate public values for potential management changes to the Santa Cruz River in southern Arizona. The Santa Cruz watershed is a subject of continuing researc h collaboration between USGS , ORD, and other partners , with a peer

- reviewed research plan published by Norman et al. ( 2010 ). ORD is also collaborating with recipients of a recent N ational S cience F oundation grant engaging in Santa Cruz River natural and social science research, led b y the University

of Arizona (NSF, 2010)

. The survey will gather public value information on Santa Cruz River management scenarios to complement partnering natural sci ence researc h

. 2(b) Practical Utility

/Users of the Data The primary

reason for the proposed survey is public value research

. The Santa Cruz River is a case study of a waterway highl y impacted by human modifications. However it still represents potentially

valua ble ecological goods such as rare riparian habitat and recreational opportunities for the regional population. As a secondary purpose, the survey results may be informative to local decision

- makers considering Santa Cruz River management options. Water scarcity in the region raises periodic debates on the best uses of effluent. 3. **Non duplication, Consultations, and Other Collection Criteria** 3(a) Non duplication Willingness to pay

survey research has occurred for changes to other US rivers, as well as other southwestern US rivers (e.g. Weber and Stewart, 2009 ; Berrens et al., 2000). While techniques of benefit transfer could be applied to the results of prior studies in an attempt to gain a limited sense of the public value for Santa Cruz River management options, there are a number of hurdles to value estimates derived b y benefit transfer (e.g. Desvousges et al., 1992, Brouwer, 2000). Differences in the ecological good being considered, local availability of substitute resources, and local taste s and preferences are some of the limitations in transferring estimates from one study or group of studies to a new valuation context. The proposed survey incorporates natural science modeling of the relationship between surface water and riparian forest. The ecological changes respondents would value are tailored to the Santa Cruz River, have been explicitly defined in the survey , and the survey has been extensively

pretested on the regional population to minimize cognitive problems. EPA has not identifie d any other studies that would consider public values for Santa Cruz River o ptions considered in the proposed survey . The survey options were specifically designed to encompass changes to both the South and North effluent

- dominated perennial reaches . The o ptions were also carefully defined to specify

miles of flow, acreage of riparian forest, and safety of water contact for different ty pes of recreation

. The language, graphics, and question formats in the survey

were carefully pretested. However , there is p rior willingness to pay survey research pertaining to the South reach of the Santa C ruz River ( Frisvold and Sprouse, 2006) . Although full documentation and results of th at survey are neither available n or published , furtherinformation on this survey was s ought before initiating plans for this new collection (personal

communication with G. Frisvold, August, 2009 )

. It was determined that the prior survey , even if results become available, would not be sufficient for the Santa Cruz research goals of this study

. This survey

will ask respondents to choose between numericall y defined levels of environmental attributes matching natural science quantitative modeling (alongside varying cost levels). In contrast, the prior survey asked a more general que stion of willingness to pay “to permanently preserve the Santa Cruz River habitat as it is today” , using photos to describe a baseline perennial stream habitat, and a changed habitat without perennial flow. Unfortunately the specific marginal change to be valued was not defined, limiting the reliability of respondent data as well as clouding how the data could be applied to a specific management scenario. Furthermore, a major geographic difference is that the prior survey focused on the South Santa Cruz onl y, whereas this survey considers management changes to both the South and North Santa Cruz River , and the reaches have significant differences in both vegetation and proximity to the Tucson urban area

. 3(b) Public Notice Required Prior to ICR submission to OMB This is the first of two federal register notices. 3(c) Consultations The principal investigator for this effort is Matthew Weber, postdoctoral researcher at USEPA, ORD, Western Ecology

Division, Corvallis, OR. The principal investigator has past direct experience with willingness to pay survey research, with a study

estimating public values for management changes for the river and riparian area of the Rio Grande in Albuquerque, New Mexico (Weber and Stewart, 2009 ). P reviousl y approved OMB sur vey s were consulted in designing this survey , in particular a NOAA coral reef valuation s tudy (OMB # 0 648

- 0585) and an EPA study

on fish and a quatic h abitat impacts from cooling water intake structures (OMB # 2020

- 0283)

. The survey

instrument booklet format and several questions were adapted from the EPA study

. The principal investigator participated in a workshop amongst stated preference survey practitioners working on federal government projects, convened b y NOAA and Stratus Consulting in June of 2 012 (N OAA and Stratus Consulting, 2012) . This workshop was a helpful forum for comparing notes in willingness to pay survey design , with an emphasis on strategies for presenting ecological goods in a way meaningful to the lay

public . Several completed or working draft willingness to pay survey instruments were presented for group discussion. Th is survey

uses an explicit approach to defining ecological commodities to be valued, following guidance in Bo yd and Banzhaf (2007 ). Dr. Paul L. Ringold, research ecologist at at USEPA, ORD was consulted for his experience identifying publicly valued stream commodities and metrics (Ringold et al., 2009; Ringold et al., 2013). Although the need to clearl y define the ecological good to be valued is established advice for stated preference research (Arrow et al. , 1993 ) , Bo yd and Krupnick (2009) found that practitioners sometimes use only vague language to define water
- related ecological commodities. This survey

includes natural science modeling outcomes which quantify the relationship between riparian forest acreage and surface flow extent in both the South and North Santa Cruz River,two river areas with different hydrogeological conditions. The natural science modeling is based

on diss ertation research at Arizona State University (White, 2011 ) and further anal ys is by Arizona State University

Professor Dr. Juliet Stromberg (personal communication, May , 2013)

. Drs. White and Stromberg were consulted throughout development of the natural s cience background provided in the survey instrument as well as the ecological changes the survey poses. Additional consultations were conducted to ensure changes associated with river flow and forest extent posed in the survey are realisticall y aligned w ith potential changes for Santa Cruz River management , to facilitate respondent acceptance of the scenarios

. Dr. Thomas Meixner and Ph.D. student Rewati N iraula at the University of Arizona were consulted on potential surface streamflow extents under different effluent release scenarios for the North and South reaches of the Santa Cruz River. The most recent Arizona Department of Environmental Quality (2010 ) report summarizing water quality status for the South and North reaches of river were reviewed. Persons with either research or management interests in the Santa Cruz River (USGS, University of Arizona, Pima County , and Tumacácori National Historical Par k) were consulted on the range of likely treated wastewater releases into the South and North reaches of the Santa Cruz River, and the current state of water quality. 3(d) Effects of Less Frequent Collection Without this collection the public values f or Santa Cruz River management scenarios being modeled by

collaborating natural scientists could not be estimated. There would then be a gap in understanding the public welfare relevance of the associated natural science studies. Furthermore, results from the case study would not be available to the willingnes s to pay literature . Finally , there would also be less information on public values regarding Santa Cruz River management available to the local community for their planning purposes. 3(e) General Guidelines The survey

will not violate any

of the general guidelines described in 5 CFR 1320.5 or in EPA’s I CR handbook. 3(f) Confidentiality All responses to the survey will be kept confidential

. The survey s will be processed, including data entry , by

the principal investigator; nobody else will have a record of who has responded or the answers of any given respondent. A list of the a ddresses of the members of the sample who have responded versus those who have not will be maintained in order to more efficientl y mail reminders and replacement survey s . This will be a single file, accessible to and updated onl y b y the principal investigator

. To protect confidentiality in survey results , each respondent will be identified by

a numeric code in that file rather than their name or address. The survey questions do not ask for any personally identifiable information and personall y identifiable information will not be entered in the result s even if volunteered by the respondent, for example in the comments section. In the cover letter , respondents will be informed that their responses will be kept confidential. After the data collection is complete , the respondent status file will be deleted,and only

the numeric code assigned to each respondent will remain. Aft er data entry is complete, the survey s themselves will be destroyed. The USEPA office location (the Western Ecology Division of USEPA) and USEPA electronic file sy stem used b y the principal investigator are highl y secure. A keycard possessed only b y USEPA employees and contractors is necessary to enter the building . The principal investigator is then in a separat e keyed office space within the secure building. The computer sy stem where the personal names and addresses associated with respondent numeric codes will be stored during the process of data entry is a secure server requiring principal investigator personal login username and password

. At the conclusion of data entry , this file linking personal names and addresses to respondent codes will destroyed (along with hard cop y survey responses themselves) at the conclusion of data entry and only respondent codes will remain. 3(g) Sensitive Questions In focus groups two questions were found to be sensitive by some of the participants; the question of racial category , and the question of income category . However it was found that describing the research need for these questions, of gauging how well different groups are represented in survey

results, was accepted by

these participants as a worthwhile rea son for asking these questions. The reason for these questions now prominently appears preceding those questions within the survey : "We need the following questions to ensure votes from all groups have been fairl y represented in this survey "

. Confidentiali ty of responses is then reiterated. 4. **The Respondents and the Information Requested** 4(a) Respondents/SIC Codes The target respondents for this survey are representatives 18 y

rs or older of households in the two most populated urban areas of Arizona, the Phoenix metro area , and the Tucson me tro area. A sample of household representatives 18 y rs or older in each metro area will be contacted by mail following multiple contact protocol in Dillman ( 2009 ) . A response rate of 30% will be targeted. To increas e response rates from the sample, several contacts will be used, including a prenotice to all recipients , a reminder postcard , and followup mailing

. The target responses from the Phoenix and Tucson metro areas is 250 households each , or 500 households total. 4(b) Information Requested (i) Data items, including record keeping requirements The current draft survey

has also been uploaded to the federal register (note that the pages numbers are out of sequence on the electronic file, they are sequenced so that they will print correctly double

- sided)

. The survey is divided into 4 main parts. The first part is background for the choice questions . The second part is the choice questions themselves . The third part is questions designed to understand the context for why respondents responded to the choice questions as they

did

. These questions include attitudinal questions as well as recreational preferences questions. The fourth part is designed to assess whether major sociodemographiccategories of the received sample are representative of the population s ampled. There are no

record keeping requirements.

(ii) Respondent Activities The following respondent activities are envisioned. Participants will read the cover letter and survey , respond to the survey questions, and return the survey using a provided postage paid envelope . Focus group and cognitive interview participants ty pically took no longer than 30 minutes to complete the survey , so 30 minutes per response is the estimate d burden for the average respondent. 5. **The Information Collected**

**– Agency Activities, Collection Methodology, and Information**  **Management** 5(a) Agency

Activities Development of the survey questionnaire through focus group and cognitive interview pretesting is occurring under the separate IC R# 2090

- 0028. Pretest techniques follow standard approaches in the qualitative methods literature (Morgan and Krueger, 1998; Rubin and Rubin, 200 5), as well as guidance in the economics literature for the specific purposes of pretesting a willingness to pay survey (Johnston et al., 1995; Kaplowitz et al. 2001, Hoehn et al. 2003 ). Under this I CR, a genc y activities will include :  Develop the choice experiment design
 Obtain a representative sample mailing list for each of the two target metro area populations , Phoenix and Tucson
 Printing of questionnaires
 Mailing of prenotices
 Mailing of cover letters and questionnaires
 Reminder mailings
 Follow

- up mai lings and replacement questionnaires to non - respondents as needed
 Data entry

and quality

assurance of data file
 Analy sis of survey results , including characterization of nonresponse and potential degree of nonresponse bias
 Modeling choice experiment result s with a standard multinomial logit approach
 Reporting survey

results 5(b) Collection Methodology and Management The proposed survey

is a choice experiment questionnaire delivered and returned by mail. Standard multi

- contact mail survey methods will be used to increasing response rate (Dillman, 2009, pg. 242). The desired number of completed survey s is 250 in each of the Phoenix and Tucson metro areas with a target response rate of 30% in each area. Thus it will be necessary to contact approximately

834 households in each metro area.Data quality will be monitored by checking returned survey responses for consistency, and b y

assessing any comments made on the survey or returned with the survey that signal strategic responses or respondent confusion. Code d survey data will not include any identifying information of the respondents. Returned survey data will be coded and used as the dataset for multinomial logit regression modelling. 5(c) Small Entity

Flexibility This survey

will be administered to indiv iduals, not businesses. Thus, no small entities will be affected b y this information collection. 5(d) Collection Schedule A breakdown of the expected collection schedule is as follows :

 Week 1: Printing survey s  Week 2: First contact mailing for pilot survey , notifying that a survey will be mailed in 1

- 2 weeks
 Week 3 and 4: Pilot survey mailing
 Week 5 and 6 : Pilot survey reminder postcards mailing
 Week 7 through 9: Data entry of pilot survey

results. Revising estimation of the beta vector (co efficients on utility variables, see part B of the supporting statement) . Adjusting th e choice experiment and cost levels for the main survey mailing based on the beta vector estimated from the pilot survey
 Week 10: First contact mailing for main survey mailing, notifying that a survey will be mailed in 1

- 2 weeks
 Week 11 and 12: Main survey mailing
 Week 13 and 14: Main survey reminder postcards mailing
 Week 15 through 18: Main survey a dditional reminders and replacement survey s as necessary to reach target response rate
 Week 19 to 20 : Data entry The schedule above is staged such that if response rates are higher or lower than expected , the appropriate number of replacement surveys will be printed and mailed to most efficiently use funds

. 6. **Estimating The Burden and Cost of the Collection** 6(a) Estimating Respondent Burden For a typical respondent, a conservative estimate of their time to review and respond to survey questions is 30 minutes. Assuming the target of 500 people total respond to the survey , the burden is 250 hours. This would be a one

- time expenditure of their time. 6(b) Estimating Respondent Costs (i) Estimating Labor CostsThe Bureau of Labor Statistics reports average wage rates for some metropolitan areas , wi th the

most recent data being May 2011 ( Bureau of Labor Statistics, 2011 ). The average hourl y wage for all occupations in the Phoenix metro area was $21.61, or an average cost per participant of $10.81. The average hourly wage for all occupations in the Tu cson metro area was $20.55, or an average cost per participant of $10.28. Assuming 250 participants in each metro area fill out the survey , the total estimated respondent labor cost is $5,270.

(ii) Estimating Capital and Operations and Maintenance Cost s There are no anticipated capital, operations or maintenance costs associated with this collection.

(iii) Capital/Start

- up Operating and Maintenance (O&M) Costs There are no anticipated capital, operations or maintenance costs associated with this co llection.

(iv) Annualizing Capital Costs There are no anticipated capital, operations or maintenance costs associated with this collection. 6(c) Estimating Agency

Burden and Cost The various aspects of the survey mailing are assumed to be done by the principal investigator, with an associated hourl y wage rate of $32.50 . Preparing survey mailings, tracking nonrespondents , sending new mailings as needed, and data entry are anticipated to amount to 8 weeks total or 320 hours of work. Agency labor cos t would be 320 hours times $32.50 per hour or $10 ,400. 6(d) Estimating the Respondent Universe and Total Burden and Costs Assuming 250 participants in each of the Phoenix and Tucson metro areas fill out the survey , the total labor cost will be $5,270. 6(e) Bottom Line Burden Hours and Cost Tables **Item Quantity**  **Cost Public Burden**  Time burden: 0.5 hours per respondent 500 persons 250 hours ; $5,270 labor **Agency Burden** Time burden Entire project 320 hrs; $10,400 labor Mailing list 1,000 names in Tucson area & 1,000 names in Phoenix area (accounts for % of incorrect addresses) $800

Prenotice letter paper and 1,7 00 pieces $100printing

Prenotice envelopes 1,7 00 pieces $150 Prenotice postage (bulk mail) 1,7 00 pieces $70 0 Color survey s paper and printing 2,000 pieces (includes estimated replacements) $2,900
Printing return envelopes 10.5” x 7.5” 2,000 pieces (includes estimated replacements) $450
Outgoing envelopes 11.5” x 8.75” 2,000 pieces (includes estimated replacements) $300
Outgoing survey

postage (bulk mail) 2,000 pieces (includes estimated replacements) $1,900
Return survey

postage (bulk mail) 500 pieces $500 Reminder postcard paper & printing 1,7 00 pieces $ 10 0 Total $2 3,57 0 The estimated respondent burden for this study is 250 hours and $5,270. The estimated agency cost for this study

is 320 hours and $10,400. Agency costs besides labor hours total $7,90 0 for the mailing list, paper, printing, and postage. 6(f) Reasons for Change in Burden The survey

is a one

- time data collection activity

. 6(g) Burden Statement The annual public reporting and recordkeeping burden for this collection of information is estimated to average 0.5 hours per response. Burden means the total time, effort, or financial resources expended b y persons to generate, maintain, retain, or disclose or provide information to or for a Federal agency. This includes the time needed to review instructions; develop, acquire, install, and utilize technology and s ys tems for the purposes of collecting, validating, and verifying information, processing and maintaining information, and disclosing and providing information; adjust the existing way s to compl y with any pre viously

applicable instructions and requirements; train personnel to be able to respond to a collection of information; search data sources; complete and review the collection of information; and transmit or otherwise disclose the information. An agency m ay not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currentl y valid OMB control number. The OMB control numbers for EPA's regulations are listed in 40 CFR part 9 and 48 CFR chapter 15. To comment on the Agency's need for this information, the accuracy of the provided burden estimates, and any suggested methods for minimizing respondent burden, including the use ofautomated collection techniques, EPA has established a public docket for this I CR under Docket

ID Number EPA

- HQ

- ORD

- 2013

- 0282, which is available for online viewing at www.regulations.gov , or in person viewing at the Office of Research & Development (ORD) Docket in the EPA Docket Center (EPA/DC), EPA West, Room 3334, 1301 Constitution Avenue, NW, Washington, D.C. The EPA Docket Center Public Reading Room is open from 8:30 a.m. to 4:30 p.m., Monday through Friday , excluding legal holiday s. The telephone number for the Reading Room is (202) 566

- 1744, and the telephone number for the ORD Docket is (202) 566

- 1752. An electronic version of the public docket is available at www.regulations.gov

. This site can be used to submit or view public c omments, access the index listing of the contents of the public docket, and to access those documents in the public docket that are available electronically

. When in the sy stem, select “search,” then key in the Docket ID Number identified above. Also, yo u can send comments to the Office of Information and Regulatory Affairs, Office of Management and Budget, 725 17th Street, NW, Washington, D.C. 20503, Attention: Desk Officer for EPA. Please include the EPA Docket ID Number EPA

- HQ

- ORD

2013

- 0282 and OMB Control Number 2080

-NEW in any correspondence.
**Part B of Supporting Statement 1. Survey Objectives, Key Variables, And Other Preliminaries**  (a) Survey

Objectives The objectives of the survey are bulleted below :  To estimate public values for changing the extent of the flow mileage and associated forest vegetation acreage along the effluent

- dominated Santa Cruz River.
 To estimate public values for full contact recreation in the effluent

- dominated Santa Cruz such as submersion , as a change from partial body contact recreation such as wading.
 To provide a case study for estimating public values for modifying river attributes of a waterway highly

impacted by urban processes

.  To compare estimated public values for changing attrib utes of two different reaches of the Santa Cruz River, the South and the North

.  To compare estimated public values between two population centers, the Phoenix metro area and the Tucson metro area. (b) Key Variables The survey

asks respondents whether they would choose a permanent tax increase for their household in exchange for changes in Santa Cruz River attributes. The key variables are: North Santa Cruz Flow and Forest: This is a bundled varia ble with two numeric values for each level specific to the North Santa Cruz. One number shows miles of surface flow , and another number shows acres of cottonwood/willow forest associated with that flow

. The survey considers three possible levels of this variable . The future baseline level is termed the “expected future”. Two different increases from the expected future are posed, the largest of which is the same as the current condition.North Santa Cruz Full Body Contact: This is a binary “Yes” or “No” variable specific to the surface flows in the North Santa Cruz. A “Yes” means the surface flow would be considered safe for full body contact at normal flow levels, including submersion. A “No” means the surface flow would be considered safe onl y for parti al body contact, i.e. wading, and normal flow levels. The Expected Future and Current Condition are both “No”, but the survey poses the possibility of a “Yes”. South Santa Cruz Flow and Forest: This is a bundled variable with two numeric values for each l evel specific to the South Santa Cruz. One number shows miles of surface flow, and another number shows acres of cottonwood/willow forest associated with that flow. The survey con siders three possible levels of this variable. The future baseline level is t ermed the “expected future”. Two different increases from the expected future are posed, the largest of which is the same as the current condition. South Santa Cruz Full Body Contact: This is a binary “Yes” or “No” variable specific to the surface flows in the South Santa Cruz. A “Yes” means the surface flow would be considered safe for full body contact at normal flow levels, including submersion. A “No” means the surface flow would be considered safe onl y for partial body contact, i.e. wading, and normal flow levels. The Expected Future and Current Condition are both “No”, but the survey poses the possibility of a “Yes”. Tax increase per ye ar: Each change varying from the e xpected future of reduced flows and cottonwood/willow acreages in the North and South has an associated cost. These cost levels currentl y vary from $0 for the Expected Future, to as high as $50 (subject to change based on pilot survey

results) . These cost levels are not tied to actual costs estimates for the changes, but rather are designed to bracket values. That is, the design goal is to set cost levels such that some people agree to them and some people don’t agree to them. A pilot survey will be used to test whether c ost levels posed in the survey should be revised. (c) Statistical Approach The statistical approach to anal yz ing survey results will be a multinomial logit model (Ben

Akiva and Lerman, 1985). (d) Feasibility The survey

has been extensively

pretested, a s described below, to reduce cognitive difficulties for respondents. The principal investigator has research funding to cover the costs of the survey

. **2. Survey Design** (a) Target Population And Coverage The target population is households of the Phoenix and Tucson metropolitan areas in southern Arizona. Respondent coverage will be such that each household in each respective area has an equal probability

of being selected to receive a survey , based on the mailing list

.(b) Sample Design

(i ) Sampling Frame The sample frame is households of the Phoenix and Tucson metropolitan areas in southern Arizona. A sample will be such that each household in each respective area has an equal probability

of being selected to receive a survey , based on be st available mailin g lists, available from companies specializing in preparing mail ing lists for survey s. (ii) Sample Size There is no single sample size choice since there will be uncertainty with estimates regardless of sample size. This survey

design will utilize the rule of thumb of available from the developers of S awtooth Software (Orme, 1998), a software popular for designing choice sets . This formula was also recently

utilized by

NOAA (OMB # 0648

- 0585). The rule of thumb formula for a minimum sample size is : (n × t × a)/c > = 500 Where: n = minimum number of respondents t = number choice questions a = number of alternatives per task (not including the “status quo” option) c = number of “anal ys is cells.” When considering main effects, c is eq ual to the largest number of levels for any single attribute. If considering all two

- way interactions, c is equal to the largest product of levels of any two attributes (Orme, 1998). The sample size will be based on a main effects model. A minimum of 3 choice questions will be in each survey , with two options each (not counting “expected future”), and the maximum number of levels for any single attribute is 3. Thus the minimum sample size “n” is 250 for each population to be sampled, and this is our target number of respondents for both the Phoenix and Tucson metro areas. This value is larger than the 200 minimum suggested when the intent is to compare subgroups (Orme, pg 67). Bateman et al. (2002; pg. 110) recommend a sample size of 500 to 1,000 (for each subgroup) for close

- ended contingent valuation questions, but also note a smaller sample size can be used if one collects more information per respondent (as with replications in choi ce experiments). With a target response rate of 30%, this means approximately 834 households in each metro area will receive a survey

. (iii) Stratification Variables The Phoenix and Tucson metro areas will be treated as different populations. (iv) Sampling Method A sample mailing list for each of the two metro areas will be purchased from a mail survey support company . The company will be given instructions to prepare the sample such that eachhousehold in each metro area has an equal chance of being ch osen (a simple random sample

approach). (v) Multi

- Stage Sampling Not applicable. (c) Precision Requirements (i ) Precision Targets Louviere et al. (2000) provide a formula, based on elementary statistical theory , for the minimum sample size “n” for target accuracy and confidence interval of predicting a proportion , assuming a l arge sample frame population, a simple random sample strategy is used , and choice occasions from each respondent can be assumed to be independent :

n > = (q/r pa2 )Φ - 1 ((1+α)/2) where “p” is the population pro portion, as predicted within “a” percent of the true value with probability

“ α ” or greater, “ q ” = 1

- p, “r ” is replications (choice occasions per respondent) and
“ Φ - 1 (.) ” is the inverse cumulative normal distribution function. This study will use a target of plus or minus 10% for predicting population proportion s to be estimated , with a probability of 0.95. Assuming a population proportion of 0.3, and a minimum r of 3, the minimum sample size is 174 respondents, less than the 250 sample size planned for each metro area. (ii) Nonsampling error With a target response rate of 30% there will be a large percentage of nonrespondents. If preferences of nonrespondents differ markedl y from respondents, nonrespons e bias will affect the results. A nonresponse anal ys is will be conducted by comparing the sociodemographics of the respondents with the sampling frame. A description of any sociodemographics that were less represented i n the responses will be included in the results writeup. If respondents and nonrespondents have markedly different sociodemographics, the sociodemographic vector of the sampling frame (as opposed to the respondents) will be fed into the model to obtain valuation estimates for an “average” household (Morrison, 2000).
(d) Questionnaire Design The current draft survey

is also uploaded to the federal register (note that the pages numbers are out of sequence on the electronic file, they are sequenced so that they will print correctly

double

sided) . Below is a description of the sections and questions. **PART 1 Background**  . The cover photo shows the result of a reduction in perennial stream length that has been recentl y documented on the Santa Cruz River. This ch ange has already occurred and is not a change considered in th e survey , but does pictorially shows a “before” and “after” view at asingle location. Page 2 shows the Santa Cruz River within the landscape of the broader river

network in Arizona, for perspec tive. Page 3 shows where the treated wastewater flow in the South and North reaches are in southern Arizona , background on how they came to exist, and introduces wh y these resources might be relevant to the respondent. Page 4 describes the partitioning of treated wastewater releases and the relativel y small fraction that is consumptively used by plants or that evaporates in the perennial river ecos ys tem. Page 5 describes the type of riparian forest that will be a topic in the survey , and some of the wildlif e that are found in that ty pe of habitat. Pages 6, 7, and 8 describe the different attributes that will be in the later choice questions. The “Expected Future” with no intervention is described as opposed to potential management changes. The first attribut e of management changes are those that would retain more of the current condition flow miles and riparian forest acres in the North or South. Representative photos are shown of the riparian area with and without perennial water, along with specified numeri c changes of flow mileage and forest acres that the survey will consider. Representative photos are shown for both South and North since the vegetation character is different; this difference is also described in the text and numerically in terms of acres of forest. Page 8 describes the second attribute of management changes, the safety of direct contact with the water in the South and North. The term Full Body Contact is equivalent to “swimmable” water quality but since the river reaches are typically not deep enough to swim in, we did not use the more familiar “swimmable” term since it could be misleading. Page 9 is an example vote showing the format of the choice question and page 10 describes how the attribute levels will be described. **PART 2 Question**  **1** : This question begins the respondent’s thought process of weighing the relative importance of the different attributes within the choice experiment in questions 2

- 6. **Questions 2 through 6** : These questions comprise the choice experiment portion of the survey , where respondents choose between different cost levels and different marginal changes in river

related attributes. There is alway s an opt
- out zero cost option. Following standard techniques of choice experiments, the options (also known as profiles ) participants choose between will be a fraction of the theoretically possible combinations of attributes, selected to yield the most informative preference information. There will be different survey versions, with five questions per survey

(also known a s “replications”), as an efficient method of allowing sufficient number of tradeoffs for model estimation. Different survey versions allow “blocking” the still large number of tradeoff questions posed into different groups. These practices save expense and also reduce the sample siz e and associated public burden. **Choice Experiment Design** All possible choice profile tradeoffs could be presented to respondents, but would be an inefficient way

to gauge preferences. Instead, “fractional factorial” models are a standard approach (Louviere et al. , 2000). A statistical software will be used to develop the most efficient choice experiment design, given a total number of design choice sets to manipulate, as well as a provisional beta vector (Kuhfeld, 2010). Essentially the software will search for the questions, given the constraint on choice sets, likely to yield the most preference information. The computer generated design will be manually checked for any

potentiall y dominating choices, or scenarios that may seem unlikely

to respondents. The total number of choic e sets must be at least as largeas the number of parameters to be estimated and is ty picall y much more. A number of choice sets that allows each level to occur an equal number of times is also desirable, f or balance (Kuhfeld, 2010; pg. 78). **PART 3 Questions**  **7 through**  **14** : These questions shed light on motivations for respondents’ answers, and also test for inconsistencies in their responses. Question 9 helps identify “protest bids”, that is, occasions when people choose not to pay for philosophical reasons rather than a price that is too high. Recreation behavior questions 12 and 13 allow insight into recreational preferences specific to the resources being considered. **PART 4 Questions 15 through 22**  : These are sociodemographic questions that allow comparing the received sample with the sample population as a gauge of representativeness. **3. PRETESTS AND PILOT TESTS Pretests**  The survey

content and format has undergone extensive pretesting. Several phases of qualitative survey development have occurred and are ongoing under a different I CR (ICR # 2090

- 0028). The earliest phases of survey development did not present study participants with a survey , instead the intention of those research sessions was to identify the most relevant variables to include . The first phase of qualitative cognitive interviews occurred in October 2011. Interviews were held with a convenience sample of 12 neighborhoo d presidents in Tucson. In the s pring of 2012, there were 10 focus groups in southern Arizona, with 8 in Tucson, 1 in Rio Rico, and 1 in Tubac. Focus group p articipants were recruited from the general public by a market research contractor using standard market research methods, including paying participants an incentive fee as compensation for their opportunity cost of time . At this stage participants were still not asked to take or react to a survey , but instead were asked to help ORD identify attributes important to them about southern Arizona rivers and streams, as well as for the Santa Cruz River in particular. The information from the above qualitative research was used to develop a first draft of a survey focusing on the North Santa Cruz, the reach nearest to southern Arizona population centers. This version was pretested in the fall of 2011. Cognitive interviews were conducted with 17 persons, all recruited from the general population of Tucson by a marke t research contractor, again paying incentive fees

. The survey draft included key

variables identified b y earlier qualitative research, but the list of attributes seemed to be near the limit for respondents to effectively conside r . In addition there were two attributes both dealing with forest acreage that were easil y confused . At the conclusion of the pretest, participants were asked to comment on the relative appeal of preserving the North Santa Cruz River versus the South Santa Cruz River, based on a map of their respective locations and representative photos of the two areas. Many participants preferred maintaining the South Santa Cruz location despite it being further away from Tucson. Based on these pretests it was decided to narrow the scope of attrib ute ty pes , and to feature both the North and South so as to include two different effluent

- dominated sections of the same river

.For the revised survey , the principal investigator requested and received u pdated natural science modeling of the relationship between surface water and forest acreage for the North and South Santa Cruz River (personal communication, J. Stromberg, May 2013)

. In the s pring of 2013, there were an additional 2 focus groups and 8 cognitive interviews , with one cognitive interview sti ll pending . One of the focus groups and 2 of the interviews were with people living in the Phoenix area , the pending interview is also with someone living in the Phoenix area , with one focus group and the remaining interviews being with persons living in the Tucson area. The survey booklet format and improved debriefing questions were adapted from a prior EPA survey (OMB # 2020

- 0283). The current draft survey instrument has also been uploaded to the federal register (note that the pages numbers are out of sequence on the electronic file, they are sequenced so that they

will print correctl y double

- sided)

. The current draft reflects several edits that were made durin g the latest round of pretests (which is still ongo ing)

. A primary change was revising the description of the full contact vs. partial contact recreation. It was originall y posed as “Safe” for contact recreation or “Unsafe” for contact rec reation. In the earl y sessions i t was found that people frequentl y f elt compelled to vote for “Safe ”, presuming there to be a significant public health hazard if the water was left “Unsafe”. The labeling in the choice experiment matrix was thus changed to the current “Yes” vs. “No” language, along with a fuller description of the attribute, which helped participants have a more accurate gras p of the issue . Another change was inclusion of more background describing
“ expected f

uture ” and the competing options. In particular, the revisions emphasized the difference with North and South forest which was not well

- conveyed for some respondents despite photo visual aids. Inaddition , color coding for attributes that remain at “expected f uture ” levels was used to make differences between cho ice questions clear at a glance; p reviousl y, many partic ipants described confusion that the series of choice questions appeared to be the same. **Pilot Test**  A pilot survey

will be mailed to a subset of the Phoenix and Tucson samples. This will not represent an additional burden, but will be some designated fraction of the total mailing. This will allow for the possibility of adjusting the survey

for any problems that may

surface after this initial wave of survey

returns before committing to the full mailing

. The entire beta parameter vector (see econometric specification section below) may be revised based on anal ys is of the results, in particular the cost levels may need to be adjusted to efficientl y bracket values. Costs will not vary

between the Phoenix and Tucson samples to guard against “ starting point bias ” as being a potential reason for any statistically significant changes in values between Phoenix and Tucson respondents. **4. COLLECTION METHODS AND FOLLOW**
**- UP** 

. **(a) Collection Methods** A mail survey collection method is selected due to its frequent and successful use in the choice experiment literature and its relatively low cost. **(b) Survey Response And Follow**
**- up** Multiple contact methods (Dillman, 2009; pg 242) will be used. Thus, those who have already

responded will be tracked in a spreadsheet to ensure follow

- up mailings are only sent to those who have not yet responded. **5. ANALYZING AND REPORTING SURVEY RESULTS (a) Data Preparation**  All data entry

will be conducted by

the Principal Investigator. Debriefing question responses that are at odds with voting question responses will be used to flag respondent confusion , and these data will not be used . Responses that indicate protest to the pay ment vehicle used in this survey , i.e. philoso phical objection to increased taxes, will not be used. Responses from persons less than 18 y rs of age as indicated from the ‘what year were you born’ question will not be used. **(b) Analysis** A standard multinomial logit model, as described by Ben

- Akiva and Lerman (1985), will be fit to the data. Let U = utility of household (well

- being). Consider U to be a function of a vector z in of attributes for alternative i , as perceived b y household respondent n . The variation of preferences b etween individuals is partially explained by a vector S

n of s ociodemographic characteristics for person n . U in = V ( z in , S n ) + ε ( z in , S n ) = V in + ε in The “ V ” term is known a s indirect utility and “ ε ” is an error term treated as a random variable (McFadden 1974), making utility itself a random variable. An individual is assumed to choose the option that maximizes their utility

. The choice probability of any particular option ( Expected Future, Option A, or Option B) is the probability that the utility

of that option is gre atest across the choice set C

n : P ( i │ C

n ) = Pr[ V

in + ε in ≥ V

jn + ε jn , for all j ∈ C

n , j not equal to i ] If error terms are assumed to be independentl y and identically distributed, and if this distribution can be assumed to be Gumbel , the above can be expressed in terms of the logistic distribution: Pn ( i) = e

μVin / ∑ e

μ Vjn The summation occurs over all options Jn in a choice set. The assumption of independent and identically

distribute d error terms implies independence of irrelevant attributes, meaning the ratio of choice probabilities for any two alternatives is unchanged b y addition or removal of other unchosen alternatives (Blamey et al. 2000). T he “

μ ” term is a scale parameter, a convenient value for which may

be chosen without affecting valuation results if the marginal utility of income is assumed to be linear. The anal ys t must speci fy the deterministic portion of the utility equation ‘‘V,’’ wi th subvectors z and S. The vector z comes from choice experiment attributes, and the vector S comes from attitudinal, recreational, and sociodemographic questions in the survey . An econometrics software will be used to estimate the regression coefficients for z and S,with a linear

- in

- parameters model specification. These coefficients are used in estimating

average household value for a change in one level to another level of a particular attribute for welfare estimation. Welfare of a change is given by (Ho lmes & Adamowicz 2003): $ Welfare = (1/β c )[V 0

- V 1 ] where β c is the c oefficient on cost, V 0 is an initial scenario, and V 1 is a change scenario. **Econometric Specification** A main effects utility

function is hy

pothesized for each of the Phoenix and Tucson metro area s. A generic format of the indirect utility function to be model ed is : V = β o + β 1 (North Flow & Forest Change ) + β 2 (North Full Contact Recreation Change ) + β 3 (South Flow & Forest Change ) + β 4 (South Full Contact Recreation Change ) + β 5 (Co st) **(c) Reporting Results** The results will be written up and submitted to a peer - reviewed environmental journal

.**References**

Arizona Department of Environmental Quality . 2010. Draft 2010 Status of Water Quality in Arizona 305(b) Assessment and 303(d) Listing Report. http://www.azdeq.gov/environ/water/assessment/assess.html . Retrieved March, 2013. Arrow, K., Solow, R., Leamer, E., Portney , P., Rander, R., Schuman, H., 1993. Report of the NOAA panel on contingent valuation. Federal Register 58(10): 4602

- 14. Bateman, I.J., R.T. Carson, B. Day , M. Hanemann, N. Hanley , T. Hett, M. Jones

- Lee, G. Loomes , S. Mourato, E. Ozdemiroglu, D.W. Pierce, R. Sugden, and J. Swanson. 2002. Economic Valuation with Stated Preference Survey s: A Manual . Northampton, MA: Edward Elgar. Ben

- Akiva, M., and S. R. L erman. 1985. Discrete choice anal ys is. MIT Press, Cambridge, Massachusetts. Berrens, R. P., A. K. Bohara, C. L. Silv a, D. Brookshire, and M. McKee. 2000. Contingent values for New Mex ico instream flows with test of scope, group - size reminder and t emporal reliability . Journal of Environmental Management 58:73

– 90. B lamey , R. K., J. W. Bennett, J. J. L ouviere, M. D. Morrison, and J. Rolfe. 2000. A test of policy labels in environmental choice modelling studies. Ecological Economics 32:269

–286. Bo yd, J., Banzhaf

, S., 2007. What are ecos ys tem services? The need for standardized environmental accounting units. Ecological Economics 63 (2

– 3), 616

– 626. Bo yd, J., Krupnick, A., September, 2009. The Definition and Choice of Environmental Commodities for Nonmarket Valuation Resources For the Future Discussion Paper 09

- 35. 60p. Brouwer, R. 2000. Environmental value transfer: state of the art and future prospects

. Ecological Economics 32(1): 137

- 152

. Bureau of Labor Statistics. 2011. http://www.bls.gov/oes/current/oessrcma.htm . Retrieved March, 2013. Desvousges, W.H., Naughton, M.C., and G.R. Parsons. 1992. Benefit transfer: conceptual proble ms in estimating water quality benefits using existing studies. Water Resources Research 28 (3), 675

– 683. Dillman, D. A., J.D. Smy

th, and L .M. Christian. Internet, Mail, and Mixed

- Mode Survey s: The Tailored Design Method. Third Edition. 2009. John Wiley & Sons, Inc., Hoboken, N.J. Frisvold, G., and T.W. Sprouse. 2006. Willingness t o Pay for Binational Effluent. Water Sustainability

Program. http://wsp.arizona.edu/node/277 . Retrieved May , 2012

.Hoehn, J.P., Lu pi, F., Kaplowitz , M.D

. , July , 2003. Untying a Lancastrian bundle: valuing ecos ys tems and ecos ys tem services for wetland mitigation. Journal of Environmental Management 68(3): 263

- 272. Holmes, T. P., and W. L . Adamowicz. 2003. Attribute

- based methods. Pages 171

–220 in P. A. Champ, K. J. Boyle, and T. C. Brown, editors

. A primer on nonmarket valuation. Chap . 6. Kluwer Academic Publishers, The Netherlands. Johnston, R.J., Weaver, T.F., Smith, L .A., Swallow, S.K., April, 1995. Contingent Valuation Focus Groups: Insights from Ethnographic Interview Techniques. Agricultural and Resource Economics Review , 56

- 68. Kaplowitz, M.D., Hoehn, J.P., February , 2001. Do focus groups and individual interviews reveal the same information for natural resource valuation? Ecological Economics 36(2): 237

- 247. Kuhfeld, W.F. 2010. Marketing Research Methods in SAS. SAS 9.2 Edition, MR

- 2010. Available for download at: http://support.sas.com/techsup/technote/mr2010.pdf

. McFadden, D. 1974. Conditional logit analy sis of qualitative choice behavior. Pages 105

– 142 in P. Zarembka, edi tor. Frontiers in econometrics. Chap. 4. Academic Press, New York. Morrison, M. 2000. Aggregation biases in stated preference studies. Australian Economic Papers 39: 215

–230. Louviere, J.J., D.A. Hensher, and J.D. Swait. 2000. Stated Choice Methods: Analy sis and Application. Cambridge University Press. 402 p. Morgan, D.L., and R.A. Kruege r. 1998. Focus Group Kit (6 volumes). Sage Publications, Thousand Oaks, CA. NOAA Office of Habitat Conservation and Office of Response and Restoration, and Stratus Consulting. 2012. Ecosy stem Valuation Workshop (binder prepared for workshop participants). Dates: June 6

- 7, 2012. Location: Asheville, N.C. Norman, L.M.; N. Tallent

- Halsell, W. L abiosa, M. Weber, A. McCoy , K. Hirschboeck, J. Callegary , C. van Riper III, and F. Gray . 2010. Developing an Ecos ys tem Services Online Decision Support Tool to Assess the Impacts of Climate Change and Urban Growth in the Santa Cruz Watershed; Where We Live, Work, and Play. Sustainability 2(7):2044

- 2069. NSF. 2010. Press Release 10

- 182 : NSF Awards Grants for Study of Water Sustainability

and Climate

. http://www.nsf.gov/news/news_summ.jsp?cntn_id=117819 . Retrived April, 2013. Orme, B. 1998. Sample Size I ssues for Conjoint Analy sis Studies. Sawtooth Software Research Paper Series, Sawtoo th Software, Inc.Ringold, P.L ., Boyd, J.W., L anders, D., Weber, M., Meeting Date: July 13 to 16, 2009. Report from the Workshop on Indicators of Final Ecos ys tem Services for Streams. EPA/600/R

- 09/137. 56 p. http://www.epa.gov/nheerl/arm/streameco/index.html Ringold, P.L ., J. Boyd, D. Lan ders, and M. Weber. 2013. What data should we collect? A framework for identifying indicators of ecos ys tem contributions to human well

- being. Frontiers in Ecology

and the Environment 11 : 98

– 105

. Rubin, H.J., Rubin, I .S, 2005. Qualitative Interviewing. 2nd Edition. Sage Publications. Thousand Oaks, CA. USEPA. 2013a. Research Programs: Science for a Sustainable Future. http://www.epa.gov/ord/research

- programs.htm . Retrieved April, 2013. US EPA. 2013 b . Sustainability

. http://www.epa.gov/sustainability / . Retrieved April, 2013. Weber, M., Stewart , S

. , 2009. Public Valuation of River Restoration Options on the Middle Rio Grande. Restoration Ecology 17(6):762

- 771. White, M.S. 2011. Effluent

- Dominated Waterways in the Southwestern United States: Advancing Water Policy through Ecological Analysi s. Ph.D. Dissertation, Arizona State University

. 244p.