Document ID: EPA-HQ-OA-2008-0701-0004
Agency: epa
Document Type: Supporting & Related Material
Title: 
Posted Date: 2008-11-28T05:00Z

FOCUS GROUPS AS USED BY EPA FOR ECONOMICS PROJECTS (Renewal)

EPA ICR No. 2205.02

SUPPORTING STATEMENT

Part A

Section 1.  Identification of the Information Collection

1(a)  Title of the Information Collection:

Focus Groups as Used by EPA for Economics Projects (Renewal)

1(b)  Short Characterization/Abstract:

The Environmental Protection Agency (EPA) is seeking approval for a
generic information collection request (ICR) for the conduct of focus
groups and one-on-one interviews related to survey development for
economics projects.   Focus groups are groups of individuals brought
together for moderated discussions on a specific topic or issue.  These
groups are typically formed to gain insight and understanding of
attitudes and perceptions held by the public surrounding a particular
issue.  One-on-one interviews, as the term implies, are individual
interviews in which a respondent is generally asked to review materials
and provide feedback on their content and design as well as the thought
processes that the materials invoke.

Focus groups and one-on-one interviews (hereafter referred to
collectively as “focus groups”) used as a qualitative research tool
have three major purposes:

To better understand respondents’ attitudes, perceptions and emotions
in response to specific topics and concepts;

To obtain respondent information useful for better defining variables
and measures in later quantitative studies; and

To further explore findings obtained from quantitative studies.

Through these focus groups, the Agency will be able to gain a more
in-depth understanding of the public’s attitudes, beliefs, motivations
and feelings regarding specific issues and will provide invaluable
information regarding the quality of draft survey instruments.  Focus
group discussions are necessary and important steps in the design of a
quality survey.

Section 2.  Need for and use of the Collection

2(a)	Need/Authority for the Collection

Over the next three years, the Agency anticipates embarking on a number
of survey development efforts associated with a variety of economics
projects including those related to valuation of ecosystems,
children’s health risks, improvements to coastal waters, and invasive
species to name a few.  Focus groups are an important part of any survey
development process, allowing researchers to directly gauge what
specific issues are important to the public and providing a means for
explicitly testing draft survey materials.  

If this information is not collected, a vital link in developing methods
to better understand the economic benefits and costs associated with
Agency actions will be lost.   This loss will cause further delays in
the development of improved estimates of benefits and costs.

This data collection is conducted for research purposes; there are no
legal requirements.  The materials prepared for these discussions will
fully conform to federal regulations – specifically the Privacy Act of
1974 (5 U.S.C. 552a), the Hawkins-Stafford Amendments of 1988 (P.L
100-297), and the Computer Security Act of 1987.

2(b)	Practical Utility/Users of the Data

The information collected in the focus groups will be used to develop
and improve economics-related surveys.  To the extent that these surveys
are ultimately successfully administered, they will serve to expand the
Agency’s understanding of benefits and costs of a variety of actions
and could provide the means to quantitatively assess the effects of
others.  Participation in the focus groups will be voluntary and the
identity of the participants will be kept confidential.

Focus groups generally do not yield meaningful quantitative findings and
do not yield data about public opinion that can be generalized.  As
such, they cannot be used directly to estimate benefits and costs
associated with a specific environmental action.  However, program
offices engaged in survey research use focus groups as an important tool
in the survey development process to test and refine their ideas.  The
conduct of quantitative research would need to be completed to develop
new estimates of benefits or costs.

Section 3.  Non duplication, Consultations, and Other Collection
Criteria

3(a)	Non duplication

It is not expected that any of the information to be submitted to the
EPA during these focus group studies is duplicative or is already in the
possession of the Federal Government.  The proposed focus groups will
address the needs of the Agency and significantly improve our ability to
test and redefine ideas that will allow EPA to conduct further
quantitative research on various environmental economics issues.

3(b)	Public Notice Required Prior to ICR Submission to OMB

On September 23, 2008 (73 FR 54798), EPA sought comments on this ICR
pursuant to 5 CFR 1320.8(d).  EPA received no comments.  Any additional
comments on this ICR should be submitted to EPA and OMB within 30 days
of this notice.

3(c) 	Consultations

EPA will use in-house staff and/or outside contractors (including
possible contacts with the academic community) to develop focus group
plans for areas of interest.  According to OMB guidelines for generic
clearances for focus groups, EPA will establish an independent review
process to assure the development and implementation of high quality
focus groups by EPA.  EPA will provide OMB a copy of the survey
instrument for inclusion in the public docket.

3(d)	Effects of Less Frequent Collection

	Each focus group will be a one-time collection exercise for the
enrolled participants.

3(e)	General Guidelines

This collection does not violate any of OMB’s general guidelines for
information collections.

Information will be collected according to the guidelines in 5 CFR 1320.
 Respondents will be asked to participate in one focus group and their
participation will be voluntary. There will be no need for participants
to maintain records or submit documents or proprietary trade secrets. 
There will be complete protection of any demographic information
collection from participant—full names, phone numbers and addresses
will not be associated with responses.  

EPA has developed EPA Information Quality Guidelines (2002) to ensure
the utility, objectivity and integrity of information that is
disseminated by the Agency.  It is EPA’s intention that collection of
information under this ICR will result in information that will be
collected, maintained, and used in ways consistent with both the EPA
Information Quality Guidelines (2002) and the OMB Information Quality
Guidelines (2002).   EPA intends to conduct a pre-dissemination review
when the Agency prepares to disseminate information collected under this
ICR.

3(f)	Confidentiality

Each focus group will fully conform to federal regulations –
specifically the Privacy Act of 1974 (5 U.S.C. 552a), the
Hawkins-Stafford Amendments of 1988 (P.L 100-297), and the Computer
Security Act of 1987.  

3(g) 	Sensitive Questions

No questions will be asked that are of a personal or sensitive nature.

Section 4.  The Respondents and the Information Requested

4(a)	Respondents/SIC Codes

The target population for the focus group discussions will vary by
project, but will generally include members of the general public.

4(b)	Information Requested

Data items, including record keeping requirements

Respondent Activities

Respondents will be asked to participate in a moderated discussion on a
particular topic or issue, during which they will be asked their
thoughts, perceptions and beliefs regarding the issue.  The collection
will be a one time event and there will be no need for participants to
maintain records or submit documents or proprietary trade secrets. 
There will be complete protection of any demographic information
collection from participants -- names, phone numbers and addresses will
not be associated with responses.

Section 5.  The Information Collected – Agency Activities, Collection
Methodology, and Information Management

5(a) Agency Activities

Agency activities associated with this information collection will
include:

-- Drafting focus groups scripts and accompanying materials

-- Observing and in some cases moderating the focus group discussions

-- Summarizing focus group results and making changes to draft survey
materials as appropriate

In addition, the Agency will establish a three-member cross-office panel
to review focus group projects proposed under this ICR.  Membership on
the panel will be on a rotational basis and will consist of one
economist from the Office of Policy, Economics, and Innovation’s
National Center for Environmental Economics and two other economists
from elsewhere in the Agency.  Each of the panel members will have
experience with surveys.  Only projects that have as their primary goal
the estimation of benefits, the estimation of costs, or the elicitation
of preferences for health outcomes, safety and/or environmental goods
will be considered.  Additional details about the panel review process
can be found in the Appendix 2.  

5(b) Collection Methodology and Management

Focus group studies are directed group discussions that do not produce
quantitative data, but which enable skilled observers to infer the
underlying views and assumptions of the group that are expressed in the
discussion.  To facilitate interpretation, discussions are generally
recorded and videotaped so that both a visual record and written
transcript of the discussion are available for review.  Participants are
informed in advance that the sessions will be recorded.  Transcripts and
video tapes will be maintained in the individual project files.

5(c) Small Entity Flexibility

No information will be collected from small businesses or small
organizations or small governmental jurisdictions as a result of this
information collection.

5(d) Collection Schedule

Focus groups will be scheduled according to the needs of individual
projects.  No firm schedule for this collection has been established
otherwise.

Section 6.  Estimating the Burden and Cost of Collection

6(a)	Estimating Respondent Burden

6(b)	Estimating Respondent Costs

Estimates of respondent burden were derived from projected focus group
usage over the next three years.  Each program office was asked for the
number and size of the focus groups that they anticipate conducting for
economics projects over the next three years.  The total estimated
hourly burden imposed by this collection of information over the next
three years is approximately 2,358 hours or approximately 786 hours
annually. The total burden per year is valued at approximately $22,385. 
There are no capital costs or operating and maintenance costs associated
with this collection.

TABLE 1. – Average Annual Respondent Burden and Costs1

Center	

Subject	

Approximate Number of Studies	

Average Number  of Focus Groups per Study

	

Average Number of Participants per Group	

Average Hours of Duration for Each Group (includes screening)

	

Total Estimated “Respondent” Hours 

Over next 3 years

	

Total Estimated

Burden per Year ($)

Office of Policy, Economics and Innovation	

Various (e.g, coastal water valuation, children’s health valuation,
ecosystem valuation, air toxics)	

6	

10.5	

9	

2.0	

1,134	

$10,765

Office of Pollution Prevention and Toxics	

Various (e.g.,implications of chemical substitutes, consumer chemical
use)	

4	

12.5	

6	

3.0	

900	

$8,544

Office of Water	

Various (e.g.,value of information on beach closures and fish
advisories)

	

2	

8	

9	

2.25	

324	

$3,076

	

TOTAL

	

2,358

	

$22,385

1  There are no capital costs or operating and maintenance costs
associated with this collection of information.	

2  Hourly rate ($28.48) from “Total Employer costs per hour worked for
employee compensation and costs as a percent of total compensation:
Civilian workers, by major occupational and industry group, June 2008.
U.S. Department of Labor, Bureau of Labor Statistics.

6(c)	Estimating Agency Burden and Costs

The Agency incurs costs to develop the focus group materials, organize
and conduct focus group discussions, and observe focus group
discussions.  These expenses will vary by specific project.  The table
below provides a hypothetical assessment of what the costs might be per
year based on a number of assumptions regarding the level of effort
required.  EPA person-costs are estimated using an hourly rate for a
GS-14 (step 1) based in Washington, DC.  Time spent on each step may
vary as well as the GS-level of the employees involved.  Contractor
costs will also depend on the location of focus groups, degree of
involvement in materials preparation and whether written transcripts of
each focus group are required.  The estimates presented below assume
that the Agency prepares all of the materials and that approximately 3
individuals observe each focus group. 

Estimated Average Annual Agency Burden and Costs

Task	Costs (and Person-hours) Per Focus Group Hour	Total Hours and Cost

	EPA

($46.97/

Hour)	Estimated Contractor Costs1	O&M Cost	Number of focus group
hours/year.	Total Cost/Year

Prepare Materials for Focus Group Discussion	$939

(20 hrs)	

--	

--	

125	

$117,375

Organize and conduct focus group discussion

(contractor)	--	

$4,500	

--	

125	

$562,500

Observe focus group discussion	$141

(3 hrs)

	--	--	

125	

$17,625

Total

	

$1,080	

$4,500	--	

125	

$697,500

Notes:  1includes recruiting respondents, meeting space, respondent
reimbursement for approximately 9 participants, and recording of
discussion.

6(d)	Estimating the Respondent Universe and Total Burden and Costs

6(e)	Bottom Line Burden Hours and Cost Tables

We expect respondent focus group hours to total 2,358 over the next 3
years or 786 each year.  These hours will be spread over approximately
129 focus groups over the course of the 3-year time frame.

Respondent Tally

Action	Approximate Number of Focus Groups per year	 Estimated Respondent
Hours per Year	Total labor Cost per Year	Total Annual Capital Costs
Total Annual O&M costs

Focus Group Discussion	43	786	$22,385	$0	$0

Agency Tally

	Approximate Number of Focus Groups per year	Estimated Focus Group Hours
per year	Total Capital/Startup Cost Per Year	Total Labor Cost per Year
Total Annual Cost 

Focus Group Discussion	43	125	$562,500	$135,000	$697,500

6(f)	Reasons for Change in Burden

There is a decrease of 214 hours in the annual estimated burden
currently identified in the OMB Inventory of Approved ICR Burdens.  This
decrease is based on new estimates provided by the program offices at
EPA on their projected use of focus groups.

6(g) 	Burden Statement

As noted previously, we expect respondent focus group hours to total
about 2,358 over the next 3 years or 786 hours each year.  These hours
will be spread over approximately 129 focus groups over the course of
the 3-year time frame.  The approximate respondent burden for this
collection comes to $22,385 per year whereas the annual Agency burden is
approximately $697,500.

Burden means the total time, effort, or financial resources expended by
persons to generate, maintain, retain, or disclose or provide
information to or for a Federal agency.  This includes the time needed
to review instructions; develop, acquire, install, and utilize
technology and systems for the purposes of collecting, validating, and
verifying information, processing and maintaining information, and
disclosing and providing information; adjust the existing ways to comply
with any previously applicable instructions and requirements; train
personnel to be able to respond to a collection of information; search
data sources; complete and review the collection of information; and
transmit or otherwise disclose the information.  An Agency may not
conduct of sponsor, and a person is not required to respond to, a
collection of information unless it displays a currently valid OMB
control number.  The OMB control number for EPA’s regulations are
listed in 40 CFR Part 9 and 48 CFR Chapter 15.

Send comments on the Agency’s need for this information, the accuracy
of the provided burden estimates, and any suggested methods for
minimizing respondent burden, including through the use of automated
collection techniques to the Director, Collection Strategies Division,
U.S. Environmental Protection Agency (2822T), 1200 Pennsylvania Ave.,
NW, Washington, D.C. 20460; and to the Office of Information and
Regulatory Affairs, Office of Management and Budget, 725 17th Street,
NW, Washington, D.C. 20503, Attention: Desk Officer for EPA.  Include
the EPA ICR number and OMB control number in any correspondence.



Part B.

There are no tabulated results for this information collection.

Information gathered from focus groups is qualitative in nature.  They
allow for a more in-depth understanding of respondents’ attitudes,
beliefs, motivations, and feelings than do quantitative studies. It
serves the narrowly defined need for direct and informal opinion on a
specific topic.

Appendix 1

Agency Information Collection Activities; Proposed Collection; Comment
Request; Focus Groups as Used by EPA for Economics Projects (Renewal);
EPA ICR No. 2205.02, OMB Control No. 2090-0028 

  HYPERLINK
"http://www.epa.gov/fedrgstr/EPA-AIR/2008/September/Day-23/a22243.pdf" 
PDF Version  (3 pp, 83K,   HYPERLINK
"http://www.epa.gov/epahome/pdf.html"  About PDF )

[Federal Register: September 23, 2008 (Volume 73, Number 185)]

[Notices]

[Page 54798-54800]

From the Federal Register Online via GPO Access [wais.access.gpo.gov]

[DOCID:fr23se08-59]

-----------------------------------------------------------------------

ENVIRONMENTAL PROTECTION AGENCY

[EPA-HQ-OA-2008-0701; FRL-8718-4]

Agency Information Collection Activities; Proposed Collection;

Comment Request; Focus Groups as Used by EPA for Economics Projects

(Renewal); EPA ICR No. 2205.02, OMB Control No. 2090-0028

AGENCY: Environmental Protection Agency (EPA).

ACTION: Notice.

-----------------------------------------------------------------------

SUMMARY: In compliance with the Paperwork Reduction Act (PRA) (44

U.S.C. 3501 et seq.), this document announces that EPA is planning to

submit a request to renew an existing approved Information Collection

Request (ICR) to the Office of Management and Budget (OMB). This ICR is

scheduled to expire on November 30, 2008. Before submitting the ICR to

OMB for review and approval, EPA is soliciting comments on specific

aspects of the proposed information collection as described below.

DATES: Comments must be submitted on or before November 24, 2008.

ADDRESSES: Submit your comments, identified by Docket ID No. EPA-HQ-OA-

2008-0701, by one of the following methods:

    •   HYPERLINK "http://www.regulations.gov" 
http://www.regulations.gov : Follow the on-line instructions

for submitting comments.

    • E-mail:   HYPERLINK "mailto:oei.docket@epa.gov" 
oei.docket@epa.gov .

    • Fax: (202) 566-9744

    • Mail: Office of Environmental Information, Environmental

Protection Agency, Mailcode: 28221T, 1200 Pennsylvania Ave., NW.,

Washington, DC 20460.

    Instructions: Direct your comments to Docket ID No. EPA-HQ-OA-2008-

0701. EPA's policy is that all comments received will be included in

the public docket without change and may be made available online at

  HYPERLINK "http://www.regulations.gov"  http://www.regulations.gov ,
including any personal information

provided, unless the comment includes information claimed to be

Confidential Business Information (CBI) or other information whose

disclosure is restricted by statute. Do not submit information that you

consider to be CBI or otherwise protected through   HYPERLINK
"http://www.regulations.gov"  www.regulations.gov 

or e-mail. The   HYPERLINK "http://www.regulations.gov" 
http://www.regulations.gov  Web site is an ``anonymous

access'' system, which means EPA will not know your identity or contact

information unless you provide it in the body of your comment. If you

send an e-mail comment directly to EPA without going through   HYPERLINK
"http://www.regulations.gov"  http://

www.regulations.gov  your e-mail address will be automatically captured

and included as part of the comment that is placed in the public docket

and made available on the Internet. If you submit an electronic

comment, EPA recommends that you include your name and other contact

information in the body of your comment and with any disk or CD-ROM you

submit. If EPA cannot read your comment due to technical difficulties

and cannot contact you for clarification, EPA may not be able to

consider your comment. Electronic files should avoid the use of special

characters, any form of encryption, and be free of any defects or

viruses. For additional information

[[Page 54799]]

about EPA's public docket visit the EPA Docket Center homepage at

  HYPERLINK "http://www.epa.gov/epahome/dockets.htm" 
http://www.epa.gov/epahome/dockets.htm .

FOR FURTHER INFORMATION CONTACT: Nathalie Simon, Office of Policy

Economics and Innovation, (MC 1809T), Environmental Protection Agency,

1200 Pennsylvania Ave., NW., Washington, DC 20460; telephone number:

202-566-2347; fax number: 202-566-2363; e-mail address:

  HYPERLINK "mailto:simon.nathalie@epa.gov"  simon.nathalie@epa.gov .

SUPPLEMENTARY INFORMATION:

How Can I Access the Docket and/or Submit Comments?

    EPA has established a public docket for this ICR under Docket ID

No. EPA-HQ-OA-2008-0701 which is available for online viewing at  
HYPERLINK "http://www.regulations.gov"  

http://www.regulations.gov , or in person viewing at the Office of

Environmental Information (OEI) Docket in the EPA Docket Center (EPA/

DC), EPA West, Room 3334, 1301 Constitution Ave., NW., Washington, DC.

The EPA/DC Public Reading Room is open from 8 a.m. to 4:30 p.m., Monday

through Friday, excluding legal holidays. The telephone number for the

Reading Room is 202-566-1744, and the telephone number for the OEI

Docket is 202-566-1752.

    Use   HYPERLINK "http://www.regulations.gov" 
http://www.regulations.gov  to obtain a copy of the draft

collection of information, submit or view public comments, access the

index listing of the contents of the docket, and to access those

documents in the public docket that are available electronically. Once

in the system, select ``search,'' then key in the docket ID number

identified in this document.

What Information Is EPA Particularly Interested in?

    Pursuant to section 3506(c)(2)(A) of the PRA, EPA specifically

solicits comments and information to enable it to:

    (i) Evaluate whether the proposed collection of information is

necessary for the proper performance of the functions of the Agency,

including whether the information will have practical utility;

    (ii) Evaluate the accuracy of the Agency's estimate of the burden

of the proposed collection of information, including the validity of

the methodology and assumptions used;

    (iii) Enhance the quality, utility, and clarity of the information

to be collected; and

    (iv) Minimize the burden of the collection of information on those

who are to respond, including through the use of appropriate automated

electronic, mechanical, or other technological collection techniques or

other forms of information technology, e.g. , permitting electronic

submission of responses. In particular, EPA is requesting comments from

very small businesses (those that employ less than 25) on examples of

specific additional efforts that EPA could make to reduce the paperwork

burden for very small businesses affected by this collection.

What Should I Consider When I Prepare My Comments for EPA?

    You may find the following suggestions helpful for preparing your

comments:

    1. Explain your views as clearly as possible and provide specific

examples.

    2. Describe any assumptions that you used.

    3. Provide copies of any technical information and/or data you used

that support your views.

    4. If you estimate potential burden or costs, explain how you

arrived at the estimate that you provide.

    5. Offer alternative ways to improve the collection activity.

    6. Make sure to submit your comments by the deadline identified

under DATES.

    7. To ensure proper receipt by EPA, be sure to identify the docket

ID number assigned to this action in the subject line on the first page

of your response. You may also provide the name, date, and Federal

Register citation.

What Information Collection Activity or ICR Does This Apply to?

    Docket ID No. EPA EPA-HQ-OA-2008-0701

    Affected entities: Entities potentially affected by this action are

members of the general public, although the target population for the

focus group discussions will vary by project.

    Title: Focus Groups as used by EPA for Economics Projects (Renewal).

    ICR numbers: EPA ICR No. 2205.02, OMB Control No. 2090-0028.

    ICR status: This ICR is currently scheduled to expire on November

30, 2008. An Agency may not conduct or sponsor, and a person is not

required to respond to, a collection of information, unless it displays

a currently valid OMB control number. The OMB control numbers for EPA's

regulations in title 40 of the CFR, after appearing in the Federal

Register when approved, are listed in 40 CFR part 9, are displayed

either by publication in the Federal Register or by other appropriate

means, such as on the related collection instrument or form, if

applicable. The display of OMB control numbers in certain EPA

regulations is consolidated in 40 CFR part 9.

    Abstract: The Environmental Protection Agency (EPA) is seeking

renewal of a generic information collection request (ICR) for the

conduct of focus groups and protocol interviews (hereafter jointly

referred to as focus groups) related to economics projects. Over the

next three years, the Agency anticipates embarking on a number of

survey development efforts associated with a variety of economics

projects including those related to valuation of ecosystems, children's

health risks, improvements to coastal waters, and invasive species to

name a few. Focus groups are an important part of any survey

development process, allowing researchers to directly gauge what

specific issues are important to the public and providing a means for

explicitly testing draft survey materials. Through these focus groups,

the Agency will be able to gain a more in-depth understanding of the

public's attitudes, beliefs, motivations and feelings regarding

specific issues and will provide valuable information regarding the

quality of draft survey instruments.

    The information collected in the focus groups will be used to

develop and improve economics-related surveys. To the extent that these

surveys are ultimately successfully administered, they will serve to

expand the Agencies understanding of benefits and costs of a variety of

actions and could provide the means to quantitatively assess the

effects of others. Participation in the focus groups will be voluntary

and the identity of the participants will be kept confidential.

    Burden Statement: The annual public reporting and recordkeeping

burden for this collection of information is estimated to average 2.4

hours per response. Burden means the total time, effort, or financial

resources expended by persons to generate, maintain, retain, or

disclose or provide information to or for a Federal agency. This

includes the time needed to review instructions; develop, acquire,

install, and utilize technology and systems for the purposes of

collecting, validating, and verifying information, processing and

maintaining information, and disclosing and providing information;

adjust the existing ways to comply with any previously applicable

instructions and requirements which have subsequently changed; train

personnel to be able to respond to a collection of information; search

data sources; complete and review the collection of information; and

transmit or otherwise disclose the information.

    The ICR provides a detailed explanation of the Agency's estimate,

which is only briefly summarized here:

[[Page 54800]]

    Estimated total number of potential respondents: 1758.

    Frequency of response: Once.

    Estimated total average number of responses for each respondent: 1.

    Estimated total annual burden hours: $30,147.

    Estimated total annual costs: $30,147. This includes estimated

burden costs only as there are no capital costs or operating and

maintenance costs associated with this collection of information.

Are There Changes in the Estimates From the Last Approval?

    Burden estimates included here are based on the supporting

statement submitted for the original, approved ICR. Burden estimates

will be revised to reflect new information and will be made available

for public comment at the time the ICR is submitted to OMB for approval.

What is the Next Step in the Process for This ICR?

    EPA will consider the comments received and amend the ICR as

appropriate. The final ICR package will then be submitted to OMB for

review and approval pursuant to 5 CFR 1320.12. At that time, EPA will

issue another Federal Register notice pursuant to 5 CFR

1320.5(a)(1)(iv) to announce the submission of the ICR to OMB and the

opportunity to submit additional comments to OMB. If you have any

questions about this ICR or the approval process, please contact the

technical person listed under FOR FURTHER INFORMATION CONTACT.

    Dated: September 15, 2008.

Brett R. Snyder,

Acting Director, National Center for Environmental Economics.

[FR Doc. E8-22243 Filed 9-22-08; 8:45 am]

BILLING CODE 6560-50-P

Appendix 2

Proposed Process for Review of Focus Group Submissions 

Under Generic ICR “Focus Groups as Used by EPA for Economics
Projects” 

A cross-office, standing panel will be created, consisting of three
economists with survey experience, to review requests from individuals
or teams wishing to conduct focus groups under the generic ICR.   One
member of the panel will be from NCEE.  Nominations for the other two
seats will be solicited from the Program offices through the Econ Forum
and will be decided by the Econ Forum Steering Committee.  Membership on
the panel will be on a rotational basis with each member appointed to a
1-year term.  Members will be permitted to serve up to five, consecutive
terms, but must then step down for a 12-month period before serving in
this capacity again.  In order to prevent wholesale turn-over of the
panel at one time, the following maximum term limits may be applied to
members of the first panel (if needed):

NCEE – no more than 3 consecutive terms

Program Office #1 – no more than 4 consecutive terms

Program Office #2 – no more than 5 consecutive terms.

Only relevant projects will be considered.  Relevant projects are
defined as those with an economics component.  That is, they must have
as their primary goal the estimation of benefits, the estimation of
costs, or the elicitation of preferences for health outcomes, safety
and/or environmental goods.  

Projects submitted for consideration must be entered into the Science
Inventory Database.  The Science Inventory Database is a publicly
searchable database designed to track and report peer review and other
science activities across the Agency.  Peer review work products are
divided into three categories: highly influential scientific
assessments, influential scientific information and other products. 
Creating an entry in the database will allow more public scrutiny of the
proposed research and will allow the project to be reflected in the
Agency’s Annual report to OMB summarizing peer review activities.  

Entries should clearly indicate whether or not the survey under
development will yield data that is expected to be "highly influential."
 According to EPA’s Science Policy Council Peer Review Handbook,
influential scientific or technical work products are those expected to
have “a major impact, [involve] precedential, novel, and/or
controversial issues, or the Agency has a legal and/or statutory
obligation to conduct a peer review.”  Highly influential scientific
assessments are those that “could have a potential impact of more than
$500 million in any year,” or that are considered “novel,
controversial, or precedent-setting or has significant interagency
interest.”  Our reading of these definitions would place all surveys
in the “influential scientific assessments” category. The
classification of a specific survey as “highly influential” will
need to be determined on a case by case basis.  Most surveys developed
specifically for direct input into an economic analysis for a rule or
regulation will be considered “highly influential.” However, other
survey activities could also be considered “highly influential”
depending on the subject matter. 

Supporting statements, clearly indicating peer review plans, must
accompany each request.  Individuals or teams wishing to submit a
project for consideration under this generic ICR must submit a draft
supporting statement for review by the standing panel.  Since focus
group results are not expected to yield data that can be analyzed
statistically, only Part A of the supporting statement will be expected.

In addition to the other standard requirements of the supporting
statement, the document should clearly describe the need for and purpose
of the project as well as the projected peer-review plan to assess the
quality of any resulting survey instruments.  For highly influential
projects, an external peer review panel process, as recommended by the
EPA Peer Review Handbook, will be expected under this generic ICR.  This
panel review could take one of two forms: periodic consultations with
experts in the field throughout the survey development process or a
panel review of the survey development process in advance of submitting
an ICR to OMB should the project advance to that stage.  

Time-lines for project completion should accompany the supporting
statement, highlighting hard deadlines where they exist. In assessing
the project, the review panel will consider whether in their view there
is sufficient and reasonable time to complete the survey development
given these timing constraints.  As separate ICR approval will be
required for administration of the survey once developed, the submitted
timeline should reflect the date by which the project team expects to
file the ICR for anticipated survey administration.

 PAGE   

 PAGE   1