> OMB 0990-0115

**PART I - THE SCHEDULE** Request for Proposal

**SECTION A - SOLICITATION FORM** No. AHRQ-01-0006

Date Issued: **May 17, 2001**

Questions and Notice of Intent

Due: **June 6, 2001**

Proposal Due: **July 6, 2001**

You are invited to submit a proposal to the Agency for Healthcare
Research and Quality (AHRQ) for Request for Proposal (RFP) No.
AHRQ-01-0006, entitled "**National Quality Measures Clearinghouse**,"
formerly called the "National Measures Clearinghouse. Your proposal must
be developed and submitted in accordance with the requirements and
instructions of this RFP.

A Performance Based Cost Plus Award Fee Completion type of contract is
contemplated for a period of four (4) years. The planned performance
period of this contract is from September 17, 2001 to September 16,
2005.

**[NOTICE OF SMALL BUSINESS GOALS:]{.underline}** All offerors (other
than small businesses) must submit a complete subcontracting plan with
their initial proposal. The requirement to submit a subcontracting plan
also applies to colleges, universities, and non-profit organizations, as
well as large business concerns. AHRQ recommended goal (as a percentage
of total contract value for the base period) is **23% for Small
Businesses,** which shall include at least **5%** (as a percentage of
total contract value for the base period) for **Small Disadvantaged
Businesses,** and at least **5%** (as a percentage of total contract
value for the base period) for **Women-Owned Small Businesses,** and at
least **2%** (as a percentage of total contract value) for **HUBZone
Small Businesses.** These goals represent AHRQ's expectation of the
minimum level for subcontracting with small businesses at the prime
contract level. Any goal stated less than the AHRQ recommended goal
shall be justified and is subject to negotiation. A copy of the AHRQ
model subcontracting plan is provided as an attachment to this
solicitation. If the model is not used, all elements outlined must be
addressed in the offeror's format. **If the offeror is not a small
business and fails to submit a subcontracting plan with the initial
proposal, the offeror will be considered non-responsive and their
proposal will be returned without further consideration**. The approved
plan will be included in any resultant contract.

Offerors shall submit the following:

A. Technical Proposal (See Section L.9) **Original and 11 copies**

B. Past Performance Information (See Section L.10) **Original and 3
copies**

C. Small Disadvantaged Business Participation Plan (See Section L.11)
**Original and 1 copy**

D. Business Proposal (See Section L.12) **Original and 5 copies**-**set
forth in Cost Plus Award Fee arrangement**

E.  Small Business Subcontracting Plan (See Section L.12.B.) **Original
    and 5 copies** (This does not apply to small business concerns)

Your technical proposal must be concisely written and should be limited
to **150 typewritten pages** (double-spaced), exclusive of personnel
qualifications (i.e., resume, etc., see Section L.9 for additional
details). This limitation is for administrative purposes only and
exceeding the limitation shall not, of itself, be considered a basis for
rejection of your proposal.

Your proposal must provide the full name of your company, the address,
including county, Tax Identification Number (TIN), Dun and Bradstreet
No., and if different, the address to which payment should be mailed.

**YOUR ATTENTION IS CALLED TO THE LATE PROPOSAL PROVISIONS PROVIDED IN
SECTION L.3 OF THIS RFP. YOUR ATTENTION IS ALSO DIRECTED TO THE
TECHNICAL PROPOSAL INSTRUCTIONS PROVIDED IN SECTION L.9 OF THE
SOLICITATION.**

Questions regarding this solicitation shall be received in this office
no later than **June 6, 2001** (See Section L.6). Your questions should
be submitted to the attention of Mary Haines, Contracting Officer,
Agency for Healthcare Research and Quality, Suite 502, 2101 E. Jefferson
Street, Rockville, Maryland 20852 and the envelope should be marked
"Proposal Questions RFP No. AHRQ-01-0006**."**

The proposal shall be signed by an authorized official to bind your
organization and must be received in our Contracts Office no later than
**12:00 noon,** local prevailing time, on **July 6, 2001.** Your
proposal must be mailed to the following address:

Agency for Healthcare Research and Quality

Division of Contracts Management

2101 E. Jefferson Street, Suite 502

Rockville, Maryland 20852

Hand carried proposals may be dropped off at the above location, at Room
5E108A. The Division of Contracts Management offices are located in
Suite 502 in the East Wing of the 5^th^ Floor. Allow sufficient time for
parking and delivery.

The RFP does not commit the Government to pay any cost for the
preparation and submission of a proposal. It is also brought to your
attention that the Contracting Officer is the only individual who can
legally commit the Government to the expenditure of public funds in
connection with the proposed acquisition.

Requests for any information concerning this RFP should be referred to
Mary Haines,

\(301\) 594-7193.

[TABLE OF CONTENTS]{.underline}

[PART I Pages]{.underline}

Section A Solicitation 1-2

Table of Contents 3

Section B Supplies or Services & Prices/Costs 4-6

Section C Description/Specification/Work Statement 7-29

Section D Packaging and Marking 30

Section E Inspection and Acceptance 30

Section F Deliveries or Performance 30-33

Section G Contract Administration Data 34-36

Section H Special Contract Requirements 37-45

[PART II]{.underline}

Section I Contract Clauses 46-50

[PART III]{.underline}

Section J List of Attachments 51

[PART IV]{.underline}

Section K Representations and Instructions 52-70

Section L Instructions, Conditions & Notices to Offerors 71-93

Section M Evaluation Factors for Award 94-98

[Attachments]{.underline}

**[SECTION B-SUPPLIES OR SERVICES AND PRICES/COSTS]{.underline}**

**B.1 BRIEF DESCRIPTION OF SUPPLIES OR SERVICES**

> "National Quality Measures Clearinghouse." See Section C for a
> complete description.

**B.2. ESTIMATED COST**

**Note:** The Government estimates the cost of this procurement at
approximately \$8.4 million, inclusive of all fees.

> a\. The estimated cost (exclusive of any fees) for performance of the
> work under the contract including direct and indirect costs for the
> four year period is

\$ (TO BE COMPLETED UPON AWARD)

> b\. The base fee for the contract is \$(TO BE COMPLETED UPON AWARD).
> The base fee shall be paid in installments based on the percentage of
> completion of work, as determined by the Contracting Officer, and
> subject to the withholding provisions of the Clauses ALLOWABLE COST
> AND PAYMENT and FIXED FEE incorporated herein. Payment of the base fee
> shall not be made in less than monthly increments.
>
> c\. The maximum amount of Award Fee that may be earned for the
> contract period is\$ (TO BE COMPLETED UPON AWARD).
>
> d\. The Government's maximum obligation, represented by the sum of the
> Estimated Cost plus the Base Fee plus total award fee obtainable for
> the contract period is \$ (TO BE COMPLETED UPON AWARD).
>
> \(1\) The Contractor's performance shall be evaluated on a semi-annual
> basis, during the period of the contract. The award periods and
> maximum amounts for each are listed in Section H, Special Contract
> Requirements, H.4., Award Fee
>
> \(2\) The criteria set forth in the Quality Assurance Plan, Attachment
> 2 shall be used to evaluate the Contractor's performance.

3.  The Contractor further agrees that the final determination as to the
    amount of Award Fee earned will be made by the Contracting Officer,
    taking into consideration an analysis and evaluation of the
    Contractor's performance made by the Evaluation Group described in
    Section H.2., and shall not be subject to the terms of the
    "Disputes" clause of this contract. The Contractor shall be advised
    in writing of the decision setting forth reasons why the Award Fee
    was earned, or why it was not earned, in order that the Contractor
    may improve its performance during the next six (6) months, if the
    latter is applicable.

```{=html}
<!-- -->
```
3.  Notwithstanding any other provisions of this contract, the fee for
    performing this contract shall not exceed the statutory limitations
    prescribed in the first sentence of Section 304(b) of the Federal
    Property and Administrative Services Act (41 USC 254(b)) for
    services other than research, development or experimental work.

```{=html}
<!-- -->
```
3.  Payment of Award Fee under this contract will be accomplished by an
    Administrative Modification, executed by the Contracting Officer,
    when the Award Fee, if any, has been determined to be due. The
    Administrative Modification shall set forth the amount of fee to be
    awarded for the performance period evaluated. Upon receipt of the
    contract/ modification, the Contractor may submit a public voucher
    for payment of the total Award Fee earned for the period evaluated.
    Payment of the Award Fee shall be subject to the withholding
    provision of the clause entitled "Fixed Fee."

```{=html}
<!-- -->
```
e.  The amounts negotiated (and anticipated incremental funding
    schedule) for the contract as follows:

+-----------------------+-----------+--------+---------+-------------+
| **Period of           | **Es      | **Base | **Award | **Tot. Est. |
| Performance**         | timated** | Fee**  | Fee**   | Cost**      |
|                       |           |        |         |             |
|                       | **Cost**  |        | **Pos   | **Plus      |
|                       |           |        | sible** | Fees**      |
+-----------------------+-----------+--------+---------+-------------+
| Year 1 9/17/01 -      | \$        | \$     | \$      | \$          |
| 09/16/02              |           |        |         |             |
+-----------------------+-----------+--------+---------+-------------+
| Year 2 9/17/02 -      | \$        | \$     | \$      | \$          |
| 09/16/03              |           |        |         |             |
+-----------------------+-----------+--------+---------+-------------+
| Year 3 9/17/03 -      | \$        | \$     | \$      | \$          |
| 09/16/04              |           |        |         |             |
+-----------------------+-----------+--------+---------+-------------+
| Year 4 9/17/03 -      | \$        | \$     | \$      | \$          |
| 09/16/05              |           |        |         |             |
+-----------------------+-----------+--------+---------+-------------+
| **Total Estimated     | \$        | \$     | \$      | \$          |
| Cost Plus** **Fees**  |           |        |         |             |
+-----------------------+-----------+--------+---------+-------------+

f\. It is estimated that the amount currently allotted will cover
performance of the contract through \_[\_\_\_\_]{.underline}.

g\. The Contracting Officer may allot additional funds to the contract
without the concurrence of the contractor. For further provisions on
funding, see the LIMITATION OF COST/ LIMITATION OF FUNDS and the
ALLOWABLE COST AND PAYMENT (AND FIXED FEE) clauses incorporated into the
contract.

**B.4 PROVISIONS APPLICABLE TO DIRECT COSTS**

a\. Items Unallowable Unless Otherwise Provided

> Notwithstanding the clauses, ALLOWABLE COST AND PAYMENT, and FIXED
> FEE, incorporated into this contract, unless authorized in writing by
> the Contracting Officer, the costs of the following items or
> activities shall be unallowable as direct costs:

\(1\) Acquisition, by purchase or lease, of any interest in real
property;

\(2\) Rearrangement or alteration of facilities;

\(3\) Purchase or lease of [any]{.underline} item of general
purpose-office furniture or office equipment regardless of dollar value.
(General purpose equipment is defined as any items of personal property
which are usable for purposes other than research, such as office
equipment and furnishings, pocket calculators, etc.);

\(4\) Accountable Government property (defined as both real and personal
property with an acquisition cost of \$1,000 or more, with a life
expectancy of more than two years) and \"sensitive items\" (defined and
listed in the [Contractor\'s Guide for Control of Government Property,
1990,]{.underline} regardless of acquisition value;

\(5\) Travel to attend general scientific meetings;

\(6\) Foreign Travel;

\(7\) Any costs incurred prior to the contract\'s effective date;

\(8\) Rental of meeting rooms not otherwise expressly paid for by the
contract;

\(9\) Any formal subcontract arrangements not otherwise expressly
provided for in the contract;

\(10\) Consultant fees in excess of \$500/day; and

\(11\) ADP hardware or software.

b\. This contract is subject to the provisions of Public Law (P.L.)
99-234 which amends the Office of Federal Procurement Policy Act to
provide that contractor costs for travel, including lodging, other
subsistence, and incidental expenses, shall be allowable only to the
extent that they do not exceed the amount allowed for Federal employees.

> The Contractor, therefore, shall invoice and be reimbursed for all
> travel costs in accordance with Federal Acquisition Regulations (FAR)
> 31.205-46.

**SECTION C**

**[DESCRIPTION/SPECIFICATION/WORK STATEMENT]{.underline}**

**[National Quality Measures Clearinghouse (NQMC)]{.underline}**

Independently and not as an agent of the Government, the Contractor
shall furnish all the necessary services, qualified personnel, material,
equipment, and facilities, not otherwise provided by the Government as
needed to perform the Statement of Work as described in the following
sections.

The Agency for Healthcare Research and Quality (AHRQ) is interested in
producing tools which will help translate evidence-based information on
healthcare outcomes, quality, and cost, use, and access into healthcare
practice. This procurement is one of a series that will ultimately
result in the production of an integrated suite of Internet based tools
for healthcare providers, managers, and policymakers. This suite of
tools will initially be comprised of a significant enhancement of the
Agency's **[CO]{.underline}**mputerized **[N]{.underline}**eeds-Oriented
**[QU]{.underline}**ality Measurement **[E]{.underline}**valuation
**[S]{.underline}**ys**[T]{.underline}**em (CONQUEST) library of quality
measures and the Agency's highly successful National Guideline
Clearinghouse™ (NGC). Feedback from NGC users indicates that some users
desire a convenient mechanism to identify relevant measures to evaluate
how well a guideline is being implemented and used. Similarly, some
CONQUEST users have indicated that a linkage with NGC would be desirable
so that the full, evidence-based guideline is accessible as a complete
reference. As a result, AHRQ believes there would be significant added
value in integrating the two clinical information tools such that users
would have the choice to search one or both tools and retrieve an
integrated result set.

An evaluation of CONQUEST also indicated that users would value a
dynamic Internet based library of quality measures. Through this
procurement the Agency will migrate the software-based CONQUEST library
of quality measures to the Internet and rename that new tool the
National Quality Measures Clearinghouse (NQMC). AHRQ also believes that
standardizing the language of fields in the new NQMC is a desirable
goal, should be a part of its migration to the Web, and will aid in the
integration of the NQMC and NGC. In addition to the NQMC, this
procurement will design, develop, and maintain a database backbone (an
"umbrella site") to house the NQMC as one module and be expandable to
include additional AHRQ clinical tools such as the NGC and others in
subsequent modules. This database backbone must be designed to take
advantage of what has worked well with the NGC and accommodate future
NGC enhancements. In addition to enhancements with functionality, it is
anticipated that NGC enhancements will include the addition of
references (citations) used in the development of the guideline, linking
the references to recommendations when provided by the developer, and
linking references to PubMed when appropriate. It is also anticipated
that NGC will have an on-line submission and review process. The NGC
will be substantially enhanced through a separate but related
procurement beginning FY 2003 and migrated to the database backbone in
the fourth quarter of FY 2003.

The specific aims of this solicitation are to 1) establish and maintain
an Internet-based National Quality Measures Clearinghouse (NQMC)
containing detailed information on quality measures; 2) design, develop,
and maintain a database backbone and "umbrella" Web site that will house
the NQMC as one module and be expandable to include additional AHRQ
clinical tool modules such as the National Guideline Clearinghouse™ and
others in subsequent efforts; 3) provide appropriate and timely
technical assistance to NQMC users; and 4) provide appropriate
integration between different Internet-based AHRQ clinical information
and decision modules.

A.  [Background Statement]{.underline}

The Agency for Healthcare Research and Quality (AHRQ) was established in
1989 as the Agency for Health Care Policy and Research. Re-authorizing
legislation passed in November 1999 establishes AHRQ as the lead Federal
agency charged with supporting research designed to improve the quality
of healthcare, reduce its cost, improve patient safety, decrease medical
errors, and broaden access to essential services. AHRQ sponsors and
conducts research that provides evidence-based information on healthcare
outcomes, quality, and cost; use and access. The information helps
healthcare decisionmakers, patients and clinicians, health system
leaders, and policymakers make more informed decisions and improve the
quality of healthcare services.

Legislation re-authorizing AHRQ specifically directs it to support
activities that:

1.  **Improve the quality of health care.** AHRQ is to coordinate,
    conduct, and support research, demonstrations, and evaluations
    related to the measurement and improvement of health care quality.
    AHRQ is also to disseminate scientific findings about what works
    best and facilitate public access to information on the quality of,
    and consumer satisfaction with, health care.

2.  **Promote patient safety and reduce medical errors.** AHRQ is to
    develop research and build partnerships with health care
    practitioners and health care systems and establish a permanent
    program of Centers for Education and Research on Therapeutics
    (CERTs). These initiatives will help address concerns raised in a
    1999 report by the Institute of Medicine (IOM) that estimates as
    many as 98,000 patients die as a result of medical errors in
    hospitals each year. (IOM [^1].)

3.  **Advance the use of information technology for coordinating patient
    care and conducting quality and outcomes research.** AHRQ is to
    promote the use of information systems to develop and disseminate
    quality measures; create effective linkages between health
    information sources to enhance health care delivery and coordination
    of evidence-based health care services; and promote protection of
    individually identifiable patient information used in health
    services research and health care quality improvement.

AHRQ supports a variety of investigator-initiated and targeted projects
focused on quality measurement and improvement, evidence-based medicine,
and implementation of research into practice. For example, AHRQ is
supporting twelve (12) Evidence-based Practice Centers to conduct
rigorous, comprehensive reviews of the relevant scientific literature on
selected topics and publish results in evidence reports and technology
assessments[^2].

Particularly relevant to this solicitation, AHRQ has developed the
National Guideline Clearinghouse™ (NGC), in partnership with the
American Association of Health Plans (AAHP) and the American Medical
Association (AMA). The NGC is an Internet-based repository of clinical
practice guidelines[^3] allowing detailed comparisons across different
guidelines[^4]. The contents of NGC include structured summaries of
guidelines using controlled terms with descriptive free-text fields. The
structured summaries capture information on each guideline in the
following three areas: bibliographic, clinical, and methodological and
are available in brief and complete formats. Each summary contains a
copyright statement created by the guideline developer. In most cases,
the full-text of each guideline is available via hyperlink or on the NGC
site. In instances where the guideline developer does not make the
full-text available, ordering information is posted. The NGC database
contains information on almost 1,000 clinical practice guidelines; new
guidelines are added every week. The site has been operational since
December 15, 1998 and has seen a steady increase in use. Currently, the
site has approximately 30,000 to 33,000 visits per week. The design of
the NQMC should take advantage of the success of the NGC model.

Additionally, the Agency supports research on clinical performance
measurement[^5] and improvement that involves developing reliable[^6]
and valid[^7] clinical performance measures. The Expansion of Quality of
Care Measures (Q-SPAN) project is designed to strengthen the science
base of quality measurement while expanding the scope and availability
of validated, ready-to-use measures. Q-SPAN builds on past work in
quality measurement by public and private organizations through eight
cooperative agreements to develop and test additional clinical
performance measures for specific conditions, patient populations, and
health care settings[^8]. More recently the Agency has sponsored a joint
project with the Health Care Financing Administration to develop
measures of patient safety through the National Quality Forum. The
Agency has also been charged by the Congress to develop a National
Healthcare Quality Report by FY 2003. A recent report from the Institute
of Medicine provides a vision for the development of that report and
makes suggestions concerning the selection of appropriate quality
measures.[^9]

To address some of the quality measurement needs, AHRQ (then the Agency
for Health Care Policy and Research \[AHCPR\]) sponsored several
projects designed to develop, test, and refine a typology or
classification scheme for understanding how to evaluate, select, and use
clinical performance measures. The products from these two projects were
documents entitled 1) Understanding and Choosing Clinical Performance
Measures for Quality Improvement: Development of a Typology and
Attachments (AHCPR publication numbers 95-N001 and 95-N002) and 2) the
**[CO]{.underline}**mputerized **[N]{.underline}**eeds-Oriented
**[QU]{.underline}**ality Measurement **[E]{.underline}**valuation
**[S]{.underline}**ys**[T]{.underline}**em (CONQUEST 1.0) which was
released to the public in April 1995, accompanied by a User's Guide.
CONQUEST 1.0 required the use of Microsoft Access 2.0®.

AHRQ has funded several projects related to improving CONQUEST. CONQUEST
1.1 was released to the public in mid-1996. It converted CONQUEST 1.0
into a more user-friendly application that operated in a Microsoft
Windows® environment without the requirement to use a Microsoft
Access-based application although it remained the platform upon which
CONQUEST 1.1 was built. A User's Guide also accompanied CONQUEST 1.1. In
September 1996, the Agency sponsored the Quality Measurement Network
(QMNet) project. The main objective of QMNet was to enhance and expand
CONQUEST 1.1 by adding more clinical performance measures and related
conditions and to assess the relational database software platform of
CONQUEST 1.1. The most important products from QMNet were the release of
CONQUEST 2.0 and the Final Report (March 12, 1998) which included
procedures to code measures from raw data, procedures for mail
validation of coded measures, time estimates for coding measures from
raw data and for validating measures by mail, programming specifications
for CONQUEST 2.0, a CONQUEST 2.0 User's Guide, and a list of all gaps in
CONQUEST 2.0\'s condition database by condition and type of gap -
including recommendations for filling those gaps. The QMNet contract
ended in March 1998. CONQuest 2.0 (which contains over 1100 measures),
the User's Guide, Fact Sheet, and Overview are available on the Internet
at <http://www.ahrq.gov/qual/conqix.htm>.

A related activity funded by AHRQ was the Performance Measures Inventory
(PMI). Its purpose was to collect all performance measures (e.g.,
clinical, population, and system measures) in use nationally or under
development and soon to be implemented nationally by Agencies and
Departments within the Federal government. This work was completed by
the Center for Health Policy Studies (CHPS) [^10]. The purpose of the
project was to provide an inventory of measures and to help identify
areas for potential coordination and collaboration in the development
and implementation of measures across Federal agencies and departments.
The most relevant product of this project includes a CONQUEST-compatible
database containing a limited subset of the measure-specific variables
found in CONQUEST. This subset includes measure name, measure set name,
numerator and denominator descriptions, measure type, applicable age
range, level of care for which the measure was designed, current/planned
use, and contact information such as Agency, Department, person,
address, phone and fax numbers, e-mail address, date of measure entry,
and date of last update.

Two other related activities have direct relevance to this solicitation.
The first activity is the CONQUEST 2.0 Evaluation project (Contract No.
290-96-0011, Task Order No. 5)[^11] which was awarded to the Research
Triangle Institute and completed in June 2000. The results of the
evaluation included five main conclusions.

1.  Only a small number of end users requesting CONQUEST 2.0 had
    actually used the software.

2.  A major reason for not using CONQUEST 2.0 was lack of time to load
    the program and/or to learn how to use it. Another barrier was lack
    of measures and typology data for conditions of interest for the end
    user.

3.  Of those who used CONQUEST 2.0, they were genuinely pleased with the
    advances that CONQUEST 2.0 represented over earlier versions both in
    terms of interface and number of new measures.

4.  Drawbacks and limitations of CONQUEST 2.0 were varied but pointed to
    limitations in the CD-ROM-based system. For example, it was
    perceived as being outdated shortly after release and users wanted
    more interactive capabilities not supported by the software.

5.  Moving CONQUEST to an Internet-based system was viewed as highly
    desirable and would help keep it current, provide linkages to
    related information, and free up valuable hard drive space on users
    computers.

Another activity was a commissioned study to explore and detail the
conceptual and technological issues, complexity, and cost implications
involved in redesigning CONQUEST as a Web-based utility and integrating
it with an enhanced NGC, in a way that will result in a seamless,
integrated set of programs that are also capable of expansion[^12]. The
study made recommendations in three management areas: content,
technology, and enterprise management. The study report in its entirety
is attached as an appendix to this solicitation. AHRQ has considered
recommendations and findings of this study and particular interests and
needs of AHRQ and the Government, along with all previous activities in
preparing this solicitation.

AHRQ has gained valuable experience in its sponsorship of CONQUEST and
the National Guideline Clearinghouse™ and believes significant
advantages for the health care community can result from the development
of a National Quality Measures Clearinghouse™ and an integrated suite of
quality and clinical information tool modules. AHRQ also believes that
economies can be realized by developing a common database backbone to
house the proposed NQMC, NGC, and other clinical information and
decision tool modules. While some of the audiences for NGC and the NQMC
do not overlap, many users will be interested in both tools. The Agency
would like to provide a mechanism for those users who wish to coordinate
their search for information within both systems.

It is the intent of AHRQ that NQMC and NGC be accessible individually
through unique Uniform Resource Locators (URLs), as well as through an
umbrella Web site, also with a unique URL. The umbrella Web site would
be capable of housing both information tools and potentially other
clinical information tools while providing a user-friendly universal
Web-based interface. Thus, the goal is to develop a suite of
Internet-based tool modules with a common "look and feel." Each tool
will appear as an individual module and site to the user but will share
a common information system infrastructure and backbone database system
and have clear prompts to open the user's searches to include materials
from the other related tool modules. It is expected that each tool
module, including the umbrella site, will utilize standard, common
Web-based data query, database storage software and search engine tools,
have consistent graphic and navigational features and controlled
vocabularies, and share other technical database, software and computer
specifications where content-appropriate and cost-effective.

Offerors should keep in mind that computer capabilities of users will
differ significantly in their level of technological sophistication. For
this reason, it will be necessary to provide a platform that will
address the needs of users with either high-end or low-end capabilities.
Pages that use table formatting must also be available in formats (i.e.,
plain text) for browsers that cannot render tables. Frames may be used
as long as an option to turn off the frames is supported. Any
recommendation for the use of persistent cookies must be justified and
the rationale clearly described. All Web site development efforts under
this contract must comply fully with the Section 508 provisions of the
Americans with Disabilities Act (ADA). For example, ASCII text files
must be made available to be in compliance with the Americans with
Disabilities Act (ADA). The NQMC Web nonframes/text only site should be
Bobby-approved[^13] and Lynx-compatible. Under no circumstances will
personally identifiable information be gathered on NQMC users unless it
is supplied voluntarily by the user (e.g., e-mail communication).

B. [Objectives]{.underline}

The objectives of project are to:

1\) establish and maintain an Internet-based National Quality Measures
Clearinghouse (NQMC) containing detailed information on quality
measures;

2\) design, develop, and maintain a database backbone and umbrella Web
Site that will house the NQMC as one module and be expandable to include
additional AHRQ clinical tool modules such as the National Guideline
Clearinghouse™ (NGC) and others in subsequent efforts;

3\) provide appropriate and timely technical assistance to NQMC users;

4\) finalize and maintain the database structure that will house an
enhanced NGC;

5\) migration of an enhanced NGC consistent with a the new database
environment in the fourth quarter FY 2003; and

6\) provide appropriate integration between different Internet-based
AHRQ clinical information and decision tool modules.

C. [Specific Requirements]{.underline}

All work under this contract shall be monitored by the AHRQ Project
Officer (PO) as authorized by the AHRQ Contracting Officer (CO).

The Contractor is expected to maintain such internal policies and
procedures as may be required to ensure a high-quality, smooth operation
of a project of this scope and complexity, including such training
materials as may be necessary to introduce new employees to the project.
The NQMC Contractor is expected to maintain a highly effective internal
quality control process which assures that the deliverables developed
under the contract accurately and consistently address the stated
objectives and accurately portray substantive content. The Contractor is
expected to ensure the accuracy of the content of the NQMC and its
ability to correct contents, links, etc. quickly. The Contractor's
quality control policies, procedures, and materials are deliverables
under this contract.

All report and document deliverables under the NQMC contract, except
routine memoranda, must be submitted in hard copy and electronically in
a file format and to print specifications as instructed by the Project
Officer and shall be in compliance with any Agency standardized contract
reporting systems.

Specifically, the National Measures Clearinghouse Contractor shall
perform tasks described in the following sections.

**1.** **RECRUIT, MANAGE, AND SUPPORT AN ADVISORY PANEL OF EXPERTS IN
QUALITY MEASUREMENT, CLINICAL INFORMATION TOOLS, AND INFORMATICS**

The Contractor shall work with the Project Officer to assemble a group
of experts that represent a broad range of interests related to quality
measurement and health informatics. The Panel shall not exceed seventeen
(17) members who are representative of private and public interests.
Representatives may include measure developers; measurement
methodologists and researchers; health informatics experts;
accreditation, health professional, and insurance organizations; and
users such as clinicians, managed care organizations, hospitals, quality
assurance organizations, employee benefit managers, and State and
Federal government programs. The Government will be responsible for
identifying and recruiting appropriate Federal experts. The Project
Officer will serve on the panel in an *ex officio* status.

The experts will provide feedback to the NQMC Contractor on broad
project areas including the state-of-the-art in measure development; the
unique needs of NQMC users; methods for obtaining the maximum number of
measures possible for inclusion into the NQMC; and mechanisms for
reaching NQMC's target audience.

1.1 Recruit a group of experts.

> The Contractor shall finalize recruitment of experts by the third (3)
> month of the project. The criteria for selection shall include factors
> such as knowledge of issues concerning public and private measure
> development and implementation; current activity and research in the
> area of measure development and use; ability to represent the needs of
> a significant segment of the NQMC target audience; and ability and
> interest in fostering public-private partnerships. The panel of
> experts is expected to include one representative of the Foundation
> for Accountability (FACCT), National Center for Quality Assurance
> (NCQA), Joint Commission on Accreditation of Healthcare Organizations
> (JCAHO), American Hospital Association (AHA), and American Health
> Quality Association (AHQA); the American Medical Association (AMA);
> the American Association of Health Plans (AAHP); the American Nurses
> Association (ANA); Health Care Financing Administration (HCFA),
> Department of Defense (DoD), Veterans= Administration (VA) the
> National Library of Medicine (NLM), one measure development
> methodologist, one health informatics expert, and one measure
> implementation (i.e., quality improvement) researcher. To facilitate
> the integration of an enhanced NGC into the Internet backbone being
> created under this procurement, the offeror should consider including
> members of the NGC Advisory panel on the panel being created for this
> project.
>
> Final expert nominations shall be provided to the AHRQ Project Officer
> for review and comment no later than two (2) months after the
> effective date of the contract. Because of organizational
> representation and technical requirements, in conjunction with the
> limit on number of experts, nominees are expected to represent more
> than one area of relevance to this project.

1.2 Hold Expert Panel meetings.

Hold and provide support (i.e., pre-, post-, and interim support) for
Panel of Experts meetings. The Panel of Experts is expected to meet at
least one time in each year of the contract. It is also anticipated that
quarterly conference calls of panel subsets and periodic electronic and
paper correspondence will occur between meetings. The purpose of the
meetings and communications will be to provide feedback to the
Contractor on issues related to broad project areas including the
state-of-the-art in measure development; the unique needs of NQMC users;
methods for obtaining the maximum number of measures possible for
inclusion into the NQMC; and mechanisms for reaching NQMC's target
audience.

> In consultation with the Project Officer, the Contractor shall plan
> all activities in support of all meetings and inter-meeting conference
> calls and mailings. Specifically, the Contractor shall plan agendas;
> assemble, prepare, print, and distribute materials needed for
> meetings; prepare audio-visual materials as required; distribute
> materials to meeting participants; reserve meeting facilities and
> hotel accommodations; notify members and confirm participation in the
> meetings; arrange travel and process expense vouchers for non-Federal
> participants; and prepare detailed written summaries of the meetings.
> All agendas and materials will be provided to the Project Officer for
> review, comment, and approval at least 21 calendar days prior to the
> meeting, and all materials shall be sent to the Panel of Experts and
> participants at least 14 calendar days before the meeting.
>
> The meetings will be one day in length and held on a date in which at
> least 90 percent of expert members can attend. Federal experts will be
> responsible for their own travel arrangements and lodging costs. The
> Contractor shall provide hotel reservations at the Federal Government
> lodging per diem for Federal participants. All non-Federal expert
> members will be reimbursed at the rate of \$200 per day for their
> participation in the meetings. It is estimated that all of the Expert
> Panel members will require overnight accommodations for one (1)
> evening for each meeting.

The Contractor shall provide a detailed written draft meeting summary
within two weeks after the expert meeting. The summary should include
names and titles of participants and observers, agenda, and a
substantive, detailed summary of the discussions, action items, and
recommendations. The Contractor shall provide a final summary one (1)
week after receiving Agency comments.

**2. DESIGN, IMPLEMENT, AND MAINTAIN A SYSTEM FOR OBTAINING AND UPDATING
QUALITY MEASURES CONTAINED WITHIN THE NQMC.**

An accurate accounting of the total universe of measures does not exist.
In addition to CONQUEST, efforts at gathering measure information have
been made by JCAHO, NCQA, and HCFA through MedQuest[^14] and HCFA's Peer
Review Organization's automated database called the Standard Data
Processing System (SDPS), which will be another useful link for users of
the NQMC. In addition, since 1998 the National Library of Medicine (NLM)
has included "quality indicators" as a Medical Subject Heading (MeSH)
term for indexed articles to facilitate retrieval of articles published
in medical journals that include information on measures.[^15] NLM MeSH
terms have included "quality assurance" since 1980, and "outcomes and
process assessment" have been included as MeSH terms since 1992. The
NQMC will consist of measures assessing the clinical performance of
individuals and organizations directly responsible for providing or
arranging for clinical care. The NQMC database shall contain quality
measures that assess the following domains:

-   Processes of care (e.g., diagnosis, therapy, prevention, safe
    clinical practices, etc.)

-   Outcomes of care (e.g., intermediate or surrogate outcomes,
    functional status, iatrogenic illness, actual clinical outcomes,
    etc.)

-   Access to care (e.g., availability and convenience of clinical
    services, etc.)

-   Patient/Customer satisfaction (e.g., patient satisfaction, cultural
    competency of providers, etc.)

Within five (5) months after contract award, the Project Officer will
prepare a notice to be published in the *Federal Register* requesting
measure developers and organizations supporting measure development to
submit measures, in both hard copy and electronic format, if available,
and the full name and address of the developer and/or contact person
whom NQMC staff can contact. The *Federal Register* notice will describe
the National Quality Measures Clearinghouse and will request that
information be submitted directly to the Contractor. The Project Officer
will organize a direct mailing of a letter to relevant organizations
with copies of the *Federal Register* notice encouraging them to
respond. The Contractor shall:

2.1 Maintain an on-going database of measure developers and
organizations that sponsor measure development to be shared with the
Project Officer. The Contractor shall develop a relational database of
measure developers that includes full name, mailing and electronic mail
addresses, telephone and facsimile numbers, and name (or names) of
contact person(s) for measures and measure sets. The Contractor shall
maintain the database on an on-going basis, in both hard and electronic
copy and forward updates to the Project Officer for dissemination by
AHRQ as appropriate. The database shall be maintained in a format that
can be used for mailing labels and word-processing. This database shall
be implemented within six (6) months of the EDOC and maintained
continuously thereafter.

2.  Identify and collect measures for inclusion in the National Quality
    Measures Clearinghouse. By four (4) months of EDOC, the Contractor
    shall propose inclusion criteria for including measures into the
    NQMC. The proposed inclusion criteria shall be distributed to the
    Panel of Experts for comment and the Project Officer for both
    comment and approval. The Project Officer will coordinate AHRQ
    review. In addition, the Contractor shall pilot test the proposed
    inclusion criteria against a heterogeneous group of no less than 100
    measures to test the appropriateness, reliability, and ease of
    application. The inclusion criteria shall be displayed on the NQMC
    Web site in an easily found location. In reviewing measures for
    potential inclusion, each measure must be evaluated for inclusion by
    at least two persons. In the event of a disagreement, a third person
    shall review the measure. The Project Officer will take these
    evaluations under advisement and make a final decision on the
    inclusion of specific measures. The proposed inclusion criteria
    shall include the following two dimensions:

    [Dimension one]{.underline}.

> The measure must meet all of the following criteria:

-   The measures must assess some aspect(s) of clinical performance of a
    specified individual or organization.

-   The measures must address at one of the following domains, processes
    of care, outcomes of care, utilization of health care resources,
    access to care, patient/customer satisfaction, or experiences with
    care.

```{=html}
<!-- -->
```
-   The measure developer allows sufficient information to be included
    in the NQMC record to document fulfillment of inclusion criteria.

    [Dimension two]{.underline}.

> The measure must meet at least one, and preferably all, of the
> following criteria:

-   The measure developer can provide evidence that the measure has been
    cited in one or more reports published in national or international
    peer-reviewed journals. The reports should document that the measure
    has been reliably used to measure performance.

-   The measure has supplementary evidence that it has been tested and
    shown to accurately and reliably measure what it is intended to
    measure. This is interpreted to mean the measure's face validity,
    reproducibility, and predictive power. The supplementary evidence
    about validation should be of sufficient quality to confirm that the
    validation studies have been completed.

-   The measure has been adopted by at least one nationally or
    internationally recognized organization for promoting equitable
    measurement systems that has a policy of subjecting proposed
    measurements and systems to rigorous assessments of validity and
    reducibility. Examples of these organizations include, but are not
    limited to, Foundation for Accountability (FACCT), Joint Commission
    on Accreditation of Healthcare Organizations (JCAHO), National
    Commission for Quality Assurance (NCQA), U.S. Federal Government,
    State Government, Foreign Governments, World Health Organization
    (WHO), and other International Health Authorities.

-   

> The Project Officer, and anyone else that the Project Officer deems
> appropriate, must review measures that are submitted and determined by
> the Contractor to have failed to meet criteria in either dimension.
> The Contractor shall submit a detailed summary of reasons for
> exclusion and keep a detailed electronic log of actions related to
> submitted measures. The electronic log will be submitted to the
> Project Officer monthly with the progress report (Task 7) and shall be
> maintained on a password protected Web page accessible to the project
> team and Agency staff.
>
> The Contractor shall:
>
> 2.2.1 Mail copies of the *Federal Register* and AHRQ letter inviting
> response to the notice to a broad base of measure developers,
> researchers, and methodologists.
>
> 2.2.2 Search the peer reviewed literature for published measures or
> references to measures in development.
>
> 2.2.3 Search existing databases, compendiums, and source books for
> reference to existing measures.

2.2.4 Contact known measure developers, researchers, and methodologists
to further identify measure-related documents.

> 2.2.5 Enlist the help of the Panel of Experts in refining inclusion
> criteria and identifying candidate measures.

6.  Collect hardcopy, and electronic copy if possible, of identified
    measures, including references and accompanying supplemental
    material.

7.  Develop a secure Internet-based mechanism for submission of measures
    to the NQMC in conjunction with the NQMC Web site by the
    sixteenth (16) month of the Contract. The on-line submission process
    shall use drop down menus and required fields for completion in
    order to lesson the workload of the project staff and of those
    submitting measures.

> 2.2.8 Obtain written copyright permission as appropriate from the
> measure developers to make their measure(s) available for NQMC users
> through downloadable files or hyperlink to the developer's Web site.
> When measures are proprietary and the developer will not allow
> distribution of the abstracted measure information through the NQMC,
> the Contractor shall obtain copyright clearance for purposes of
> inclusion of the measure in the NQMC database for abstracting and
> summarizing. The Contractor shall include language in the NQMC Web
> site that will refer users back to the developer, using hyperlinks if
> possible, to obtain or purchase the full documentation,
> specifications, etc.

2.3 The Contractor shall contact the developers of measures included in
the NQMC on an annual basis regarding the status of their measures
(i.e., revisions, taken out of use, etc.).

> 2.3.1 The Contractor shall develop an update mechanism to be used
> annually with developers whose measures are included in the NQMC. The
> purpose of the process is to obtain specific information regarding the
> status of the developer's measures and measure set(s) with respect to
> whether they have been or will be amended, updated, changed, or
> retired.
>
> 2.3.2 The Contractor shall track and maintain copies of the query
> responses and update the NQMC database accordingly.

**3.** **DESIGN, IMPLEMENT, AND MAINTAIN A SYSTEM FOR EVALUATING
MEASURES FOR INCLUSION AND FOR CODING AND VALIDATING THE CODING OF
MEASURES INCLUDED WITHIN THE NQMC.**

3.1 Measures included in the NQMC shall be coded using standard
reference terminologies (e.g. SNOMED RT, etc.), whenever possible and
they shall be displayed using a standardized (structured) format.

3.1.1 The Contractor shall utilize the most cost-effective mechanism for
tagging and coding measures and should consider the utility of the
Unified Medical Language System (UMLS) Metathesaurus over more costly
proprietary solutions whenever possible. If a necessary concept is not
adequately represented in the Metathesaurus, the Contractor shall select
a term to describe the concept. In doing so, care should be taken to
avoid confusion with other recognized terms and to provide consistent
and reliable application. Further, the Contractor shall provide mapping
to outdated or revised terms when defining and maintaining new terms.
The goal should be to utilize already recognized terminologies and to
create new terms only when concepts are not adequately represented. In
some cases concepts are defined in existing terminologies but not
adequately for the purposes of quality measurement. For example,
"discharge" in the Metathesaurus refers to physiological \[fluid\]
discharges as opposed to discharge from a facility or type of medical
care - most often used in quality measurement.

2.  The Contractor shall remove obsolete measures and replace
    revised/updated measures with current versions. Because of the
    important temporal aspects of quality measurement, the Contractor
    shall maintain and provide explicit documentation to the public
    about the disposition of measures in an easily accessible page of
    the NQMC Web site.

3.  The Contractor shall develop a template of measure attributes and
    definitions. The Contractor shall not be restricted by the current
    structure and typology of CONQUEST 2.0. The Contractor shall
    consider previous work done by JCAHO, Performance Measurement
    Coordinating Council (PMCC), HEDIS, NCQA, HCFA, the federal National
    Healthcare Quality Report workgroup, the Institute of Medicine
    Committee on the National Quality Report on Health Care Delivery,
    and SCRIPT (Study of Clinically Relevant Indicators for
    Pharmacologic Therapy) and other relevant efforts to create a
    measure template or structured summary that describes *at least* the
    following attributes:

-   Measure release date and subsequent updates, developer, information
    on obtaining the measure.

-   The population to which the measure has been and can be applied.

-   The conditions for which the measure can be and has been applied.

-   The appropriate settings for which the measure was designed and
    could potentially be applied.

-   How the measure should be used and key design issues.

-   What clinical practice guidelines are related to the measure.

-   A description of evidence supporting the measure (e.g., research
    articles, systematic reviews, technology assessments, practice
    guidelines, etc.) and a listing of the citations and links to the
    full-text and/or the PubMed record. Modifications of these
    attributes and inclusion of additional attributes and definitions
    will be done in consultation with the Project Officer and subject to
    Project Officer approval

The attribute fields shall include controlled terms in addition to
descriptive full text fields. When developing the template/structured
summary, the Contractor shall take into consideration descriptive
attributes chosen as important by different measure developing
organizations and researchers. The template shall contain copyright
information supplied by the measure's developer or holder of the
measure's copyright. The draft template of attributes and definitions
should be pilot tested against a heterogeneous sample of at least 100
measures for ease of use, availability of information, and reliability
of abstraction and coding. The Contractor shall develop a draft template
of attributes and definitions no later than three (3) months after
contract award and submit it to the Project Officer for review and
comment. The Contractor shall finalize the template within two (2) weeks
after receipt of the comments from the Project Officer (i.e.,
approximately month 4).

2.  The Contractor shall be responsible for the completeness and
    accuracy of data contained in the measure templates. The Contractor
    shall contact the measure developer when more information is needed
    but it is not expected that every attribute will be completed for
    every measure. *However, those attributes that are correlated with
    the inclusion criteria for measures into the NQMC must be
    completed*. This shall be reflected in the required fields for
    on-line submission. Developers shall be given three weeks to comment
    or provide revisions to the template. If no comments are received,
    the Contractor shall assume the developer has no comment but
    designate that the summary has not been verified by the developer.
    Measure summaries shall be identified as "verified" or "unverified"
    by the measure developer.

```{=html}
<!-- -->
```
1.  The Offeror shall assume that all of the CONQUEST[^16] measures that
    meet the inclusion criteria developed and approved under this
    Contract and a minimum of 300 new measures will be added to the
    database within the first twelve (12) months of the project, in
    addition to obtaining full measure information on the currently used
    clinical performance measures subset obtained from the Phase III
    Inventory of Performance Measures contract (Requirements Contract
    #290-96-0008) and adding them to the database. For measures already
    in the database, the Contractor will be continually responsible for
    ensuring that they are accurate and current. Each year it is
    estimated that 250-300 new or updated measures will be added to the
    database.

2.  The Offeror shall propose a strategy for what types of measures
    shall be addressed and added to NQMC first. In preparing the
    strategy, the Offeror shall consider different alternatives such as
    priority disease/conditions, areas in which there is a gap in
    measures, new types of measures, or completion of one type of
    measure before moving on to another type (e.g., clinical performance
    measures then another type of measure). When presenting its
    strategy, the Offeror shall provide a rationale for the approach.

3.  The Contractor shall make available for download complete measures
    when copyright permission is received from the measure developer.
    The measures shall be made available for download in at least two
    formats one of which must be ASCII text. In the event that the
    measure developer does not provide permission for hosting full-text
    measures on NQMC, the Contractor shall provide a hyperlink to the
    developer site (if appropriate) and ordering information.

**4.** **THE TECHNICAL REQUIREMENTS FOR CREATING THE NATIONAL QUALITY
MEASURES CLEARINGHOUSE WEB SITE.**

4.1 Overview.

The Contractor shall test and implement the Web sites to be known as the
National Quality Measures Clearinghouse (NQMC) and an "umbrella" Web
site, and maintain their presence on the World Wide Web (WWW) via the
Internet. The NQMC Web site shall be available through an unique Uniform
Resource Locator (URL) and through an "umbrella" Internet site, also
with a unique URL. The Contractor shall create, implement and maintain
all mechanisms necessary to support the database backbone of the NQMC.
The Contractor shall also create and implement an umbrella Web site that
can accommodate the future integration of the NGC and other modules, and
maintain its presence on the WWW. The umbrella Web site shall allow
users to chose which Web site they wish to search or browse. The
capacity to retrieve search results for more than one site shall be
developed as different modules are added to the database backbone.The
NQMC and umbrella Web sites shall become operational within twelve (12)
months from the contract start date.

> In completing the requirements of this project, the Contractor shall
> employ a \"System Life Cycle" (SLC) approach. SLC is defined as a
> structured development approach with defined activities, phases,
> products, and reviews that provide a standard to support the
> development of systems from identification through implementation,
> operation, maintenance, and eventual retirement.[^17] The Contractor
> shall choose a life cycle model for development of the NQMC and
> justify any deviation from the chosen model. The Contractor shall
> meet, at minimum, the Software Engineering Institute (SEI) Capability
> Maturity Model (CMM) level 2, the repeatable level, of this five-step
> model. In level 2, basic project management processes are established.
> Cost, schedule, and functionality are tracked and reported. The
> Contractor shall fully describe how they will meet these requirements.

4.2 Startup Requirements.

> The Contractor shall propose complete, detailed specifications for all
> software, hardware, network, system development, testing,
> configuration management and other technology architecture solutions
> to complete these requirements. The Project Officer must approve all
> proposed hardware and software solutions.
>
> The Contractor shall develop and deliver a detailed mock-up of the
> NQMC and umbrella Web sites that include hierarchical structure and
> hyperlinks for the Project Officer to review within eight (8) months
> of the contract start date. The deliverable shall include all Web site
> and associated software design specifications, Oracle database and
> stored procedure specifications, indexing, data models, and any other
> prototype system specifications and associated documentation.

4.3 Software Requirements.

> The Contractor shall be responsible for designing, testing,
> implementing, and maintaining the database backbone, modules, the NQMC
> Web site, and umbrella Web site. The system shall be developed using a
> three-tier architecture[^18]. The Contractor shall use commercial
> off-the-shelf (COTS) components when possible.
>
> For document and text transfer required by the NQMC, the Contractor
> shall use an e-mail system compatible with Microsoft Exchange,
> including Exchange's digitally encrypted PKI solution. The Contractor
> shall also utilize a distribution list software package for
> maintaining mass distribution electronic mailing lists.

4.4 Database Requirements.

> The Contractor shall use an AHRQ approved version of the Oracle®
> Database System for all the database management needs of the project
> ,and shall use a compatible version of the Oracle® Designer tool (or
> an equivalent) to document all data and functional model requirements
> of the system, and to implement the version and build control
> processes.
>
> The contractor shall use an open systems, industry standard,
> object-oriented software design and software technology solutions,
> 3-tier architecture, and enterprise reusable object software
> components to ensure cost-effective system development, operations and
> maintenance.
>
> The search engine software solution shall facilitate effective
> searches by using a combination of indexes and XML metadata tags,
> numeric primary keys, and use of controlled vocabularies for important
> concepts. Both manual and algorithmic indexing shall be used.

The Contractor shall develop and maintain a style guide to promote
consistent coding.

> The Contractor shall not be restricted by the current structure and
> typology of CONQUEST 2.0 and shall consider the need for developing a
> new paradigm to accommodate a more heterogeneous pool of measures when
> developing the database model and relationships.

The Contractor shall design, develop, and maintain a database backbone
to house the NQMC as one module and be expandable to include additional
AHRQ clinical tools such as the National Guideline Clearinghouse™ and
others in subsequent modules.

NGC will be substantially enhanced beginning FY 2003 and migrated to the
database backbone in the fourth quarter FY 2003. In addition to
enhancements with functionality, it is anticipated that NGC enhancements
will include the addition of references (citations) used in the
development of the guideline, linking the references to recommendations
when provided by the developer, and linking references to PubMed when
appropriate. It is also anticipated that like the NQMC, the enhanced NGC
will have an on-line submission and review process.

The Contractor will be responsible for designing, developing, and
maintaining the database environment for the enhanced NGC consistent
with a migration to the new environment in the fourth quarter FY 2003.
Beginning in FY 2003, the Contractor shall be responsible for the
maintenance of the legacy NGC database and Web site, which is in
Microsoft SQL 2000 at the present time. ***The Contractor shall not be
responsible for the content of NGC but shall work with the Contractor
responsible for developing and maintaining the NGC content.***

> The Contractor shall establish a set of common data elements that will
> serve to appropriately link the contents of NQMC and NGC. The NQMC/NGC
> data model shall be expandable to include other clinical information
> modules such as patient safety best practices, outcome measurement
> instruments, etc.

4.5 Web Site Requirements.

The Contractor shall develop an application interface for the NQMC and
the umbrella site that is both versatile and expandable so that it can
accommodate the varied needs of NQMC users -- this while allowing for
expansion and technological improvements as needs arise, and for
technical and information-environments change.

> The NQMC and umbrella Web sites shall include descriptions of the
> NQMC, NGC, and AHRQ. The umbrella site shall also include a
> description of NGC. The sites shall contain sections that describe how
> the contents are maintained, including inclusion criteria for measures
> and attributes, and definitions used in the template. The site shall
> also contain a direct link to a privacy statement approved by the
> Project Officer. Information on how measures may be submitted and how
> users can contact NQMC shall be displayed in an easily accessible
> manner. The Web sites shall include resource sections that include
> technical information about the sites, as well as a Site Map and a
> Frequently Asked Questions (FAQs) section where users can perform both
> keyword searches or scroll for information. The resource sections
> should also include a description of the technical assistance support
> (e.g., where to e-mail for technical assistance with using the NQMC,
> what to look for in selecting measures; and how to use, apply, and
> interpret measures).
>
> The NQMC and the umbrella Web sites will be accessed via "gov"
> domains. The Government will be responsible for registering the
> appropriate "gov" domains, but the Contractor shall register analogous
> non-gov domains.

The Contractor shall use Extensible Markup Language (XML) as the main
form of presentation. In using XML, the Contractor shall take into
account the importance of obtaining consistency in the use of medical
terms and the work of HL7 (Health Level 7) and ASTM (American Standard
for Testing and Materials) whenever possible.

The Contractor shall design logos for the NQMC and umbrella Web sites
that include the title of the Web site (i.e., National Quality Measures
Clearinghouse spelled out) and the Uniform Resource Locator (URL). If
the Contractor determines that placement of the URL shall be separate
from the actual logo, it should be present on the title page and
subsequent pages. A facsimile of the logo shall be developed for
black/white print and duplication on letterhead, envelopes, and flyers.
It is not expected that the Web site logo be literally translated for
this purpose. A logical reproduction that is recognizable of the Web
site logo is sufficient. The Web site also must explicitly note the
support of the Agency.

> The Contractor shall make provisions for a wide range of user's needs.
> The Contractor shall provide a platform which addresses the technical
> needs of both the high and low-end users and users. The capability to
> view text only, without tables shall be incorporated into the design
> of the NQMC and umbrella Web sitea. Frames may be used as long as an
> option to turn off the frames is supported. While the Contractor shall
> primarily use XML, the site will be configured so that the application
> server will detect users who do not use XML, and redirect their
> traffic to a parallel HTML or text document.
>
> The Contractor shall provide Web sites that are in compliance with all
> relevant sections of the Americans with Disabilities Act (ADA). (For
> example all text files should also be available in ASCII.) To this
> end, it is expected that both Web sites will be "Bobby Approved[^19]";
> i.e., that all graphics will have text descriptions and not be reliant
> on the use of color to make meaningful substantive distinctions.
> (Further information on accessibility can be found at the Web
> Accessibility Initiative <http://www.w3.org/WAI/References/Policy#US>)
> or at [www.usability.gov](http://www.usability.gov/).

In designing the Web sites, the Contractor shall use persistent cookies
only when the following conditions are met:

-   there is a strong functional reason for doing so (for example, use
    of the Web site is significantly enhanced for the visitor);

```{=html}
<!-- -->
```
-   appropriate and publicly disclosed privacy safeguards exist for
    handling any information derived from the cookies; and

```{=html}
<!-- -->
```
-   they have been approved by HHS.

If the Contractor determines that the use of persistent Web cookies is
desirable, they shall submit a request with justification to the Project
Officer. If the Project Officer concurs, AHRQ will submit a request for
formal waiver from the Secretary of HHS.

> The Contractor shall employ limited usability testing while developing
> the functional features of the Web sites. Testers shall consist of
> Expert Panel members, Federal employees, and selected end-users. The
> testing shall be completed by month eleven (11) of the contract.
> Results of the testing shall be made available to the Project Officer
> within ten (10) days of the completed testing.

The NQMC and umbrella Web sites shall be maintained as a public service,
however the Contractor may collect the name of the domain users utilize
to access the site, bandwidth, the type of browser and operating system
the user used to access the site, the date and time of the users visit,
the pages visited, and the address of the Web site the user came from
when referred by another site. COTS software shall be proposed to track
and monitor site usage. Keywords entered into the search engine of the
Web site may also be tracked.

The Contractor shall not require the provision of personal information
to visit the Web sites. Individual, personal information shall not be
automatically collected but may be collected to respond to a user's
message or to fulfill the stated purpose of any communication initiated
by a user.

The Contractor shall store 24 hours of transient data online. Older data
may be transferred to off to an off-line archive device.

All communication to the Web sites, including customer feedback, shall
be destroyed at the end of the project.

> It is anticipated that the NQMC will be hyperlinked to a variety of
> relevant Internet sites such as the AHRQ Web site, Web sites of
> measure developers, the NLM, and HCFA's MedQuest. The Contractor will
> make provisions for such requirements.
>
> The Contractor shall register the NQMC and umbrella sites with search
> engines and Web site portals appropriate for NQMC content.
>
> The Contractor shall utilize appropriate metatags to facilitate
> location of the NQMC and umbrella Web sites by other search engines.
>
> As directed by the Project Officer, the Contractor shall add
> additional links, or remove existing links to other Web sites within a
> period of fifteen (15) working days.

4.6 Hardware Requirements.

The Contractor shall provide all hardware necessary to host and connect
the Web sites.

The Contractor shall provide for a physical location to house the Web
sites and arrange for appropriate onsite visits by the Project Officer
and other program representatives. All visits during normal working
hours shall be permissible with two hours notice, and within 24 hours
notice for all other times.

> The Contractor shall provide access to the Internet for the Web sites,
> and that access shall have sufficient bandwidth to meet the needs
> delineated in this document.
>
> The Contractor shall provide physical support for Web production, and
> all application hardware as necessary.
>
> Usage Requirements:
>
> From the beginning, the Contractor shall plan for a load tolerance of
> at least 300-500 simultaneous users and per-day traffic equal to the
> third-year estimate.
>
> In year one (1) of operation, the anticipated number of user sessions
> on the NQMC Web site is estimated at 1,000 to 3,000 per day. It is
> expected that usage will to double in each subsequent year. The
> Contractor shall construct Web sites that have the ability to support
> 130% of the usage listed above.
>
> The Contractor also shall prepare contingency plans, in case the
> traffic appears to be exceeding the above estimates, so that it will
> be able reconstitute the hardware/software platform to tolerate an
> increased load within 50 workdays. No costs shall be budgeted or
> incurred by the contractor in connection with this contingency plan.
> The contingency plan will be negotiated and funded on an as needed
> basis. Costs for implementation will not be included in the initial
> contract award.
>
> The Contractor shall propose and develop mechanisms for 24 x 7 systems
> near-fulltime availability to ensure system uptime for user operations
> including updates

-   The Contractor shall provide for system failures such that: any
    hardware, software, or database failure will not result in a loss of
    more than 27 hours of the most current data; any software failure
    will not result in more than 8 hours of downtime after notification
    of the situation; any hardware failure will not result in more than
    26 hours of downtime; and that any Internet connectivity failure
    will not result in more than 48 hours downtime.

```{=html}
<!-- -->
```
-   The contractor shall provide a system that maximizes security and
    data privacy even in the event of a catastrophic failure.

The Contractor shall test backup/restore process at a minimum of once
every month to insure that the process is viable, and report any
failures to the Project Officer.

4.8 Reporting Requirements.

> The Contractor shall provide monthly reports of the Web site and
> database uptime and shall include an "Anomalies Report" to the Project
> Officer describing any major problems with the system's hardware or
> software.
>
> The Contractor shall maintain for inspection, documentation on
> requirement management, project estimation, project reviews, software
> quality assurance and software configuration management --
> particularly as it pertains to the SLC and SEI approaches.
>
> The Contractor shall monitor sites linking to NQMC on a monthly basis
> and include this information in the monthly progress report.

The Contractor shall provide monthly reports that characterize Web site
usage trends, including information such as: utilization; frequently
visited pages; and other performance metrics.

4.9 Security and Privacy Requirements.

The Contractor shall be responsible for the security and the privacy of
the system.

> The Contractor shall insure that the Web sites and data are secured
> behind appropriate firewall mechanisms and/or other blocking devices
> so as to minimize that chance that they can be accessed or altered by
> unauthorized individuals.

The Contractor shall immediately report any unauthorized access to the
Project Officer.

> The Contractor shall insure that unscrubbed data are never allowed on
> a system with public (Internet) access.
>
> The Contractor will comply with all Federal and HHS security
> guidelines that are in effect at the time of the award of this
> contract. A current copy of HHS's Systems Security Program Handbook
> may be found at <http://wwwoirm.nih.gov/policy/aissp.html>. An
> overview of all HHS policies is available at
> <http://www.hhs.gov/oirm/security/docs.html>, and the federal Computer
> Security Act of 1987 may be seen at
> <http://csrc.ncsl.nist.gov/secplcy/csa_87.txt>.

**TASK 5. PROVIDE TECHNICAL ASSISTANCE TO NQMC USERS**

The Contractor shall provide technical assistance to NQMC users via a
variety of formats (e.g., where to E-mail for technical assistance with
using the NQMC, what to look for in selecting measures, how to use,
apply, and interpret measures). The Contractor is not expected to
provide routinely telephone technical assistance.

5.1 The Contractor shall develop text describing the NQMC Web site for
use by organizations that list or link to the NQMC Web site. (The
Project Officer will coordinate AHRQ requirements for publishing,
electronic dissemination, and public affairs with staff from AHRQ=s
Office of Health Care Information.) The Contractor shall develop and
display "linking" policies to organizations that want to establish links
to the NQMC and umbrella site. The Contractor shall monthly track sites
that link to NQMC utilizing COTS software.

5.2 The Contractor shall develop detailed help pages for each function
of NQMC and the umbrella Web site in easily understood language. The
help function shall be accessible from every page of NQMC and the
umbrella Web site.

5.3 The Contractor shall create a list of Frequently Asked Questions
(FAQs) and answers that are available via the help function. The FAQs
shall be updated regularly.

5.4 The Contractor shall display on the NQMC Web site technical
specifications that will assist users and developers in taking full
advantage of NQMC.

5.5 The Contractor shall display information on how to contact NQMC by
e-mail on every page of the Web site. The Contractor shall answer all
e-mail within 24 hours during the business week and within 48 hours
during the weekend. The Contractor shall develop standard answers to
questions that occur frequently. These questions and answers shall be
added to the FAQs (Task 5.3).

6.  The Contractor shall develop an on-line and a CD-ROM tutorial on how
    to use the NQMC. The Contractor shall prepare a script and mock-up
    by month sixteen (16) of the contract and complete the final version
    by month eighteen (18). The Government will publish the CD-ROM and
    create packaging for its distribution.

7.  The Contractor shall develop and maintain an electronic mail-based
    notification system for NQMC users who register to receive regular
    updates on the NQMC content and Web site (Task 4.3).

5.8 Conduct a customer satisfaction survey, analyze the results and
prepare a report detailing the results. The Contractor shall prepare a
detailed workplan for how the survey will be conducted and analyzed no
later than eighteen (18) months from the EDOC.

> The Contractor shall conduct an electronic voluntary annual Customer
> Satisfaction Survey of the NQMC Web site beginning after the first
> full year of operation in month twenty-four (24) of the contract. The
> goal of this effort is to assess customer opinion on the relevance,
> content, utility, and ease of use of the NQMC Web site. A pop-up
> window and a banner shall be used to invite users to voluntarily
> participate in the customer satisfaction survey. The Offeror may
> propose a periodic or continuous use of a customer satisfaction
> survey. In either case, the advantages and disadvantages of continuous
> versus periodic administration of the customer satisfaction
> questionnaire shall be included in the Offeror=s proposal.

The survey shall inform AHRQ with respect to (but not be limited to) the
following questions:

-   What kinds of persons doing what kinds of jobs (Aaudiences=) are
    using the NQMC?

-   What components and features the NQMC are being used?

-   How do the users in various Aaudiences@ compare to one another in
    their satisfaction with the components and features of the NQMC?

-   Do users find the NQMC Afriendly@ and easy to use?

-   What barriers exist to users?

-   How do users rate their satisfaction with the components and
    features (e.g., structural design, format, etc.) of the NQMC?

-   Do users consider the information retrieved from the NQMC to be
    accurate, complete, reliable, timely, and relevant?

-   Do users find the information in NQMC helpful in their quality
    measurement and improvement activities? Does it meet their needs?

-   Do users have any suggestions for improvements in NQMC?

-   How is NQMC being used in quality measurement and improvement
    activities?

> The Contractor shall design, implement, and evaluate a pretest of the
> data collection instrument, then revise the instrument based on the
> results of the pretest and submit the final draft instrument to AHRQ
> for review three months prior to fielding the survey.
>
> The Contractor shall prepare and submit to AHRQ the necessary OMB
> clearance package for an assessment of customer satisfaction with the
> NQMC. Both a draft and final package will be required. The OMB
> clearance will be requested under AHRQ's blanket OMB customer
> satisfaction survey approval. Among other requirements, the OMB
> package will need to include the research design, the data collection
> plan, a description of the methodology for sampling users from across
> the period under study, a justification for the chosen target sample
> size, a plan for assuring an appropriately high survey response rate,
> and the final draft data collection instrument.
>
> The draft survey instrument shall be submitted by the 20^th^ month
> after the effective date of the contract. The final survey instrument
> shall be completed no later than one (1) month after submission of
> comments by the Project Officer. The draft OMB package will be due no
> later than the 22^nd^ month of the contract and the final package two
> (2) weeks after receipt of comments. The Agency will submit the
> package to OMB and will expect a determination from OMB within 10
> working days of the submission of the package to OMB by AHRQ.

5.8 The Contractor shall prepare an analysis of the findings from each
annual customer satisfaction survey. A draft analysis shall be submitted
to the Project Office no later than one month after completion of each
survey. A final report shall be submitted no later than two weeks after
receiving the Project Officer's comments.

**6. DESIGN, IMPLEMENT, AND MAINTAIN AN ELECTRONIC FORUM FOR USERS OF
THE NATIONAL QUALITY MEASURES CLEARINGHOUSE WEB SITE.**

6.1 The Contractor shall design an Internet-based electronic forum using
L-Soft or other appropriate forum software solution that is accessed
through the National Measures Clearinghouse Web site. The design,
specifications, user interface, system security, and monitoring features
of the NQMC electronic forum shall be compatible with features of other
Agency Web site electronic forums being developed for public and
customer access.

> The electronic forum shall be available for users of the NQMC for the
> purposes of exchanging information with other users; allowing NQMC
> users to pose questions of other users; and allowing NQMC users to
> enter into on-going dialogues with other Electronic forum registrants
> that share similar or like concerns. The electronic forum should also
> allow NQMC users to exchange information with AHRQ about issues such
> as measure development, methodology, research, dissemination,
> implementation, and use. In considering the establishment of the
> electronic forum, the Contractor shall consider whether topic specific
> electronic forum groups (e.g., methodology, dissemination,
> implementation, clinical, etc.) would be more useful. The Contractor
> shall present a detailed design, implementation, and maintenance
> workplan for the electronic forum(s) ten (10) months after the
> beginning of the contract for Project Officer review. The Contractor
> shall finalize the plan based two (2) weeks after receipt of Project
> Officer comments (i.e., approximately the eleventh (11) month of the
> project.

6.2 The Contractor shall implement the electronic forum(s) plan no later
than one (1) month after Project Officer concurrence with the plan
(i.e., approximately month twelve (12) after the start of the contract).
After successful implementation of the electronic forum(s) plan, the
Contractor shall maintain the electronic forum(s).

**7. MANAGEMENT**

The Contractor shall provide for the effective and efficient management
of the technical, administrative, logistical, and support functions
described in this statement of work. The Contractor shall carry out the
following tasks in implementing the management of the project.

7.1 Meet with the Project Officer and designated Agency staff.

> Not later than one (1) week after the effective date of the contract
> award, the Contractor shall meet with the Project Officer and key
> Agency staff in Rockville, Maryland to discuss the comprehensive work
> plan. Also at this meeting, the parties shall clarify any procedural
> issues related to the Statement of Work, propose any modifications
> deemed necessary, and provide an opportunity for the Project Officer
> to provide the Contractor with any additional materials and
> information to be used in the performance of the contract
> requirements. Additionally, the Contractor shall provide at this
> meeting a formal management plan (based on the response to the Request
> for Proposal) which includes all required tasks and, staffing plans.

7.2 Prepare and submit comprehensive work plans.

The Contractor shall prepare a comprehensive work plan that outlines the
structure of the organization of the project, the work to be done, the
schedule for completing the work, an estimate of the resources required,
and the detailed approach to be applied to each task and subtask area.
The work plan shall also include the staffing plans and any anticipated
changes, the Contractor's quality control policies, procedures, and
materials. The initial (draft) work plan is to be submitted as part of
the proposal in response to the project solicitation. An updated draft
work plan will be required at month one (1) and the final work plan will
be completed two (2) weeks after receipt of the Project Officer
comments. After year one (1), the annual work plan shall be part of the
annual report (Task 7.6).

> The work plan in the transition/closeout year will be a separate
> chapter in the final report and will include information on those
> procedures, documents, files, etc. necessary to close-out/transition
> the project. The Contractor shall prepare, submit, and implement a
> close-out/transition plan. To complete this transition/close out of
> the project, the Contractor will transfer all systems, hard copy and
> electronic files and their associated documentation (e.g., all system,
> subsystem, module designs; database models and dictionaries; data flow
> charts, software test plans and test analysis reports, software
> configuration management and version changes, detailed software inline
> coding, summarized extent of any coding, how it was done, and what the
> Contractor thought should have been documented; details and summary of
> all inline documentation and any other code written; description of
> standards for naming of variables in the code, and for all inline and
> offline documentation; complete inventory/product list of all retail
> hardware and software used; and a complete inventory of all HTML/XML
> page settings), procedures, raw materials, other related
> documentation, and any other material necessary to transition the NQMC
> or to close it out. The transition plan shall include forty (40) hours
> for meetings with Agency staff and others, and transitional consulting
> of approximately 100 hours, if necessary.

7.3 All NQMC systems documentation shall be maintained in an electronic
format, stored in a document management/filing system, and kept current
throughout the life of the contract. All systems documentation shall be
accessible via online remote access to the Agency for review and
download at any time during the life of the contract. The Contractor
shall at least weekly archive electronic files uploaded onto the NQMC
Web site and electronic mail received through the NQMC electronic mail
box.

7.4 Prepare and submit a monthly progress report. Beginning on the tenth
calendar day of the second month of contract performance and on the
tenth calendar day of every month of contract performance thereafter,
the Contractor shall submit to the AHRQ Contracts Office and to the
Project Officer a monthly progress report in both hard copy and
electronic format via e-mail with appropriate attachments. At a minimum,
the monthly progress report will summarize the progress of work
performed during the reporting period, note milestones, describe past
problems (including a concise statement of success or lack thereof in
solving the problems encountered), describe anticipated problems and
proposed solutions, describe work planned for the next reporting period,
compare progress and resource expenditures to the original schedule and
budget and provide explanations for any variances, assess whether the
current total estimated contract cost is sufficient to complete the
contract, and describe significant changes in the Contractor\'s
operational personnel. The report shall also summarize all additions,
modifications, and configuration changes to all NQMC software and
database designs, specifications, testing, quality assurance efforts,
maintenance and operational solutions and associated work efforts
accomplished during the month. The contractor shall utilize a project
management software system, e.g., Microsoft Project 2000, and submit an
electronic copy of the latest complete project plan and database, as an
attachment to the monthly progress report.

> The monthly progress report need not exceed ten (10) pages and shall
> also include disclosure of any new work products, computer databases
> or programs, or any other inventions that may be subject to
> intellectual property protection, together with a description of how
> the Contractor intends to manage intellectual property rights to these
> inventions under the terms and conditions of the contract.

7.5 Hold management meetings. During the project, at a minimum, the
Contractor shall hold a monthly management meeting at its office during
which the project will be discussed. After completion of the first year,
management meetings shall be held every other month. The participants in
the management meetings will include the Project Officer (in person or
via telephone) and other Agency staff as appropriate, the Project
Director, and relevant project staff as selected by the Contractor.
Progress will be reviewed, milestones discussed, problems examined,
solutions explored, and short-range and long-range plans made. Action
items resulting from this meeting will be prepared by the Contractor and
submitted to the Project Officer within three days after completion of
the meeting. If corrections are necessary, a revised replacement shall
be submitted within two (2) days after receipt of the Project Officer's
comments.

7.6 Prepare and submit annual reports. The Contractor shall prepare an
outline, draft and final annual report for the Project Officer that
compares work performed in the current year to the work that was planned
for that year. At a minimum, the annual reports will include full
details on the purpose of the contract, methods of performance,
activities undertaken to accomplish tasks and goals of the contract and
whether the tasks were successfully completed, findings, conclusions,
and recommendations resulting from the work performed. An outline shall
be completed by the 11^th^ and 23^rd^ months of the contract. Draft
reports shall be completed by the 12^th^ and 24th month of the contract.
Final reports shall be completed by the 13^th^ and 25th month of the
contract.

> Generally, the annual report will include a cover, title page, table
> of contents, text with associated graphics, and addenda (e.g.,
> appendices, glossary, bibliography, indexes). The main text of the
> annual report shall address all the requirements listed and provide
> all information called for in the scope of work of the contract unless
> otherwise specified by the Agency.
>
> The annual report shall also include an executive summary submitted
> under separate cover that concisely describes the results to a
> non-technical audience, which may include but not be limited to
> policymakers and program administrators. The executive summary shall
> be complete and able to stand alone as a separate document.
>
> The substantive content and format of the executive summary and final
> report shall be agreed upon by the Project Officer and the Contractor
> within the 9^th^ and 21^st^ months of the contract. All reports,
> including text, tables, and graphics shall be provided in hard copy
> and as an electronic file in a format that is acceptable to the
> Project Officer (e.g., Microsoft Word).
>
> The Contractor shall submit the revised/approved report with ten (10)
> hard copies to the Project Officer, one (1) copy to the Contracting
> Officer, and one (1) electronic copy to both the Project Officer and
> the Contracting Officer.

7.7 Prepare and Submit Final Report. Two months prior to the end of the
contract, the Contractor shall submit a draft final report. It will
summarize the full contract experience. Such as: (1) accomplishments of
contract objectives; (2) evaluations of barriers encountered; (3)
recommendations to the Agency on ways to improve the process and
products. The Project Officer may suggest revisions or approve the
draft. At the end of the final month of performance, the Contractor
shall submit the revised/approved report with ten (10) hard copies to
the Project Officer, one (1) copy to the Contracting Officer, and one
(1) electronic copy to both the Project Officer and the Contracting
Officer.

7.8 Work with other Agency content/substance-related Contractors related
to other tool modules. Because some content of this contract will be
driven or influenced by other existing or subsequent Agency contracts
that produce new or modified tool modules, this Contractor shall, as
needed, work with other Agency Contractors to enhance the NQMC\'s
content.

7.9 Meet with Agency stakeholders. The Contractor shall plan to attend
or teleconference meetings with Agency stakeholders, at the direction of
the Project Officer, two times a year for four hours each meeting. The
meetings will all take place in the metropolitan Washington, DC area.

**SECTION D - PACKAGING AND MARKING**

All deliverables required under the contract shall be packaged, marked,
and shipped in accordance with Government specifications. The Contractor
shall guarantee that all required material shall be delivered in
immediate usable and acceptable condition.

**SECTION E - INSPECTION AND ACCEPTANCE**

**E.1 INSPECTION AND ACCEPTANCE**

a\. The Contracting Officer or the duly authorized representative will
perform inspection and acceptance of materials and services to be
provided.

b\. For the purpose of this SECTION the Government Project Officer is
the authorized technical representative of the contracting officer.

c\. Inspection and acceptance will be performed at:

Agency for Healthcare Research and Quality

Executive Office Center

2101 East Jefferson Street

Rockville, Maryland 20852

**E.2 CLAUSES INCORPORATED BY REFERENCE (FEB 1998)**

> This contract incorporates the following clause by reference, with the
> same force and effect as if it were given in full text. Upon request,
> the Contracting Officer will make its full text available. Also, the
> full text of a clause may be assessed electronically at this address:
> http://www.arnet.gov.far.
>
> [FAR Clause No. Title and Date]{.underline}
>
> 52.246-5 Inspection of Services-Cost Reimbursement (April 1984)

**SECTION F - PERIOD OF PERFORMANCE AND DELIVERY SCHEDULE**

**F.1 CLAUSES INCORPORATED BY REFERENCE (FEB 1998)**

> This contract incorporates the following clause by reference, with the
> same force and effect as if they were given in full text. Upon
> request, the Contracting Officer will make their full text available.
> Also, the full text of a clause may be assessed electronically at this
> address:

[FAR Clause No. Title and Date]{.underline}

52.242‑15 Stop Work Order (AUG 1989)

Alternate I (APRIL 1984)

**F.2 PERIOD OF PERFORMANCE**

> The period of performance for the contract shall be from the effective
> date of the contract through 48 months thereafter.

**F.3 DELIVERY SCHEDULE**

> The items specified for delivery below are subject to the review and
> approval of the Project Officer before final acceptance. The
> Contractor shall be required to make revisions deemed necessary by the
> Project Officer.
>
> The Contractor shall produce the following scheduled
> reports/deliverables in the amount, and within the time frame
> indicated. Deliverables shall be submitted to the Project Officer,
> Agency for Healthcare Research and Quality, 2101 East Jefferson St.,
> Rockville, Maryland 20852
>
> The Contractor shall submit the following items in accordance with the
> stated delivery schedule as noted below:

+----+-----------------------------+-----------------+-----------------+
| ** |                             |                 |                 |
| Ta |                             |                 |                 |
| sk |                             |                 |                 |
| D  |                             |                 |                 |
| es |                             |                 |                 |
| cr |                             |                 |                 |
| ip |                             |                 |                 |
| ti |                             |                 |                 |
| on |                             |                 |                 |
| Qu |                             |                 |                 |
| an |                             |                 |                 |
| ti |                             |                 |                 |
| ty |                             |                 |                 |
| D  |                             |                 |                 |
| ue |                             |                 |                 |
| Da |                             |                 |                 |
| te |                             |                 |                 |
| ** |                             |                 |                 |
+----+-----------------------------+-----------------+-----------------+
| 01 | Finalize Panel of Experts   | 1 electronic    | Within 2 months |
|    | Nomination                  | and 5 copies to | of the          |
|    |                             | PO              | effective date  |
|    |                             |                 | of the contract |
|    |                             |                 | (EDOC)          |
+----+-----------------------------+-----------------+-----------------+
| 02 | Finalize Panel of Experts   | 1 electronic    | Within 3 months |
|    | membership (Task 1.1)       | and 5 copies to | EDOC            |
|    |                             | PO              |                 |
+----+-----------------------------+-----------------+-----------------+
| 03 | Meeting Agenda and          | 1 electronic    | Draft to PO, 21 |
|    | materials                   | and 5 copies to | calendar days   |
|    |                             | PO              | prior to        |
|    |                             |                 | meeting         |
|    |                             | 1 copy to each  |                 |
|    |                             | meeting         | Final to        |
|    |                             | participant     | participants 14 |
|    |                             |                 | calendar days   |
|    |                             |                 | prior to        |
|    |                             |                 | meeting         |
+----+-----------------------------+-----------------+-----------------+
| 04 | Hold Meeting                | Per             | At least once   |
|    |                             | requirements of | every year of   |
|    |                             | SOW             | the contract    |
+----+-----------------------------+-----------------+-----------------+
| 05 | Meeting Summary (Task 1.2)  | 1 electronic    | 14 days after   |
|    |                             | and 5 copies to | Meeting, final  |
|    |                             | PO              | 7 days after    |
|    |                             |                 | receiving       |
|    |                             |                 | comments        |
+----+-----------------------------+-----------------+-----------------+
| 06 | Database of Measure         | Per             | Implemented     |
|    | Developers and Sponsors of  | requirements of | within 6 months |
|    | Measures (Task 2.1)         | SOW             | EDOC and then   |
|    |                             |                 | ongoing         |
+----+-----------------------------+-----------------+-----------------+
| 07 | Inclusion Criteria (Task    | 1 electronic    | Within 4 months |
|    | 2.2)                        | copy and 5      | EDOC            |
|    |                             | copies to PO; 1 |                 |
|    |                             | copy for each   |                 |
|    |                             | Expert Panel    |                 |
|    |                             | Member          |                 |
+----+-----------------------------+-----------------+-----------------+
| 08 | Electronic log of actions   | 1 electronic    | Monthly with    |
|    | and summary of reasons for  | copy to PO      | Progress Report |
|    | exclusion (Task 2.2)        |                 | beginning 6     |
|    |                             |                 | months EDOC     |
+----+-----------------------------+-----------------+-----------------+
| 09 | Template of Attributes and  | 1 electronic    | Draft within 3  |
|    | Definitions (Task 3.1.3)    | copy and 5      | months EDOC;    |
|    |                             | copies to PO    | final within 2  |
|    |                             |                 | weeks of        |
|    |                             |                 | receiving       |
|    |                             |                 | comments        |
+----+-----------------------------+-----------------+-----------------+
| 10 | CONQUEST measures meeting   | Per             | Within 12       |
|    | criteria and 300 new        | requirements of | months EDOC     |
|    | measures in database in     | SOW             | then on-going   |
|    | Year 1 and then 250-300     |                 |                 |
|    | thereafter (Task 3.2)       |                 |                 |
+----+-----------------------------+-----------------+-----------------+
| 11 | Usability testing completed | Per             | Within 11       |
|    | (Task 4.5)                  | requirements of | months of EDOC  |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 12 | Mock-up of NQMC and         | Per             | Within 8 months |
|    | Umbrella Web sites (Task    | requirements of | of EDOC         |
|    | 4.2)                        | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 13 | NQMC Umbrella Web site      | Per             | Within 12       |
|    | becomes operational (Task   | requirements of | months of EDOC  |
|    | 4.1)                        | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 14 | On-line submission (Task    | Per             | Within 16       |
|    | 2.2.7)                      | requirements of | months of EDOC  |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 15 | Database environment for    | Per             | Fourth Quarter  |
|    | enhanced NGC (Task 4.4)     | requirements of | FY 2003         |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 16 | Enhanced NGC migrated to    | Per             | Fourth Quarter  |
|    | database backbone (Task     | requirements of | FY 2003         |
|    | 4.4)                        | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 17 | Maintenance of NGC legacy   | Per             | October 1, 2002 |
|    | database and Web site (Task | requirements of |                 |
|    | 4.4)                        | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 18 | Maintain an Electronic Mail | Per             | On-going after  |
|    | Box for Web Site (Task 5.5) | requirements of | Site activation |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 19 | Customer Satisfaction       | 1 electronic    | Workplan within |
|    | Survey (Task 5.8)           | and 5 copies to | 18 months EDOC; |
|    |                             | PO              | draft           |
|    |                             |                 | instrument 20   |
|    |                             |                 | monnths EDOC;   |
|    |                             |                 | draft OMB       |
|    |                             |                 | package at 22   |
|    |                             |                 | months EDOC;    |
|    |                             |                 | conduct of the  |
|    |                             |                 | survey at 24    |
|    |                             |                 | months EDOC     |
+----+-----------------------------+-----------------+-----------------+
| 20 | Electronic Forum (Task 6)   | 1 electronic    | Workplan within |
|    |                             | and 5 copies to | 10 months EDOC; |
|    |                             | PO              | implementation  |
|    |                             |                 | 12 months EDOC  |
+----+-----------------------------+-----------------+-----------------+
| 21 | Meet with PO (Task 7.1)     | Per             | 1 week of EDOC  |
|    |                             | requirements of |                 |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 22 | Comprehensive Project       | 5 copies to PO  | Within 1 month  |
|    | Workplan (Task 10.2)        |                 | after initial   |
|    |                             |                 | meeting with PO |
|    |                             |                 | and updated     |
|    |                             |                 | annually        |
+----+-----------------------------+-----------------+-----------------+
| 23 | Systems Documentation (Task | Per             | Ongoing through |
|    | 7.3)                        | requirements of | life of the     |
|    |                             | SOW             | contract        |
+----+-----------------------------+-----------------+-----------------+
| 24 | Web Site Archive (Task 7.3) | Per             | Weekly after    |
|    |                             | requirements of | initiation of   |
|    |                             | SOW             | Web Site        |
+----+-----------------------------+-----------------+-----------------+
| 25 | Contract Progress Reports   | 1 electronic    | Monthly         |
|    | (Task 7.4)                  | copy and 5      |                 |
|    |                             | copies to PO; 1 |                 |
|    |                             | to CO           |                 |
+----+-----------------------------+-----------------+-----------------+
| 26 | Management Meetings (Task   | Per             | Monthly         |
|    | 7.5)                        | Requirements of |                 |
|    |                             | SOW             |                 |
+----+-----------------------------+-----------------+-----------------+
| 27 | Annual Report (Task 7.6)    | 1 electronic    | Annually        |
|    |                             | and 10 copies   |                 |
|    |                             | to PO; 1 copy   |                 |
|    |                             | to CO           |                 |
+----+-----------------------------+-----------------+-----------------+
| 28 | Final Report (Task 7.7)     | 1 electronic    | Within 48       |
|    |                             | and 10 copies   | months EDOC     |
|    |                             | to PO; 1 copy   |                 |
|    |                             | to CO           |                 |
+----+-----------------------------+-----------------+-----------------+

> \*In addition, one copy of the final work plan, the monthly progress
> reports and annual final reports shall be submitted to the Contracting
> Officer at the following address:

Agency for Healthcare Research and Quality

ATTN: Contracting Officer

Division of Contracts Management

2101 East Jefferson Street, Suite 502

Rockville, Maryland 20852

In addition, the following reports are required to be submitted to the
Contracting Officer.

+-----------------------+-----------------------+-----------------------+
| **Type of Report Due  |                       |                       |
| Date Quantity**       |                       |                       |
+-----------------------+-----------------------+-----------------------+
| Subcontracting Report | April 30 (annually)   | 3 each (1 original    |
| for Individual        |                       | and 2 copies)         |
| Contracts (SF-294)    | October 30 (annually  |                       |
+-----------------------+-----------------------+-----------------------+
| Summary Subcontractor | October 30 (annually) | 1 copy to the Office  |
| Report (SF-295)       |                       | of Small              |
|                       |                       | Disadvantaged         |
|                       |                       | Business Utilization  |
|                       |                       | (DHHS)                |
+-----------------------+-----------------------+-----------------------+
| Small Disadvantaged   | At contract           | 3 each (1 original    |
| Business              | completion            | and 2 copies)         |
| Participation Report  |                       |                       |
| (OF-312)              |                       |                       |
+-----------------------+-----------------------+-----------------------+

**SECTION G - CONTRACT ADMINISTRATION DATA**

**G.1 KEY PERSONNEL**

> Pursuant to the Key Personnel clause incorporated in Section I.5 of
> this contract, the following individual(s) is/are considered to be
> essential to the work being performed hereunder:

[NAME]{.underline} [TITLE]{.underline}

> **NOTE TO THE OFFEROR: Please designate proposed key personnel,
> including name, title, phone and fax numbers, and e-mail address in
> the proposal**
>
> The clause cited above contains a requirement for review and approval
> by the Contracting Officer of written requests for a change of Key
> Personnel reasonably in advance of diverting any of these individuals
> from this contract. Receipt of written requests at least 30 days prior
> to a proposed change is considered reasonable.

**G.2 PROJECT OFFICER**

> The following Project Officer will represent the Government for the
> purpose of this contract:

**To be named at contract award**

> The Project Officer is responsible for: (1) monitoring the
> Contractor\'s technical progress, including the surveillance and
> assessment of performance and recommending to the Contracting Officer
> changes in requirements; (2) interpreting the statement of work and
> any other technical performance requirements; (3) performing technical
> evaluation as required; (4) performing technical inspections and
> acceptances required by this contract; and (5) assisting in the
> resolution of technical problems encountered during performance.
>
> The Contracting Officer is the only person with authority to act as an
> agent of the Government under this contract. Only the Contracting
> Officer has authority to: (1) direct or negotiate any changes in the
> statement of work; (2) modify or extend the period of performance; (3)
> change the delivery schedule; (4) authorize reimbursement to the
> contractor of any costs incurred during the performance of this
> contract; or (5) otherwise change any terms and conditions of this
> contract.
>
> The Government may unilaterally change its Project Officer.

**G.3 INVOICE SUBMISSION**

a\. INVOICE SUBMISSION

> The following directions for the submission of invoices must be
> followed to meet the requirements of a \"proper\" payment request
> pursuant to FAR 32.9, and must be in accordance with the General
> Provisions clause 52.232-25 Prompt Payment (MAR 2001).

Invoices/financing requests shall be submitted in an original and three
copies to:

Contracting Officer

Agency for Healthcare Research and Quality

Division of Contracts Management

Executive Office Center

2101 East Jefferson Street, Suite 601

Rockville, Maryland 20852

**G.4 INFORMATION ON VOUCHERS**

\(1\) The Contractor agrees to include the following minimum information
on vouchers:

\(a\) Contractor's name and invoice date;

\(b\) Contract Number;

\(c\) Description and price of services actually rendered;

\(d\) Other substantiating documentation or information as required by
the contract;

\(e\) Name (where practicable), title, phone number, and complete
mailing address or responsible official to whom payment is to be sent;
and

\(f\) The Internal Revenue Service Taxpayer Identification Number.

\(2\) The Contractor shall furnish the following [minimum]{.underline}
information in support of costs submitted:

\(a\) [Direct Labor]{.underline} - include all persons, listing the
person's name, title, number of hours or days worked, the total cost per
person and a total amount of this category;

\(b\) [Fringe Costs]{.underline} - show rate, base and total amount as
well as verification/allowability or rate changes (when applicable);

\(c\) [Overhead or Indirect Costs]{.underline} - show rate, base and
total amount as well as verification/allowability or rate changes (when
applicable);

\(d\) [Consultants]{.underline} - include the name, number of days or
hours worked, a total amount per consultant and a total amount for this
category;

\(e\) [Travel]{.underline} - include for each airplane or train trip
taken the name of the traveler, date of travel, destination, the
transportation costs including ground transportation, shown separately,
and per diem costs. Other travel costs shall also be listed. A total
amount for this category shall be provided;

\(f\) [Subcontractors]{.underline} - include for each subcontractor, the
same data that is being provided for the prime contractor. A total
number for this category shall be provided.

\(g\) [Data Processing]{.underline} - include all non-labor costs, i.e.,
computer time, equipment purchase, lease or rental, data tapes, etc. A
total amount for this category shall be provided.

\(h\) [Other]{.underline} - include a listing of all other direct
charges to the contract, i.e., office supplies, telephone, equipment
rental, duplication, etc.

\(i\) [Equipment Cost]{.underline} - itemize and identify separately
from material costs including reference to approval in all cases;

\(j\) [G&A]{.underline} - show rate, base and total as well as
verification/allowability of rate changes (when applicable); and

\(k\) [Fee]{.underline} - show rate, base and total.

\(3\) Payment shall be made by:

PSC Finance

Parklawn Building, Room 16-23

5600 Fishers Lane

Rockville, Maryland 20857

Telephone Number (301) 443-6766

**G.5 INDIRECT COST RATES AND FEE**

> In accordance with Federal Acquisition Regulation (FAR) (48 CFR
> Chapter 1) Clause 52.216-7(d)(2), [Allowable Cost and
> Payment]{.underline}, incorporated by reference in this contract, in
> Part II, Section I, the primary contact point responsible for
> negotiating provisional and/or final indirect cost rates is the
> cognizant contracting official as set forth in FAR Subpart 42.7 -
> Indirect Cost Rates.
>
> Reimbursement will be limited to the rates and time periods covered by
> the negotiated agreements. The rates, if negotiated, are hereby
> incorporated without further action of the Contracting Officer.

**G.6 ELECTRONIC FUNDS TRANSFER**

Pursuant to FAR 52.232-34, Payment by Electronic Funds Transfer - Other
than Central Contractor Registration (MAY 1999), the Contractor shall
designate a financial institution for receipt of electronic funds
transfer payments. This designation shall be submitted, in writing, to
the finance office designated in the contract.

**SECTION H - SPECIAL CONTRACT REQUIREMENTS**

**H.1 AWARD FEE**

**\[NOTE TO OFFEROR: The Government anticipates a Cost-Plus-Award Fee
contract to result from this solicitation. In this type of contract, the
contractor shall receive a small base fee. In addition to the base fee,
award fee will be tied to evaluation of specific products/ services.\]**

The Agency's decision to pay or not to pay Award Fee in no way alters
the contractor's responsibilities to perform any functions or produce
any deliverables required by this contract. The Agency's decision to pay
or not to pay award fee in no way alters the Department's obligation to
pay the contractor for satisfactory deliverables in accordance with this
contract.

Award Fee is available for services and products identified below:

**ANNUAL AMOUNTS AVAILABLE FOR AWARD FEE (to be evaluated and paid
semi-annually):**

**EACH CONTRACT YEAR**

+----------------+--------------+--------+---------+--------+---------+
| **             | **Award      | *      | **Award | *      | **Award |
| Service/Task** | Evaluation   | *Award | for     | *Award | for     |
|                | Un           | for**  | Evalu   | for    | Evalu   |
| **See amounts  | acceptable** |        | ation** | Evalua | ation** |
| available      |              | **Eval |         | tion** |         |
| annually at    | Below 61%    | uation | **      |        | **Sup   |
| Section B.2**  |              | Accept | Satisfa | *      | erior** |
|                | Reduces base | able** | ctory** | *Excel |         |
|                | fee by       |        |         | lent** | 100%    |
|                | \$1000       | 0%     | 40%     |        |         |
|                | s            |        |         | 80%    | 90-100  |
|                | emi-annually | 61-69  | 70-79   |        |         |
|                |              |        |         | 80-89  |         |
+----------------+--------------+--------+---------+--------+---------+
| Recruit,       |              |        |         |        |         |
| Manage and     |              |        |         |        |         |
| Support Panel  |              |        |         |        |         |
| of Experts     |              |        |         |        |         |
| (Task 1)       |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Design,        |              |        |         |        |         |
| Implement,     |              |        |         |        |         |
|                |              |        |         |        |         |
| and Maintain a |              |        |         |        |         |
| System for     |              |        |         |        |         |
| Updating       |              |        |         |        |         |
| Quality        |              |        |         |        |         |
| Measures (Task |              |        |         |        |         |
| 2)             |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Design,        |              |        |         |        |         |
| Implement, and |              |        |         |        |         |
| Maintain a     |              |        |         |        |         |
| System for     |              |        |         |        |         |
| Evaluating     |              |        |         |        |         |
| Measures (Task |              |        |         |        |         |
| 3)             |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Technical      |              |        |         |        |         |
| Requirements   |              |        |         |        |         |
| for Creating   |              |        |         |        |         |
| the National   |              |        |         |        |         |
| Quality        |              |        |         |        |         |
| Measure        |              |        |         |        |         |
| Clearinghouse  |              |        |         |        |         |
| Web Site (Task |              |        |         |        |         |
| 4)             |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Provide        |              |        |         |        |         |
| Technical      |              |        |         |        |         |
| Assistance to  |              |        |         |        |         |
| NQMC Users     |              |        |         |        |         |
| (Task 5)       |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Design,        |              |        |         |        |         |
| Implement and  |              |        |         |        |         |
| Maintain an    |              |        |         |        |         |
| Electronic     |              |        |         |        |         |
| Forum for      |              |        |         |        |         |
| Users of the   |              |        |         |        |         |
| NQMC Web Site  |              |        |         |        |         |
| (Task 6)       |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Management     |              |        |         |        |         |
| (Task 7)       |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+
| Total Award    |              |        |         |        |         |
| Fee            |              |        |         |        |         |
+----------------+--------------+--------+---------+--------+---------+

**Each Pool gets 14.25%** of the available award fee for the current
year. The evaluation rating will be that % of the available award fee.

The Contracting Officer and the GPO shall together determine whether a
service/ task is delivered on time and within budget. If it is deemed to
be on time and within budget, it will be evaluated for quality by an
Award Fee Evaluation Group (Group). Each Group will consist of the GPO,
the Contracting Officer or his/ her designee, and approximately two
other government officials or non-government personnel (depending on
specific expertise) specified by the Project Officer and approved by the
Contracting Officer.

Each member of the Award Fee Evaluation Group will evaluate the quality
of the deliverable using a numerical rating scale from 0 to 100. The
scale is defined as follows:

  --------------------------------- -------------- ------------- --------------
  **Definition of Rating**          **Adjective    **Numerical   **Fee %**
                                    Rating**       Rating**      

  [Superior]{.underline} -          Superior       90 - 100      100%
  Contractor's performance exceeds                               
  standards by substantial margin,                               
  the monitor can cite few areas                                 
  for improvement, all of which are                              
  minor.                                                         

  [Excellent]{.underline} -         Excellent      80 - 89       80%
  Contractor's performance exceeds                               
  standard, and although there may                               
  be several areas for improvement,                              
  these are more than offset by                                  
  better performance in other areas                              

  [Satisfactory]{.underline} -      Satisfactory   70 - 79       40%
  Contractor's performance is                                    
  standard and areas for                                         
  improvement are approximately                                  
  offset by better performance in                                
  other areas.                                                   

  [Acceptable]{.underline} -        Acceptable     61 - 69       0%
  Contractor's performance is                                    
  standard.                                                      

  [Unacceptable]{.underline} -      Unacceptable   Below 61      Unacceptable
  Contractor's performance is less                               Performance
  than standard by a substantial                                 Reduces Base
  margin, and the monitor can cite                               Fee by \$1000
  many areas for improvement which                               per 6 month
  are not offset by better                                       period
  performance in other areas.                                    
  --------------------------------- -------------- ------------- --------------

Each member of the Group will give the service/task a numerical rating
and those ratings will be averaged. An Average of less than 61
(Unacceptable) will result in a reduction in the base fee of \$1000 for
that six month rating period. An average score between 61-69 (Acceptable
Performance) will result in award of 0% of the Award Fee, an average of
70-79 (Satisfactory Performance) will result in award of 40% of the
Award Fee, an average of 80-89 (Excellent) will result in award of 80%
of the Award Fee, and an average of 90 through 100 (Superior) will
result in Award of 100% of the Award Fee for each Service/Task being
evaluated. **The Award determinations are not subject to the disputes
clause.**

**H.2 PRIOR REVIEW OF PUBLICATION AND DISSEMINATION OF MATERIAL DERIVED
FROM WORK PERFORMED UNDER THIS CONTRACT**

> Section 924(c) of the Public Health Service Act as amended by the
> Healthcare Research and Quality Act of 1999 states in part that \"No
> information, if the establishment or person supplying the information
> or described in it is identifiable, obtained in the course of
> activities undertaken or supported under this title may be used for
> any purpose other than the purpose for which it was supplied unless
> such establishment or person has consented (as determined under
> regulations of the Director) to its use for such other purpose. Such
> information may not be published or released in other form if the
> person who supplied the information or who is described in it is
> identifiable unless such person has consented (as determined under
> regulations of the Director) to its publication or release in other
> form.\" Section 923 (b) (1) states that "The Director shall take
> appropriate action to ensure that statistics and analyses developed
> under this title are of high quality, timely and duly comprehensive,
> and the statistics are specific, standardized, and adequately analyzed
> and indexed."
>
> Except as otherwise authorized under this contract, to ensure
> compliance with the requirements of section 924(c) and 923 (b) (1),
> the Agency for Healthcare Research and Quality (AHRQ) must, prior to
> any release by the contractor, review all reports, presentations, or
> other disclosures that contain information, statistics, analytical
> material, or any other material which is based on or derived from work
> performed under this contract. Accordingly:

\(A\) The contractor must, in writing, request permission to publish,
present or otherwise release any reports/material/data developed under
the contract. AHRQ will, within two months of the receipt of this
request and the proposed publication/presentation, review the proposed
disclosure of such information or material to determine that (1) the
information is being used solely for the purpose for which it was
supplied and (2) the privacy of entities supplying the information or
described in it is not violated; and (3) the quality of statistical work
and/or analyses meets the statutory standards cited above. AHRQ will
provide written notification to the contractor of the results of this
review within this same two month time period.

\(B\) Except as provided in paragraph (C) below, the Contractor will not
publish, have published, or otherwise disseminate any material resulting
from the work being performed under this contract including the final
report, unless notified in writing by the Project Officer that the
review is complete and no potential violations or quality deficiencies
with respect to statutory standards were noted. Any noted violations or
deficiencies must be addressed by the contractor in accordance with
instructions provided by the Project Officer and resubmitted in writing
to the Project Officer at least ten business days before the release of
any material.

\(C\) In the event no written notice of review is received from the
Project Officer by the end of the two-month period following a request
to publish a final or other report or to make a presentation or other
disclosure of material derived from work performed under this contract,
the Contractor may publish, present, or otherwise disclose this material
subject to the provisions of section 924(c) and 923 (b)(1).

> However, the Contractor must print prominently on the report or any
> portion of it which is released, or state prior to any oral or other
> disclosure of material derived from work performed under this
> contract, the following disclaimer:

**\"THIS REPORT/PRESENTATION HAS NOT BEEN APPROVED BY THE AGENCY FOR
HEALTHCARE RESEARCH AND QUALITY.\"**

\(D\) Whether or not a written notification is received, the Contractor
must print the following statement prominently on written reports or
other forms of recorded data derived from work performed under this
contract which is to be released or preceding any presentation or other
oral disclosure of such material make the following statement:

**\"THE CONFIDENTIALITY OF IDENTIFIABLE INFORMATION IN THIS REPORT,
PRESENTATION, OR (specify other form of disclosure) IS PROTECTED BY
FEDERAL LAW, SECTION 924(c) OF THE PUBLIC HEALTH SERVICE ACT AS AMENDED
BY THE HEALTH CARE RESEARCH AND QUALITY ACT OF 1999. THIS INFORMATION IS
BEING USED SOLELY FOR THE PURPOSE FOR WHICH IT WAS SUPPLIED. NO
IDENTIFIABLE INFORMATION ABOUT ANY INDIVIDUALS SUPPLYING THE INFORMATION
OR DESCRIBED IN IT IS KNOWINGLY DISCLOSED EXCEPT WITH THE CONSENT OF
SUCH INDIVIDUALS.\"**

5.  Whenever any data or analysis is to be developed by a subcontractor
    under this contact, the contractor must include the terms of
    paragraph (A), (B), (C), or (D) above in the subcontract, without
    substantive alteration and with a prohibition on the subcontractor
    engaging in further assignment of its obligations to the Contractor,
    and no other clause will be included to diminish the Government's
    review rights prior to publication and or dissemination of material
    derived from work performed under the contract.

**H.3 RIGHTS IN DATA \-- SPECIAL WORKS *(FAR Clause 52-227-17 June 1987)
(DEVIATION)***

\(a\) Definitions

> \"Computer software\", as used in this clause, means computer
> programs, computer data bases, and documentation thereof.
>
> \"Data\", as used in this clause, means recorded information,
> regardless of form or media on which it may be recorded (e.g.,
> reports, tabulations, questionnaires, punch cards, data tapes, data
> files, tables, data processing and computer programs, graphic
> representations, sound recordings, form, work flow charts, equipment
> descriptions, and works of any similar nature). The term does not
> include information incidental to contract administration, such as
> financial, administrative, cost or pricing, or management information.
>
> \"Form, fit, and function data\", as used in this clause, means data
> relating to items, components, or processes that are sufficient to
> enable physical and functional interchangeability, as well as data
> identifying source, size, configuration, mating, and attachment
> characteristics, functional characteristics, and performance
> requirements; except that for computer software it means data
> identifying source, functional characteristics, and performance
> requirements, but specifically excludes the source code, algorithm,
> process, formulae, and flow charts of the software.
>
> \"Unlimited rights\", as used in this clause, means the right of the
> Government to use, disclose, reproduce, prepare derivative works,
> distribute copies to the public, and perform publicly and display
> publicly, in any manner and for Agency for Healthcare Research and
> Quality purposes, and to have or permit others to do so for Agency for
> Healthcare Research and Quality purposes.

\(b\) Allocation of Rights

> \(1\) The Government shall have:

\(i\) Unlimited rights in all data delivered under this contract, and in
all data first produced in the performance of this contract, except as
provided in paragraph (c) of this clause for copyright.

\(ii\) The right to limit exercise of claim to copyright in data first
produced in the performance of this contract, and to obtain assignment
of copyright in such data, in accordance with subparagraph (c)(1) of
this clause.

\(iii\) The right to limit the release and use of certain data in
accordance with paragraph (d) of this clause.

\(2\) The Contractor shall have, to the extent permission is granted in
accordance with subparagraph (c)(1) of this clause, the right to
establish claim to copyright subsisting in data first produced in the
performance of this contact.

\(c\) Copyright

\(1\) Data first produced in the performance of this contract

\(i\) The Contractor agrees not to assert, establish, or authorize other
to assert or establish, any claim to copyright subsisting in any data
first produced in the performance of the contract without prior written
permission of the Contracting Officer. When claim to copyright is made,
the Contractor shall affix the appropriate copyright notice of 17 U.S.C.
401 or 402 and acknowledgment of Government sponsorship (including
contract number) to such data when delivered to the Government, as well
as when the data are published or deposited for registration as a
published work in the U.S. Copyright Office.

> The Contractor grants to the Government and the Government\'s
> licensees, a paid-up nonexclusive, irrevocable, worldwide license for
> all such data to reproduce, prepare derivative works, distribute
> copies to the public, and perform publicly and display publicly, for
> Government purposes.

\(ii\) If the Government desires to obtain copyright in data first
produced in the performance of this contract and permission has not been
granted as set forth in subdivision (c)(1)(i) of this clause, the
Contracting Officer may direct the Contractor to establish, or authorize
the establishment of, claim to copyright in such data and to assign, or
obtain the assignment of, such copyright to the Government or its
designated assignee.

2\) Data not first produced in the performance of this contract.

> The Contractor shall not, without prior written permission of the
> Contracting Officer, incorporate in the data delivered under this
> contract any data not first produced in the performance of this
> contract and which contain the copyright notice of 17 U.S.C. 401 or
> 402, unless the Contractor identifies such data and grants to the
> government, or acquires on its behalf, a license of the same scope as
> set forth in subparagraph (c)(1) of this clause.

\(d\) Release and Use Restrictions

> Except as otherwise specifically provided for in this contract (e.g.,
> H.2(e)), the Contractor shall not use for purposes other than the
> performance of this contract, nor shall the Contractor release,
> reproduce, distribute, or publish any data first produced in the
> performance of this contract, nor authorize others to do so, without
> prior written permission of the Project Officer or until AHRQ has
> published the research for which the data were first produced.

\(e\) Indemnity

> The Contractor shall indemnify the Government and its officers,
> agents, and employees acting for the Government against any liability,
> included costs and expenses, incurred as the result of the violation
> of trade secrets, copyrights, or right of privacy or publicity,
> arising out of the creation, delivery, publication, or use of any data
> furnished under this contract; or any libelous or other unlawful
> matter contained in such data.

The provisions of this paragraph do not apply unless the Government
provides notice to the Contractor as soon as practicable of any claim or
suit, affords the Contractor an opportunity under applicable laws,
rules, or regulations to participate in the defense thereof, and obtains
the Contractor\'s consent to the settlement of any suit or claim other
than as required by final decree of a court of competent
jurisdiction***.*** Further, these provisions do not apply to material
furnished to the Contractor by the Government and incorporated in data
to which this clause applies, nor in cases where Government officers,
agents, and employees are solely at fault.

\(f\) The Contractor must release all required deliverables under this
contract solely in accordance with the reporting requirements of this
contract.

\(g\) In accordance with the Federal Register (Vol. 57, No. 167, August
27, 1992, pp:38845-38848) the Contractor is to provide for secure and
confidential storage, retrieval access, maintenance, and disposition of
data and other information used in the work performed under the
contract.

\(h\) Whenever any data is to be developed by a subcontractor under this
contract, the Contractor must include the terms of H.2(a), (b), (c),
(d), (e), (f) and (g) in the subcontract, without substantive
alteration, and with a prohibition on the subcontractor engaging in
further assignment of its obligations to the contractor, and no clause
may be included to diminish the Government\' rights in those data.

**H.4 DEBARMENT**

> Violation of the special provision of this contract entitled **REVIEW
> OF PUBLICATION AND DISSEMINATION OF MATERIAL DERIVED FROM WORK
> PERFORMED UNDER THIS CONTRACT** would be viewed as a serious violation
> of the terms of this contract as the requirements in this provision
> reflect statutory obligations and responsibilities of the Agency for
> Healthcare Research and Quality. Such violations, as well as other
> violations of the contract terms which are deemed serious, could
> result in the initiation of debarment proceedings in accordance with
> the Federal Acquisition Regulations and the Department of Health and
> Human Services implementing regulations. In addition, in accordance
> with Section 924 (d) of the Healthcare Research and Quality Act of
> 1999, any person who violates subsection (c) of Section 924 shall be
> subject to a civil monetary penalty of not more than \$10,000 for each
> such violation. Such penalty shall be imposed and collected in the
> same manner as civil money penalties under subsection (a) of section
> 1128A of the Social Security Act are imposed and collected.

**H.5 SUBCONTRACTS**

The Contractor must include in any subcontracts executed or used to
provide the support specified in this contract the terms of requirements
H.2, H.3, and H.4. These requirements are to be included without
substantive alteration, and no clause may be included to diminish these
requirements.

> Award of any subcontract is subject to the written approval of the
> Contracting Officer upon review of the supporting documentation as
> required by FAR Clause 52.215-12, Subcontractor Cost or Pricing Data,
> of the General Clauses incorporated into this contract. A copy of the
> signed subcontract shall be provided to the Contracting Officer.

**H.6 LATE PAYMENTS TO THE GOVERNMENT**

> Late payment of debts owed the Government by the Contractor, arising
> from whatever cause, under this contract/order shall bear interest at
> a rate or rates to be established in accordance with the Treasury
> Fiscal Requirements Manual. For purposes of this provision, late
> payments are defined as payments received by the Government more than
> 30 days after the Contractor has been notified in writing by the
> Contracting Officer of:

a\. The basis of indebtedness.

b\. The amount due.

c\. The fact that interest will be applied if payment is not received
within 30 days from the date of mailing of the notice.

d\. The approximate interest rate that will be charged.

**H.7 PRIVACY ACT**

> The Privacy Act clauses cited in Section I (FAR 52.224-1 and 52.224-2)
> are applicable to the consultant records kept by the Contractor for
> the Agency for Healthcare Research and Quality.
>
> You are hereby notified that the Contractor and its employees are
> subject to criminal penalties for violations of the Act (5 U.S.C.
> 552a(i)) to the same extent as employees of the Department. The
> Contractor shall assure that each Contractor employee is aware that
> he/she can be subjected to criminal penalties for violations of the
> Act. Disposition instructions: Records are to be destroyed after
> contract closeout is completed and final payment is made and in
> accordance with IRS regulations.

**H.8 GOVERNMENT-FURNISHED MATERIALS**

> Unless otherwise stated in a specific task order, the contractor will
> furnish all the necessary personnel, materials, data, facilities, or
> services or otherwise all things necessary for or incident to the
> performance of the tasks stated in an individual task order.

**H.9 POST AWARD EVALUATION OF CONTRACTOR PERFORMANCE**

a.  [Contractor Performance Evaluations]{.underline}

> Interim and final evaluations of contractor performance will be
> prepared on this contract in accordance with FAR Subpart 42.15. A
> final performance evaluation will be prepared at the time of
> completion of work. In addition to the final evaluation, interim
> evaluations will be prepared annually to coincide with the anniversary
> date of the contract.
>
> Interim and final evaluations will be provided to the Contractor as
> soon as practicable after completion of the evaluation. The Contractor
> will be permitted thirty days to review the document and to submit
> additional information or a rebutting statement. Any disagreement
> between the parties regarding an evaluation will be referred to an
> individual one level above the Contracting Officer, whose decision
> will be final.
>
> Copies of the evaluations, Contractor responses, and review comments,
> if any, will be retained as part of the contract file, and may be used
> to support future award decisions.
>
> b\. [Electronic Access to Contractor Performance
> Evaluations]{.underline}
>
> Contractors that have Internet capability may access evaluations
> through a secure Web site for review and comment by completing the
> registration form that can be obtained at the following address:
>
> The registration process requires the Contractor to identify an
> individual that will serve as a primary contact and who will be
> authorized access to the evaluation for review and comment. In
> addition, the Contractor will be required to identify an alternate
> contact who will be responsible for notifying the cognizant
> contracting official in the event the primary contact is unavailable
> to process the evaluation within the required 30-day time frame.

**PART II ‑ CONTRACT CLAUSES (05/01-DCM)**

> **(FAC 97-25)**

**SECTION I**

**CONTRACT CLAUSES**

**GENERAL CLAUSES FOR A**

**COST‑PLUS‑AWARD FEE CONTRACT**

**I.1 CLAUSES INCORPORATED BY REFERENCE (FEBRUARY 1998)**

> This contract incorporates the following clauses by reference, with
> the same force and effect as if they were given in full text. Upon
> request, the Contracting Officer will make their full text available.
> Also, the full text of a clause may be assessed electronically at this
> address: http://www.arnet.gov/far/

**FEDERAL ACQUISITION REGULATION (FAR) (48 CFR CHAPTER 1) CLAUSES**

**FAR Clause No. Title and Date**

52.203‑3 Gratuities (APRIL 1984)

52.203‑5 Covenant Against Contingent Fee (APRIL 1984)

52.203‑6 Restrictions on Subcontractor Sales to the Government

(July 1995)

52.203‑7 Anti‑Kickback Procedures (JULY 1995)

52.203-8 Cancellation, Rescission, and Recovery of Funds for Illegal or
Improper Activity (JAN 1997)

52.203-10 Price or Fee Adjustment for Illegal or Improper Activity (JAN
1997)

52.203-12 Limitation on Payments to Influence Certain Federal
Transactions (JUN 1997)

52.204-4 Printing/Copying Double-Sided on Recycled Paper (AUG 2000)

52.209-6 Protecting the Government\'s Interest When Subcontracting With
Contractors Debarred, Suspended, or Proposed for Debarment (JULY 1995)

52.215‑2 Audit and Records - Negotiation (JUNE 1999)

52.215‑8 Order of Precedence-Uniform Contract Format (Oct 1997)

52.215‑10 Price Reduction for Defective Cost or Pricing Data (OCT 1997)
(applicable to contract actions over \$550,000)

52.215‑12 Subcontractor Cost or Pricing Data (OCT 1997) (applicable to
contract actions over \$550,000)

52.215-15 Pension Adjustments and Asset Reversions (DEC 1998)

52.215-18 Reversion or Adjustment of Plans for Postretirement Benefits
Other Than Pensions (PRB) (OCT 1997)

52.215-19 Notification of Ownership Changes (OCT 1997)

52.216‑7 Allowable Cost and Payment (MAR 2000)

52.216‑8 Fixed Fee (MARCH 1997)

52.217-8 Option to Extend Services (NOV 1999)

52.219-4 Notice of Price Evaluation Preference for HUBZone Small
Business Concerns (JAN 1999)

52.219‑8 Utilization of Small Business Concerns (OCT 2000)

52.219‑9 Small Business Subcontracting Plan (OCT 2000) (Applicable to
contracts over \$500,000)

52.219-16 Liquidated Damages - Subcontracting Plan (JAN 1999)

52.219-23 Notice of Price Evaluation Adjustment for Small Disadvantaged
Business Concerns (MAR 2001)

52.219-25 Small Disadvantaged Business Participation Plan -
Disadvantaged Status and Reporting (OCT 1999)

52.222‑2 Payment for Overtime Premiums (JULY 1990). The amount in
paragraph (a) is \"zero\" unless different amount is separately stated
elsewhere in contract.

52.222‑3 Convict Labor (AUG 1996)

52.222‑26 Equal Opportunity (FEB 1999)

52.222‑35 Affirmative Action for Disabled Veterans and Veterans of the
Vietnam Era (APR 1998)

52.222‑36 Affirmative Action for Workers With Disabilities (JUNE 1998)

52.222‑37 Employment Reports on Disabled Veterans and Veterans of the
Vietnam Era (JAN 1999)

52.223-6 Drug Free Workplace (MAR 2001)

52.223-14 Toxic Chemical Release Reporting (OCT 2000)

52.224‑1 Privacy Act Notification (APRIL 1984)

52.224‑2 Privacy Act (APRIL 1984)

52.225‑1 Buy American Act ‑ Balance of Payments Program - Supplies (FEB
2000)

52.225-13 Restrictions on Certain Foreign Purchases (JUL 2000)

52.227‑1 Authorization and Consent (JULY 1995)

52.227‑2 Notice and Assistance Regarding Patent and Copy‑Right
Infringement (AUG 1996)

52.227‑3 Patent Indemnity (APRIL 1984)

52.227‑14 Rights in Data ‑ General (JUNE 1987)

52.228-7 Insurance-Liability to Third Persons (MAR 1996)

52.230‑2 Cost Accounting Standards (APR 1998)

52.230‑3 Disclosure and Consistency of Cost Accounting Practices

(APR 1998)

52.230‑6 Administration of Cost Accounting Standards (NOV 1999)

52.232‑9 Limitation on Withholding of Payments (APRIL 1984)

52.232‑17 Interest (JUNE 1996)

52.232‑20 Limitation of Cost (APR 1984)

52.232‑22 Limitation of Funds (APR 1984) (This clause supersedes the
Limitation of Cost clause found in the General Clauses of this
contract.)

52.232‑23 Assignment of Claims (JAN 1986)

52.232‑25 Prompt Payment (MAR 2001)

52.232-34 Payment by Electronic Funds Transfer-Other than Central
Contractor Registration (MAY 1999)

52.233‑1 Disputes (DEC 1998)

52.233‑3 Protest After Award (AUG 1996) Alternate I (JUNE 1985)

52.237-10 Identification of Uncompensated Overtime (Oct 1997)

52.242‑1 Notice of Intent to Disallow Costs (APRIL 1984)

52.242-3 Penalties for Unallowable Costs (OCT 1995)

52.242-4 Certification of Final Indirect Costs (Jan 1997)

52.242-13 Bankruptcy (JULY 1995)

52.243‑2 Changes ‑ Cost Reimbursement (AUG 1987) ‑

Alternate II (APRIL 1984)

52.244‑2 Subcontracts (AUGUST 1998)

52.244‑5 Competition in Subcontracting (DEC 1996)

52.245‑5 Government Property (Cost Reimbursement, Time‑and‑Material, or
Labor‑Hour Contract (JAN 1986)

52.246‑5 Inspection of Services‑Cost Reimbursement (APRIL 1984)

52.246‑23 Limitation of Liability‑(FEB 1997)

52.248-1 Value Engineering (FEB 2000)

52.249‑6 Termination (Cost‑Reimbursement) (SEP 1996)

52.249‑14 Excusable Delays (APRIL 1984)

52.251‑1 Government Supply Sources (APRIL 1984)

52.253-1 Computer Generated Forms (JAN 1991)

> **DEPARTMENT OF HEALTH AND HUMAN SERVICES ACQUISITION REGULATION
> (HHSAR) (48 CFR CHAPTER 3) CLAUSES**

**HHSAR**

**Clause No. Title and Date**

352.202‑1 Definitions (JAN 2001) Alternate I (JAN 2001)

352.224‑70 Confidentiality of Information (APRIL 1984)

352.228‑7 Insurance - Liability to Third Persons (DEC 1991)

352.232‑9 Withholding of Contract Payments (APRIL 1984)

352.233‑70 Litigation and Claims (APR 1984)

352.242‑71 Final Decisions on Audit Findings (APRIL 1984)

352.270‑1 Accessibility of Meetings, Conferences, and Seminars to
Persons With Disabilities (JAN 2001)

352.270-6 Publication and Publicity (JUL 1991)

352.270‑7 Paperwork Reduction Act (JAN 2001)

The following clauses are applicable to this contract and are provided
in full text:

> **KEY PERSONNEL (APRIL 1984)(HSAR 352.270‑5)**
>
> The personnel specified in this contract are considered to be
> essential to the work being performed hereunder. Prior to diverting
> any of the specified individuals to other programs, the Contractor
> shall notify the Contracting Officer reasonably in advance and shall
> submit justification (including proposed substitutions) in sufficient
> detail to permit evaluation of the impact on the program. No diversion
> shall be made by the Contractor without the written consent of the
> Contracting Officer; provided, that the Contracting Officer may ratify
> in writing such diversion and such ratification shall constitute the
> consent of the Contracting Officer required by this clause. The
> contract may be amended from time to time during the course of the
> contract to either add or delete personnel, as appropriate.

(End of clause)

**PART III- LIST OF DOCUMENTS, EXHIBITS AND ATTACHMENTS**

**SECTION J - LIST OF ATTACHMENTS**

[Attachment Page Number]{.underline}

1\. List of Reference Materials 100

2\. Past Performance Questionnaire and Contractor Performance Form
100-105

3\. DHHS Small Disadvantaged, Hubzone and Women-Owned Small 106-113

Business Subcontracting Plan

4\. Proposal Intent Response Sheet 114

5\. SF LLL-A, Disclosure of Lobbying Activities 114-119

6\. Sample Estimated Cost Proposal Format 120-121

7\. Performance Indicators 122-124

**NOTE: ALL ATTACHMENTS ARE LOCATED AT THE END OF THIS REQUEST FOR
PROPOSAL**

(FAC 97-25)

**PART IV. REPRESENTATIONS AND INSTRUCTIONS**

**SECTION K**

**REPRESENTATIONS, CERTIFICATIONS AND OTHER STATEMENTS OF OFFERORS**

K.1 HHSAR 315.204-5 Representations and Instructions

K.2 FAR 52.203-2 Certification of Independent Price Determination (APRIL
1985)

K.3 FAR 52.203-11 Certification and Disclosure Regarding Payments to
Influence Certain Federal Transactions (APR 1991)

K.4 FAR 52.204-3 Taxpayer Identification (OCT 1998)

K.5 FAR 52.204-5 Women-Owned Business Other than Small Business (May
1999)

K.6 FAR 52.209-5 Certification Regarding Debarment, Suspension, Proposed
Debarment, and Other Responsibility Matters (APR 2001)

K.7 FAR 52.215-6 Place of Performance (OCT 1997)

K.8 FAR 52.219-1 Small Business Program Representations (MAR 2001)

K.9 FAR 52.222-21 Prohibition of Segregated Facilities (FEB 1999)

K.10 FAR 52.222-22 Previous Contracts and Compliance Reports (FEB 1999)

K.11 FAR 52.222-25 Affirmative Action Compliance(APRIL 1984)

K.12 FAR 52.223-13 Certification of Toxic Chemical Release

Reporting (OCT 2000)

K.13 FAR 52.225-2 Buy American Act - Balance of Payment Program
Certificate (FEB 2000)

K.14 FAR 52.226-2 Historically Black College or University and Minority
Institution Representation (MAR 2001)

K.15 FAR 52.230-1 Cost Accounting Standards Notice and Certification
(JUNE 2000)

K.16 FAR 15.406-2 Certificate of Current Cost and Pricing Data

K.17 P.L. 103-227 Certification Regarding Environmental

> Tobacco Smoke Use for Full and Open Competition

52.219-22 Small Disadvantaged Business Status

(Oct 1999) Alternate I (Oct 1998)

K.l REPRESENTATIONS AND INSTRUCTIONS

\(a\) Section K, Representations, certifications, and other statements
of offerors.

\(1\) This section shall begin with the following and continue with the
applicable representations and certifications:

TO BE COMPLETED BY THE OFFEROR: (The Representations and Certifications
must be executed by an individual authorized to bind the Offeror.) The
Offeror makes the following Representations and Certifications as part
of its proposal. (Check or complete all appropriate boxes or blanks on
the following pages.)

(Name of Offeror) (RFP No.)

(Signature of Authorized Individual) (Date)

(Typed Name of Authorized Individual)

NOTE: The penalty for making false statements in offers is prescribed in
18 U.S.C. 1001.

K.2 CERTIFICATE OF INDEPENDENT PRICE

DETERMINATION (APR 1985) (FAR 52.203-2)

\(a\) The offeror certifies that\--

> \(1\) The prices in this offer have been arrived at independently,
> without, for the purpose of restricting competition, any consultation,
> communication, or agreement with any other offeror or competitor
> relating to (i) those prices, (ii) the intention to submit an offer,
> or (iii) the methods or factors used to calculate the prices offered;
>
> \(2\) The prices in this offer have not been and will not be knowingly
> disclosed by the offeror, directly or indirectly, to any other offeror
> or competitor before bid opening (in the case of a sealed bid
> solicitation) or contract award (in the case of a negotiated
> solicitation) unless otherwise required by law; and

\(3\) No attempt has been made or will be made by the offeror to induce
any other concern to submit or not to submit an offer for the purpose of
restricting competition.

\(b\) Each signature on the offer is considered to be a certification by
the signatory that the signatory\--

\(1\) Is the person in the offeror\'s organization responsible for
determining the prices being offered in this bid or proposal, and that
the signatory has not participated and will not participate in any
action contrary to subparagraphs (a)(1) through (a)(3) above; or

(2)(i) Has been authorized, in writing, to act as an agent for the
following principals in certifying that those principals have not
participated, and will not participate in any action contrary to
subparagraphs (a)(1) through (a)(3) above.

\[Insert full name of person(s) in the offeror\'s organization
responsible for determining the prices offered in the bid or proposal,
and the title of his or her position in the offeror\'s organization\];

\(ii\) As an authorized agent, does certify that the principals named in
subdivision (b)(2)(i) above have not participated, and will not
participate, in any action contrary to subparagraphs (a)(1) through
(a)(3) above; and

\(iii\) As an agent, has not personally participated, and will not
participate, in any action contrary to subparagraphs (a)(1) through
(a)(3) above.

\(c\) If the offeror deletes or modifies subparagraph (a)(2) above, the
offeror must furnish with its offer a signed statement setting forth in
detail the circumstances of the disclosure.

(End of provision)

> K.3 CERTIFICATION AND DISCLOSURE REGARDING
>
> PAYMENTS TO INFLUENCE CERTAIN FEDERAL TRANSACTIONS (APR 1991) (FAR
> 52.203-11)

\(a\) The definitions and prohibitions contained in the clause at

> FAR 52.203-12, Limitation on Payments to Influence Certain Federal
> Transactions, included in this solicitation, are hereby incorporated
> by reference in paragraph (b) of this certification.

\(b\) The offeror, by signing its offer, hereby certifies to the best of
his or her knowledge and belief that on or after December 23, 1989,\--

\(1\) No Federal appropriated funds have been paid or will be paid to
any person for influencing or attempting to influence an officer or
employee of any agency, a Member of Congress, an officer or employee of
Congress, or an employee of a Member of Congress on his or her behalf in
connection with the awarding of any Federal contract, the making of any
Federal grant, the making of any Federal loan, the entering into of any
cooperative agreement, and the extension, continuation, renewal,
amendment, or modification of any Federal contract, grant, loan, or
cooperative agreement;

\(2\) If any funds other than Federal appropriated funds (including
profit or fee received under a covered Federal transaction) have been
paid, or will be paid to any person for influencing or attempting to
influence an officer or employee of any agency, a Member of Congress, an
officer or employee of Congress, or an employee of a Member of Congress
on his or her behalf in connection with this solicitation, the offeror
shall complete and submit, with its offer, OMB Standard Form-LLL,
Disclosure of Lobbying Activities, to the Contracting Officer; and

\(3\) He or she will include the language of this certification in all
subcontract awards at any tier and require that all recipients of
subcontract awards in excess of \$100,000 shall certify and disclose
accordingly.

\(c\) Submission of this certification and disclosure is a prerequisite
for making or entering into this contract imposed by section 1352, title
31, United States Code. Any person who makes an expenditure prohibited
under this provision or who fails to file or amend the disclosure form
to be filed or amended by this provision, shall be subject to a civil
penalty of not less than \$10,000 and not more than \$100,000 for each
such failure.

(End of provision)

K.4 TAXPAYER IDENTIFICATION

(FAR 52.204-3) (OCT 1998)

\(a\) Definitions:

> \"Common parent,\" as used in this provision, means that corporate
> entity that owns or controls an affiliated group of corporations that
> files its Federal income tax returns on a consolidated basis, and of
> which the offeror is a member.
>
> \"Taxpayer Identification Number (TIN),\" as used in this provision,
> means the number required by the Internal Revenue Service (IRS) to be
> used by the offeror in reporting income tax and other returns. The TIN
> may either be a Social Security Number or an Employer Identification
> Number.

\(b\) All offerors are required to submit the information required in
paragraph (d) through (f) of this provision to comply with debt
collection requirements of 31 U.S.C. 7701(c) and 3325(d), reporting
requirements of 26 U.S.C. 6041, 6041A, and 6050M and implementing
regulations issued by the IRS. If the resulting contract is subject to
the payment reporting requirements described in FAR 4.904, the failure
or refusal by the offeror to furnish the information may result in a 31
percent reduction of payments otherwise due under the contract.

(c) The TIN may be used by the Government to collect and report on any
    delinquent amounts arising out of the offeror's relationship with
    the Government (31 U.S.C. 7701(c)(3)). If the resulting contract is
    subject to the payment reporting requirements described in FAR
    4.904, the TIN provided hereunder may be matched with IRS records to
    verify the accuracy of the offeror's TIN.

```{=html}
<!-- -->
```
(c) Taxpayer Identification Number (TIN).

( ) TIN:

( ) TIN has been applied for.

( ) TIN is not required because:

( ) Offeror is a nonresident alien, foreign

corporation, or foreign partnership that does not have an income
effectively connected with the conduct of a trade or business in the
United States (U.S.) and does not have an office or place of business or
a fiscal paying agent in the U.S.;

( ) Offeror is an agency or instrumentality of a foreign government;

( ) Offeror is an agency or instrumentality of a Federal, state, or
local government.

\(e\) Type of organization.

( ) Sole proprietorship;

( ) Partnership;

( ) Corporate entity (not tax-exempt);

( ) Corporate entity (tax-exempt);

( ) Government entity (Federal, State, or local);

( ) Foreign government;

( ) International organization per 26 CFR 1.6049-4;

( ) Other\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_.

\(f\) Common Parent.

> ( ) Offeror is not owned or controlled by a common parent as defined
> in paragraph (a) of this clause.

( ) Name and TIN of common parent:

> Name
>
> TIN

(End of provision)

K.5 WOMEN-OWNED BUSINESS(Other Than Small Business

(MAY 1999) (FAR 52.204-5)

\(a\) Definition. \"Women-owned business concern,\" as used in this
provision, means a concern that is at least 51 percent owned by one or
more women; or in the case of any publicly owned business, at least 51
percent of its stock is owned by one or more women; and whose management
and daily business operations are controlled by one or more women.

\(b\) Representation.\[*Complete only if the offeror is a women-owned
business concern and has not represented itself as a small business
concern in paragraph (b)(1) of FAR 52.219-1, Small Business Program
Representations, of this solicitation.\]* The offeror represents that it
is \[ \] is not \[ \] a women-owned business concern.

(End of Provision)

K.6 CERTIFICATION REGARDING DEBARMENT,

SUSPENSION, PROPOSED DEBARMENT,

AND OTHER RESPONSIBILITY MATTERS

> (APR 2001) (FAR 52.209-5)

(a)(1) The Offeror certifies, to the best of its knowledge and belief,
that\--

> \(i\) The Offeror and/or any of its Principals\--
>
> \(A\) Are \[ \] are not \[ \] presently debarred,suspended, proposed
> for debarment, or declared ineligible for the award of contracts by
> any Federal agency;
>
> \(B\) Have \[ \] have not \[ \] , within the three-year period
> preceding this offer, been convicted of or had a civil judgement
> rendered against them for: commission of fraud of a criminal offense
> in connection with obtaining, attempting to obtain, or performing a
> public (Federal, state, or local) contract or subcontract; violation
> of Federal or state antitrust statutes relating to the submission of
> offers; or commission of embezzlement, theft, forgery, bribery,
> falsification or destruction of records, making false statements, tax
> evasion or receiving stolen property;
>
> \(C\) Are \[ \] are not \[ \] presently indicted for, or otherwise
> criminally or civilly charged by a governmental entity with,
> commission of any of the offenses enumerated in subdivision
> (a)(l)(i)(B) of this provision; and
>
> \(D\) Have\[ \] have not \[ \], within a three-year period preceding
> this offer, been convicted of or had a civil judgement rendered
> against them for: commission of fraud or a criminal offense in
> connection with obtaining, attempting to obtain, or performing a
> public (Federal, state, or local contract or subcontract; violation of
> Federal or state antitrust statutes relating to the submission of
> offers,; or commission of embezzlement, theft, forgery, bribery,
> falsification or destruction of records, making false statements, tax
> evasion, or receiving stolen property; and
>
> \(E\) Are \[ \] are not \[ \] presently indicted for, or otherwise
> criminally or civilly charged by a governmental entity with,
> commission of any of the offenses enumerated in subdivision
> (a)(1)(i)(D) of this provision.

\(ii\) (A)The Offeror, aside from the offenses enumerated in paragraphs
(a)(1)(i)(A),(B), and (C) of this provision, has \[ \] has not \[ \],
within the past three-year, relative to tax, labor and employment,
environmental, antitrust, or consumer protection laws -

> \(1\) Been convicted of a Federal or State felony (or has any Federal
> or State felony indictments currently pending against them); or
>
> \(2\) Had a Federal court judgement in a civil case brought by the
> United States rendered against them; or
>
> \(3\) Had an adverse decision by a Federal administrative law judge,
> board, or commission indicating a willful violation of law.

\(B\) If the offeror has responded affirmatively, the offeror shall
provide additional information if requested by the Contracting Officer;
and

\(iii\) The Offeror has \[ \] has not \[ \], within a three-year period
preceding this offer, had one or more contracts terminated for default
by any Federal agency.

\(2\) \"Principals,\" for the purposes of this certification, means
officers; directors; owners; partners; and, persons having primary
management or supervisory responsibilities within a business entity
(e,g., general manager; plant manager; head of a subsidiary, division,
or business segment, and similar positions).

THIS CERTIFICATION CONCERNS A MATTER WITHIN THE JURISDICTION OF AN
AGENCY OF THE UNITED STATES AND THE MAKING OF A FALSE, FICTITIOUS, OR
FRAUDULENT CERTIFICATION MAY RENDER THE MAKE SUBJECT TO PROSECUTION
UNDER SECTION 1001, TITLE 18, UNITED STATES CODE.

\(b\) The Offeror shall provide immediate written notice to the
Contracting Officer if, at any time prior to contract award, the Offeror
learns that its certification was erroneous when submitted or has become
erroneous by reason of changed circumstances.

\(c\) A certification that any of the items in paragraph (a) of this
provision exists will not necessarily result in withholding of an award
under this solicitation. However, the certification will be considered
in connection with a determination of the Offeror\'s responsibility.
Failure of the Offeror to furnish a certification or provide such
additional information as requested by the Contracting Officer may
render the Offeror nonresponsible.

\(d\) Nothing contained in the foregoing shall be construed to require
establishment of a system of records in order to render, in good faith,
the certification required by paragraph (a) of this provision. The
knowledge and information of an Offeror is not required to exceed that
which is normally possessed by a prudent person in the ordinary course
of business dealings.

\(e\) The certification in paragraph (a) of this provision is a material
representation of fact upon which reliance was placed when making award.
If it is later determined that the Offeror knowingly rendered an
erroneous certification, in addition to other remedies available to the
Government, the Contracting Officer may terminate the contract resulting
from this solicitation for default.

(End of provision)

K.7 PLACE OF PERFORMANCE

(OCT 1997) (FAR 52.215-6)

\(a\) The offeror or respondent, in the performance of any contract
resulting from this solicitation, \[ \] intends, \[ \] does not intend
(check applicable box) to use one or more plants or facilities located
at a different address from the address of the offeror or respondent as
indicated in this proposal or response to request for information.

\(b\) If the offeror or respondent checks \"intends\" in paragraph (a)
of this provision, it shall insert in the following spaces required
information:

Place of Performance (Street Name and Address of Owner Address, City,
County State, and Operator of the Plant Zip Code) or Facility if Other
than Offeror or respondent

(End of provision)

K.8 SMALL BUSINESS PROGRAM REPRESENTATIONS

(MAR 2001) (FAR 52.219-1)

\(a\) (1) The North American Industry Classification System (NAICS) code
for this acquisition is .

> \(2\) The small business size standard is \_\_\_\_\_\_\_\_\_\_\_\_\_.
>
> \(3\) The small business size standard for a concern which submits an
> offer in its own name, other than on a construction or service
> contract, but which proposes to furnish a product which it did not
> itself manufacture, is 500 employees.

\(b\) Representations.

> \(1\) The offeror represents as part of its offer that it

\[ \] is, \[ \] is not a small business concern.

> \(2\) \[Complete only if offeror represented itself as a small
> business concern in block (b)(1) of this provision.\]
>
> The offeror represents, for general statistical purposes that it \[ \]
> is \[ \] is not a small disadvantaged business concern as defined in
> 13 CFR 124.1002.
>
> \(3\) \[Complete only if offeror represented itself as a small
> business concern in block (b)(1) of this section.\]
>
> The offeror represents as part of its offer that it \[ \] is \[ \] is
> not a women-owned small business concern.

4.  (Complete only if the offeror represented itself as a small business
    concern in paragraph (b) (1) of this provision.) The offeror
    represent as part of its offer that it \[\] is, \[\] is not a
    veteran-owned small business concern.

```{=html}
<!-- -->
```
4.  (Complete only if the offeror represented itself as a veteran-owned
    small business concern in paragraph (b) (4) of this provision.) The
    offeror repesents as part of its offer that it \[\] is, \[\] is not
    a service-disable veteran-owned small business concern.

\(c\) Definitions. As used in this provision -

**Service-disabled veteran-owned small business concern-**

\(1\) Means a small business concern -

\(i\) Not less than 51 percent of which is owned by one or more
service-disabled veterans or, in the case of any publicly owned
business, not less than 51 percent of the stock of which is owned by one
or more service-disabled veterans; and

\(ii\) The management and daily business operations of which are
controlled by one or more service-disabled veterans or, in the case of a
veteran with permanent and severe disability, the spouse or permanent
caregiver of such veteran.

\(2\) Service-disabled veteran means a veteran, as defined in 38 U.S.C.
101(2), with a disability that is service connected, as defined in 38
U.S.C. 101(16).

> **Small business concern**, means a concern, including its affiliates,
> that is independently owned and operated, not dominant in the field of
> operation in which it is bidding on Government contracts, and
> qualified as a small business under the criteria in 13 CFR Part 121
> and the size standard in paragraph (a) of this provision.
>
> **Veteran-owned small business concern**, means a small business
> concern -

\(1\) Not less than 51 percent of which is owned by one or more veterans
(as defined at 38 U.S.C. 101(2)) or, in the case of any publicly owned
business, not less than 51 percent of the stock of which is owned by one
or more veterans; and

\(2\) The management and daily business operations of which are
controlled by one or more veterans.

> **Women-owned small business concern**, means a small business concern
> \--
>
> \(1\) That is at least 51 percent owned by one or more women or, in
> the case of any publicly owned business, at least 51 percent of the
> stock of which is owned by one or more women; and
>
> \(2\) Whose management and daily business operations are controlled by
> one or more women.

\(d\) Notice.

> \(1\) If this solicitation is for supplies and has been set aside, in
> whole or in part, for small business concerns, then the clause in this
> solicitation providing notice of the set-aside contains restrictions
> on the source of the end items to be furnished.

\(2\) Under 15 U.S.C. 645(d), any person who misrepresents a firm\'s
status as a small, HUBZone small, small disadvantaged or women-owned
small business concern in order to obtain a contract to be awarded under
the preference programs established pursuant to sections 8(a), 8(d), 9,
or 15 of the Small Business Act or any other provision of Federal law
that specifically references section 8(d) for a definition of program
eligibility, shall

> \(i\) be punished by imposition of a fine, imprisonment, or both;
>
> \(ii\) be subject to administrative remedies, including suspension and
> debarment; and

\(iii\) be ineligible for participation in programs conducted under the
authority of the Act.

(End of Provision)

Alternate I (OCT 2000) As prescribed in 19.307(a)(2), add the following
paragraph (b)(6) to the basic provision:

\(6\) \[Complete only if offeror represented itself as a small business
concern in paragraph (b)(1) of this provision.\] The offeror represents,
as part of its offer, that -

\(i\) It \[\]is, \[\]is not a HUBZone small business concern listed, on
the date of this representation, on the List of Qualified HUBZone Small
Business Concerns maintained by the Small Business Administration
(SBA),and no material changed in ownership and control, principal place
of ownership, or HUBZone employee percentage has occurred since is was
certified by the SBA in accordance with 13 CFR part 126 and

\(ii\) It \[\] is, \[\] is not a joint venture that complies with the
requirements of 13 CFR part 126, and the representation in paragraph
(b)(6)(i) of this provision is accurate for the HUBZone small business
concern or concerns that are participating in the joint venture. (*The
offeror shall enter the name and names of the HUBZone small business
concern or concerns that are participating in the joint
venture*:\_\_\_\_\_\_\_\_\_\_\_\_.) Each HUBZone small business concern
participating in the joint venture shall submit a separate signed copy
of the HUBZone representation.

Alternate II (OCT 2000). As prescribed in 19.307(a)(3), add the
following paragraph (b)(7) to the basic provision:

\(7\) \[Complete if offeror represented itself as disadvantaged in
paragraph (b)(2) of this provision.\] The offeror shall check the
category in which its ownership falls.

Black American.

Hispanic American.

> Native American (American Indians, Eskimos, Aleuts, or Native
> Hawaiians).

Asian-Pacific American (persons with origins from Burma, Japan, China,
Taiwan, Laos, Cambodia, (Kampuchea), Vietnam, Korea, The Philippines,
U.S. Trust Territory of the Pacific Island, (Republic of Palau),
Republic of the Marshall Islands, Federated States of Micronesia, the
Commonwealth of the Northern Mariana Islands Guam, Samoa, Macao, Hong
Kong, Fiji, Tonga, Kiribati, Tuvalu, or Naura).

Subcontinent Asian (Asia-Indian) American (persons with origins from
India, Pakistan, Bangladesh, Sri Lanka, Bhutan, the Maldives Islands, or
Nepal).

Individual/concern, other than one of the preceding.

K.9 PROHIBITION OF SEGREGATED FACILITIES

(FEB 1999) (FAR 52.222-21)

\(a\) \"Segregated facilities,\" as used in this clause, means any
waiting rooms, work areas, rest rooms and wash rooms, restaurants and
other eating areas, time clocks, locker rooms and other storage or
dressing areas, parking lots, drinking fountains, recreation or
entertainment areas, transportation, and housing facilities provided for
employees, that are segregated by explicit directive or are in fact
segregated on the basis of race, color, religion, or national origin
because of written or oral policies or employee custom. The term does
not include separate or single-user rest rooms or necessary dressing or
sleeping areas provided to assure privacy between the sexes.

\(b\) The Contractor agrees that it does not and will not maintain or
provide for its employees any segregated facilities at any of its
establishments, and that it does not and will not permit its employees
to perform their services at any location under its control where
segregated facilities are maintained. The Contractor agrees that a
breach of this clause is a violation of the Equal Opportunity clause in
this contract.

\(c\) The Contractor shall include this clause in every subcontract and
purchase order that is subject to the Equal Opportunity clause of this
contract.

(End of Clause)

K.10 PREVIOUS CONTRACTS AND COMPLIANCE REPORTS

(FEB 1999) (FAR 52.222-22)

The offeror represents that\--

\(a\) It \[ \] has, \[ \] has not participated in a previous contract or
subcontract subject either to the Equal Opportunity clause of this
solicitation;

\(b\) It \[ \] has, \[ \] has not filed all required compliance reports;
and

\(c\) Representations indicating submission of required compliance
reports, signed by proposed subcontractors, will be obtained before
subcontract awards.

(End of provision)

K.11 AFFIRMATIVE ACTION COMPLIANCE

(APR 1984) (FAR 52.222-25)

The offeror represents that\--

\(a\) It \[ \] has developed and has on file, \[ \] has not developed
and does not have on file, at each establishment, affirmative action
programs required by the rules and regulations of the Secretary of Labor
(4) CFR 60-1 and

> 60-2,

or

\(b\) It \[ \] has not previously had contracts subject to the written
affirmative action programs requirements of the rules and regulations of
the Secretary of Labor.

(End of provision)

K.12 CERTIFICATION OF TOXIC CHEMICAL RELEASE REPORTING

(OCT 1996) (FAR 52.223-13)

\(a\) Submission of this certification is a prerequisite for making or
entering into this contract imposed by Executive Order 12969, August 8,
1995.

\(b\) By signing this offer, the offeror certifies that -

\(1\) As the owner or operator of facilities that will be used in the
performance of this contract that are subject to the filing and
reporting requirements described in section 313 of the Emergency
Planning and Community Right-to-Know Act of 1986 (EPCRA) (42 U.S.C.
11023) and section 6607 of the Pollution Prevention Act of 1990 (PPA)
(42 U.S.C. 13106), the offeror will file and continue to file for such
facilities for the life of the contract the Toxic Chemical Release
Inventory Form (Form R) as described in sections 313(a) and (g) of EPCRA
and section 6607 of PPA; or

\(2\) None of its owned or operated facilities to be used in the
performance of this contract is subject to the Form R filing and
reporting requirements because each such facility is exempt for at least
one of the following reasons: (Check each block that is applicable.)

\[ \] (i) The facility does not manufacture, process, or otherwise use
any toxic chemicals listed under section 313(c) of EPCRA, 42 U.S.C.
11023(c);

\[ \] (ii) The facility does not have 10 or more full-time employees as
specified in section 313(b)(1)(A) of EPCRA, 42 U.S.C. 11023(b)(1)(A).

\[ \] (iii) The facility does not meet the reporting thresholds of toxic
chemicals established under section 313(f) of EPCRA, 42 U.S.C. 11023(f)
(including the alternate thresholds at 40 CFR 372.27, provided an
appropriate certification form has been filed with EPA).

\[ \] (iv) The facility does not fall within Standard Industrial
Classification Code (SIC) designations 20 through 39 or their
corresponding North American Industry Classification System (NAICS)
sectors 31 through 33; or

\[ \] (v) The facility is not located within any State of the United
States, the District of Columbia, the Commonwealth of Puerto Rico, Guam,
American Samoa, the United States Virgin Islands, the Northern Mariana
Islands, or any other territory or possession over which the United
States has jurisdiction.

K.13 BUY AMERICAN ACT - BALANCE OF PAYMENTS PROGRAM CERTIFICATE

(FEB 2000) (FAR 52.225-2)

\(a\) The offeror certifies that each end product, except those listed
in paragraph (b) of this provision, is a domestic end product as defined
in the clause of the solicitation entitled \"Buy American Act-Balance of
Payments Program - Supplies\", and that the offeror has considered
components of unknown origin are considered to have been mined,
produced, or manufactured outside the United States. The offeror shall
list as foreign end products those end products manufactured in the
United States that do not qualify as domestic end products.

\(b\) Foreign End Products:

Line Item No. Country of Origin

(List as necessary)

\(c\) The Government will evaluate offers in accordance with the
policies and procedures of Part 25 of the Federal Acquisition
Regulation.

(End of provision)

K.14 HISTORICALLY BLACK COLLEGE OR UNIVERSITY AND

MINORITY INSTITUTION REPRESENTATION

(FAR 52.226-2) (MAR 2001)

\(a\) *Definitions.* As used in this provision-

"Historically Black College or University" means an institution
determined by the Secretary of Education to meet the requirements of 34
CFR 608.2. For the Department of Defense, the National Aeronautics and
Space Administration , and the Coast Guard, the term also includes any
nonprofit research institution that was an integral part of such a
college or university before November 14, 1986.

"Minority Institution" means an institution of higher education meeting
the requirements of Section 1046(3) of the Higher Education Act of 1965
(20 U.S.C. 1076k, including a Hispanic-serving institution of higher
education as defined in Section 316(b)(1) of the Act (20 U.S.C.
1101(a)).

\(b\) *Representation.* The offeror represents that it-

\_\_ is \_\_\_ is not a Historically Black College or University;

\_\_ is \_\_\_ is not a Minority Institution

(End of Provision)

K.15 COST ACCOUNTING STANDARDS NOTICES AND

CERTIFICATION

(FAR 52.230-1) (JUNE 2000)

NOTE: This notice does not apply to small businesses or foreign
governments. This notice is in three parts, identified by Roman numerals
I through III.

> Offerors shall examine each part and provide the requested information
> in order to determine Cost Accounting Standards (CAS) requirements
> applicable to any resultant contract.
>
> If the offeror is an educational institution, Part II does not apply
> unless the contemplated contract will be subject to full or modified
> CAS-coverage pursuant to 48CFR 9903.201-2(c)(5) or
> 9903.201-2(c)(6),respectively.

I. Disclosure Statement - Cost Accounting Practices and Certification

\(a\) Any contract in excess of \$500,000 resulting from this
solicitation, will be subject to the requirements of the Cost Accounting
Standards Board (48 CFR, Chapter 99), except for those contracts which
are exempt as specified in 48 CFR 9903.201-1.

\(b\) Any offeror submitting a proposal which, if accepted, will result
in a contract subject to the requirements of 48 CFR Chapter 99 must, as
a condition of contracting, submit a Disclosure Statement as required by
48 CFR 9903.202. When required, the Disclosure Statement must be
submitted as a part of the offeror\'s proposal under this solicitation
unless the offeror has already submitted a Disclosure Statement
disclosing the practices used in connection with the pricing of this
proposal. If an applicable Disclosure Statement has already been
submitted, the offeror may

satisfy the requirement for submission by providing the information
requested in paragraph (c) of Part I of this provision. Caution: In the
absence of specific regulations or agreement, a practice disclosed in a
Disclosure Statement shall not, by virtue of such disclosure, be deemed
to be a proper, approved, or agreed-to practice for pricing proposals or
accumulating and reporting contract performance cost data.

\(c\) Check the appropriate box below:

\[ \] (1) Certificate of Concurrent Submission of Disclosure Statement.

> The offeror hereby certifies that, as a part of the offer, copies of
> the Disclosure Statement have been submitted as follows: (i) original
> and one copy to the cognizant Administrative Contracting Officer (ACO)
> or cognizant Federal agency official authorized to act in that
> capacity, as applicable, and (ii) one copy to the cognizant Federal
> auditor.

(Disclosure must be on Form No. CASB DS-1 or CASB

> DS-2, as applicable. Forms may be obtained from the cognizant ACO or
> Federal official and/or from the loose-leaf version of the Federal
> Acquisition Regulation.)

Date of Disclosure
Statement:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Name and Address of Cognizant

ACO or Federal official where filed:

The offeror further certifies that practices used inestimating costs in
pricing this proposal are consistent with the cost accounting practices
disclosed in the Disclosure Statement.

> \[ \] (2) Certificate of Previously Submitted Disclosure Statement.
>
> The offeror hereby certifies that the required Disclosure Statement
> was filed as follows:
>
> Date of Disclosure
> Statement:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Name and Address of Cognizant

ACO or Federal official where filed:

> The offeror further certifies that the practices used in estimating
> costs in pricing this proposal are consistent with the cost accounting
> practices disclosed in the applicable Disclosure Statement.
>
> \[ \] (3) Certificate of Monetary Exemption.
>
> The offeror hereby certifies that the offeror together with all
> divisions, subsidiaries, and affiliates under common control, did not
> receive net awards of negotiated prime contracts and subcontracts
> subject to CAS totaling more than \$25 million in the cost accounting
> period immediately preceding the period in which this proposal was
> submitted. The offeror further certifies that if such status changes
> before an award resulting from this proposal, the offeror will advise
> the Contracting Officer immediately.
>
> \[ \] (4) Certificate of Interim Exemption.
>
> The offeror hereby certifies that (i) the offeror first exceeded the
> monetary exemption for disclosure, as defined in (3) of this
> subsection, in the cost accounting period immediately preceding the
> period in which this offer was submitted and (ii) in accordance with
> 48 CFR, Subpart 9903.202-1, the offeror is not yet required to submit
> a Disclosure Statement. The offeror further certifies that if an award
> resulting from this proposal has not been made within 90 days after
> the end of that period, the offeror will immediately submit a review
> certificate to the Contracting Officer, in the form specified under
> subparagraph (c)(1) or (c)(2) of Part I of this provision, as
> appropriate, to verify submission of a completed Disclosure Statement.

Caution: Offerors currently required to disclosebecause they were
awarded a CAS-covered prime contract or subcontract of \$25 million or
more in the current cost accounting period may not claim this exemption
(4). Further, the exemption applies only in connection with proposals
submitted before expiration of the 90-day period following the cost
accounting period in which the monetary exemption was exceeded.

II\. Cost Accounting Standards - Eligibility for Modified Contract
Coverage

> If the offeror is eligible to use the modified provisions of 48 CFR,
> Subpart 9903.201-2(b) and elects to do so, the offeror shall indicate
> by checking the box below. Checking the box below shall mean that the
> resultant contract is subject to the Disclosure and Consistency of
> Cost Accounting Practices clause in lieu of the Cost Accounting
> Standards clause.
>
> \[ \] The offeror hereby claims an exemption from the Cost Accounting
> Standards clause under the provisions of 48 CFR, Subpart 9903.201-2(b)
> and certifies that the offeror is eligible for use of the Disclosure
> and Consistency of Cost Accounting Practices clause because during the
> cost accounting period immediately preceding the period in which this
> proposal was submitted, the offeror received less than \$25 million in
> awards of CAS-covered prime contracts and subcontracts or the offeror
> did not receive a single CAS-covered award exceeding \$1 million. The
> offeror further certifies that if such status changes before an award
> resulting from this proposal, the offeror will advise the Contracting
> Officer immediately.

Caution: An offeror may not claim the above eligibility for modified
contract coverage if this proposal is expected to result in the award of
a CAS-covered contract of \$25 million or more or if, during its current
cost accounting period, the offeror has been awarded a single
CAS-covered prime contract or subcontract of \$25 million or more.

III\. Additional Cost Accounting Standards Applicable to Existing
Contracts

> The offeror shall indicate below whether award of the contemplated
> contract would, in accordance with subparagraph (a)(3) of the Cost
> Accounting Standards clause, require a change in established cost
> accounting practices affecting existing contracts and subcontracts.

\[ \] Yes \[ \] No

(End of Provision)

ALTERNATE I (APR 1996)

\[ \] (5) Certificate of Disclosure Statement Due Date by Educational
Institution.

> If the offeror is an educational institution that, under the
> transition provisions of 48 CFR 9903.202-1(f), is or will be required
> to submit a Disclosure Statement after receipt of this award, the
> offeror hereby certifies that (check one and complete):

\[\] (a) A Disclosure Statement filing Due Date of

has been established with the cognizant Federal agency.

> \[\] (b) The Disclosure Statement will be submitted within the six
> month period ending months after receipt of this award.
>
> Name and Address of cognizant ACO or Federal Official where Disclosure
> Statement is to be filed:

**(END OF ALTERNATE I)**

K.16 CERTIFICATE OF CURRENT COST OR PRICING DATA

(FAR 15.406-2)

CERTIFICATE OF CURRENT COST OR PRICING DATA

When cost or pricing data are required, the contracting officer shall
require the contractor to execute a Certificate of Current Cost or
Pricing Data using the format in this paragraph, and shall include the
executed certificate in the contract file.

This is to certify that, to the best of my knowledge and belief, the
cost or pricing data (as defined in Section 15.401 of the Federal
Acquisition Regulation(FAR) and required under FAR subsection 15.403-4)
submitted, either actually or by specific identification, in writing, to
the contracting officer or the contracting officer\'s representative in
support of \* are accurate, complete, and current as of \*\*.

This certification includes the cost or pricing data supporting any
advance agreements and forward pricing rate agreements between the
offeror and the Government that are part of the proposal.

FIRM

NAME Signature

TITLE

DATE OF EXECUTION\*\*\*

\* Identify the proposal, request for price adjustment, or other
submission involved, giving the appropriate identifying number (e.g.,
Request for Proposal number).

\*\* Insert the day, month, and year when price negotiations were
concluded and price agreement was reached or, if applicable, an earlier
date agreed upon between the parties that is as close as practicable to
the date of agreement on price.

\*\*\* Insert the day, month, and year of signing, which should be as
close as practicable to the date when the price negotiations were
concluded and the contract price agreed to.

End of Certificate

K.17 ENVIRONMENTAL TOBACCO SMOKE

> The Public Health Service strongly encourages all grant and contract
> recipients to provide a smoke-free workplace and to promote the nonuse
> of all tobacco products. In addition, Public Law 103-227, the
> Pro-Children Act of 1994, prohibits smoking in certain facilities (or
> in some cases, any portion of a facility) in which regular or routine
> education, library, day care, health care or early childhood
> development services are provided to children.

[CERTIFICATION REGARDING ENVIRONMENTAL TOBACCO SMOKE]{.underline}

Public Law 103-227, also known as the Pro-Children Act of 1994 (Act),
requires that smoking not be permitted in any portion of any indoor
facility owned or leased or contracted for by an entity and used
routinely or regularly for the provision of health, day care, early
childhood development services, education or library services to
children under the age of 18, if the services are funded by Federal
programs either directly or through State or local governments, by
Federal grant, contract, loan, or loan guarantee. The law also applies
to children\'s services that are provided in indoor facilities that are
constructed, operated, or maintained with such federal funds. The law
does not apply to children\'s services provided in private residences;
portions of facilities used for inpatient drug or alcohol treatment;
service providers whose sole source of applicable Federal funds is
Medicare or Medicaid; or facilities where WIC coupons are redeemed.
Failure to comply with the provisions of the law may result in the
imposition of a civil monetary penalty of up to \$1000 for each
violation and/or the imposition of an administrative compliance order on
the responsible entity.

By signing this certification, the offeror/contractor certifies that the
submitted organization will comply with the requirements of the Act and
will not allow smoking within any portion of any indoor facility used
for the provision of services for children as defined by the Act.

The submitting organization agrees that it will require that the
language of this certification be included in any subawards which
contain provisions for children\'s services and that all subrecipients
shall certify accordingly.

Organization:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Signature\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_
Title\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Date\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Small Disadvantaged Business Status.

(Oct 1998) (FAR 52.219-22)

\(a\) *General.*

This provision is used to assess an offeror's small disadvantaged
business status for the purpose of obtaining a benefit on this
solicitation. Status as a small business and status as a small
disadvantaged business for general statistical purposes is covered by
the provision at FAR 52.219-1, Small Business Program Representation.

\(b\) *Representations.*

\(1\) General. The offeror represents, as part of its offer, that it is
a small business under the size standard applicable to this acquisition;
and either -

> \[\](i) It has received certification by the Small Business
> Administration as a small disadvantaged business concern consistent
> with 13 CFR 124, Subpart B; and
>
> \(A\) No material change in disadvantaged ownership and control has
> occurred since certification.
>
> \(B\) Where the concern is owned by one or more disadvantaged
> individuals, the net worth of each individual upon whom the
> certification is based does not exceed \$750,000 after taking into
> account the applicable exclusions set forth at 13 CFR 124.104(c)(2);
> and
>
> \(C\) It is listed, on the date of this representation, on the
> register of small disadvantaged business concerns maintained by the
> Small Business Administration; or
>
> \[\] (ii) It has submitted a completed application to the Small
> Business Administration or a Private Certifier to be certified as a
> small disadvantaged business concern in accordance with 13 CFR 124,
> Subpart B, and a decision on that application is pending, and that no
> material change in disadvantaged ownership and control has occurred
> since its application was submitted.

(2) \[\] For Joint Ventures. The offeror represents, as part of its
    offer, that it is a joint venture that complies with the
    requirements at 13 CFR 124.1002(f) and that the representation in
    paragraph (b)(1) of this provision is accurate for the small
    disadvantaged business concern that is participating in the joint
    venture. (The offeror shall enter the name of the small
    disadvantaged business concern that is participating in the joint
    venture: [)]{.underline}

\(c\) *Penalties and Remedies*. Anyone how misrepresents any aspect of
the disadvantaged status of a concern for the purposes of securing a
contract or subcontract shall -

\(1\) Be punished by imposition of a fine, imprisonment, or both;

(2) Be subject to administrative remedies, including suspension and
    debarment; and

(3) Be ineligible for participation in programs conducted under the
    authority of the Small Business Act.

(End of Provision)

Use Alternate I, when SDB concerns is authorized on a regional basis.

Alternate I (Oct 1998)

\(3\) Address. The offeror represents that its address \[\]is, \[\]is
not in a region for which a small disadvantaged business procurement
mechanism is authorized and its address has not changed since its
certification as a small disadvantaged business concern or submission of
its application for certification. The list of authorized small
disadvantaged business procurement mechanisms and regions is posed at
The offeror shall use the list in effect on the date of this
solicitation. "Address," as used in this provision, means the address of
the offeror as listed on the Small Business Administrations or a Private
Certifier in accordance with 13 CFR part 124, subpart B. For joint
ventures, "address" refers to the address of the small disadvantaged
business concern that is participating in the joint venture.

**SECTION L - INSTRUCTIONS, CONDITIONS AND NOTICES TO OFFERORS**

**L.1 SOLICITATION PROVISIONS INCORPORATED BY REFERENCE (FEB 1998) (FAR
52.252-1)**

> This solicitation incorporates the following solicitation provisions
> by reference, with the same force and effect as if they were given in
> full text. Upon request, the contracting officer will make the full
> text available. Also, the full text of a clause may be assessed
> electronically at this address: http://www.arnet.gov/far/

a\. Federal Acquisition Regulation (FAR) (48 CFR Chapter 1) Solicitation
Provisions

> \(1\) 52.215-20 Requirements for Cost or Pricing Data or Information
> Other Than Cost or Pricing Data (OCT 1997)

\(2\) 52.215-16 Facilities Capital Cost of Money (OCT 1997)

**L.2 DATA UNIVERSAL NUMBERING (DUNS) NUMBER (JUNE 1999) (FAR
52.204-6)**

\(a\) The offeror shall enter, in the block with its name and address on
the cover page of its offer, the annotation "DUNS" followed by the DUNS
number that identifies the offeror's name and address exactly as stated
in the offer. The DUNS number is a nine-digit number assigned by Dun and
Bradstreet Information Services.

\(b\) If the offeror does not have a DUNS number, it should contact Dun
and Bradstreet directly to obtain one. A DUNS number will be provided
immediately by telephone at no charge to the offeror. For information on
obtaining a DUNS number, the offeror, if located within the United
States, should call Dun and Bradstreet at 1-800-333-0505. The offeror
should be prepared to provide the following information:

\(1\) Company name.

\(2\) Company address.

\(3\) Company telephone number.

\(4\) Line of business.

\(5\) Chief executive officer/key manager.

\(6\) Date the company was started.

\(7\) Number of people employed by the company.

\(8\) Company affiliation.

\(c\) Offerors located outside the United States may obtain the location
and phone number of the local Dun and Bradstreet Information Services
office from the Internet home page at If an offeror is unable to locate
a local service center, it may send an e-mail to Dun and Bradstreet at

(End of provision)

**L.3 INSTRUCTIONS TO OFFERORS - COMPETITIVE ACQUISITION (FEB 2000)**

**ALTERNATE I (OCT 1997)(FAR 52.215-1)**

\(a\) *Definitions.* As used in this provision --

> "Discussions" are negotiations that occur after establishment of the
> competitive range that may, at the Contracting Officer's discretion,
> result in the offeror being allowed to revise its proposal.
>
> "In writing" or "written" means any worded or numbered expression
> which can be read, reproduced, and later communicated, and includes
> electronically transmitted and stored information.
>
> "Proposal modification" is a change made to a proposal before the
> solicitation's closing date and time, or made in response to an
> amendment, or made to correct a mistake at any time before award.
>
> "Proposal revision" is a change to a proposal made after the
> solicitation closing date, at the request of or as allowed by a
> Contracting Officer as the result of negotiations.
>
> "Time," if stated as a number of days, is calculated using calendar
> days, unless otherwise specified, and will include Saturdays, Sundays,
> and legal holidays. However, if the last day falls on a Saturday,
> Sunday or legal holiday, then the period shall include the next
> working day.

\(b\) *Amendments to solicitations.* If this solicitation is amended,
all terms and conditions that are not amended remain unchanged. Offerors
shall acknowledge receipt of any amendment to this solicitation by the
date and time specified in the amendment(s).

\(c\) *Submission, modification, revision, and withdrawal of proposals.*

\(1\) Unless other methods (e.g., electronic commerce or facsimile) are
permitted in the solicitation, proposals and modifications to proposals
shall be submitted in paper media in sealed envelopes or packages (i)
addressed to the office specified in the solicitation, and (ii) showing
the time and date specified for receipt, the solicitation number, and
the name and address of the offeror. Offerors using commercial carriers
should ensure that the proposal is marked on the outermost wrapper with
the information in paragraphs (c)(1)(i) and (c)(1)(ii) of this
provision.

\(2\) The first page of the proposal must show---

\(i\) The solicitation number;

\(ii\) The name, address, and telephone and facsimile numbers of the
offeror (and electronic address if available);

\(iii\) A statement specifying the extent of agreement with all terms,
conditions, and provisions included in the solicitation and agreement to
furnish any or all items upon which prices are offered at the price set
opposite each item;

> \(iv\) Names, titles, and telephone and facsimile numbers (and
> electronic addresses if available) of persons authorized to negotiate
> on the offeror's behalf with the Government in connection with this
> solicitation; and

\(v\) Name, title, and signature of person authorized to sign the
proposal. Proposals signed by an agent shall be accompanied by evidence
of that agent's authority, unless that evidence has been previously
furnished to the issuing office.

\(3\) *Submissions, modification, revision, and withdrawal of
proposals.*

\(i\) Offerors are responsible for submitting proposals, and any
modification or revisions, so as to reach the Government office
designated in the solicitation by the time specified in the
solicitation. If no time is specified in the solicitation, the time for
receipt is 4:30 p.m., local time, for the designated Government office
on the data that proposal or revision is due.

\(ii\) (A) Any proposal, modification, or revision received at the
Government office designated in the solicitation after the exact time
specified for receipt of offers is "late" and will not be considered
unless it is received before award is made, the Contracting Officer
determines that accepting the late offer would not unduly delay the
acquisition; and -

\(1\) If it was transmitted through an electronic commerce method
authorized by the solicitation, it was received at the initial point of
entry to the Government infrastructure not later than 5:00 p.m. one
working day prior to the date specified for receipt of proposals; or

\(2\) There is acceptable evidence to establish that it was received at
the Government installation designated for receipt of offers and was
under the Government's control prior to the time set for receipt of
offers; or

\(3\) It is the only proposal received.

\(B\) However, a late modification of an otherwise successful proposal
that makes its terms more favorable to the Government, will be
considered at any time it is received and may be accepted.

\(iii\) Acceptable evidence to establish the time of receipt at the
Government installation includes the time/date stamp of that
installation on the proposal wrapper, other documentary evidence of
receipt maintained by the installation, or oral testimony or statements
of Government personnel.

\(iv\) If an emergency or unanticipated event interrupts normal
Government processes so that proposals cannot be received at the office
designated for receipt of proposals by the exact time specified in the
solicitation, and urgent Government requirements preclude amendment of
the solicitation, the time specified for receipt of proposals will be
deemed to be extended to the same time of day specified in the
solicitation on the first work day on which normal Government processes
resume.

\(v\) Proposals may be withdrawn by written notice received at any time
before award. Oral proposals in response to oral solicitations may be
withdrawn orally. If the solicitation authorizes facsimile proposals,
proposals may be withdrawn via facsimile received at any time before
award, subject to the conditions specified in the provision at 52.215-5,
"Facsimile Proposals." Proposals may be withdrawn in person by an
offeror or an authorized representative, if the representative's
identity is made known and the representative signs a receipt for the
proposal before award.

\(1\) Unless otherwise specified in the solicitation, the offeror may
propose to provide any item or combination of items.

\(2\) Offerors shall submit proposals submitted in response to this
solicitation in English, unless otherwise permitted by the solicitation,
and in U.S. dollars, unless the provision at FAR 52.225-17, Evaluation
of Foreign Currency Offers, is included in the solicitation.

\(3\) Offerors may submit modifications to their proposals at any time
before the solicitation closing date and time, and may submit
modifications in response to an amendment, or to correct a mistake at
any time before award.

\(4\) Offers may submit revised proposals only if requested or allowed
by the Contracting Officer.

\(5\) Proposals may be withdrawn at any time before award. Withdrawals
are effective upon receipt of notice by the Contracting Officer.

*(d) Offer expiration date.* Proposals in response to this solicitation
will be valid for the number of days specified on the solicitation cover
sheet (unless a different period is proposed by the offeror).

*(e) Restriction on disclosure and use of data.* Offerors that include
in their proposals data that they do not want disclosed to the public
for any purpose, or used by the Government except for evaluation
purposes, shall ---

\(1\) Mark the title page with the following legend:

> This proposal includes data that shall not be disclosed outside the
> Government and shall not be duplicated, used, or disclosed--in whole
> or in part--for any purpose other than to evaluate this proposal. If,
> however, a contract is awarded to this offeror as a result of--or in
> connection with-- the submission of this data, the Government shall
> have the right to duplicate, use, or disclose the data to the extent
> provided in the resulting contract. This restriction does not limit
> the Government's right to use information contained in this data if it
> is obtained from another source without restriction. The data subject
> to this restriction are contained in sheets \[*insert numbers or other
> identification of sheets\];* and

\(2\) Mark each sheet of data it wishes to restrict with the following
legend:

> Use or disclosure of data contained on this sheet is subject to the
> restriction on the title page of this proposal.

\(f\) *Contract award.*

\(1\) The Government intends to award a contract or contracts resulting
from this solicitation to the responsible offeror(s) whose proposal(s)
represents the best value after evaluation in accordance with the
factors and subfactors in the solicitation.

\(2\) The Government may reject any or all proposals if such action is
in the Government's interest.

\(3\) The Government may waive informalities and minor irregularities in
proposals received.

\(4\) The Government intends to evaluate proposals and award a contract
after conducting discussions with offerors whose proposals have been
determined to be within the competitive range. If the Contracting
Officer determines that the number of proposals that would otherwise be
in the competitive range exceeds the number at which an efficient
competition can be conducted, the Contracting

> Officer may limit the number of proposals in the competitive range to
> the greatest number that will permit an efficient competition among
> the most highly rated proposals. Therefore, the offeror's initial
> proposal should contain the offeror's best terms from a price and
> technical standpoint.

\(5\) The Government reserves the right to make an award on any item for
a quantity less than the quantity offered, at the unit cost or prices
offered, unless the offeror

specifies otherwise in the proposal.

\(6\) The Government reserves the right to make multiple awards if,
after considering the additional administrative costs, it is in the
Government's best interest to do so.

\(7\) Exchanges with offerors after receipt of a proposal do not
constitute a rejection or counteroffer by the Government.

\(8\) The Government may determine that a proposal is unacceptable if
the prices proposed are materially unbalanced between line items or
subline items.

> Unbalanced pricing exists when, despite an acceptable total evaluated
> price, the price of one or more contract line items is significantly
> overstated or understated as indicated by the application of cost or
> price analysis techniques. A proposal may be rejected if the
> Contracting Officer determines that the lack or balance

poses an unacceptable risk to the Government.

\(9\) If a cost realism analysis is performed, cost realism may be
considered by the source selection authority in evaluating performance
or schedule risk.

\(10\) A written award or acceptance of proposal mailed or otherwise
furnished to the successful offeror within the time specified in the
proposal shall result in a binding contract without further action by
either party.

\(11\) The Government may disclose the following information in
postaward debriefings to other offerors:

\(i\) The overall evaluated cost or price and technical rating of the
successful offeror.

\(ii\) The overall ranking of all offerors, when any ranking was
developed by the agency during source selection;

\(iii\) A summary of the rationale for award; and

\(iv\) For acquisitions of commercial items, the make and model of the
item to be delivered by the successful offeror.

(End of provision)

**L.4 TYPE OF CONTRACT (APRIL 1984)(FAR 52.216-1)**

> The Government anticipates a Cost-Plus-Award fee contract to result
> from this solicitation.
>
> It is anticipated that a single award will be made from this
> solicitation and that the award will be made on/about September 17,
> 2001.

**L.5 SERVICE OF PROTEST(AUG 1996)(FAR 52.233-2)**

\(a\) Protests, as defined in Section 33.101 of the Federal Acquisition
Regulation, that are filed directly with an agency, and copies of any
protests that are filed with the General Accounting Office (GAO) shall
be served on the Contracting Officer (addressed as follows) by obtaining
written and dated acknowledgment of receipt from:

Director, Division of Contracts Management

Agency for Healthcare Research and Quality

2101 East Jefferson Street, Suite 502

Rockville, Maryland 20852

\(b\) The copy of any protest shall be received in the office designated
above within one day of filing a protest with the GAO.

**L.6 POINT OF CONTACT FOR TECHNICAL INQUIRIES**

> The technical contact for additional information and answering
> inquiries is the Contracting Officer.
>
> All questions regarding this solicitation shall be in writing and
> received by the Contracting Officer no later than **[June 6,
> 2001]{.underline}**. Answers to questions shall be sent to each
> prospective offeror by solicitation amendment.
>
> Questions should be sent both in hard copy (by mail or fax) **AND**
> electronically via e-mail with the questions provided as an attachment
> either in Word or WordPerfect format to Mary Haines, mhaines@ahrq.gov.

Mail inquiries to: Agency for Healthcare Research and Quality

Division of Contracts Management

2101 East Jefferson Street, Suite 502

Rockville, MD 20852

Attention: Mary Haines, Contracting Officer

Fax: (301) 443-7523

**L.7 REFERENCE MATERIALS**

> Attached to this solicitation is a list of reference material
> applicable to this acquisition. Failure of offerors to examine the
> reference material prior to proposal preparation and submission will
> be at the offeror's risk. References are a listing only and are not
> being provided as an attachment to this solicitation, since they are
> so extensive. Requests for the reference material may be made by fax
> or e-mail to Mary Haines, see information in L.6 above. Materials will
> be mailed, offerors may provide federal express account information
> for expedited delivery. Materials may also be viewed (no photocopying)
> on site in a Reading Room, Monday through Friday, 8:30 AM to 3:30 PM.
> Contact Jessica Alderton at 301-594-7187 for an appointment.

**L.8 GENERAL INSTRUCTIONS**

[Introduction]{.underline}

> The following instructions will establish the acceptable minimum
> requirements for the format and contents of proposals. Special
> attention is directed to the requirements for technical and business
> proposals to be submitted in accordance with these instructions:

a\. [Contract Type and General Provisions]{.underline}: It is
contemplated that a cost-type contract will be awarded. In addition to
the special provisions of this request for proposal (RFP), any resultant
contract shall include the general clauses applicable to the selected
offeror\'s organization and type of contract awarded. Any additional
clauses required by Public Law, Executive Order, or procurement
regulations, in effect at the time of execution of the proposed
contract, will be included.

b\. [Authorized Official and Submission of Proposal]{.underline}: The
proposal shall be signed by an official authorized to bind your (the
offeror\'s) organization. Your proposal shall be submitted in the number
of copies, to the address, and marked as indicated in the cover letter
of this solicitation. Proposals will be typewritten, reproduced on
letter sized paper and will be legible in all required copies. To
expedite the proposal evaluation, all documents required for responding
to the RFP should be placed in the following order:

I. [COVER PAGE]{.underline}: Include RFP title, number, name of
organization, author(s) of technical proposal, and indicate whether the
proposal is an original or a copy.

II\. [TECHNICAL PROPOSAL]{.underline}: See Technical Proposal
Instructions for recommended format (L.9).

> III\. [PAST PERFORMANCE INFORMATION:]{.underline} See Past Performance
> Information Instructions for format (L.10)

IV\. [SMALL DISADVANTAGED BUSINESS PARTICIPATION PLAN:]{.underline} See
Small Disadvantaged Business Plan Instructions for format (L.11)

V. [BUSINESS PROPOSAL]{.underline}: See Business Proposal Instructions
for recommended format (L.12).

c\. [Separation of Technical, Past Performance Information, Small
Disadvantaged Business Participation Plan and Business
Proposal]{.underline}: The proposal shall be in four parts:

> \(1\) Technical Proposal; (2) Past Performance Information; (3) Small
> Disadvantaged Business Participation Plan; and (4) Business Proposal.
> Each of the parts shall be separate and complete in itself so that
> evaluation of one may be accomplished independently of, and
> concurrently with, evaluation of the other. The technical proposal
> shall not contain reference to cost; however resources information,
> such as data
>
> concerning labor hours and categories, materials, subcontracts, etc.,
> shall be contained in the technical proposal so that your
> understanding of the Statement of Work (SOW) may be evaluated. It must
> disclose your technical approach in as much detail as possible,
> including, but not limited to, the requirements of the technical
> proposal instructions.

d\. [Evaluation of Proposals]{.underline}: The Government will evaluate
technical proposals in accordance with the criteria set forth in Section
M, [Evaluation/Award Criteria]{.underline}.

e\. [Rejection of Proposals]{.underline}: The Government reserves the
right to reject any or all proposals received. It is understood that
your proposal will become part of the official contract file.

f\. [Unnecessarily Elaborate Proposals]{.underline}: Unnecessarily
elaborate brochures or other presentations beyond those sufficient to
present a complete and effective proposal are not desired and may be
construed as an indication of the offeror\'s lack of cost consciousness.
Elaborate art work, expensive visual and other presentation aids are
neither necessary nor wanted.

g\. [Privacy Act]{.underline}: The Privacy Act of 1974 (Public Law
(P.L.) 93-579) requires that a Federal agency advise each individual
whom it asks to supply information: 1) the authority which authorized
the solicitation; 2) whether disclosure is voluntary or mandatory; (3)
the principal purpose or purposes for which the information is intended
to be used; (4) the uses outside the agency which may be made of the
information; and 4) the effects on the individual, if any, of not
providing all or any part of the requested information.

Therefore:

> \(1\) The Government is requesting the information called for in this
> RFP pursuant to the authority provided by Section 301(g) of the Public
> Health Service Act, as amended, and P.L. 92-218, as amended.

\(2\) Provisions of the information requested are entirely voluntary.

\(3\) The collection of this information is for the purpose of
conducting an accurate, fair, and adequate review prior to a discussion
as to whether to award a contract.

\(4\) Failure to provide any or all of the requested information may
result in a less than adequate review.

\(5\) The information provided by you may be routinely disclosed for the
following purposes:

-to the cognizant audit agency and the General Accounting Officer for
auditing;

-to the Department of Justice as required for litigation;

-to respond to Congressional inquiries; and

-to qualified experts, not within the definition of Department employees
for opinions as a part of the review process.

> In addition, the Privacy Act of 1974 (P.L. 93-579, Section 7) requires
> that the following information be provided when individuals are
> requested to disclose their social security number.
>
> Provision of the social security number is voluntary. Social security
> numbers are requested for the purpose of accurate and efficient
> identification, referral, review and management of AHRQ contracting
> programs. Authority for requesting this information is provided by
> Section 305 and Title IV of the Public Health Service Act, as amended.

h\. [The]{.underline} [RFP]{.underline} [does]{.underline}
[not]{.underline} [commit]{.underline} [the]{.underline}
[Government]{.underline} [to]{.underline} [pay]{.underline}
[any]{.underline} [cost]{.underline} [for]{.underline} [the]{.underline}
[preparation]{.underline} [and]{.underline} [submission]{.underline}
[of]{.underline} [a]{.underline} [proposal]{.underline}. It is also
brought to your attention that the Contracting Officer is the only
individual who can legally commit the Government to the expenditure of
public funds in connection with this or any acquisition action.

> The Government reserves the right to award a contract without
> discussions if the Contracting Officer determines that the initial
> prices are fair and reasonable and that discussions are not necessary.

**L.9 TECHNICAL PROPOSAL INSTRUCTIONS**

> The technical proposal shall contain an original and eleven (11)
> copies. The technical proposal described below shall be limited to
> **150 pages** not including resumes or bibliographies, with no less
> than a 11 point pitch, with the majority of the text double-spaced
> (lists of deliverables, person loading charts, and similar materials
> need not be double-spaced, so long as they are legible).

a\. [Recommended Technical Proposal Format]{.underline}

The Offeror's proposal should present sufficient information to reflect
a thorough understanding of the work requirements and a detailed plan
for achieving the objectives of the scope of work. Technical proposals
shall be limited to **150** pages. Proposals shall not merely paraphrase
the requirements of the Agency's scope of work or parts thereof, or use
of paraphrases such as "will comply" or "standard techniques will be
employed." The technical proposal must include a detailed description of
the techniques and procedures to be employed in achieving the proposed
end results in compliance with the requirements of the Agency's scope of
work. Offerors are hereby advised that the Agency, unless otherwise
specified, i.e., by law, will acquire the right to use, duplicate or
disclose in any manner and for any purpose whatsoever, and have or
permit others to do so, all subject data required to be delivered under
any contract resulting from this soliciatation. Any reservations to
these stated Agency rights should be enunciated in the proposal and will
be resolved during subsequent negotiations.

> To assist in the expeditious and comprehensive evaluation of your
> proposal, the Government desires that you follow the guidelines and
> format listed below:

\(1\) [Cover Page]{.underline}: The name of the proposing organization,
author(s) of the technical proposal, the RFP number and the title of the
RFP should appear on the cover.

One (1) manually signed original copy of the proposal and the number of
copies specified in the RFP cover letter are required.

\(2\) [Table of Contents]{.underline}: Provide sufficient detail so that
all important elements of the proposal can be located readily.

\(3\) [Introduction]{.underline}: This should be a one or two page
summary outlining the proposed work, your interest in submitting a
proposal, and the importance of this effort in relation to your overall
operation.

\(4\) [Technical Discussion]{.underline}: The offeror shall prepare a
technical discussion which addresses evaluation criteria A, B, C, and D
below. Evaluation criteria E and F are to be prepared in accordance with
Sections L.10 and L.11. The offeror shall further state that no
deviations or exceptions to the SOW are taken. The evaluation criteria
are as follows:

A. Response to the Statement of Work

B. Staffing and Management Plan

C. Corporate/ Organization Experience

> D. Facilities and Equipment

E. Past Performance (See Section L.10)

> F. Small Disadvantaged Business Participation Plan (See Section L.11)
>
> **[Technical proposals submitted in response to this RFP shall address
> each of the items described below, and shall be organized in the same
> manner and within the page limitations specified. Proposals shall be
> prepared in double-spaced format, with numbered pages.]{.underline}**

b\. [Technical Proposal Requirements]{.underline}

**A.** **Response to Statement of Work (SOW)**

\(1\) The Offeror shall submit a narrative describing pertinent work
already published and/ or performed that is relevant to this project,
particularly as it relates to quality measures, clinical information
tools, complex database development, development and implementation of
Web-based services, and to the Offeror's proposed approach. This
narrative should support the Offeror's interpretation of the statement
of work.

\(2\) The Offeror shall submit a narrative that provides a concise
statement of its overall understanding of the issues of this project.
Within this narrative, the Offeror shall provide a concise discussion
demonstrating an understanding of the objectives of the project as well
as each task described in the Statement of Work, including a concise
description of the challenges and problems that might be encountered in
meeting the objectives and in the performance of the tasks. A
description o how these challenges and problems can be met or resolved
shall also be provided.

\(3\) In this section, the Offeror shall provide the name(s) of the
author(s) of each section of its proposal.

\(4\) The Offeror shall include a narrative that clearly addresses how
it plans to develop, design and implement a process to produce high
quality deliverables and to meet the requirements of the project,
particularly within the time constraints of the project. The Offeror may
use as many paragraphs and subparagraphs, appropriately titled, as
necessary to clearly outline the technical approach. Within the content
of the narrative, the Offeror shall:

\- indicate the rationale for the approach and relate it to comparable
work in progress elsewhere;

\- address plans for identifying, utilizing and monitoring
subcontractors and consultants;

\- describe the production of clear, concise reports on project
findings;

\- specify quality control activities, problem area identification and
resolution strategies;

\- mention phasing of the project, when appropriate;

\- characterize methodological design and possible or likely outcomes of
approaches proposed;

\- delineate anticipated difficulties within the technical approach
together with recommended solutions; and

\- depict the extent to which the proposed approach can be expected to
meet or exceed the requirements of the statement of work.

\(5\) Additionally, in the discussion of its technical approach to the
SOW, the Offeror shall:

\- Clearly demonstrate its understanding of: quality measure development
methodology, implementation, and use; clinical interventions and
outcomes and needs of quality measure users; complex database
development.

\- Describe previous experience working with expert panels representing
diverse interests.

\- Describe its approach to and its ability to successfully design and
implement a large Web-based relational database of quality
measures-related information. The Offeror shall also clearly demonstrate
its knowledge of software, hardware, programming, logistics, and
technical assistance necessary to support those mechanisms. The offeror
shall include a detailed discussion of the specific hardware, software,
network and other technology architecture components and solutions
proposed to design, develop, build, test, implement, maintain,
backup/recover and secure the system.

\(6\) The Offeror shall address the technical approach proposed for each
task required by the Statement of Work.

**B**. **Staffing and Management Plan**

> The Offeror shall demonstrate its ability to achieve the delivery of
> performance requirements through the proposed use of corporate
> management and other personnel resources as well as demonstrate that
> the Offeror's organizational structure and capabilities will meet the
> project's milestones in a timely manner. In doing so, and at a
> minimum, the Offeror shall:

1.  Provide a fully supported narrative showing the Offeror's
    understanding of the requirements of the Statement of Work from a
    managerial perspective. The narrative should at a minimum address
    the following topics:

\- Provide reasons for labor skill mix determination (why you chose the
skill mix for this project);

\- Provide reasons for personnel selection and assignment (why you chose
an individual person for an individual job);

\- Indicate the percentage of full time core personnel to the percentage
of consultants/ subcontractors proposed. The Offeror shall provide a
detailed explanation of how the proposed staffing plan ensures that the
work is conducted by individuals with a mastery of the technical
requirements of the Statement of Work.

\- Describe monitoring and control of services provided as it relates to
technical quality, responsiveness, cost control, effective and efficient
resource utilization, and compliance with technical requirements and
contract provisions. Clearly show proposed system for quality control of
work performed including deliverables to be produced, and proposed
system for management control and contract provision compliance.

\- Describe managerial problems the Offeror expects to encounter and the
methods proposed to solve these problems. Demonstrate ability and
flexibility to rapidly solve the same or similar managerial problems
encountered previously.

1.  Provide a person-level task-loading chart (to include consultants
    and subcontractor effort) and an organizational chart indicating
    clear lines of authority, delineating staff responsibilities and a
    plan for organizational backup. Employees not currently employed by
    the Offeror will be listed with an asterisk (\*) to denote their
    status.

\(2\) For each person named for the proposed effort, with the exception
of general support personnel, the Offeror shall provide a list of
Federal, State and other contracts to which they are currently obligated
and the proportion of time committed to these contracts during the first
year of contract performance for this project. This information shall be
provided for subcontractor employees and consultants as well.

\(3\) Describe the relationship with all subcontractors and consultants
including monitoring of their performance. **[Letters of commitment for
detailed subcontracting arrangements, consulting arrangements, and for
consultants and members shall be included with the
proposal.]{.underline}** For consultants, the letters of commitment
shall specify the number of hours that each will be available throughout
each year of project performance.

\(4\) Provide a PERT chart showing all tasks to include any critical
milestones and all deliverables.

\(5\) Describe the Offeror's ability and flexibility to respond rapidly
to changes in requirements, budget, priorities, and schedule.

\(6\) Specify the project team, including subcontractors and consultants
in the following labor classes:

[Class I]{.underline}

Senior management personnel, holding an advanced clinical, technical, or
professional degree, at the Masters, Ph.D. or M.D. level, with a minimum
of ten (10) years experience in analyzing quality
measurement/improvement, biomedical, medical effectiveness or outcomes,
or other scientific literature, research findings and data, with
significant experience related to development and application of quality
measures; evaluation and implementation of evidence-based clinical
information including quality measures; management of large complex
projects including the development and implementation of original work;
and work with organizations, or medical specialty societies. This class
of personnel shall also have corporate level management experience that
reflects an ability to command organizational resources and direct staff
within the broader organization.

[Class II]{.underline}

Associated management or clinical/professional/technical personnel
holding an advanced degree, at the Masters, Ph.D., M.D., level, with a
minimum of five (5) years experience in the development and application
of quality measures; evaluation and implementation of evidence-based
clinical information; construction of large relational databases; and
development of clinically-related classification schemes; and
development of Web sites.

[Class III]{.underline}

Intermediate clinical/technical personnel, holding a B.S. or B.A. degree
and at least three (3) years experience in technical activities of which
at least two (2) are related to construction of larger relational
databases, development of classification schemes, analysis of quality
improvement, biomedical, medical effectiveness or outcomes, and other
scientific literature, research findings, and data. The individual is
capable of carrying out independent assignments with minimum supervision
or acting as team leader of small projects. Includes specialists in
computer programming, World Wide Web site construction, etc.

[Class IV]{.underline}

Data support, document search and retrieval staff, report editors, at a
research assistant level.

The Offeror's proposed Project Director shall be clearly identified.
This individual shall possess strong corporate level management
experience. The Project Director is responsibile for the overall
management of this contract, including coordination and cooperation with
the Government Project Officer and members of the Panel of Experts;
direction and oversight of all activities to be performed under this
contract; and assuring the high quality sand timeliness of work
performed.

The Offeror shall clearly identify proposed Project manager responsible
for the day to day management of activities to be performed under this
contract. The Project Manager must be a highly experienced and qualified
individual with significant leadership and communications skills and
demonstrated experience in managing complex, large scale projects with
similar requirements. It is expected that the Project Manager will have
training and experience in health services research, development and
application of quality measures, construction and management of large
relational databases, and personnel/project management. In addition, the
Project Manager must have experience in working with diverse groups such
as quality measures developers, health care providers and purchasers,
clinical and health services researchers, and health care policy makers.

**C**. **Corporate/Organizational Experience**

The Offeror must possess demonstrated experience as an organization in
conducting and managing projects of this magnitude and complexity. It is
essential that the Offeror demonstrate the capability to organize and
manage resources and personnel effectively, and to successfully
undertake and complete highly technical and complex projects.

The Offeror shall describe its relevant organizational qualifications
and experience, especially that relate to development, implementation,
use, and evaluation of quality measures; development of
clinically-related classifications schemes and relational databases;
work with expert panels and advisory boards; formulation of
user-friendly World Wide Web sites, and provision of technical
assistance. The descriptions shall delineate how these qualifications
and experience are relevant to fulfilling the requirements of this
proposed contract. In addition, the Offeror shall submit, if available,
up to two examples of relevant or similar work that it has performed in
the past.

**D.** **Facilities and Equipment**

The Offeror shall demonstrate that it has adequate facilities and
equipment for successful completion of tasks under this contract. This
includes the availability of IBM-compatible word processing equipment
with Microsoft Office, specific software and hardware packages required
to complete the tasks required in the Statement of Work, duplicating
capacity, facsimile capabilities, access to electronic databases
necessary to search biomedical and health services literature, ability
to obtain hard and electronic copy of quality measures, and ability to
link via electronic mail with subcontractors, consultants, Panel of
Experts, and Agency staff.

**L.10 Past Performance Information**

> Offerors shall submit the following information in an original and
> three (3) copies as part of their proposal for both the offeror and
> proposed major subcontractors:
>
> \(1\) Provide a listing of the offeror\'s recently completed (within
> the last 3 years - since January 1, 1998) and ongoing work (contracts
> and grants) [directly related to the requirements of this
> acquisition]{.underline}. This listing shall include a brief
> description of each relevant project. Contracts or grants may include
> those entered into by the Federal Government, agencies of State and
> local governments and commercial customers.
>
> Offerors that are newly formed entities without prior contracts/grants
> should provide evaluations forms for contracts/grants and subcontracts
> as required above for all key personnel.

Include the following information for each contract, subcontract or
grant:

A. Name of contracting/grant activity

B. Contract/Grant number

C. Contract/Grant type

D. Total contract/grant value

E. Brief description of Contract/Grant

F. List of publications and reports from those projects

G. Contracting Officer and telephone number

H. Program Manager and telephone number

I. Administrative Contracting Officer, if different from F., and
telephone number

J. List of major subcontractors

> \(2\) The offeror may provide information on problems encountered on
> the contracts, grants and subcontracts identified in (1) above and
> corrective actions taken to resolve those problems. Offerors should
> not provide general information on their performance on the identified
> contracts/grants. General performance information will be obtained
> from the evaluation forms.

\(3\) The offeror may describe any quality awards or certifications that
indicate the offeror possesses a high-quality process for developing and
producing the product or service required. Identify what segment of the
company (one division or the entire company) that received the award or
certification. Describe when the award or certification was bestowed. If
the award or certification is over three years old, present evidence
that the qualifications still apply.

> \(4\) Each offeror will be evaluated on his/her performance under
> existing and prior contracts for similar products or services.
> Performance information will be used for both responsibility
> determinations and as an evaluation factor against which offerors'
> relative rankings will be compared to assure best value to the
> Government. The Government will focus on information that demonstrates
> quality of performance relative to the size and complexity of the
> procurement under consideration.

The attached Past Performance Questionnaire and Contractor Performance
Form shall be completed by those contracting organizations listed in (1)
above. The evaluation forms shall be completed and forwarded directly to
the following:

Mary Haines

Agency for Healthcare Research and Quality

Contracts Management Staff

2101 East Jefferson Street, Suite 502

Rockville, Maryland 20852

FAX: 301-443-7523

Evaluation forms must be received by **[June 6, 2001]{.underline}** in
order to be included in the review process. It is the responsibility of
the offeror to ensure that these documents are forwarded to the
Contracting Officer.

**L.11 Small Disadvantaged Business Participation Plan**

> In accordance with FAR Part 15.304(c)4, the extent of participation of
> Small Disadvantaged Business (SDB) concerns in performance of the
> contract shall be evaluated in unrestricted acquisitions expected to
> exceed a total estimated cost of \$500,000 (\$1,000,000 for
> construction) subject to certain limitations (see FAR 19.201 and
> 19.1202).
>
> A. All offerors, regardless of size, shall submit the following
> information in an original and one copy:

A plan on the extent of participation of Small Disadvantaged Business
concerns in performance of the contract. Participation in performance of
the contract includes the work expected to be performed by SDB
concern(s). This can include SDB (as prime contractor), joint ventures,
teaming arrangements, and subcontracts. Include the following
information in SDB participation plans:

1\. The extent of an offeror's commitment to use SDB concerns.
Commitment should be as specific as possible, i.e., are subcontract
arrangements already in place, letters of commitment, etc. Enforceable
commitments will be weighted more heavily than non-enforceable ones.

> 2\. Specifically identify the SDB concerns with point of contact and
> phone number.

3\. The complexity and variety of the work SDB concerns are to perform.

4\. Realism for the use of SDB in the proposal.

> 5\. Past performance of the Offeror in complying with subcontracting
> plans for SDB concerns.

6\. Targets expressed as dollars and percentage of total contract value
for each participating SDB; which will be incorporated into and become
part of any resulting contract.

> 7\. The extent of participation of SDB concerns in terms of the total
> acquisition.

B. SDB participation information will be used for both responsibility
determinations and as an evaluation factor against which offeror's
relative rankings will be compared to assure the best value to the
Government. The Government will focus on information that demonstrates
realistic commitments to use SDB concerns relative to the size and
complexity of the acquisition under consideration. The Government is not
required to contact all references provided by the offeror. Also,
references other than those identified by the offeror may be contacted
by the Government to obtain additional information that will be used in
the evaluation of the offeror's commitment to SDB participation.

**L.12 BUSINESS PROPOSAL**

The offeror shall submit as part of the proposal a
[separate]{.underline} enclosure titled "Business Proposal." The
Business Proposal shall include the Cost/Price Proposal, the Small
Business Subcontracting Plan, and Other Administrative Data in
accordance with the following: **Note: Business proposal must be
submitted in Cost Plus Award Fee format. A base fee and an award fee
must be proposed.**

A. [Cost/Price Proposal]{.underline}

> 1\. A cost proposal, in the amount of an original and five (5) copies
> submitted in accordance with FAR 15, in a format similar to Attachment
> 6. The offeror's own format may be used, but all required information
> in Attachment 6 shall be provided.
>
> The business proposal must contain sufficient information to allow the
> Government to perform a basic analysis of the proposed cost or price
> of the work. This information shall include the amounts of the basic
> elements of the proposed cost or price.
>
> As appropriate, cost breakdowns shall be provided for the following
> cost elements:
>
> \(a\) [Direct Labor]{.underline}
>
> The estimated cost for all personnel who will be assigned for direct
> work on this project shall be included. Give the name, title, percent
> of effort or time, salary and fringe benefits, for each employee.
>
> Salary increases that are anticipated during performance of a
> resultant contract should be proposed as a cost. If escalation is
> included, state the degree (percent) and methodology, e.g., annual
> flat rate applied to a base rate as of a specific date or a
> mid-pointed rate for the period of performance. State whether any
> additional direct labor (new hires) will be required during the
> performance period of this procurement. If so, state the number
> required and anticipated date of hire. Also, specify the month and day
> on which your fiscal year commences.
>
> \(b\) [Supplies and Equipment]{.underline}
>
> Include description, unit price, quantity, total price, justification
> for purchasing or leasing items and the basis for pricing (vendor
> quotes, invoice prices, etc.).
>
> \(c\) [Travel]{.underline}
>
> The amount proposed for travel shall be supported with a breakdown
> which includes purpose, destination, duration, and estimated cost
> (transportation and per diem) for each proposed trip. If travel costs
> are proposed on the basis of your organization\'s established travel
> policy, a copy of the policy must be provided.
>
> \(d\) [Consultants]{.underline}
>
> This element should include names(s) of consultant, number of days,
> and daily rate. The method of obtaining each consultant, either sole
> source or competitive, and the degree of competition or the rationale
> for sole source shall be explained.

\(e\) [Subcontractors]{.underline}

> Subcontractor costs shall be broken down and supported by cost and
> pricing data adequate to establish the reasonableness of the proposed
> amount. Support documentation should include degree of subcontract
> competition and basis for selecting source.

\(f\) [Other Direct Costs]{.underline}

> Any proposed other direct costs shall be supported with breakdown
> outlining the separate costs proposed and details supporting the
> formulation of the costs proposed. A signed agreement between the
> offeror and any personnel other than direct employees that includes
> dates of employment, salary, and specific tasks to be performed should
> be included.

\(g\) [Indirect Costs]{.underline}

> Indicate how you have computed and applied indirect costs, and provide
> a basis for evaluating the reasonableness of the proposed rates.
>
> 2\. Certified documentation indicating that the offeror has a cost
> accounting system in place which allows for the collection, tracking
> and reporting of all costs under a cost reimbursement-type contract.

3\. Certified documentation that the offeror has a current indirect cost
rate agreement in place with a federal agency or that is in the process
of obtaining or revising such an agreement. A copy of the indirect cost
rate agreement or the proposed rate agreement shall be provided.

> B. [Small Business Subcontracting Plan:]{.underline} All offerors
> except for small businesses are required to submit a subcontracting
> plan in accordance with the Small, Small Disadvantaged and Women-Owned
> Small Business Subcontracting Plan, FAR 52.219-9, incorporated in this
> solicitation. A copy of the AHRQ model subcontracting plan is provided
> as an attachment to this solicitation. If the model plan is not used,
> all elements outlined must be addressed in the offeror's format. **If
> the offeror is a not a small business and fails to submit a
> subcontracting plan with the initial proposal, the offeror will be
> considered nonresponsive and their proposal will be returned without
> further consideration.** The subcontracting plan should be submitted
> with the business proposal.

***[This provision does not apply to small business concerns. This
provision does apply to all other offerors, including large business
concerns, colleges, universities, and non-profit
organizations.]{.underline}***

> The term "subcontract" means any agreement (other than one involving
> an employer-employee relationship) entered into by a Federal
> Government prime contractor or subcontractor calling for supplies or
> services required for the performance of the original contract or
> subcontract. This includes, but is not limited to, agreements/purchase
> orders for supplies and services such as equipment purchase, copying
> services, and travel services.

The offeror understands that:

a\. No contract will be awarded unless and until an acceptable plan is
negotiated with the Contracting Officer. The plan will be incorporated
into the contract.

b\. An acceptable plan must, in the determination of the Contracting
Officer, provide the maximum practicable opportunity for small business
concerns and small business concerns owned and controlled by socially
and economically disadvantaged persons to participate in the performance
of the contract.

c\. If a subcontracting plan acceptable to the Contracting Officer is
not negotiated within the time limits prescribed by the contracting
activity and such failure arises out of causes within the control and
with the fault or negligence of the offeror, the offeror shall be
ineligible for award. The Contracting Officer shall notify the
Contractor in writing of the reasons for determining a subcontracting
plan unacceptable early enough in the negotiation process to allow the
Contractor to modify the plan within the time limits prescribed.

d\. Prior compliance of the offeror with other such subcontracting plans
under previous contracts will be considered by the Contracting Officer
in determining the responsibility of the offeror for award of the
contract.

e\. It is the offeror's responsibility to develop a satisfactory
subcontracting plan with respect to small business concerns and small
business concerns owned and controlled by socially and economically
disadvantaged individuals, and women-owned small business concerns, and
that each such aspect of the offeror's plan will be judged independent
of the other.

f\. The offeror will submit, as required by the Contracting Officer,
subcontracting reports in accordance with the instructions thereon, and
as further directed by the Contracting Officer. Subcontractors will also
submit these reports to the Government's Contracting Officer or as
otherwise directed, with a copy to the prime Contractor's designated
small and disadvantaged business liaison.

g\. For this particular acquisition, the AHRQ recommended goal (as a
percentage of total contract value for the base period) is **23% for
Small Businesses,** which shall include at least **5%** (as a percentage
of total contract value for the base period) for **Small Disadvantaged
Businesses,** at least **5%** (as a percentage of total contract value
for the base period) for **Women-Owned Small Businesses**, and at least
**2%** (as a percentage of total contract value for the base period) for
**HUBZone Small Businesses.** These goals represent AHRQ's expectation
of the minimum level for subcontracting with small business at the prime
contract level. Any goal stated less than the AHRQ recommended goal
shall be justified and is subject to negotiation.

> C. Other Administrative Data
>
> \(1\) [Terms and Conditions]{.underline}: The proposal shall stipulate
> that it is predicated upon the terms and conditions of the RFP. In
> addition, it shall contain a statement to the effect that it is firm
> for a period of at least 120 days from the date of receipt thereof by
> the Government.

Minimum Bid Acceptance Period (April 1984)

\(a\) \"Acceptance period,\" as used in this provision, means the number
of calendar days available to the Government for awarding a contract
from the date specified in this solicitation for receipt of bids.

\(b\) This provision supersedes any language pertaining to the
acceptance period that may appear elsewhere in this solicitation.

\(c\) The Government requires a minimum acceptance period of 120 days.

\(d\) A bid allowing less than the Government\'s minimum acceptance
period may be rejected.

\(e\) The bidder agrees to execute all that it has undertaken to do, in
compliance with its bid, if that bid is accepted in writing within (i)
the acceptance period stated in paragraph (3) above, or (ii) any longer
acceptance period stated in paragraph (4) above.

\(2\) [Authority to Conduct Negotiations]{.underline}: The proposal
shall list the names and telephone numbers of persons authorized to
conduct negotiations and to execute contracts.

\(3\) [Property]{.underline}:

\(a\) It is DHHS policy that contractors will provide all equipment and
facilities necessary for performance of contracts. Exception may be
granted to furnish Government-owned property, or to authorize purchase
with contract funds, only when approved by the contracting officer. If
additional equipment must be acquired, you shall include the
description, estimated cost of each item and whether you will furnish
such items with your own funds.

\(b\) You shall identify Government-owned property in your possession
and/or property acquired from Federal funds to which you have title,
that is proposed to be used in the performance of the prospective
contract.

\(c\) The management and control of any Government property shall be in
accordance with HHS Publication (OS) 74-115 entitled,
[Contractor\'s]{.underline}

> [Guide for Control of Government Property\" 1990]{.underline}, a copy
> of which will be provided upon request.

\(4\) [Royalties]{.underline}: You shall furnish information concerning
royalties which are anticipated to be paid in connection with the
performance of work under the proposed contract.

\(5\) [Commitments]{.underline}: You shall list other commitments with
the Government relating to the specified work or services and indicate
whether these commitments will or will not interfere with the completion
of work and/or services contemplated under this proposal.

\(6\) [Financial Capacity]{.underline}: You shall provide sufficient
data to indicate that you have the necessary financial capacity, working
capital, and other resources to perform the contract without assistance
from any outside source. If not, indicate the amount required and the
anticipated source. (Financial data such as balance sheets, profit and
loss statements, cash forecasts, and financial histories of your
organization\'s affiliated concerns should be utilized.)

\(7\) [Performance Capability]{.underline}: You shall provide acceptable
evidence of your \"ability to obtain\" equipment, facilities, and
personnel necessary to perform the requirements of this project. If
these are not represented in your current operations, they should
normally be supported by commitment or explicit arrangement, which is in
existence at the time the contract is to be awarded, for the rental,
purchase, or other acquisition of such resources, equipment, facilities,
or personnel. In addition, you shall indicate your ability to comply
with the required or proposed delivery or performance schedule taking
into consideration all existing business commitments, commercial as well
as Government.

\(8\) [Representations and Certifications]{.underline}: Section K,
\"Representations and Certifications and Other Statements of Offerors\"
shall be completed and signed by an official authorized to bind your
organization. **This section shall be made a part of the original
business proposal**

**L.13 SELECTION OF OFFERORS**

a\. The acceptability of the technical portion of each contract proposal
will be evaluated by the technical review committee. The committee will
evaluate each proposal in strict conformity with the evaluation criteria
of the RFP, utilizing point scores and written critiques. The committee
may suggest that the Contracting Officer request clarifying information
from an offeror.

b\. The business portion of each contract proposal will be subjected to
a limited cost review, management analysis, small business plan
analysis, etc.

c\. The Contracting Officer will, in concert with program staff,
evaluate past performance and the Small Disadvantaged Business
Participation Plan of the technically acceptable offerors and decide
which proposals are in the competitive range. Oral or written
discussions will be conducted with all offerors in the competitive
range, if necessary. All aspects of the proposals are subject to
discussions, including cost, technical approach, past performance, Small
Disadvantaged Business Participation Plan and contractual terms and
conditions. Final Proposal Revisions will be requested with the
reservation of the right to conduct limited negotiations after
submission of the Final Proposal Revisions.

d\. A final best-buy analysis will be performed taking into
consideration the results of the technical evaluation, cost analysis,
past performance, small disadvantaged business utilization plan, and
ability to complete the work within the Government's required schedule.
The Government reserves the right to make an award to the best advantage
of the Government, technical merit, cost, past performance, and other
factors considered.

e\. The Government reserves the right to make a single award, multiple
awards, or no award at all to the RFP.

**[SECTION M - EVALUATION FACTORS FOR AWARD]{.underline}**

**M.1** Selection of an offeror for contract award will be based on an
evaluation of proposals against four factors and award will be made to
that responsible offeror whose proposal is most advantageous to the
Government. The four factors are: technical, cost, past performance, and
the small disadvantaged business (SDB) subcontracting plan. The
technical proposal will receive paramount consideration in the selection
of the Contractor(s) for this acquisition. Offerors that submit
technically acceptable proposals will then be evaluated for past
performance and for their Small Disadvantaged Business Subcontracting
Plan. Following the evaluation of the offeror's past performance and
Small Disadvantaged Business Participation Plan, a competitive range
will be determined.

**M.2** All evaluation factors, other than cost or price, when combined
are significantly more important than cost or price. However, cost/price
may become a critical factor in source selection in the event that two
or more offerors are determined to be essentially equal following the
evaluation of all factors other than cost or price. In any event, the
Government reserves the right to make an award to that offeror whose
proposal provides the best overall value to the Government. The
Government reserves the right to make a single award, multiple awards,
or no award at all.

**THE GOVERNMENT RESERVES THE RIGHT TO MAKE AN AWARD WITHOUT
DISCUSSION**

**M.3** All proposals will be reviewed in accordance with the governing
regulations and AHRQ policies and procedures. The technical proposal,
past performance information and Small Disadvantaged Business
Participation Plan will be evaluated in terms of the offeror's responses
to each of the evaluation factors. Each proposal will be evaluated on
the likelihood of meeting the Government's requirements. The evaluation
factors and assigned weights which will be used in the overall review of
the offeror's proposal are outlined below. The technical proposal shall
consist of the responses to evaluation criteria 1 through 5. The offeror
should show that the objectives stated in the proposal are understood
and offer a logical program for their achievement. The following
criteria will be used to evaluate proposals and will be weighted as
indicated in establishing a numerical rating for all proposals
submitted. Factors facilitating the evaluation of each criteria below
are referenced in the corresponding criteria found in Section L of this
solicitation:

***OFFERORS PLEASE NOTE:*** Evaluation Criteria A through D, for a total
of 100 points, will be evaluated by a peer review technical committee,
who will also recommend technical acceptability or unacceptability of
the proposal. Program staff and contracting personnel will review and
evaluate Criteria E and F, for a total of 25 points. The total possible
points for Evaluation Criteria 1 through 7 is 125 points.

  ----------------------------------------------------------- --------------------------
  **[Evaluation Criteria]{.underline}**                       **[Weight]{.underline}**

  ----------------------------------------------------------- --------------------------

**A. [Response to Statement of Work]{.underline}** **[40]{.underline}**

Proposal prepared in response to the Statement of Work (SOW) will be
evaluated on the following:

1\. Completeness of the proposal.

2\. Offeror's demonstrated understanding of the overall objectives of
the SOW and of the i ndividual tasks of the SOW.

3\. Proposed technical approach to accomplishing each of the tasks in
the SOW.

4\. Qualifications and experience of the personnel to be assigned to the
various tasks, including key personnel, subcontractors, and consultants.

5\. Approach to identifying and obtaining input from Panel of Experts,
technical experts, and other relevant organizations.

6\. Extent to which the proposal demonstrates a capability to complete
the tasks outlined in the SOW within the specified time frames and
produce high-quality, accurate deliverables and information.

7\. Extent to which the proposal demonstrates an efficient use of staff
and other resources to accomplish the required tasks.

**B. [Staffing and Management Plan]{.underline}** **[30]{.underline}**

> Proposals will be evaluated on the extent to which the Offeror
> demonstrates the availability of experienced and qualified personnel
> or staff, and through subcontracting or consulting arrangements, with
> the breadth and depth of methodological, technical, quality
> measurement, and clinical expertise as specified in the technical
> proposal instructions.
>
> Proposals will also be evaluated on the effectiveness of the
> procedures proposed for managing tasks outlined in the SOW and meeting
> critical project milestones, including: measures to ensure that
> qualified personnel will be available for individual tasks outlined in
> the SOW; plans for organizing, managing, and coordinating the
> respective roles and responsibilities of the various personnel;
> quality control processes; procedures to assure timely start-up and
> completion of work; methods to manage relationships with consultants,
> subcontractors; and members of the Panel of Experts; and methods to
> ensure the efficient use of staff and other resources in conducting
> required tasks.

**C. Corporate/Organizational Experience** **[20]{.underline}**

Proposals will be evaluated on the following criteria:

1\. Extent and relevance of prior experience related to development,
implementation, use, and evaluation of quality measures.

2\. Extent and relevance of prior experience in development of
clinically related classifications schemes and relational databases.

3\. Extent and relevance of prior experience working with expert panels.

4\. Extent and relevance of prior experience in working with quality
measure developers, as well as, clinical organizations, including
hospitals, health plans, and medical specialty societies.

5\. Extent and relevance of prior experience successfully completing
highly technical and complex projects.

6\. Experience developing and maintaining Oracle-based databases.

7\. Extent and relevance of prior experience developing user-friendly
World Wide Web sites.

8\. Extent and relevance of prior experience in successfully completing
projects of a similar nature and scale within the required time and
budgetary constraints.

9\. Quality of submitted examples of prior work of a similar nature.

**D. [Facilities and Equipment]{.underline}** **[10]{.underline}**

Proposals will be evaluated on the extent to which the offeror
demonstrates adequate availability of the following:

1\. Appropriate software and hardware capabilities to complete the tasks
required in the SOW.

2\. Duplicating and facsimile capabilities

3\. Capacity to access electronic databases necessary to search
biomedical and health services literature and to obtain hard and
electronic copies of measures.

4\. Capacity to communicate via electronic mail using state-of-the-art
hardware and software.

5\. Capacity to teleconference using state-of-the-art equipment

**TOTAL POINTS BEFORE PAST PERFORMANCE AND**

**SMALL DISADVANTAGE BUSINESS UTILIZATION PLAN [100]{.underline}**

**E. [Past Performance]{.underline} [20]{.underline}**

> Offerors will be evaluated on their past performance (since January 1,
> 1998).
>
> The offerors' past performance will be evaluated on the basis of the
> following factors:

\(a\) Quality: How well the contractor conformed to the performance
standard in providing the research services or achieved the stated
objective of the contract or grant. Quality will be evaluated by the
personnel provided, the level of effort agreed to in the contract
statement of work or grant, and quality of final products (e.g., written
reports).

\(b\) Timeliness: How well the contractor adheres to time-tables and
delivery schedules in providing the research services or products.
Consideration is given to contractor's effort to recommend and/or take
corrective actions to keep the contract or grant on schedule.

\(c\) Customer-satisfaction: Rates the professional and cooperative
behavior of the contractor or grantee with the client.

\(d\) Cost control: Rates the cost-effectiveness of the contractor or
grantee in conducting the research.

> Assessment of the offeror's past performance will be one means of
> evaluating the credibility of the offeror's proposal, and relative
> capability to meet performance requirements.
>
> The completed questionnaires will provide a basis for determining past
> performance evaluation as well as information obtained from the
> references listed in the proposal, other customers known to the
> Government, consumer protection organizations, and others who may have
> useful and relevant information. Information will also be considered
> regarding any significant subcontractors and key personnel records.
> Past performance will be scored on a range from 0 to 20, with 20 being
> the most favorable.
>
> Evaluation of past performance will often be quite subjective based on
> consideration of all relevant facts and circumstances. It will not be
> based on absolute standards of acceptable performance. The Government
> is seeking to determine whether the offeror has consistently
> demonstrated a commitment to customer satisfaction and timely delivery
> of services at fair and reasonable prices.
>
> The assessment of the offeror's past performance will be used as a
> means of evaluating the relative capability of the offeror and the
> other competitors. Thus, an offeror with an exceptional record of past
> performance may receive a more favorable evaluation than another whose
> record is acceptable, even though both may have acceptable technical
> proposals.
>
> By past performance, the Government means the offeror's record of
> conforming to specifications and to standards of good workmanship; the
> contractor's record of forecasting and controlling costs; the
> offeror's adherence to contract schedules, including the
> administrative aspects of performance; the offeror's reputation for
> reasonable and cooperative behavior and commitment to customer
> satisfaction; and generally, the offeror's business-like concern for
> the interest of the customer.
>
> The Government will consider the number or severity of an offeror's
> problems, the effectiveness of corrective actions taken, the offeror's
> overall work record, and the age and relevance of past performance
> information.
>
> The lack of a performance record may result in an unknown performance
> risk assessment, which will neither be used to the advantage nor
> disadvantage of the offeror.
>
> The Government reserves the right to evaluate relevant past
> performance information not specifically provided by the offeror.
>
> **F. [Small Disadvantaged Business Participation Plan 5]{.underline}**
>
> The evaluation will be based on information obtained from the plan
> provided by the offeror, the realism of the proposal, other relevant
> information obtained from named SDB concerns, and any information
> supplied by the offeror concerning problems encountered in SDB
> participation.
>
> Evaluation of the SDB Participation Plan will be a subjective
> assessment based on a consideration of all relevant facts and
> circumstances. It will not be based on absolute standards of
> acceptable performance. The Government is seeking to determine whether
> the offeror has demonstrated a commitment to use SDB concerns for the
> work that it intends to perform as the prime contractor.
>
> The assessment of the offeror's SDB Participation Plan will be used as
> a means of evaluating the relative capability and commitment of the
> offeror and the other competitors. Thus, an offeror with an
> exceptional record of participation with SDB concerns may receive more
> points and a more favorable evaluation than another whose record is
> acceptable, even though both may have acceptable technical proposals.
>
> SDB participation will be scored with offerors receiving points from 0
> to 5, with 5 being the most favorable.

**Attachment 1**

**List of Reference Materials**

Inventory of the Department of Health and Human Services Performance
Measures--Phase III Data Collection and Analysis , Requirements Contract
No. 290-96-0008, Task Order No. 5, July 23, 1999, prepared by Center for
Health Policy Studies, 10440 Little Patuxent Parkway, 10^th^ Floor,
Columbia, MD 21044

Research Triangle Institute, CONQUEST Evaluation Final Report, June 7,
2000. Contract No. 290-96-0011, Task Order No. 5.

The Lewin Group, Feasibility Study for Developing a Web-based,
Redesigned and Enhanced CONQUEST and Integrating it with an Enhanced
National Guidelines Clearinghouse ™, November 22, 2000. Contract No.
290-96-0009, Task order 2000-07

NOTE: Copies of the above references are not being provided with this
solicitation.

**Attachment 2**

**PAST PERFORMANCE QUESTIONNAIRE**

**[PART ONE: INSTRUCTIONS]{.underline}**

The offeror listed below has submitted a proposal in response to the
Agency for Healthcare Research and Quality (AHRQ) Solicitation No.
AHRQ-01-0011, entitled "Develop, Implement, Maintain and Assess a
National Electronic Web-Based Morbidity and Mortality Conference Site."
Past performance is an important part of the evaluation criteria for
this acquisition, so input from previous customers of the offeror is
important. This office would greatly appreciate you taking the time to
complete this form. **This information is to be provided to Mary Haines,
the AHRQ Contracting Officer and is NOT to be disclosed to the offeror
either verbally or in writing.** Please provide an honest assessment and
return to AHRQ to the address shown below, no later than **June 6,
2001**. If you have any questions, please contact Mary Haines at (301)
594-7193.

Mary Haines

Agency for Healthcare Research and Quality

Division of Contracts Management

2101 East Jefferson Street, Suite 601

Rockville, Maryland 20852

FAX: (301) 443-7523

NAME OF OFFEROR:

ADDRESS:

**[Contractor Performance Form]{.underline}**

1\. Name of Contractor:

2\. Address:

3\. Contract/Grant Number:

4\. Contract/Grant Value (Base Plus Options):

5\. Contract/Grant Award Date:

6\. Contract/Grant Completion Date:

7\. Type of Contract/Grant: (Check all that apply) ( )FP ( )FPI (
)FP-EPA

( ) Award Fee ( ) CPFF-Completion ( ) CPFF-Term ( ) CPIF ( ) CPAF

( ) IO/IQ ( ) BOA ( ) Requirements ( ) Labor-Hour ( )T&M ( ) SBSA

( )8(a) ( )SBIR ( ) Sealed Bid( )Negotiated( )Competitive (
)Non-Competitive

8\. Description of Requirement:

**[CONTRACTOR'S PERFORMANCE RATING]{.underline}**

Ratings: Summarize contractor performance and circle in the column on
the right the number which corresponds to the performance rating for
each rating category. Please see reverse page for explanation of rating
scale.

+------------------+-----------------------------------------------+---+
| Quality of       | Comments                                      | 0 |
| Product or       |                                               |   |
| Service          |                                               | 1 |
|                  |                                               |   |
|                  |                                               | 2 |
|                  |                                               |   |
|                  |                                               | 3 |
|                  |                                               |   |
|                  |                                               | 4 |
|                  |                                               |   |
|                  |                                               | 5 |
+------------------+-----------------------------------------------+---+
| Cost             | Comments                                      | 0 |
|                  |                                               |   |
| Control          |                                               | 1 |
|                  |                                               |   |
|                  |                                               | 2 |
|                  |                                               |   |
|                  |                                               | 3 |
|                  |                                               |   |
|                  |                                               | 4 |
|                  |                                               |   |
|                  |                                               | 5 |
+------------------+-----------------------------------------------+---+
| Timeliness of    | Comments                                      | 0 |
|                  |                                               |   |
| Performance      |                                               | 1 |
|                  |                                               |   |
|                  |                                               | 2 |
|                  |                                               |   |
|                  |                                               | 3 |
|                  |                                               |   |
|                  |                                               | 4 |
|                  |                                               |   |
|                  |                                               | 5 |
+------------------+-----------------------------------------------+---+
| Business         | Comments                                      | 0 |
| Relations        |                                               |   |
|                  |                                               | 1 |
|                  |                                               |   |
|                  |                                               | 2 |
|                  |                                               |   |
|                  |                                               | 3 |
|                  |                                               |   |
|                  |                                               | 4 |
|                  |                                               |   |
|                  |                                               | 5 |
+------------------+-----------------------------------------------+---+
|                  |                                               |   |
+------------------+-----------------------------------------------+---+

Customer Satisfaction - Is/was the Contractor committed to customer
satisfaction? Yes No ;

Would you use this Contractor again? Yes No

Reason:

**NAME OF EVALUATOR:**

**TITLE OF EVALUATOR:**

**SIGNATURE OF EVALUATOR:**

**DATE:**

**MAILING ADDRESS:**

**PHONE #:**

**Rating Guidelines:** Summarize contractor performance in each of the
rating areas. Assign each area a rating 0(Unsatisfactory), 1(Poor),
2(Fair), 3(Good), 4(Excellent) 5(Outstanding). Use the following
instructions as guidance in making these evaluations.

+-------------+--------------+------------+-------------+-------------+
|             | **Quality**  | **Cost     | *           | **Business  |
|             |              | Control**  | *Timeliness | Relation**  |
|             |              |            | of          |             |
|             |              |            | Pe          |             |
|             |              |            | rformance** |             |
+-------------+--------------+------------+-------------+-------------+
|             | -Compliance  | -Within    | -Met        | -Effective  |
|             | with         | bu         | interim     | management  |
|             | contract     | dget(over/ | milestones  |             |
|             | requirements |            |             | -B          |
|             |              | under      | -Reliable   | usinesslike |
|             | -Accuracy of | target     |             | cor         |
|             | reports      | costs)     | -Responsive | respondence |
|             |              |            | to          |             |
|             | -Technical   | -Current,  | technical   | -Responsive |
|             | excellence   | accurate,  | direction   | to contract |
|             |              | and        |             | r           |
|             |              | complete   | -Completed  | equirements |
|             |              | billings   | on time,    |             |
|             |              |            | including   | -Prompt     |
|             |              | -Re        | wrap-up and | n           |
|             |              | lationship | contract    | otification |
|             |              | of         | adm         | of problems |
|             |              | negotiated |             |             |
|             |              | costs to   | -No         | -           |
|             |              | actual     | liquidated  | Reasonable/ |
|             |              |            | damages     |             |
|             |              | -Cost      | assessed    | cooperative |
|             |              | ef         |             |             |
|             |              | ficiencies |             | -Flexible   |
|             |              |            |             |             |
|             |              | -Change    |             | -Pro-active |
|             |              | orders     |             |             |
|             |              | issue      |             | -Effective  |
|             |              |            |             |             |
|             |              |            |             | small/small |
|             |              |            |             | di          |
|             |              |            |             | sadvantaged |
|             |              |            |             | business    |
|             |              |            |             | sub-        |
|             |              |            |             | contracting |
|             |              |            |             | program     |
+-------------+--------------+------------+-------------+-------------+
| 0-uns       | Non          | Ability to | Delays are  | Response to |
| atisfactory | conformances | manage     | j           | inquiries,  |
|             | are          | cost       | eopardizing | technical/  |
|             | jeopardizing | issues is  | the         | service/adm |
|             | the          | je         | achievement | inistrative |
|             | achievement  | opardizing | of contract | issues is   |
|             | of contract  | p          | re          | not         |
|             | r            | erformance | quirements, | effective   |
|             | equirements, | of         | despite use |             |
|             | despite use  | contract   | of Agency's |             |
|             | of Agency    | req        | resources   |             |
|             | resources    | uirements, |             |             |
|             |              | despite    |             |             |
|             |              | use of     |             |             |
|             |              | Agency     |             |             |
|             |              | resources  |             |             |
+-------------+--------------+------------+-------------+-------------+
| 1-Poor      | Overall      | Ability to | Delays      | Response to |
|             | compliance   | manage     | require     | inquiries,  |
|             | requires     | cost       | major       | technical/  |
|             | major Agency | issues     | Agency      | service/adm |
|             | resources to | requires   | resources   | inistrative |
|             | ensure       | major      | to ensure   | issues is   |
|             | achievement  | Agency     | achievement | marginally  |
|             | of contract  | resources  | of contract | effective   |
|             | requirements | to ensure  | r           |             |
|             |              | a          | equirements |             |
|             |              | chievement |             |             |
|             |              | of         |             |             |
|             |              | contract   |             |             |
|             |              | re         |             |             |
|             |              | quirements |             |             |
+-------------+--------------+------------+-------------+-------------+
| 2-Fair      | Overall      | Ability to | Delays      | Response to |
|             | compliance   | manage     | require     | inquiries,  |
|             | requires     | cost       | minor       | technical/  |
|             | minor Agency | issues     | Agency      | service/adm |
|             | resources to | requires   | resources   | inistrative |
|             | ensure       | minor      | to ensure   | issues is   |
|             | achievement  | Agency     | achievement | somewhat    |
|             | of contract  | resources  | of contract | effective   |
|             | requirements | to ensure  | r           |             |
|             |              | a          | equirements |             |
|             |              | chievement |             |             |
|             |              | of         |             |             |
|             |              | contract   |             |             |
|             |              | re         |             |             |
|             |              | quirements |             |             |
+-------------+--------------+------------+-------------+-------------+
| 3-Good      | Overall      | Management | Delays do   | Response to |
|             | compliance   | of cost    | not impact  | inquiries,  |
|             | does not     | issues     | achievement | technical/  |
|             | impact       | does not   | of contract | service/adm |
|             | achievement  | impact     | r           | inistrative |
|             | of contract  | a          | equirements | issues is   |
|             | requirements | chievement |             | usually     |
|             |              | of         |             | effective   |
|             |              | contract   |             |             |
|             |              | re         |             |             |
|             |              | quirements |             |             |
+-------------+--------------+------------+-------------+-------------+
| 4-Excellent | There are no | There are  | There are   | Response to |
|             | quality      | no cost    | no delays   | inquiries,  |
|             | problems     | management |             | technical/  |
|             |              | issues     |             | service/adm |
|             |              |            |             | inistrative |
|             |              |            |             | issues is   |
|             |              |            |             | effective   |
+-------------+--------------+------------+-------------+-------------+

5-Outstanding. The Contractor has demonstrated an outstanding
performance level that justifies adding a point to the score. It is
expected that this rating will be used in those rare circumstances where
Contractor performance clearly exceeds the performance levels described
as "Excellent."

**Attachment 3**

**DHHS SMALL, SMALL DISADVANTAGED, Woman, HUBZone , VETERAN‑OWNED SMALL
BUSINESS SUBCONTRACTING PLAN**

**DATE OF PLAN**:\_\_\_\_\_\_\_\_\_\_\_\_\_\_

CONTRACTOR\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

ADDRESS:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

DUNN & BRADSTREET NUMBER:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

SOLICITATION OR CONTRACT NUMBER:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

ITEM/SERVICE (Description):
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

TOTAL CONTRACT AMOUNT: \$\_\_\_\_\_\_\_\_\_\_\_\_\_\_
\$\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ Total contract or Option #1

Base-Year, if options (if applicable)

\$ \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ 
\$\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_   \$
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_          Option #2
                            Option #3                           Option
#4

(if applicable) (if applicable) (if applicable)

TOTAL MODIFICATION AMOUNT, IF APPLICABLE   \$
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

TOTAL TASK ORDER AMOUNT, IF APPLICABLE \$
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

PERIOD OF CONTRACT PERFORMANCE (Month, Day & Year):
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

The following is a suggested model for use when developing
subcontracting plans as required by P.L. 95‑507 and implemented by
Federal Acquisition Regulations (FAR) Subpart 19.7. While this model
plan has been designed to be consistent with statutory and regulatory
requirements, other formats of a subcontracting plan may be acceptable;
however, failure to include the essential information as exemplified in
this model may be cause for either a delay in acceptance or the
rejection of a bid or offer when a subcontracting plan is required.
Further, the use of this model is not intended to waive other
requirements that may be applicable under statute or regulation.
\"SUBCONTRACT,\" as used in this clause, means any agreement (other than
one involving an employer‑employee relationship) entered into by a
Federal Government prime contractor or subcontractor calling for
supplies or services required for performance of the contract or
subcontract.

Subcontracting Plan

(Rev. October 2000)

**1. Type of Plan** (check one)

> \_\_\_\_\_ Individual plan (all elements developed specifically for
> this contract and applicable for the full term of this contract).
>
> \_\_\_\_\_ Master plan (goals developed for this contract) all other
> elements standardized and approved by a lead agency Federal Official;
> must be renewed every three years and contractor must provide copy of
> lead agency approval.
>
> \_\_\_\_\_ Commercial products/service plan, including goals, covers
> the offerer's fiscal year and applies to the entire production of
> commercial items or delivery of services sold by either the entire
> company or a portion thereof (e.g., division, plant, or product line);
> this includes planned subcontracting for both commercial and
> Government business.

**2. Goals**

> State separate dollar and percentage goals for Small Business (SB),
> Small Disadvantaged Business (SDB), Woman‑owned Small Business (WOSB),
> Historically Underutilized Business Zone (HUBZone) Small Business,
> Veteran, and "Other@ than small business (OTHER) as subcontractors,
> for the base year and each option year, as specified in FAR 19.704
> (break out and append option year goals, if applicable) or project
> annual subcontracting base and goals under commercial plans.
>
> a\. Total estimated dollar value of ALL planned subcontracting, i.e.,
> with ALL types of concerns under this contract is \$
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ (b + g = 100%)
>
> b\. Total estimated dollar value and percent of planned subcontracting
> with SMALL BUSINESSES (including SDB, WOSB, HUBZone, Veteran, -owned):
> (% of \"a\") \$ \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_% Federal Goal 23%
>
> c\. Total estimated dollar value and percent of planned subcontracting
> with SMALL DISADVANTAGED BUSINESSES: (% of \"a\") \$
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_%
> Federal Goal 5%
>
> d\. Total estimated dollar value and percent of planned subcontracting
> with WOMAN‑OWNED SMALL BUSINESSES: (% of \"a\") \$
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_%
> Federal Goal 5%
>
> e\. Total estimated dollar and percent of planned subcontracting with
> HUBZone SMALL BUSINESSES: (% of \"a\") \$
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_%
> Federal Goal 2%
>
> f\. Total estimated dollar and percent of planned subcontracting with
> VETERAN SMALL BUSINESSES: (% of \"a\") \$
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_%
>
> g\. Total estimated dollar and percent of planned subcontracting with
> AOTHER@ THAN SMALL BUSINESSES:
>
> (% of \"a\") \$ \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_ and
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_%
>
> \***Note:** Service-disabled veteran goal should be included as part
> of veteran small business goal.

Subcontracting Plan

(Rev. October 2000)

Provide a description of ALL the products and/or services, to be
subcontracted under this contract, and indicate the size and type of
business supplying them (check all that apply).

  -------------------- ------- ------ ------- --------- ----------- ---------
  Product/Service      Other   SB     SDB     WOSB      HUBZoneSB   Veteran

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    

                                                                    
  -------------------- ------- ------ ------- --------- ----------- ---------

> h\. Provide a description of the method used to develop the
> subcontracting goals for small, small disadvantaged, woman‑owned and
> HUBZone, veteran, and service-disabled veteran-owned small business
> concerns. Address efforts made to ensure that maximum practicable
> subcontracting opportunities have been made available for those
> concerns and explain the method used to identify potential sources for
> solicitation purposes. Explain the method and state the quantitative
> basis (in dollars) used to establish the percentage goals. Also,
> explain how the areas to be subcontracted to small, disadvantaged,
> woman, HUBZone, veteran, and service-disabled veteran-owned small
> business concerns were determined and how the capabilities of these
> concerns were considered for subcontract opportunities. Identify any
> source lists or other resources used in the determination process.
> (Attach additional sheets, if necessary.)
>
> i\. Indirect costs have \_\_\_\_ have not\_\_\_\_ been included in the
> dollar and percentage subcontracting goals above (check one).

j\. If indirect costs have been included, explain the method used to
determine the proportionate share of such costs to be allocated as
subcontracts to small, disadvantaged, woman, HUBZone, veteran, and
service-disabled veteran-owned small business concerns.\
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Subcontracting Plan

(Rev. October 2000)

**3.** **Program Administrator** :

> NAME/TITLE:
>
> ADDRESS:
>
> TELEPHONE/E-MAIL:
>
> **Duties**: Has general overall responsibility for the company\'s
> subcontracting program, i.e., developing, preparing, and executing
> subcontracting plans and monitoring performance relative to the
> requirements of those subcontracting plans. Other duties include, but
> are not limited to, the following activities:

a.  Developing and promoting company‑wide policy initiatives that
    demonstrate the company\'s support for awarding contracts and
    subcontracts to small, disadvantaged, woman, HUBZone, veteran, and
    service-disabled veteran-owned small business concerns; and for
    assuring that these concerns are included on the source lists for
    solicitations for products and services they are capable of
    providing.

b.  Developing and maintaining bidder source lists of small,
    disadvantaged, woman, HUBZone, veteran, and service-disabled
    veteran-owned small business concerns from all possible sources;

```{=html}
<!-- -->
```
a.  Ensuring periodic rotation of potential subcontractors on bidder\'s
    lists;

```{=html}
<!-- -->
```
a.  Ensuring that requests for contracts (RFC) are designed to permit
    the maximum practicable participation of small, disadvantaged,
    woman, HUBZone, veteran, and service-disabled veteran-owned small
    businesses;

```{=html}
<!-- -->
```
a.  Accessing various sources for the identification of small, small
    disadvantaged, woman‑owned and HUBZone, veteran, and
    service-disabled veteran-owned small business concerns to include
    the SBA\'s PRO-"Net" System, the Federal Acquisition Computer
    Network (FACNET) Contractor Registration Database, the National
    Minority Purchasing Council Vendor Information Service, the Office
    of Minority Business Data Center in the Department of Commerce,
    local small business and minority associations, contact with local
    chambers of commerce and Federal agencies\' Small Business Offices;

```{=html}
<!-- -->
```
a.  Establishing and maintaining contract and subcontract award records;

```{=html}
<!-- -->
```
a.  Participating in Business Opportunity Workshops, Minority Business
    Enterprise Seminars, Trade Fairs, Procurement Conferences, etc;

```{=html}
<!-- -->
```
a.  Ensuring that small, disadvantaged, woman, HUBZone, veteran, and
    service-disabled veteran-owned small business concerns are made
    aware of subcontracting opportunities and assisting concerns in
    preparing responsive bids to the company;

```{=html}
<!-- -->
```
a.  Conducting or arranging for the conduct of training for purchasing
    personnel regarding the intent and impact of Public Law 95‑507 on
    purchasing;

```{=html}
<!-- -->
```
a.  Monitoring the company\'s subcontracting program performance and
    making any adjustments necessary to achieve the subcontract plan
    goals;

k.   Preparing, and submitting timely, required subcontract reports;

> l.    Coordinating the company\'s activities during the conduct of
> compliance reviews by Federal agencies; and

m.  Other
duties:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

Subcontracting Plan

(Rev. October 2000)

**4. Equitable Opportunity**

> Describe efforts the offeror will make to ensure that small,
> disadvantaged, woman, HUBZone, veteran, and service-disabled
> veteran-owned small business concerns will have an equitable
> opportunity to compete for subcontracts. These efforts include, but
> are not limited to, the following activities:

a\. Outreach efforts to obtain sources:

1) Contacting minority and small business trade associations;
2) contacting business development organizations and local chambers of
commerce; 3)  attending small, disadvantaged, woman, HUBZone, veteran,
and service-disabled veteran-owned small business procurement
conferences and trade fairs; 4) requesting sources from the Small
Business Administrations (SBA) PRO-"Net", and other SBA resources; and
5) conducting market surveys to identify new sources.

b\. Internal efforts to guide and encourage purchasing personnel:

1) Conducting workshops, seminars, and training programs;

> 2) Establishing, maintaining, and utilizing small, disadvantaged,
> woman, HUBZone, veteran, and service-disabled veteran-owned small
> business source lists, guides, and other data for soliciting
> subcontractors; and

3) Monitoring activities to evaluate compliance with the subcontracting
plan.

> c\. Additional efforts:
> \_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_

**5. Flow Down Clause**

> The contractor agrees to include the provisions under FAR 52.219‑8,
> \"Utilization of Small Business Concerns," in all acquisitions
> exceeding the simplified acquisition threshold that offers further
> subcontracting opportunities. All subcontractors, except small
> business concerns, that receive subcontracts in excess of \$500,000
> (\$1,000,000 for construction) must adopt and comply with a plan
> similar to the plan required by FAR 52.219‑9, \"Small Business
> Subcontracting Plan.\" (Flow down is not applicable for commercial
> items/services as described in 52.212-5(e) and 52.244-6(c).)

**6. Reporting and Cooperation**

> The contractor gives assurance of (1) cooperation in any studies or
> surveys that may be required; (2) submission of periodic reports which
> show compliance with the subcontracting plan; (3) submission of
> Standard Form (SF) 294, \"Subcontracting Report for Individual
> Contracts,\" and attendant Optional Form 312, SDB Participation Report
> and SF‑295, \"Summary Subcontract Report,\" in accordance with the
> instructions on the forms; and (4) ensuring that subcontractors agree
> to submit Standard Forms 294 and 95.

  --------------------------- ------------------------- ------------------
  Reporting Period            Report Due                Due Date

  Oct 1 - Mar 31              SF-294/of 312             4/30

  Apr 1 - Sept 30             SF-294/of 312             10/30

  Oct 1 - Sept 30             SF-295                    10/30
  --------------------------- ------------------------- ------------------

Special instructions for commercial products plan: SF295 Report is due
on 10/30 each year for the previous fiscal year ending 9/30.

Subcontracting Plan

(Rev. October 2000)

\(a\) Submit SF‑294 and attendent optional Form 312 to cognizant
Contracting Officer

1.  Submit SF‑295 to cognizant Contracting Officer and to the:

Office of Small and Disadvantaged Business Utilization

Department of Health and Human Services

200 Independence Avenue, SW

Humphrey H. Building, Room 517‑D

Washington, D.C. 20201

> (c) Submit \"information\" copy to SBA Commercial Market
> Representative (CMR); visit the SBA at
> [http://www.sba.gov/gc]{.underline} and click on assistance directory
> to locate your nearest CMR.

**7. Record keeping**

> The following is a recitation of the types of records the contractor
> will maintain to demonstrate the procedures adopted to comply with the
> requirements and goals in the subcontracting plan. These records will
> include, but not be limited to, the following:
>
> a. Small, disadvantaged, woman, HUBZone, veteran, and service-disabled
> veteran-owned small business source lists, guides and other data
> identifying such vendors;
>
> b. Organizations contacted in an attempt to locate small,
> disadvantaged, woman, HUBZone, veteran, and service-disabled
> veteran-owned small business sources;
>
> c. On a contract‑by‑contract basis, records on all subcontract
> solicitations over \$100,000, which indicate for each solicitation (1)
> whether small business concerns were solicited, and, if not, why not;
> (2) whether HUBZone small business concerns were solicited, if not,
> why not; (3) whether small disadvantage business concerns were
> solicited, if not, why not; (4) whether woman-owned small business
> concerns were solicited, and if not, why not; (5) whether veteran or
> service-disabled veteran-owned small business concerns were solicited,
> and if not, why not; and (6) the reason for the failure of solicited
> small, disadvantaged, woman, HUBZone, veteran, and service-disabled
> veteran-owned small business concerns to receive the subcontract
> award;
>
> d. Records to support other outreach efforts, e.g., contacts with
> minority and small business trade associations, attendance at small
> and minority business procurement conferences and trade fairs;
>
> e. Records to support internal guidance and encouragement provided to
> buyers through (1) workshops, seminars, training programs, incentive
> awards; and (2) monitoring performance to evaluate compliance with the
> program and requirements; and
>
> f. On a contract‑by‑contract basis, records to support subcontract
> award data including the name address, and business type and size of
> each subcontractor. (This item is not required for company or
> division‑wide commercial products plans.)

g. Additional records:

Subcontracting Plan

(Rev. October 2000) **SIGNATURE PAGE**

(applies to Master or Commercial type plans)

**This master or commercial type subcontracting plan is submitted by:**

**Contractor:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Contractor Signature:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Typed Name:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Title:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Date Prepared:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**And Is Accepted By:**

**Agency:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Contracting Officer
Signature**:**\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Typed Name:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

**Date:
\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_**

Subcontracting Plan

(Rev. October 2000)

**ATTACHMENT 4**

***PROPOSAL INTENT RESPONSE SHEET***

[RFP No. AHRQ-01-0006]{.underline}

Please review the attached request for proposal. Furnish the information
requested below and return this page by the earliest practical date.
Your expression of intent is not binding but will greatly assist us in
planning for the proposal evaluation.

**Please submit by June 6, 2001**

\[ \] INTEND TO SUBMIT A PROPOSAL

\[ \] DO NOT INTEND TO SUBMIT A PROPOSAL FOR THE FOLLOWING REASONS:

COMPANY/INSTITUTION NAME:

AUTHORIZED SIGNATURE:

TYPED NAME AND TITLE:

DATE:

Please return to:

Mary Haines

Agency for Healthcare Research and Quality

Division of Contracts Management

2101 East Jefferson Street, Suite 502

Rockville, Maryland 20852

**ATTACHMENT 5 0348-0046**

Complete this form to disclose lobbying activities pursuant to 31 U.S.C.
1352

(See reverse for public burden disclosure.)

<table>
<colgroup>
<col style="width: 33%" />
<col style="width: 9%" />
<col style="width: 6%" />
<col style="width: 4%" />
<col style="width: 4%" />
<col style="width: 8%" />
<col style="width: 32%" />
<col style="width: 0%" />
<col style="width: 0%" />
<col style="width: 0%" />
</colgroup>
<tbody>
<tr class="odd">
<td><p>1. Type of Federal Action:</p>
<p>a. contract</p>
<p>b. grant</p>
<p>c. cooperative agreement</p>
<p>d. loan</p>
<p>e. loan guarantee</p>
<p>f. loan insurance</p></td>
<td colspan="5"><p>2. Status of Federal Action:</p>
<p>a. bid/offer/application</p>
<p>b. Initial award</p>
<p>c. post-award</p></td>
<td colspan="3"><p>3. Report Type:</p>
<p>a. initial filing</p>
<p>b. material change</p>
<p>For Material Change Only:</p>
<p>year ______ quarter _______</p>
<p>date of last report________</p></td>
<td></td>
</tr>
<tr class="even">
<td colspan="3"><p>4. Name and Address of Reporting Entity:</p>
<p><strong></strong> Prime <strong></strong> Subawardee</p>
<p>Tier_____, if known:</p>
<p>Congressional District, if known:</p></td>
<td colspan="5"><p>5. If Reporting Entity in No. 4 is Subawardee, Enter
Name and Address of Prime</p>
<p>Congressional District, if known:</p></td>
<td colspan="2"></td>
</tr>
<tr class="odd">
<td colspan="3">6. Federal Department/Agency:</td>
<td colspan="5"><p>7. Federal Program Name/Description</p>
<p>CFDA Number, if applicable: __________________</p></td>
<td colspan="2"></td>
</tr>
<tr class="even">
<td colspan="3">8. Federal Action Number, if known:</td>
<td colspan="5"><p>9. Award Amount, if known:</p>
<p>$</p></td>
<td colspan="2"></td>
</tr>
<tr class="odd">
<td colspan="3"><p>10. a. Name and Address of Lobbying Entity</p>
<p>(if individual, last name, first name, MI):</p>
<p>(attach Continuation Sheet(s)</p></td>
<td colspan="5"><p>b. Individual Performing Services (including address
if different from No. 10a)</p>
<p>(last name, first name, MI)</p>
<p>SF-LLL-A, if necessary)</p></td>
<td colspan="2"></td>
</tr>
<tr class="even">
<td colspan="3"><p>11. Amount of Payment (check all that apply):</p>
<p>$__________ <strong></strong> actual <strong></strong>
planned</p></td>
<td colspan="5"><p>13. Type of Payment (check all that apply):</p>
<p><strong></strong> a. retainer</p>
<p><strong></strong> b. one-time fee</p>
<p><strong></strong> c. commission</p>
<p><strong></strong> d. contingent fee</p>
<p><strong></strong> e. deferred</p>
<p><strong></strong> f. other; specify:
_____________________________</p></td>
<td colspan="2"></td>
</tr>
<tr class="odd">
<td colspan="3"><p>12. Form of Payment (check all that apply):</p>
<p><strong></strong> a. cash</p>
<p><strong></strong> b. in-kind; specify: nature_____________</p>
<p>value______________</p></td>
<td colspan="5"></td>
<td colspan="2"></td>
</tr>
<tr class="even">
<td colspan="9"><p>14. Brief Description of Services Performed or to be
Performed and Date(s) of Service, including officer(s), employee(s), or
Member(s) contacted, for payment indicated in Item 11:</p>
<p>(attach Continuation Sheet(s) SF-LLL-A, if necessary)</p></td>
<td></td>
</tr>
<tr class="odd">
<td colspan="2">15. Continuation Sheet(s) SF-LLL-A attached:</td>
<td colspan="2">Yes</td>
<td colspan="5">No</td>
<td></td>
</tr>
<tr class="even">
<td colspan="5">16. Information requested through this form is
authorized by title 31 U.S.C. section 1352. This disclosure of lobbying
activities is a material representation of fact upon which reliance was
placed by the tier above when this transaction was made or entered into.
This disclosure is required pursuant to 31 U.S.C. 1352. This information
will be reported to the Congress semi-annually and will be available for
public inspection. Any person who fails to file the required disclosure
shall be subject to a civil penalty of not less than $10,000 and not
more than $100,000 for each failure.</td>
<td colspan="2"><p>Signature:______________________________________</p>
<p>Print Name:_____________________________________</p>
<p>Title:__________________________________________</p>
<p>Telephone No.:_________________Date:____________</p></td>
<td colspan="3"></td>
</tr>
<tr class="odd">
<td colspan="5"><strong>Federal Use Only</strong></td>
<td colspan="5"><p>Authorized for Local Reproduction</p>
<p>Standard Form‑-LLL</p></td>
</tr>
</tbody>
</table>

**DISCLOSURE OF LOBBYING ACTIVITIES**

**CONTINUATION SHEET**

Approved by OMB

0348-0046

  -----------------------------------------------------------------------------------------------------------

  Reporting
  Entity:\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_\_
  Page \_\_\_\_\_ of \_\_\_\_\_

  -----------------------------------------------------------------------------------------------------------

Authorized for Local Reproduction

Standard Form‑-LLL-A

INSTRUCTIONS FOR COMPLETION OF SF-LLL, DISCLOSURE OF LOBBYING ACTIVITIES

This disclosure form shall be completed by the reporting entity, whether
subawardee of prime Federal recipient, at the initiation or receipt of a
covered Federal action, or a material change to a previous filing,
pursuant to title 31 U.S.C. section 1352. The filing of a form is
required for each payment or agreement to make payment to any lobbying
entity for influencing of attempting to influence an officer or employee
of any agency, a Member of Congress, an officer or employee of Congress,
or an employee of a Member of Congress in connection with a covered
Federal action. Use the SF-LLL-A Continuation Sheet for additional
information if the space on the form is inadequate. Complete all items
that apply for both the initial filing and material change report. Refer
to the implementing guidance published by the Office of Management and
Budget for additional information.

1\. Identify the type of covered Federal action for which lobbying
activity is and/or has been secured to influence the outcome of a
covered Federal action.

2\. Identify the status of the covered Federal action.

3\. Identify the appropriate classification of this report. If this is a
follow-up report caused by a material change to the information
previously reported, enter the year and quarter in which the change
occurred. Enter the date of the last previously submitted report by this
reporting entity for this covered Federal action.

4\. Enter the full name, address, city, state and zip code of the
reporting entity. Include Congressional District, if known. Check the
appropriate classification of the reporting entity that designates if it
is, or expects to be, a prime or subaward recipient. Identify the tier
of the subawardee, e.g., the first subawardee of the prime is the 1st
tier. Subawards include but are not limited to subcontracts, subgrants
and contract awards under grants.

5\. If the organization filing the report in item 4 checks
\"Subawardee,\" then enter the full name, address, city, state and zip
code of the prime Federal recipient. Include Congressional District, if
known.

6\. Enter the name of the Federal agency making the award or loan
commitment. Include at least one organizational level below agency name,
if known. For example, Department of Transportation, United States Coast
Guard.

7\. Enter the Federal program name or description for the covered
Federal action (item 1). If known, enter the full Catalog of Federal
Domestic Assistance (CFDA) number for grants, cooperative agreements,
loans, and loan commitments.

8\. Enter the most appropriate Federal identifying number available for
the Federal action identified in item 1 (e.g., Request for Proposal
(RFP) number, Invitation for Bid (IFB) number, grant announcement
number, the contract, grant, or loan award number, the
application/proposal control number assigned by the Federal agency).
Include prefixes, e.g., \"RFP-DE-90-001.\"

9\. For a covered Federal action where there has been an award or loan
commitment by the Federal agency, enter the Federal amount of the
award/loan commitment for the prime entity identified in item 4 or 5.

10\. (a) Enter the full name, address, city, state and zip code of the
lobbying entity engaged by the reporting entity identified in item 4 to
influence the covered Federal action.

\(b\) Enter the full names of the individual(s) performing services, and
include full address if different from 10(a); Enter Last Name, First
Name, and Middle Initial (MI).

11\. Enter the amount of compensation paid or reasonably expected to be
paid by the reporting entity (item 4) to the lobbying entity (item 10).
Indicate whether the payment has been made (actual) or will be made
(planned). Check all boxes that apply. If this is a material charge
report, enter the cumulative amount of payment made or planned to be
made.

12\. Check the appropriate box(es). Check all boxes that apply. If
payment is made through an in-kind contribution, specify the nature and
value of the in-kind payment.

13\. Check the appropriate box(es). Check all boxes that apply. If
other, specify nature.

14\. Provide a specific and detailed description of the services that
the lobbyist has performed, or will be expected to perform, and the
date(s) of any services rendered. Include all preparatory and related
activity, not just time spent in actual contact with Federal officials.
Identify the Federal official(s) or employee(s) contacted or the
officer(s), employee(s), or Member(s) of Congress that were contacted.

15\. Check whether or not a SF-LLL-A Continuation Sheet(s) is attached.

16\. The certifying official shall sign and date the form, print his/her
name, title and telephone number.

  -----------------------------------------------------------------------
  Public reporting burden for this collection of information is estimated
  to average 30 minutes per response, including time for reviewing
  instructions, searching existing data sources, gathering and
  maintaining the data needed, and completing and reviewing the
  collection of information. Send comments regarding the burden estimate
  or any other aspect of this collection of information, including
  suggestions for reducing this burden, to the Office of Management and
  Budget, Paperwork Reduction Project (0348-0046), Washington, D.C.
  20503.

  -----------------------------------------------------------------------

ATTACHMENT 6

[BREAKDOWN OF PROPOSED ESTIMATED COST (PLUS FEE) AND LABOR
HOURS]{.underline}

[INSTRUCTIONS FOR USE OF THE FORMAT]{.underline}

1\. Refer to Business Proposal Instructions, Section L of this
solicitation. The Instructions contain the requirements for proper
submission of cost/price data which must be adhered to.

2\. This sample format has been prepared as a universal guideline for
all solicitations. It may require amending to meet the specific
requirements of this solicitation. For example, this solicitation may
require the submission of cost/price data for three years listed on this
form. (See Section L, Instructions, Conditions and Notices to Offerors,
for the estimated duration of this project.) If this solicitation is
phased, identify each phase in addition to each year. Total each year,
phase, and sub-element.

3\. This format must be used to submit the breakdown of all proposed
estimated cost elements. List each cost element and sub-element for
direct costs, indirect costs and fee, if applicable. In addition,
provide detailed calculations for all items. For example:

a\. For all personnel, list the name, title, rate per hour and number of
hours proposed. If a pool of personnel is proposed, list the composition
of the pool and how the cost proposed was calculated. List the factor
used for prorating Year One and the escalation rate applied between
years.

Offeror\'s proposal should be stated in the same terms as will be used
to account for and record direct labor under a contract (i.e. percentage
of effort is used for most faculty and professional employees at
educational institutions). If percentages of effort are used, the basis
to which such percentages are applied [must]{.underline} also be
submitted by the offeror. The attached format should be revised to
accommodate direct labor proposed as a percentage of effort.

b\. For all materials, supplies, and other direct costs, list all unit
prices, etc., to detail how the calculations were made.

c\. For all indirect costs, list the rates applied and the base the rate
is applied to.

d\. For all travel, list the specifics for each trip.

e\. For any subcontract proposed, submit a separate breakdown format.

f\. Justification for the need of some cost elements may be listed as an
attachment, i.e., special equipment, above average consultant fees, etc.

4\. If the Government has provided \"uniform pricing assumptions\" for
this solicitation, the offeror must comply with and identify each item.

RFP Number:

Organization:

Date:

[BREAKDOWN OF PROPOSED ESTIMATED COST (PLUS FEE) AND LABOR
HOURS]{.underline}

[COST ELEMENT]{.underline} [Year 1 Year 2 Year 3 Year 4 Year 5 Year
6]{.underline} [Year 7]{.underline} [Total]{.underline}

[DIRECT LABOR:]{.underline}

[Hours]{.underline} [Hours]{.underline} [Hours]{.underline}
[Hours]{.underline} [Hours]{.underline} [Hours]{.underline}
[Hours]{.underline} [Hours]{.underline}

[Labor Category]{.underline} [Rate]{.underline} [Amt]{.underline}
[Amt]{.underline} [Amt]{.underline} [Amt]{.underline} [Amt]{.underline}
[Amt]{.underline} [Amt]{.underline} [Amt]{.underline}

(Title and Name\--

use additional

pages as necessary)

[DIRECT LABOR COST]{.underline}: \$ \$ \$ \$ \$ \$ \$ \$

[MATERIAL COST]{.underline}: \$ \$ \$ \$ \$ \$ \$ \$

[TRAVEL COST]{.underline}: \$ \$ \$ \$ \$ \$ \$ \$

[OTHER (Specify)]{.underline} \$ \$ \$ \$ \$ \$ \$ \$

[OTHER (Specify)]{.underline} \$ \$ \$ \$ \$ \$ \$ \$

TOTAL [DIRECT]{.underline} COST: \$ \$ \$ \$ \$ \$ \$ \$

[FRINGE BENEFIT COST]{.underline}:

(if applicable)

\% of Direct Labor Cost \$ \$ \$ \$ \$ \$ \$ \$

[INDIRECT COST]{.underline}:

\% of Total Direct Cost \$ \$ \$ \$ \$ \$ \$ \$

[TOTAL COST]{.underline}: \$ \$ \$ \$ \$ \$ \$ \$

[BASE FEE]{.underline}:

(if applicable)

\% of Total Est. Cost \$ \$ \$ \$ \$ \$ \$ \$

[AWARD FEE]{.underline}:

(if applicable)

\% of Total Est. Cost \$ \$ \$ \$ \$ \$ \$ \$

[GRAND TOTAL ESTIMATED COST]{.underline} \$ \$ \$ \$ \$ \$ \$ \$

[(PLUS FIXED FEE)]{.underline}

Performance Indicators - National Quality Measures Clearinghouse
Attachment 7

3 Pages

+---+--------------+----------------------+--------------------+-------+
| T | Indicator    | Standard             | Acceptable Quality | Su    |
| a |              |                      | Level              | rveil |
| s |              |                      |                    | lance |
| k |              |                      |                    |       |
|   |              |                      |                    | M     |
|   |              |                      |                    | ethod |
+---+--------------+----------------------+--------------------+-------+
| 1 | Recruit,     | Development and      | 100% appropriate   | Pr    |
|   | manage and   | implementation of    | recruitment by     | oject |
|   | support      | appropriate          | month 3;           | Of    |
|   | Advisory     | representation,      |                    | ficer |
|   | Panel of     | procedures and       | Advisory Panel     | (PO)  |
|   | Experts in   | processes in a       | meetings and       | monit |
|   | Quality      | timely manner;       | conference calls   | oring |
|   | Measurement, | punctual, smooth and | are proposed at    |       |
|   | Clinical     | thoughtful           | appropriate times  |       |
|   | Information  | preparations of      | and arrangements   |       |
|   | Tools, and   | logistics, meeting   | are timely;        |       |
|   | Informatics  | materials and        | Meeting            |       |
|   |              | reimbursements;      | arrangements       |       |
|   |              | timely and           | conducive to task; |       |
|   |              | comprehensive post   | Meeting materials  |       |
|   |              | meeting summaries    | relevant, high     |       |
|   |              |                      | quality, easy to   |       |
|   |              |                      | use and facilitate |       |
|   |              |                      | the accomplishment |       |
|   |              |                      | of meeting goals   |       |
+---+--------------+----------------------+--------------------+-------+
| 2 | Development  | Development of       | Develop and        | PO    |
|   | and          | finalized inclusion  | implementation of  | monit |
|   | im           | criteria for         | on-going database  | oring |
|   | plementation | measures to be       | of measure         |       |
|   | of           | included in the      | developers and     |       |
|   | appropriate  | NQMC, while adhering | organizations by 6 |       |
|   | processes    | to the two required  | mo. EDOC;          |       |
|   | and          | dimensions for       | I                  |       |
|   | procedures   | inclusion criteria.  | nclusion/exclusion |       |
|   | to obtain    | Implementation and   | criteria provided  |       |
|   | and update   | maintenance of       | to PO by 4 mo.     |       |
|   | quality      | appropriate          | EDOC; Electronic   |       |
|   | measures     | procedures to record | log of actions on  |       |
|   | contained in | measures that are    | measures accurate  |       |
|   | the NQMC     | excluded and why.    | and updated on     |       |
|   |              | Implementation and   | regular basis.     |       |
|   |              | maintenance of       |                    |       |
|   |              | methods for          |                    |       |
|   |              | gathering quality    |                    |       |
|   |              | measures and         |                    |       |
|   |              | maintaining an       |                    |       |
|   |              | on-line submission   |                    |       |
|   |              | process.             |                    |       |
+---+--------------+----------------------+--------------------+-------+
| 3 | Design,      | Development and      | Methodology of     | PO    |
|   | implement    | maintenance of a     | mechanisms for     | m     |
|   | and maintain | cost effective       | tagging and coding | onito |
|   | a system for | mechanism for        | acceptable to PO   | ring; |
|   | evaluating   | tagging and coding   | with minor         | PO    |
|   | measures for | measures.            | revisions.         | a     |
|   | inclusion    | Development,         |                    | dvice |
|   | and for      | implementation and   | Methodology to     | from  |
|   | coding and   | maintenance of       | cull old or        | exp   |
|   | validating   | system to cull old   | obsolete measures  | erts; |
|   | the coding   | or obsolete measures | from database      | R     |
|   | of measures  | from database, while | accurate.          | andom |
|   | included in  | having them          |                    | sam   |
|   | the NQMC     | available in a       | Pilot test         | pling |
|   |              | static form.         | successful.        |       |
|   |              | Development and      |                    |       |
|   |              | maintenance of a     | 300 measures added |       |
|   |              | standardized         | to database in     |       |
|   |              | structured format    | Year 1, following  |       |
|   |              | displaying measures  | years add          |       |
|   |              | by defining a key    | 250-300new or      |       |
|   |              | set of attributes    | updated measures,  |       |
|   |              | and definitions,     | annually.          |       |
|   |              | which are to be      |                    |       |
|   |              | pilot tested against | Ensure copyrighted |       |
|   |              | a heterogeneous pool | measures are added |       |
|   |              | of measures.         | with appropriate   |       |
|   |              | Development of       | permission.        |       |
|   |              | methodology to       |                    |       |
|   |              | populate the         |                    |       |
|   |              | structured summaries |                    |       |
|   |              | and obtain feedback. |                    |       |
+---+--------------+----------------------+--------------------+-------+
| 4 | Technical    | Development and      | Provide detailed   | PO    |
|   | requirements | implementation of    | mockup by 8 mo.    | AHRQ  |
|   | for creating | appropriate          | EDOC.              | monit |
|   | the National | processes and        |                    | oring |
|   | Quality      | procedures required  | Accurately meets   |       |
|   | Measures     | to test and          | requirements as    |       |
|   | C            | implement the NQMC   | set forth in SOW   |       |
|   | learinghouse | Web Site and         | (software,         |       |
|   | Web Site     | maintain its         | database, web      |       |
|   |              | presence on the      | site, hardware).   |       |
|   |              | World Wide Web via   |                    |       |
|   |              | the Internet.        | Accurately         |       |
|   |              | Development,         | maintain & be      |       |
|   |              | implementation and   | responsible for    |       |
|   |              | maintenance of all   | legacy NGC,        |       |
|   |              | mechanisms necessary | beginning FY 2003. |       |
|   |              | to support the       |                    |       |
|   |              | database backbone    | Transparent        |       |
|   |              | for the NQMC.        | migration of       |       |
|   |              | Operationalize the   | enhanced NGC to    |       |
|   |              | NQMC and umbrella    | new environment in |       |
|   |              | Web Site within 12   | 4^th^ Qtr. FY      |       |
|   |              | months of contract   | 2003.              |       |
|   |              | award                |                    |       |
|   |              |                      | Maintain accurate  |       |
|   |              |                      | hyperlinks,        |       |
|   |              |                      | revisions made     |       |
|   |              |                      | successfully and   |       |
|   |              |                      | promptly the first |       |
|   |              |                      | time.              |       |
|   |              |                      |                    |       |
|   |              |                      | Web site           |       |
|   |              |                      | operational 24X7   |       |
|   |              |                      | within 12 mo. EDOC |       |
+---+--------------+----------------------+--------------------+-------+
| 5 | Provide      | Provide technical    | Monthly tracking   | PO    |
|   | technical    | assistance to NQMC   | of sites that link | monit |
|   | assistance   | users and conduct a  | to NQMC utilizing  | oring |
|   | to NQMC      | Customer             | COTS software.     | and   |
|   | users and    | Satisfaction Survey  |                    | AHRQ  |
|   | conduct a    |                      | Contractor         | fee   |
|   | Customer     |                      | developed help     | dback |
|   | Satisfaction |                      | pages and          |       |
|   | Survey       |                      | technical          |       |
|   |              |                      | specifications     |       |
|   |              |                      | user-friendly; FAQ |       |
|   |              |                      | be updated         |       |
|   |              |                      | regularly, error   |       |
|   |              |                      | free. Respond to   |       |
|   |              |                      | e-mails within 24  |       |
|   |              |                      | hours/ weekday; 48 |       |
|   |              |                      | hours/weekend.     |       |
|   |              |                      |                    |       |
|   |              |                      | Prepare necessary  |       |
|   |              |                      | OMB clearance      |       |
|   |              |                      | package for        |       |
|   |              |                      | assessment of      |       |
|   |              |                      | customer           |       |
|   |              |                      | satisfaction with  |       |
|   |              |                      | NQMC within        |       |
|   |              |                      | timeframe that     |       |
|   |              |                      | allows for survey  |       |
|   |              |                      | by 24 mo. EDOC.    |       |
|   |              |                      | Customer Survey    |       |
|   |              |                      | feedback 90%       |       |
|   |              |                      | satisfactory.      |       |
+---+--------------+----------------------+--------------------+-------+
| 6 | Design,      | Development and      | Provide detailed   | PO    |
|   | implement    | successful           | design,            | monit |
|   | and maintain | implementation of    | implementation and | oring |
|   | an           | appropriate          | maintenance        | and   |
|   | electronic   | processes and        | workplan for       | AHRQ  |
|   | forum for    | procedures to        | electronic         | fee   |
|   | users of the | maintain an          | forum(s) ten mo.   | dback |
|   | NQMC and Web | electronic forum for | EDOC. Implement    |       |
|   | Site         | users of the NQMC    | electronic         |       |
|   |              | Web Site             | forum(s) no later  |       |
|   |              |                      | than one month     |       |
|   |              |                      | after PO           |       |
|   |              |                      | concurrence (12    |       |
|   |              |                      | mo. EDOC).         |       |
|   |              |                      | Maintain forum(s)  |       |
|   |              |                      | successfully.      |       |
+---+--------------+----------------------+--------------------+-------+

  --- -------------- ----------------------- -------------------- ------------
  7   Management     Meetings and reports    PO has no more than  PO and CO
                     (workplans, progress,   3 valid complaints   monitoring
                     systems documentation)  in 6 month period;   
                     are held/ submitted on  No more than 1       
                     time and include those  working day delay in 
                     topics as set forth in  responding to PO/CO  
                     the SOW, and as         defined time frame,  
                     requested by the PO;    no overruns; No more 
                     Contractor remains      than 1 invoice per 6 
                     within or below cost    month period         
                     estimates               requiring suspension 
                                             or disallowance due  
                                             to mistakes,         
                                             incompleteness or    
                                             other.               

  --- -------------- ----------------------- -------------------- ------------

[^1]: Kohn LT., Corrigan JM., Donaldson MS., eds. To Err is Human;
    Building a Safer Health System. Washington, D.C.: National Academy
    Press, 1999. Also available at:
    <http://books.nap.edu/books/0309068371/html/index.html>

[^2]: <http://www.ahrq.gov/clinic/epcix.htm>

[^3]: Clinical practice guidelines are systematically developed
    statements to assist practitioner and patient decisions about
    appropriate health care for specific clinical circumstances.
    \[Institute of Medicine. (1990). Clinical Practice Guidelines:
    Directions for a New Program, M.J. Field and K.N. Lohr (eds.)
    Washington, DC: National Academy Press. page 38\].

[^4]: [http://www.guideline.gov](http://www.guideline.gov/)

[^5]: Clinical performance measures estimate the extent to which a
    health care provider delivers clinical services that are appropriate
    for the patient's condition; provides the clinical services safely,
    competently, and in an appropriate time frame; and achieves the
    desired outcomes in terms of those aspects of patient health and
    satisfaction that can be affected by clinical services.

[^6]: Reliability refers to the extent to which measurement is
    reproducible with low levels of random error.

[^7]: Validity refers to a measure's ability to capture what it claims
    to measure.

[^8]: <http://www.ahrq.gov/qual/qspanovr.htm>

[^9]: Hurtado MP, Swift EK, Corrigan JM. Envisioning the National Health
    Care Quality Report. Washington, DC: National Academy Press, 2001.

[^10]: Inventory of the Department of Health and Human Services
    Performance Measures\--Phase III Data Collection and Analysis,
    Requirements Contract No. 290-96-0008, Task Order No. 5, July 23,
    1999, prepared by Center for Health Policy Studies, 10440 Little
    Patuxent Parkway, 10th Floor, Columbia, MD 21044.

[^11]: Research Triangle Institute. CONQUEST Evaluation Final Report.
    June 7, 2000. Contract No.290-96-0011, Task Order No. 5.

[^12]: The Lewin Group. Feasibility Study for Developing a Web-based,
    Redesigned and Enhanced CONQUEST and Integrating it with an Enhanced
    National Guideline Clearinghouse . November 22, 2000. Contract No.
    290-96-0009, Task Order 2000-07

[^13]: Bobby is a web-based public service offered by the Center for
    Applied Technology (CAST) that analyzes web pages for their
    accessibility to people with disabilities and their compatibility
    with various browsers.

[^14]: MedQuest is a suite of programs designed for HCFA and the general
    health care community for construction and maintenance of customized
    clinical data dictionaries that can be used to collect high quality
    clinical data. The suite of programs includes the: (1) MedQuest
    design/data entry software, (2) MedQuest Data Entry Engine, (3)
    MedQuest Manager for maintaining MedQuest databases, (4) MedQuest
    Quality for measuring data reliability, and (5) MedQuest Analyzer
    for building clinical indicator logic. MedQuest can be used to build
    a functional data entry system in less than a week, create rules for
    handling skip patterns, valid ranges, enabling and disabling
    variables, and create customized online help using the built‑in
    editor. MedQuest software, documentation, and tutorials are
    available free-of-charge.
    (Http://www.hcfa.gov/medicare/hsqb/medquest/medq1.htm)

[^15]: MeSH terms represent a controlled thesaurus and there are more
    than 18,000 main headings in the primary structure maintained by the
    National Library of Medicine to index citations in a number of
    biomedical databases produced by them. Each MeSH term represents a
    single concept. An article generally has 10-12 MeSH terms associated
    with it.

[^16]: The CONQUEST database contains 1,197 clinical performance
    measures.

[^17]: There are a variety of life cycle models, such as: waterfall,
    spiral, evolutionary, decomposition (or stepwise refinement), and
    formal transformation.

[^18]: 1\) user interface layer (presentation, 2) middleware layer
    (business rules repository; and 3) core systems layer (data)

[^19]: <http://www.cast.org/>