# FUTURE YEAR EMISSION INVENTORY DEVELOPMENT TO SUPPORT ATMOSPHERIC MODELING OF FINE PARTICULATE MATTER AND OZONE IN THE SOUTHEASTERN US



# DRAFT QUALITY ASSURANCE PROJECT PLAN

Effective Date: March 2006

## ASSOCIATION FOR SOUTHEASTERN INTEGRATED PLANNING

ASIP

FUTURE YEAR EMISSION INVENTORY DEVELOPMENT TO SUPPORT ATMOSPHERIC MODELING OF FINE

PARTICULATE MATTER AND OZONE IN THE SOUTHEASTERN US

QUALITY ASSURANCE PROJECT PLAN

Effective Date: March 2006

APPROVED BY

(ASIP Technical Director) (ASIP Emission Inventory Tech. Advisor)

(MACTEC Program Manager (MACTEC Quality Assurance Coordinator)

(MACTEC Task Manager) (MACTEC Task Manager)

### Table of Contents

FUTURE YEAR EMISSION INVENT ORY DEVELOPMENT TO SUPPORT ATMOSPHERIC MODELING OF FINE PARTICULATE MATTER AND OZONE IN THE SOUTHEASTERN US QA PROJECT PLAN

1.0 PROJECT MANAGEMENT ......................................................................................... 1

1.1 Problem Definition/Background................................................................................. 1 1.2 Project/Task Description ............................................................................................. 2 1.3 Project Organization.................................................................................................... 3 1.4 Quality Objectives and Criteria.................................................................................. 6 1.5 Special Training/Certification..................................................................................... 6 1.6 Documents and Records .............................................................................................. 6

2.0 DATA ACQUISITION ................................................................................................... 1

2.1 Point Source Procedures.............................................................................................. 1 2.2 Area Source Procedures .............................................................................................. 1

3.0 ASSESSMENT AND OVERSIGHT.............................................................................. 1

3.1 Assessments and Response Actions ............................................................................ 1 3.2 Reports to Management............................................................................................... 1

4.0 DATA VALIDATION AND USABILITY .................................................................... 1

4.1 Accuracy Assessment ................................................................................................... 1 4.2 Completeness Assessment............................................................................................ 1 4.3 Comparability Assessment .......................................................................................... 1 4.4 Representativeness Assessment................................................................................... 1

TABLES AND FIGURES Page

Figure 1. Project Organization Chart.................................................. 1-5 Figure 2. Audit Check Form ............................................................... 3-2

Table 1. Data Quality Objectives, Procedures, and Indicators ........... 1-8

Distribution List: Pat Brewer, ASIP (Technical Director) Greg Stella, Alpine Geophysics, Inc. (A SIP Emission Inventory Technical Advisor) Douglas Toothman, MACTEC (Quality Assurance Coordinator) William Barnard, MACTEC (Program Manager, Area and Nonroad Source Task Leader) Edward Sabo, MACTEC (Point Source Task Leader) Dan Meszler, MESZLER Engineering Servi ces, Inc. (Mobile Source Task Leader)Project: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 1 of 10

1.0 PROJECT MANAGEMENT

1.1 Problem Definition/Background

The Southeastern States Air Re source Managers (SESARM) ha s been designated by the United States Environmental Protection Agency (EPA) as the entity responsible for coordinating and implementing regional planning for the eight SE SARM states (Alabama, Florida, Kentucky, Georgia, Mississippi, North Caro lina, South Carolina and Tenn essee) plus Virginia, West Virginia, and Tribes. Through a memorandum of understanding, these parties are collaborating in the organization Visibility Improvement St ate and Tribal Association of the Southeast (VISTAS) on the technical analysis and planni ng activities that suppor t state implementation plans for regional haze. The participating agencies have concluded that a collaborative regional process is also the most efficient approach fo r the states to develop the technical analyses supporting attainment demonstrations for the fi ne particulate matter (PM2.5) and eight-hour ozone standards. Along with the local air regulatory agencies for Jefferson County, AL, Jefferson County, KY, Mecklenberg County, NC, Forsythe County, NC, Knox County, TN, and Shelby County, TN, these agencies have become si gnatory parties to the collaborative effort called the Association for Southeastern Integrated Planning (ASIP). SESARM will coordinate among participating agencies and oversee the pe rformance of the ASIP inventory and modeling tasks in parallel with the VISTAS regional haze project tasks. Emissions inventory efforts include the development of emissi ons inventories and forecasts to be utilized in ASIP modeling efforts. At least one area in seven stat es (Alabama, Georgia, North Carolina, Kentucky, Tennessee, Virginia, and West Virginia) has been designated as nonattainment for the PM 2.5 . In addition, South Carolina has one three-county area that was designated as unclassifiable. The PM 2.5 compliance date is April 2010 unless a state demons trates that more time is necessary in which case up to five additional years may be granted. State implementation plans (SIPs) will be due in April 2008 and the modeling year for the PM 2.5 attainment demonstration will be 2009.

The States of Alabama, Georgia, Kentucky, North Carolina, South Carolina, Tennessee, Virginia, and West Virginia have one or mo re nonattainment areas for the eight hour ozone standard. Basic nonattainment areas are required to attain the 8- hour ozone standard by June 15, 2009, while moderate nonattainment areas are requ ired to attain by June 15, 2010. This will require states with basic 8-hour ozone nonattainment areas to demonstrate attainment for the year 2008 and moderate areas will require 2009 as the modeling year

The objective of this project is to compile futu re year emission inve ntories to support fine particulate matter and ozone modeling efforts in th e ASIP region for all sour ce categories. This project has the following ove rall design specifications:

• Pollutant Coverage - primary and precursor annual and seasonal emissions necessary to accurately model fine particulate matter and ozone, including primary PM2.5 andProject: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 2 of 10

PM10, ammonia (NH3), oxides of sulfur (S Ox), volatile organic compounds (VOCs), oxides of nitrogen (NOx) a nd carbon monoxide (CO)

• Source Coverage – all source ca tegories except biogenic.

• Geographic Areas – the ASIP states (A labama, Florida, Georgia, Kentucky, Mississippi, North Carolina, South Carolina , Tennessee, Virginia, West Virginia)

The inventories created under this contract will be used in creating future year modeling inventories (modeled under other ASIP work tasks) to support chemical transport modeling of fine particulate matter and ozone in the southeastern U.S. and to evaluate potential control strategies for the National Ambient Air Qual ity Standards (NAAQS) fo r fine particulate and ozone. Two future year inventories will be prep ared along with evaluations of various controls for those inventories. In addition, updates of the 2002 base year inventory will be performed under this contract as necessary to develop the projection years. The purpose of this Quality Assurance Project Plan (QAPP) is to outline and guide the process for quality assuring the inventory development to ensure the development of complete, accurate, and consistent emission inventorie s. The QAPP is consistent w ith the recommendations in the EPA quality assurance requirements 1 and the Emission Inventory Improvement Program’s QA guidance 2 . The QAPP includes tasks associated w ith obtaining State data, merging and augmenting State submittals with available EP A databases, improving the activity data and emission factors for important source categorie s, obtaining and developi ng growth and control factors, obtaining State and st akeholder review of the emi ssion inventory, and providing documentation of the maintenance (revisions, updates, corrections) of the inventory.

1.2 Project/Task Description

EPA 3 has specified that calendar year 2002 be used as the base year for emission inventories to support planning efforts under the 8-hour ozone, PM 2.5, and Regional Haze programs. ASIP has planned an iterative process to use and enhance the 2002 base i nventory prepared by MATEC for the Visibility Improvement State and Tribal Association of the S outheast (VISTAS) as part of regional haze planning, that inco rporates improved information as it becomes available. In addition, work on the PM2.5 and ozone NAAQS calls fo r continued measures of progress. As a consequence, emissions inventories for 2008 and 2009 will be required to assess such progress.

• A revised 2009 Base G future year inve ntory based off of the 2009 projections developed previously for VISTAS (Base G due May 2006). This inventory will be developed using the final version of th e 2002 VISTAS base year. The revised 2009 inventory is designed to suppor t modeling runs for fine par ticulate and ozone. It will be created using readily available growth and control information from the Clean Air Interstate Rule (CAIR), the Heavy Duty Diesel Rule (HDD Rule), the DOE’s Annual Energy Outlook 2006, and other EPA rules. In addition, control programs under these rules as well as State Implementation Plans (SIP) will be incorporated. The growth and control factors will be thos e developed for the VISTAS 2009 regional haze and PM2.5 inventory development effort augmented by updated information from other regional inventory developmen t work and modifications based on StateProject: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 3 of 10

comments. Typical year emissions for elec tric generating units (EGUs), wildfire and prescribed burning sources will be revised as necessary to incorporate new data. Control programs that are “on-the-books” a nd “on-the-way” will be incorporated into the estimates. Three control strategy inventories will also be developed for 2009.

• A 2008 Inventory Base G (available Spring/ Summer 2006). This inventory will be created using information developed for th e 2009 inventory with revised growth and control factors to account for a 2008 projec tion rather than a 2009 projection. The inventory will still include “on-the-books” and “on-the-wa y” control programs as well as any SIP or other State specific controls. This QAPP focuses on the tasks associated with developing these inventories.

Projection Inventory Activities. The effort includes the following area source activities:

1. Assemble data needed to update the 2009 VISTAS inventory to account for Base G changes to the base year 2002 inventory and a ny changes to growth or control factors for 2009 based on State/workgroup review.

2. Prepare the 2009 inventory using data received as part of step 1.

3. Assemble data needed to develop the 2008 AS IP inventory. This includes development of growth and control factors for 200 8 which are not currently available.

4. Prepare the 2008 ASIP projection inventor y using data deve loped in step 3.

5. Recommend methods for cont rol strategies for 2009.

6. Prepare 2009 control strategy inventories.

7. Revise the 2002 “typical year” inventory for electric generating units (EGUs) with any updated data.

8. Revise the “typical year” inventory for wild and prescribed fires with any updated data.

Other Activities. In addition to the a bove tasks related to projecting emissions, a report detailing the methods used to develo p the projections will be prepared. 1.3 Project Organization

Figure 1 and Table 1 identify the individuals and or ganizations participating in the project. Their specific roles and res ponsibilities include:

• Ms. Pat Brewer, Technical Coordinator, will plan, conduct, and supervise technical and managerial aspects of the project. She will facilitate communications among State/local agencies, MACTEC, and the SESARM Executive Director.

• Mr. Greg Stella, Emission Inventory Technica l Advisor, will work with the Technical Coordinator to define the emission inve ntory development activities needed to support PM2.5 and ozone modeling and planning activities.Project: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 4 of 10

• State/local Agency Coordinators will compile and submit data to MACTEC, participate in QA/QC reviews, and help revise, update, and correct the inventory.

• William Barnard, MACTEC Program Manager, will direct and monitor technical and financial performance throughout the projec t and will serve as a senior primary contact with ASIP on contract and project management issues. Mr. Barnard will also direct aspects of the projec tion inventory development re lated to area and mobile sources. He will plan and conduct the technical aspects of the development of the area and mobile source inventories, supervise daily activities, identify effective QC procedures and make recommenda tions on needed QC procedures.

• Edward Sabo, MACTEC Point Source Task Le ader, will plan and manage all point source activities. He will plan and conduc t the technical aspects of the development of the point source inventory, supervise daily activities, identify effective QC procedures and make recommendati ons on needed QC procedures.

• Dan Meszler, MACTEC Mobile Source Task Leader, will plan and manage all mobile source activities. He will plan and conduct the technical aspects of the development of input files for the MO BILE and NONROAD mode ls and for nonroad sources not covered by the NONR OAD model. He will help identify effective QC procedures and make recommendati ons on needed QC procedures.

• Douglas Toothman, MACTEC QA Coordinato r, will help ensure that adequate QA/QC procedures are incorporated into th e inventory development process. He will work independent of the inventory developm ent Task Leaders to assist in the conduct of project QA/QC assessments.Project: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 5 of 10

ASIP Technical Coordinator Pat Brewer ASIP Emission Inventory Technical Advisor Greg Stella

MACTEC Program Manager

William Barnard MACTEC QA Coordinator Doug Toothman

MACTEC Point Source Manager Edward Sabo MACTEC Area/Mobile Source Manager William Barnard ASIP State/local Coordinators

MACTEC Technical Support Engineers, Scientists, Programmers, Graphic Artists, Editors

FIGURE 1 – PROJECT ORGANIZATION CHARTProject: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 6 of 10

1.4 Quality Objectives and Criteria

The goal of the inventory process is to provide the best possibl e inventory under given resource constraints. Data Quality Ob jectives (DQO) are statements about the level of acceptable uncertainty or error. Their purpose is to ensure that the final data will be sufficient for the intended use of the inventory. A well-develop ed and implemented quality assurance program fosters confidence in the invent ory and any resulting regulatory program. It also gives the end user important information about the limitations of the emission estimates in order to avoid misuse of data.

Table 1 summarizes the Data Quality Objectives for the ASIP inventories that will be compiled for this contract. The first column of Table 1 defines four data quality objectives: accuracy, completeness, comparability and representativ eness. The second column identifies the procedures that will be used to achieve each objec tive. The third column identifies Data Quality Indicators (DQI), which are qualitative and qua ntitative descriptors used in interpreting the degree of acceptability or utility of data.

1.5 Special Training/Certification

All staff performing data review and analysis ar e air quality professiona ls and have sufficient education/experience to perfor m emission estimation calculations and work with emission inventory databases. Most st aff have received specific em ission inventory training through conferences, workshops, self-study programs, and on-the-job work experiences. There are no specifically mandated training requirements for work performed on this project.

1.6 Documents and Records

QAPP Control. Any changes to this QAPP will be ini tiated either by the Program Manager, the Task Leaders, or the QA coordinator. Each change will be given a revision number and date in the document control block in the upper corner of th e affected pages. It will be the responsibility of the initiating person to dist ribute copies of the changed pa ges to all the persons on the Distribution List and to the appr opriate project team members.

Data Collection Records. Clear documentation of the data collected from the State/local agencies, EPA, and other agencies is integral to the quality analysis re view. Records will be maintained containing a description of the data received, the name of the person and agency submitting the data, the date of the submission, a nd other relevant information about the data submission. The following types of data will be collected during this project:

• EPA’s 1999 National Emission Inve ntory (Version 2 Final)

• State CERR submittals

• State/local agency data submittals in NIF 3.0 format

• Growth factors assembled by EPAProject: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 7 of 10

• EPA’s Final Summary Emission Reports for 2002 with CEM information for electric utilities regulated by the Acid Rain Program

• EPA’s Toxic Release Inventory for 1999/2000 with ammonia emissions data

• Point source surveys for target facilities to obtain missing information

• State/local agency submittals of updated activity data relate d to fugitive dust sources, primarily paved and unpaved roads, livest ock activities and agricultural activity (tilling).

• State agency submittals of information necessary to calculate fire emissions and geographically locate where th ese fires occurred in 2002.

• State agency submittals of updated activity data for animal operations for use with the Carnegie Mellon University ammonia model.

• State/local agency revisions, updates, co rrections in response to various QA/QC checks. These may be provided in a variet y of formats depending on the nature of the
response.

• Department of Energy fuel efficiency data

• EGAS growth factors

• VMT dataProject: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 8 of 10

TABLE 1 DATA QUALITY OBJECTIVES, PR OCEDURES, AND INDICATORS

Data Quality Objective Pro cedures Example Indicators Accuracy - reduce uncertainty in emission estimates where possible, validate that data elements needed for modeling are within accepted parameters, and verify that emission estimates agree with accepted reference values. 1. Identify weaknesses in existing inventories, identify new methods/data to reduce uncertainty, and obtain new activity/emission factor data where available.2. Use EPA’s NIF QA tool and adhoc reports to perform computerized checks of valid codes/data ranges and to identify outliers. 3. Conduct senior technical review

of pollutant totals by facility, source category, state, and region. 4. Compare to other published data. 1. Qualitative assessment of the inventory’s strengths and weaknesses. 2. 100% of stack data and temporal

factors in valid ranges for > 100 tpy sources. 3. 100% of sources have valid

geographic coordinates. 4. 100% correction of significant

outliers. 5. Agreement of ASIP emissions and

EPA CEM data and EPA TRI data. 6. Compare projection emissions to

base year emissions to ensure that values are within expected ranges. Completeness – include all major point sources, include emission estimates for PM2.5 and ammonia, verify that all important areas source categories are in cluded for all counties and all mobile source categories are accounted for. 1. Compare ASIP utility data to EPA CEM data. 2. Compare ASIP point source

ammonia data to EPA TRI data. 3. State/local agencies compare

facility list to their Title V permit lists. 4. Compare small point source

emissions to area source emissions. 5. Compare PM10 and PM2.5

emissions. 6. Plot area source spatial

distributions by source category and county. 1. 100% of all utilities accounted for in database. 2. 100% of large ammonia sources

in TRI accounted for in database. 3. 100% of Title V sources

accounted for in database 4. Small point sources included as

either small point sources or as

area sources. 5. PM2.5 and ammonia emissions

included in inventory 6. Area source emissions for

important source categories for all counties in region. 7. All mobile sources accounted for. 8. Explanation of any missing data

or sources. Comparability – verify that emission estimates are similar to other peer-reviewed inventories and that any major deviations are explained. 1. Compare emission totals by source category, pollutant, geographic region, and year with previous emission inventories. 1. Explanation for large discrepancies in emissions

Representativeness – use emission estimation methods that reflect local conditions and the time period of interest. 1. Identify where national defaults used instead of local activity data. 2. Identify where emissions were

grown for base year 2002 data were not available. 3. Identify growth factors for

projection years. 1. Explanation for use of national defaults. 2. Determination of representative

values for “typical years” for some sources for projections (i.e., fires, utility emissions).Project: ASIP Projection Inventories Section: 1 Revision No. 0 Revision Date: 3/17/06 Page 9 of 10

Data Handling Records. Another key element of the QA program is maintaining written documentation of calculations, assumptions, and all other activities associated with incorporating the State/local agency submittals and other data w ith the projection and base year inventories. Nearly all data being developed and/or comp iled will use computerized databases or other electronic files. For many of these databases, we will use blank fields in the database tables to keep track of the source of the data. We will al so maintain a log of activities to document how the data described above were incorporated to cr eate the ASIP inventories. The log will include complete descriptions of the data sources used, the procedures used to incorporate the data, the approach used to determine the completeness, an d any contacts made with data submitters to resolve questions. A file will be maintained to en sure that the data handling records are retained and easily located.

QA/QC Records. We will perform a variety of quality control reviews of the inventory. For example, we will check stack parameters, source classification codes, and geographic coordinates for point sources that emit at least 100 tons of a ny pollutant per year. Reports containing the results of these checks will be transmitted to the State/local agencies for investigation and correction. Documentation of each finding will include a description of the action or data reviewed that led to the quali ty concern and will provide recommendations for corrective actions.

Corrective Action Records. Records of corrective and follo w-up actions identified during the quality review process will be maintained. Both the corrective action identified and the results of the actions taken in response will be documente d for inclusion in the final report. If no corrective action can be made, we will document the implications on the overall quality of the inventory.

Data Reporting Package. The final data reporting package will contain four elements:

• An emission summary report that describes the emissions inventory by pollutant and source category, summarizes the methods a nd data used to compile the inventory, assesses the limitations and appropriate uses of the inventory data , and contains any other information pertinen t to the inventory;

• A quality assurance summary report that describes the quality assurance efforts completed, summarizes the corrective acti ons taken, and provides suggestions for further inventory improvement based on the re sults of the quality assurance process;

• Electronic data files containing the ASIP inventories in NIF 3.0 format; and

• Electronic and paper files containing all original data submittals and all backup documentation will be stored on file at MACTEC for a period of no less than three
years.Project: ASIP 2002 Inventory Section: 2 Revision No. 0 Revision Date: 3/17/2006 Page 1 of 4

2.0 DATA ACQUISITION

The projection year ASIP inventories will rely primarily on air emission information from existing databases. The data collection, handling, and management process is described below, along with the associated quality control proced ures and methods. The QC system is designed
to:

• Provide routine and consistent checks and documentation points in the inventory development process to verify data in tegrity, correctness, and completeness;

• Identify and reduce errors and omissions;

• Maximize consistency within the inventory preparation and documentation process;

• Facilitate internal and external inventory review processes. The data acquisition process should be viewed as an iterative process. As decisions are made, new questions will surface that require solu tions, until the iterations are complete.

2.1 Projection Year Inventory Procedures

For the projection inventories, the following procedures will be used to compile and quality assure the inventory:

1. Use the final version (Base G) of the 2002 VISTAS Base/Typical Ye ar inventory as a starting point.

a. Back calculate uncontrolled emissions for 2002 Base/Typical Year inventory to use as starting point for sources that w ill be grown for the projection inventory. (unclear)

2. Prepare/Obtain Growth and Control files

a. Obtain growth factor files from EGAS fo r use with categories that will be grown with EGAS growth factors; incorpor ate Annual Energy Outlook 2006 information into EGAS to replace the AEO 2004 data currently embedded in EGAS. b. Obtain control factors for “ on-the-book” and “on-the-way” controls as well as any controls for control strategy evaluations. Controls will be obtained from recent EPA rulemakings, proposed rules (e.g., Clean Air Interstate Rule [CAIR]), and State SIPs. For EGUs, control inform ation will be obtained from VISTASsponsored IPM runs, supplemented with st ate-supplied adjustments as to where future controls will be installed.

c. Determine/obtain growth factors for non- EGAS sources (e.g., agricultural crops, fertilizers, etc.). Growth factors for th ese sources will be calculated from existing projection inventories prepared by EPA (e.g., EPA Ammonia Inve ntory). Growth factors will be calculated us ing linear interpolation of projected emissions if the actual year is not available.

3. Project sources using growth and control factorsProject: ASIP 2002 Inventory Section: 2 Revision No. 0 Revision Date: 3/17/2006 Page 2 of 4

a. For sources to be grown using EGAS grow th factors, apply growth and control factors. b. For sources not using EGAS growth fact ors, apply non-EGAS growth factors.

c. Identify and resolve any errors/discrep ancies from the use of EGAS growth factors or other growth factor data d. Track comments/concerns received and corrective actions taken

4. Determine emissions for sources requir ing “typical” year emission updates.

a. These sources include EGUs and fires b. For fires make any modifications needed including incorpor ating the long-term effects of prescribed burning programs. Update and revise the typical emissions based on changes submitted by State air and forestry personnel and to include future year projections of prescribed burning.

c. Update the typical year emission da ta from EGU sources based on State comments and any revised CEM or IPM data.

5. Develop mobile source emission inventories

a. Prepare projected VMT for review by States/stakeholders for onroad mobile

sources.
b. Prepare SMOKE ready MOBILE input files for review by States/stakeholders. MOBILE input files will contain required control programs either “on-the-books” or “on-the-way”. (my understanding is this subtask is not MACTEC’s responsibility)

c. Prepare NONROAD model input files fo r review by States/stakeholders. NONROAD input files will contain requi red control programs either “on-thebooks” or “on-the-way”.

d. Run the NONROAD 2005 model, develop emission summaries and provide to States/Stakeholders for review/comment.

e. Develop growth factors and projected em issions for nonroad sources not in the NONROAD model. Growth factors will be based on existing estimates from EPA rulemaking projections (e.g., Heavy Duty Diesel and other rules). Provide growth factors for review by States/Stakeholders.

f. Prepare non-NONROAD model emi ssion estimates. Provide for States/Stakeholder review/comment.

6. Conduct QA/QC to identify e rrors and inconsistencies

a. Prepare ad-hoc reports to identify ga ps and logical inconsistencies. b. Ask States/local agencies to provide fee dback on large scale inconsistencies and on missing sources.

c. Update database with Stat e/local supplied revisions. d. Track comments/concerns received and corrective actions taken

7. Provide inventory for review by stakeholdersProject: ASIP 2002 Inventory Section: 2 Revision No. 0 Revision Date: 3/17/2006 Page 3 of 4

a. Prepare an emission summary report that describes the emissions inventory by pollutant and source category, summarizes the methods and data used to compile the inventory, assesses the limitations and a ppropriate uses of the inventory data, and contains any other informa tion pertinent to the inventory b. Prepare a quality assurance summary repor t that describes the quality assurance efforts completed, summarizes the co rrective actions taken, and provides suggestions for further inventory improveme nt based on the resu lts of the quality
assurance process

c. Provide electronic data files containing the ASIP inventories in NIF 3.0 format d. Track comments/concerns received and corrective actions taken

8. Incorporate feedback from stakeholders a nd prepare final report s and electronic filesProject: ASIP 2002 Inventory Section: 3 Revision No. 0 Revision Date: 3/17/2006 Page 1 of 3

3.0 ASSESSMENT AND OVERSIGHT

The subsections in this group address the activit ies for assessing the e ffectiveness of project implementation and associated QA and QC activities. The purpose of the assessment is to ensure that the QA Project Plan is implemented as pres cribed. The assessment consists of external activities that include a planned system of revi ew and audit procedures by personnel not actively involved in the inventory development proces s. The key concept of this component is independent objective review by a third party to access the effectiveness of the internal Quality Control program and the quality of the inventory, and to reduce or eliminate any inherent bias in the inventory process.

3.1 Assessments and Response Actions

The MACTEC Quality Assurance Coordinator will conduct techni cal systems audits throughout the project. Audits are managerial tools used to evaluate how effectivel y the emission inventory team complies with predetermined specificati ons for developing an accurate and complete inventory. The MACTEC QAC will conduct audits at the initi ation of each project to review the Work Plan and QAPP, at the 50% complete and 75% complete levels to review the technical aspects of each project and at the 95% completio n level to review the data submittal package. This provides assessment of the project during the planning stage, the data collection stage, the emissions calculations stage, a nd the report preparation stage. An example audit checklist for point sources is presented in Figure 2.

3.2 Reports to Management

Audit reports will be distributed within two weeks of the conduc t of each audit to the persons interviewed and the MACTEC Task Leaders. A summary of the types of quality concerns found will be periodically forwarded to the MACTEC Program Manager to keep him informed of the quality issues found and actions being taken to reso lve them. Audit reports will be retained in a file and used to conduct subseque nt audits and plan follow-up activ ities. When an audit team finds items that require immediate action, they will inform the MACTEC Program Manager of the necessary corrective actions.Project: ASIP 2002 Inventory Section: 3 Revision No. 0 Revision Date: 3/17/2006 Page 2 of 3

AUDIT CHECKLIST

Auditor:

______________________________________ Date:

_________________________________________ Data/Procedure Reviewed:

_____________________________________________________________

___________________________________________________________________________________ Project Personnel Involved in Work:

_____________________________________________________

____________________________________________________________________________________ Instructions: Select a facility or source category with high emissions and evaluate the quality of the data and adequacy of the data handling procedures. R ecord the findings and recommendations for corrective actions, if any, on this checklist and comment sheet. If recommendations for corrective actions are made, discuss them with the Project Manager immediately following the audit. Conduct follow-up activities to determine if the actions taken in response to th e recommendations appropriately resolved the quality issues identified.

I. DATA

A. Identify the source category evaluated: _____________________________________________ B. Describe the data included in the master file for the facility or source category.

_____________________________________________________________________________

_____________________________________________________________________________ C. Are the data documented in a manner that will not have the potential to be misinterpreted? Y/N Were the instructions for docu menting the data followed? ................................................. Y/N D. Are there missing data fields? ............................................................................................ ........ Y/N What procedures are taken by the Task Leaders to ascertain missing?

___________________________________________________________________________

___________________________________________________________________________ At what point in th e inventory process are requests for missing data made?

___________________________________________________________________________

___________________________________________________________________________ How is the receipt of the missing data handled?

___________________________________________________________________________

___________________________________________________________________________ Is the procedure followed to ascertain mi ssing data efficient and adequate? ............................ Y/N E. How do emissions compare to other inventories? 1999 NEI Version 2 Final ________________________________________________________ 2000 TRI _____________________________________________________________________ 2002 ETS/CEM ___________

__________________ ____________________ _______________ Are differences in emissions unders tandable and explainable? ................................................. Y/N If any of the values are incorrect, explain how the emissions data were corrected.

___________________________________________________________________________ Figure 2 Audit Check FormProject: ASIP 2002 Inventory Section: 3 Revision No. 0 Revision Date: 3/17/2006 Page 3 of 3

II. EMISSIONS DATABASE

A. Who provided the data for incorpora tion into the database?

__________________________

_______________________________________________________________________ B. Was there evidence that the data were re viewed for accuracy and completeness prior to incorporation in the database? ............................................................................................ ... Y/N C. Were data logs maintained to descr ibe how the data was incorporated? ................................... Y/N D. Ask the data incorporation personnel to explain the QC procedures followed to ensure data quality. Do they agree with th e procedures described in the QAPP? ................................ Y/N E. Does the computer system appear to be adequate for its intended use? (Ask the data processing personnel about the problems they have experienced with the system.) .......... Y/N F. Is the data entry progressing as expected and are the procedures followed adequate to ensure data quality? ...................................................................................................... ......... Y/N

III. RECOMMENDATIONS FOR CORRECTIVE ACTIONS

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

IV. COMMENTS

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

_____________________________________________________________________________________

V. SIGNATURES

______________________________ ____________________________ (QA Auditor) (QA Coordinator)

______________________________ ____________________________ (Program Manager) (Task Manager)

______________________________ ____________________________ (Project Participant) (Project Participant)

Figure 2 Audit Check Form (Concluded)Project: ASIP 2002 Inventory Section: 4 Revision No. 0 Revision Date: 3/17/2006 Page 1 of 1

4.0 DATA VALIDATION AND USABILITY

Section 4 addresses the QA activitie s that occur after the data coll ection phase of the project is completed. Implementation of these subsections determines whether or not the data conform to the specified criteria, thus satisfying the project objectives.

4.1 Accuracy Assessment

A qualitative discussion of accuracy will include an assessment of the extent to which the initially identified weaknesses in the inventory ha ve been remedied through the use of improved activity data, emission factors, or other source s of information. Remaining weaknesses will be assessed.

The accuracy assessment will include a summary of whether any data identified as outside of its valid range remained outside of the valid range in the final inventory. If any data remained outside of its valid range, an explanation will be given. The qualitative discussion will also include a summary of errors or discrepa ncies identified in the QA/QC process.

A final semi-quantitative discussion of accuracy will consist of pollutant summaries for individual facilities, i ndustry types, source cate gories, and statewide totals. The ASIP inventory will be compared to other peer-reviewed inventories, and where major discrepancies exist, we will provide an assessment of the reasons for the differences in emission estimates.

4.2 Completeness Assessment

A statement will be prepared assessing whethe r all required facilities, source categories, pollutants, and data elements were included in the inventory. If a ny facilities or source categories were not included, an explanation of the omission will be provided. If any individual data elements were not provided, we will disc uss the elements, frequency of omissions, and overall impact on the quality of the inventory.

4.3 Comparability Assessment

Several summations of emissions data will be made to address comparability. Overall percentage differences for indivi dual facilities (current year to prior year ), industry types, processes, and statewide inventory will be calculated. Explanations of any large differences will be made.

4.4 Representativeness Assessment

A statement will be prepared describing where national defaults have been used instead of local activity data.Project: ASIP 2002 Inventory Section: 5 Revision No. 0 Revision Date: 3/17/2006 Page 1 of 1

5.0 REFERENCES

1. U.S. Environmental Protection Agency. March 2001. EPA Requirements for Quality Assurance Project Plans (EPA/240/B-01/003). http://www.epa.gov/quality/qs-docs/r5- final.pdf

2. Emission Inventory Improvement Program (EIIP) Document Series - Volume VI Quality Assurance Procedures and DARS Software. EPA | TTN CHIEF | EIIP | Technical Reports | Volume VI Quality Assurance Procedures

3. U.S. Environmental Protection Agency. November 18, 2002. 2002 Base Year Emission Inventory SIP Planning: 8-hr Ozone, PM2.5 and Regional Haze Programs. http://www.4cleanair.org/memb ers/committee/criteria/EPA200211181.pdf