Because of their experience with the technical aspects of cleanups, EPA regional work assignment managers prepare detailed cost estimates for all new work on Superfund projects before the agency contracts for that work. These estimates should specify the scope of the work assignment (such as conducting a cleanup feasibility study), the required hours, and the expected cost of each major activity for that assignment. Regional contract officers then use these estimates to negotiate with contractors the best price that EPA can award for each work assignment, documenting any significant differences between the estimate and the awarded price. The agency also uses this process to negotiate any changes in the scope of a work assignment as the cleanup proceeds that may lead to discrepancies between the original awarded price and the final price of the contracted work. The work assignment manager uses the estimate and any revisions to develop the work plan and to manage the contractor’s work. When we last examined EPA’s cost estimates in April 1999, we reported that 11 (or about 31 percent) of the 35 estimates we reviewed fell substantially below the awarded price—an indication that the estimates may be of poor quality, according to the agency’s Financial Manager’s Financial Integrity Act Report. In addition, in 29 percent of the cases, the awarded price matched the contractor’s estimate—an indication that EPA may not be using the estimates to negotiate the best price for the government. In response to our report, the agency said it was awaiting the results of the Corps’ review and would then take further action to correct any cost-estimating problems. EPA is in the process of implementing two initiatives designed to address the weaknesses with its cost-estimating processes identified by the Corps and us. The initiatives are a new training course and new guidance, including a Web-based tool that provides work assignment managers with data on the actual, current costs of contracted work to help them develop more complete and accurate estimates. EPA has yet to determine how it will make the training available to all managers when needed or how it will ensure that the actual cost data in the tool remain up-to-date. In our April 1999 report, we noted that work assignment managers, who prepare the estimates, cited two barriers that kept them from developing better estimates. First, 15 of the 34 work assignment managers we interviewed (about 44 percent) cited their inexperience with estimate preparation. Although work assignment managers are chiefly responsible for managing the technical aspects of cleanup work, they had relatively little cost-estimating experience, because they tended to prepare only one or two estimates each year. They told us that more and better training were needed to compensate for this lack of experience. Second, all of the work assignment managers cited the need to access data on the actual costs of previously contracted work. They believed that better data on actual costs could serve as a baseline when determining what new contracted work should cost. Similarly, the Corps recommended in its December 1999 report that EPA (1) improve the training it provides work assignment managers, and (2) develop tools that contain better information on actual costs of assignments to help the work assignment managers generate better estimates. It also recommended that EPA (1) consolidate its various cost- estimating guidance documents, (2) encourage work assignment managers to make more of a commitment to using their estimates to control contract costs, and (3) better document the assumptions work assignment managers used to develop each estimate and any significant differences in the estimate, the awarded price, and actual costs incurred. Actual costs may differ if changes in the scope of the work occur as the work proceeds. To address the Corps’ and our concerns, EPA designed a new training course for regional work assignment managers and is currently in the process of consolidating and revising its guidance on preparing estimates. The agency offered its new half-day course targeted at preparing estimates as an optional seminar during the last two annual conferences for work assignment managers. According to EPA officials, about 50 (or 10 percent) of the agency’s 500 work assignment managers attended one of these two sessions. The course offered instruction on which cost components to include in an estimate and addressed pricing the components and the resources available to help staff with this pricing activity. These resources included an introduction to a database on historical costs for contracted work compiled by the New York regional office and tables detailing the typical amount of labor hours needed to complete various contracted cleanup activities. In addition, the course showed managers how to adequately document the assumptions and data used to generate EPA’s estimate. The work assignment managers who attended the course found it very helpful and suggested improvements—such as additional instruction on documenting estimates—that could make it even more useful, according to the course evaluations they completed. Superfund managers in charge of contracting practices have not yet decided how to provide the training to all work assignment managers who need it when they need it. In response to our questions, the managers said that they planned to continue offering the course at the annual conference. However, it is unlikely that a sufficient number of work assignment managers will obtain the training they need in a timely and useful manner, since the agency has only reached about 10 percent of the work assignment managers in the past 2 years by relying on this method. To provide more opportunities for work assignment managers to attend, Superfund managers also said they are considering offering more than one session during each conference and training key staff in each region, who could, in turn, train the work assignment managers in that region. However, Superfund managers do not have such a plan in place at this point. According to the Atlanta region’s cost estimator, who was instrumental in developing the training course, it would be more effective for EPA to offer future training in the regions rather than through the annual conferences because more useful and detailed cost information can be presented in that forum. State project managers also attend the annual conferences, and unlike EPA project managers, some of them are required to disclose to contractors all of the information they used to develop their estimates. EPA does not disclose how it prices estimates because that could diminish the independence of the estimates and result in higher costs to the government. By presenting the training in the regions exclusively to EPA project managers, EPA can include the cost information without fearing that it will be disclosed to contractors. As its second initiative, the Superfund managers formed a workgroup— composed of headquarters and regional contracting staff—to revise the agency’s guidance to regional staff on how to prepare independent cost estimates. According to the managers, the new guidance will consolidate eight separate guidance documents currently in use and will emphasize how good estimates are critical to controlling contract costs. The guidance will also take users through the steps of developing a thorough estimate, providing them with checklists detailing the scope of a work assignment, giving users instructions for adequately documenting the steps, and identifying reliable sources of cost data. EPA has contracted with the Corps to use its expertise and databases to develop the data on the actual costs of similarly contracted work and other information, such as data on the labor hours needed for cleanup activities, to be included in the guidance. EPA also plans to ask cleanup estimators from other agencies, such as the U.S. Navy, to review these data before they are made available to work assignment managers. The Superfund managers intend to publish the guidance in paper form and make it available as an interactive tool via EPA’s Web site by the end of 2001. Data on the actual costs and the other information, such as the labor hours needed, will only be useful if they are updated regularly and kept current. To date, the Superfund managers have told us that their primary focus is to develop and implement the revised guidance to ensure that the initial version contains accurate data. They have not yet determined how they will routinely keep the data current, including the data originally obtained from the Corps, although they have discussed obtaining the Corps’ assistance on these issues. EPA plans to include a mechanism in the Web- based tool that allows work assignment managers to provide feedback on the tool, which they hope will help them keep the data current. However, because this feedback is voluntary, it does not provide a comprehensive method for updating the actual cost data. EPA plans to continue its current method of evaluating the quality and usefulness of estimates by relying primarily on its on-site reviews of estimates in each region once every 3 years. Superfund managers believe the reviews have been effective; furthermore, they do not believe they have the resources needed to visit the regions more frequently. EPA could supplement its regional reviews fairly easily by routinely analyzing information on estimate quality that is now becoming available—such as regional data comparing estimates to awarded prices—to look for systemic problems that need addressing. According to contracting officials from EPA and the Corps, additional monitoring would help EPA better ascertain the initiatives’ effectiveness in the regions. Currently, Superfund managers and officials from EPA’s Office of Acquisition Management—the office responsible for the agency’s overall contracting practices—review all Superfund contracting activities in the regions by visiting each of the 10 regions approximately once every 3 years to conduct reviews. Superfund managers assured us that, in response to the concerns we raised in our 1999 report regarding estimate quality, the reviews conducted in the past 2 years have included an examination of the quality of a region’s estimates. The three most recent reviews, beginning with the review of the Seattle region in June 1999, contain assessments of estimates and recommendations for improvement. In addition, Superfund managers told us that they use the periodic meetings and monthly teleconferences of the Senior Regional Management Acquisition Council as a forum to exchange information on issues or problems affecting estimates. The Council includes representatives from EPA’s Office of Acquisition Management and the Superfund program in headquarters, and regional work assignment managers. Furthermore, the managers told us that the discussion of estimates is a regular topic on the agenda for the Council’s semiannual conferences. Superfund managers plan to continue to rely on the regional reviews, supplemented by the Council’s and other discussions, to determine whether the quality and usefulness of contract estimates have improved as a result of the new guidance and training.