You are given two reports by the government agency.  

Report 1:
The RAD program was authorized by Congress and signed into law by the President in November 2011 under the Consolidated and Further Continuing Appropriations Act, 2012 with amendments in 2014, 2015, 2016, and 2017. The RAD program consists of two components. The first component of the RAD program—and the focus of our review— provides PHAs the opportunity to convert units subsidized under HUD’s public housing program and owned by the PHAs to properties with long- term (typically, 15–20 years) project-based voucher (PBV) or project- based rental assistance (PBRA) contracts. These are two forms of Section 8 rental assistance that tie the assistance to the unit to provide subsidized housing to low-income residents. In a RAD conversion, PHA- owned public housing properties can be owned by the PHA, transferred to new public or nonprofit owners, or transferred to private, for-profit owners when necessary to access LIHTC financing, if the PHA preserves its interest in the property in a HUD-approved manner. The second component of RAD converts privately owned properties with expiring subsidies under old rental assistance programs to PBV or PBRA in order to preserve affordability and encourage property rehabilitation. The goals of the RAD program include preserving the affordability of federally assisted rental properties and improving their physical and financial condition. Specifically, postconversion owners (PHAs, nonprofits, or for-profit entities) can leverage the subsidy payments under the newly converted contracts to raise capital through private debt and equity investments, or conventional private debt, to make improvements. The RAD program provides added flexibility for PHAs to access private and public funding sources to supplement public housing funding. These financing sources may include debt financing through public or private lenders; mortgage financing insured by FHA; PHA operating reserves; replacement housing factor funds; seller or take-back financing; deferred developer fees; equity investment generated by the availability of 4 percent and 9 percent LIHTC; or other private or philanthropic sources. PHAs also may pursue various options for their conversions, which often depend on property needs and available financing, including property rehabilitation or new construction. Additionally, PHAs may undertake conversion involving no property rehabilitation or new construction to meet certain financial goals or for future rehabilitation or new construction, as long as the PHA can demonstrate to HUD that the property does not need immediate rehabilitation and can be physically and financially maintained for the term of the Section 8 Housing Assistance Payment contract (HAP contract). The RAD authorizing legislation and RAD Notice also specify requirements for ownership and control of converted properties. That is, converted properties must have public or nonprofit ownership or control, with limited exceptions. The RAD authorizing legislation, RAD Notice, HAP contracts, and RAD Use Agreement also establish procedures to help ensure that public housing remains a public asset should challenges arise, such as default, bankruptcy, or foreclosure. Oversight of RAD conversion and properties is primarily divided among three HUD offices. The Office of Recapitalization is responsible for administering the conversion process but generally does not oversee converted properties. Before conversion, the Office of Public and Indian Housing oversees the properties. After conversion, oversight remains with Public and Indian Housing for properties that convert to PBV contracts and transfers to the Office of Multifamily Housing Programs for PBRA. The RAD program has been implemented and expanded in phases. Since its authorization, the RAD unit cap gradually increased from 60,000 units in 2011 to 225,000 units in May 2017. The RAD program is currently fully subscribed with all 225,000 units allocated. As of September 30, 2017, 689 conversions were closed that involved a total of 74,709 units (see fig. 1 for a breakdown by fiscal year). Additionally, 706 conversions involving 79,078 units were in the process of structuring conversion plans. The remaining conversions under the cap were allocated to specific properties and in the process of having commitments issued or reserved under multi-phase or portfolio awards, according to HUD officials. RAD conversions begin with the submission of an application by PHAs after which they are notified of selection. The PHA is then required to submit a financing plan within 180 days or a later deadline based on the nature of the financing proposed. A RAD conversion is considered closed when the HAP contract is signed and financial documents are executed. The properties are considered converted to Section 8 assisted housing on the effective date of the HAP, which is generally the first day of the following month. Once the RAD conversion is closed, the PHA or ownership entity can move forward with its submitted proposals or RAD-related rehabilitation or new construction and is responsible for complying with RAD requirements and associated contracts. In some cases, rehabilitation can take place in advance of conversion closing if public housing funds are being used. Most RAD conversions involved some type of construction. Our analysis of HUD data showed that as of September 30, 2017 417 of 689 closed conversions (61 percent) involved planned rehabilitation to the property, 86 (12 percent) new construction, and 186 (27 percent) no construction; and 361 of 706 active RAD conversions (51 percent) involved planned rehabilitation, 89 (13 percent) new construction, and 256 (36 percent) no construction. HUD officials stated that they approve conversions that involve no immediate planned rehabilitation or new construction as long as the property has no immediate needs to be addressed. Such conversions allow PHAs to better position themselves to access additional capital to address future rehabilitation or construction plans. Our review of 31 conversion files also showed that the scope of proposed physical changes varied among RAD conversions. For properties that included scope of work narratives, physical changes included renovations to mitigate hazardous materials, aesthetic renovations, code and accessibility compliance, and construction of new buildings, among other changes. Financing for RAD conversions involved multiple public and private sources, but many conversions used LIHTC. Our analysis of HUD data showed that as of September 30, 2017, 173 of 689 closed RAD conversions (25 percent) utilized 4 percent LIHTC, 99 (14 percent) utilized 9-percent LIHTC, and 416 (60 percent) did not use LIHTC. By dollar amount, major financing sources were 4 percent LIHTC at $2.4 billion; new first mortgages at $1.8 billion; and 9 percent LIHTC at $1.1 billion. Construction costs constituted the highest-dollar use of financing for RAD conversions, but not all conversions incurred construction costs, as discussed earlier. On average, construction costs per closed conversion were $6.4 million (ranging from no construction costs to $236 million) and nearly $60,000 per-unit converted to RAD. Construction costs represented the highest-dollar use of financing for closed RAD conversions at $4.4 billion followed by building and land acquisition costs, and developer fees. For more information on financing sources and uses, see appendix II. PHA officials and developers we interviewed cited various factors that influence financing sources needed for RAD conversions. For example, property needs assessments help establish the level of rehabilitation or new construction that would address the capital needs of the property. In turn, needs assessments can derive from physical assessment results and incorporate federal, state, or local compliance requirements. For instance, rehabilitation or construction would need to address the accessibility requirements of the Americans with Disabilities Act and local building codes, among other requirements. PHA officials and developers we interviewed also said they had to consider competition or access to financing for RAD conversions. For example, PHAs noted that tax credit applications and other financing had to be competitive. Some PHAs we interviewed also noted that while the 9 percent LIHTC provides more equity to finance low-income units (finances 70 percent of the costs of the units), there is more competition for the 9 percent LIHTC, while the 4 percent LIHTC can be automatically awarded for certain deals involving tax exempt bonds and federally subsidized projects. Thus, while some PHAs and developers might prefer to obtain 9 percent LIHTC, they often apply for 4 percent LIHTC to increase the chances of obtaining some tax credit equity. For example, one particular PHA that had used both 4 percent and 9 percent LIHTCs noted that in one transaction it had to compete against 74 applicants for 25 available awards of 9 percent credits. The RAD authorizing statute requires HUD to assess and publish findings regarding the amount of private capital leveraged as a result RAD conversions. A leverage ratio relates the dollars other sources provide to the dollars a program provides to an institution or a project. HUD uses various quantitative, qualitative, and processing and efficiency metrics to measure conversion outcomes. To meet the RAD statutory requirement, HUD published an overall RAD leverage ratio that has fluctuated between 19:1 and 9:1 since 2014. HUD’s most recent leverage ratio in fiscal year 2017 was 19:1, nearly double what the agency reported the prior year. We asked HUD officials why the leverage ratio nearly doubled between 2016 and 2017 and received conflicting information during the course of our audit. Initially, officials noted that the ratio was intended to replicate the methodology used by PD&R in its September 2016 report. Subsequently, the officials clarified that they did not follow PD&R’s methodology for categorizing financial source data. Specifically, officials did not review or make manual adjustments to the financial data PHAs entered in open source fields to ensure sources actually represented public, private, or other funding categories when calculating the leverage ratio. Finally, they noted that they disagreed with the methodology used in the PD&R September 2016 report and stated that there are various ways to calculate leverage. For the purposes of announcing the most recent leverage ratio in 2017, HUD officials decided that a leverage ratio comparing federally appropriated public housing resources would reflect the amount of financing leveraged had RAD not existed. We found, and officials from HUD acknowledged, three limitations to the RAD leverage calculation. First, HUD generally had data on funding sources and amounts a RAD conversion proposed to use (at the time of its application to HUD and at the time of closing of construction financing) rather than data after construction is completed on funding sources and amounts. HUD officials stated that they were reviewing final closing packages to confirm that the data reflect the latest reported information on sources and uses of funds for each conversion at closing. However, sources and uses of funds and amounts at the time the RAD conversion is closed may differ from amounts upon completion of construction. In October 2017, HUD implemented procedures to verify completion of planned construction activities and costs, which we discuss later in this report. Second, HUD’s leverage ratio, published in 2017, did not manually adjust funding source data to accurately account for all sources in calculating the leverage ratio for RAD. Specifically, HUD did not isolate funding sources that were federally appropriated, contributed by the PHA, or contributed by state or local municipalities to calculate leverage. For example, among approximately $2 billion from other financial sources, HUD included Moving to Work (MTW) funding (which may include public housing capital funds, public housing operating funds, and voucher funds) and tax credit equity as leveraged sources. However, these are not necessarily private sources, which we explain later in this report. As a result, HUD’s current calculation does not reflect the amount of private- sector leveraging. HUD calculated and published a RAD leverage ratio in May of 2017 using the following formula: Total leverage ratio = (total dollars from all sources – public housing dollars) To calculate the RAD leverage ratio, HUD uses some but not all financial source data it collects (see app. II for a list of data fields collected by HUD). For example, HUD mistakenly excluded data that capture private funds, reducing the amount of total sources in the numerator. HUD calculates “public housing dollars” by adding data that capture replacement factor funds, public housing operating reserve funds, and prior-year public housing capital funds. HUD considers tax credit equity, new first mortgages, and “other funding” data to be non-public housing dollars (see app. II for a list of fields in HUD’s calculation). PHAs enter a description and amount for other funding sources in “other funding” data fields (see app. II). For example, a PHA may enter a federal financial source in one of the open-entry “other funding” data fields, requiring a manual adjustment to properly account for the financial source. According to HUD, additional fields were included in mid-2016 to better differentiate certain sources such as from the HOME Investment Partnerships Program (HOME) and seller take-back financing. Prior to this point, these financial sources were placed into “other” fields, and the standard resource desk report had not been updated until mid-2017 to include all of these fields. Third, HUD does not categorize and report its leveraging by private and public sources. According to HUD officials, informative leverage methodologies could calculate the ratio based on the leveraging of public housing program funds, the leveraging of all federally appropriated funds, or the leveraging of PHA funds (i.e., sources in the transaction that have come from the PHA itself even if not federally appropriated through the public housing program), among other methodologies. The RAD authorizing statute requires HUD to assess and publish findings on the amount of private-sector leveraging. In addition, Standards for Internal Control in the Federal Government require agencies to communicate quality information with external parties, such as other government entities, to make informed decisions and evaluate the entity’s performance in achieving key objectives. HUD also does not use final (postcompletion) funding data in another metric of RAD leveraging. Specifically, in June 2017 HUD publicly reported that RAD “has leveraged more than $4 billion in capital investment in order to make critical repairs and improvements.” HUD calculates this figure by summing the construction costs—a subcomponent of total costs—with data from the time a conversion closes and not upon completion of construction. HUD officials we spoke with clarified that this metric solely reports construction investments and does not reflect any conclusion regarding private leverage of public funds. But, HUD publically characterized this measure in different ways, including as the amount of “public-private investment in distressed public housing,” the amount of “construction achieved under RAD,” and the amount of “new private and public funds leveraged by RAD.” HUD’s 2016 interim report calculated and published multiple leverage ratios, but chose to highlight a RAD leverage ratio that is consistent with ratios used for other HUD programs. However, the ratio does not specifically follow the prescribed ratio language in the authorizing statute because the report states that the ratio represents the amount of private and public external sources invested for every dollar invested by PHAs but the statutory language only discusses private-sector leveraging. Officials further noted that the statute does not require a particular methodology and HUD relies on PD&R—and its independent contractor— to determine the appropriate methodology for purposes of compliance with the statute. Lastly, the statute does not preclude the use of other leverage metrics for other purposes, such as using the ratio to measure the amount of nonpublic housing funds leveraged in RAD transactions that would not be available to the property absent RAD. As a result, HUD’s leverage metrics announced in May 2017 do not accurately reflect the amount of private-sector leveraging achieved through RAD, do include public funding as private sources, and inconsistently measured sources that were federally appropriated or contributed by PHAs, potentially under- or over-reporting the program’s performance. Additionally, in October 2017, HUD began implementing procedures to collect data after construction is completed and is not yet able to calculate a leverage metric using final (postcompletion) financial sources rather than the financial sources collected at closing. The lack of a consistent metric for private leveraging could also lead to inconsistent reporting of the leverage ratio, as has occurred in prior years. We recalculated RAD leverage ratios in a number of different ways, including to correct errors we identified during our review. For example, HUD’s 2016 interim report noted that data on closed transactions do not provide detailed description of “other sources,” requiring a crosswalk between applications and closed transactions to develop estimates for the allocation of “other sources” across financial source categories. Abbreviated descriptions are provided in the form of notes that are not always clear and consistent; therefore public housing sources may include federally appropriated sources, as well state, city, or county sources. Through our estimates, we found that the overall leverage ratio could range from 7.44:1 for a ratio recalculating HUD’s leverage ratio to 1.23:1 for a ratio estimating private-sector leveraging. Recalculation with HUD methodology and financial source recategorization. As discussed previously, HUD’s methodology does not account for all financial data collected by HUD and includes “other” funding sources erroneously considered as leveraged funds. Thus, we manually adjusted RAD funding source data and found that nearly $1.2 billion were erroneously considered leveraged funds because they are not private funds. For example, HUD included MTW funds; public housing operating reserves; public housing capital funds; replacement housing factor funds; other federal funds; other state, local, or county funds; and take-back financing funds as leveraged financial sources. For more information, see appendix II. We obtained documentation from HUD to replicate their methodology and recategorized financial sources that corrected errors in the data, and found that the RAD leverage ratio was less than half of HUD’s most recently publicly reported leverage ratio (19:1), approximately 7.44:1 (see app. II). Recalculation to exclude LIHTC and other federal sources. We previously reported that LIHTCs are considered a federal source because tax credit equity represents foregone federal tax revenue and, therefore, are a direct cost to the government. Accordingly, we recalculated the RAD leverage ratio by excluding all federal funding sources and obtained a ratio of approximately 1.43:1 (see app. II). Recalculation of private-sector leveraging. Lastly, the RAD authorizing statute requires HUD to assess and publish findings on the amount of private-sector leveraging, but HUD’s current calculation does not present the amount of private-sector leveraging and does not include all available data (for example, the “Other Private” funds collected by HUD). We estimated the amount of private-sector leveraging by grouping public housing sources, other public sources, and private sources, resulting in a leverage ratio of approximately 1.23:1 (see app. II). In October 2017, HUD implemented procedures to certify completion after developers finish RAD-approved rehabilitation or construction. Previously, HUD had a limited ability to monitor and evaluate final (postcompletion) physical and financial changes in RAD projects with existing data. According to HUD officials, HUD did not implement completion certification procedures before October 2017 because it had been addressing what it considered to be the highest risks first (such as clarifying requirements for RAD participants, resident safeguards, and other procedural and administrative requirements). HUD’s October 2017 completion certification procedures include instructions for owners to report final construction costs and documentation on completion of repairs or construction within 45 days of the completion date recorded in the RAD Conversion Commitment. More specifically, HUD requires owners to list a final construction cost amount—a subcomponent of total costs—in the RAD resource desk, describe variances from the approved construction cost amount in a comment box, and describe how increases in costs were addressed. Additionally, a third-party must certify that the repairs in the scope of work were completed by providing an attestation to HUD. However, HUD’s procedures do not require documentation from the owners to support the final total cost figures, which include not only construction costs but also building and land acquisition costs, and developer fees, among others as noted earlier in this report. These procedures also do not require a certification from owners on all financing sources and costs recorded in the RAD Conversion Commitment. Standards for Internal Control in the Federal Government require that management implement control activities through documented policies and procedures to provide reasonable assurance that the objectives of the agency will be achieved, and also communicate quality information with external parties to make informed decisions and evaluate the entity’s performance in achieving key objectives. While HUD now has certification completion procedures in place, this process provides the agency limited financial information from owners. As a result, HUD is unable to report metrics that reflect final (postcompletion) RAD financial outcomes after construction is completed. Furthermore, HUD is limited in its ability to effectively oversee conversion budget and cost variances, and expenditures that require HUD approval. Lastly, the RAD authorizing statute requires that the Secretary of HUD demonstrate the feasibility of the RAD conversion model to recapitalize and operate public housing properties under various situations and by leveraging other sources of funding to recapitalize properties. Without metrics that reflect the final (postcompletion) financial outcomes of RAD after construction is completed, HUD and congressional decisionmakers are unable to make informed decisions concerning the RAD program. HUD has not systematically tracked or analyzed household data on residents in RAD-converted units that are available from its public housing or Section 8 databases or from PHAs or other postconversion owners—the main sources of resident data for the RAD program. In addition, HUD has not yet developed monitoring procedures for all the resident safeguards in the RAD program. Finally, residents told us of some concerns about information they received on RAD conversions, communications opportunities, and the relocation process. HUD officials told us that the agency does not systematically track or analyze household-level data on residents in RAD-converted units across existing program databases (HUD maintains household data for the public housing and Section 8 rental assistance programs in two databases). In particular, HUD does not track changes in household characteristics before and after conversion, such as changes in rent, as well as relocations or displacement of individual households. However, according to HUD officials, their databases are not designed to track the impact of RAD conversion on residents and they are unable to electronically link household information submitted before RAD conversion to information submitted after conversion. Once a property is converted, the property and corresponding household information are removed from the public housing database. Owners of converted properties are to use software to manually enter household information into the databases for the Section 8 program when submitting tenant certifications and information for assistance payments. This procedure is the standard for administration of all project-based Section 8 properties. HUD officials stated that they have explored the possibility of transferring household data from one system to another at the time of a property’s conversion. While HUD has not systematically analyzed household information from its public housing and Section 8 databases, we were able to perform a limited analysis. We requested and received data from HUD on the households affected by RAD. Using the data provided that were current as of June 2017, we were able to identify about 26,000 households that lived in units that were converted to a PBV subsidy, but we were unable to identify the total number of households converted to a PBRA subsidy. Based on our analysis of 26,000 PBV households, we found about 2,700 (about 11 percent of) households were headed by an about 6,800 (about 26 percent of) households were headed by an individual with a disability; about 2,700 households (about 10 percent of) households were headed by an elderly person who also had a disability; over half (about 14,000 or 54 percent) of the households were headed by an individual identified as black; close to 11,000 households (about 41 percent) were identified as white; and about 1,000 households (about 4 percent) were identified as Asian. Close to 3,100 households (about 12 percent) were headed by an individual identified as Hispanic; about half (about 49 percent) of the PBV households were single- person households; the median annual income of PBV households both before and after RAD conversion was about $10,000; and about 5,300 (about 20 percent) of households were paying a flat rent rather than income-based rent before RAD conversion. However, the data on PBV households were not comprehensive. For example, while about 10,000 residents (about 57 percent) experienced a rent increase following RAD conversion under PBV, we could not determine if the rent increase was the result of an increase in resident income. We also could not determine changes in location among the PBV households following RAD conversion. Rather than relying on the public housing and Section 8 databases for tracking household information during conversion, HUD officials indicated that the agency will rely on locally maintained resident logs, which contain household information collected by property owners, as the starting point when HUD determines a compliance review is warranted. The logs will be the primary way the agency collects household information for compliance reviews under the RAD program, according to HUD officials. In November 2016, HUD issued a notice, which requires the PHA or other postconversion owner to maintain a log about every household at a converting project, including information on race and ethnicity, household size, and disability. The notice also requires owners to track residence status throughout the relocation process, including whether the resident has returned, moved elsewhere, was permanently relocated or evicted; relocation dates; and details on any temporary housing and moving assistance provided. Owners are required to make the information available to HUD upon request for audits and other purposes. According to HUD officials, the agency expects the information in the resident logs to be more robust than what they would collect through the public housing and Section 8 databases, which do not track residents while they are relocated. HUD officials stated that the agency plans to review selected resident logs as part of an ongoing limited compliance review of about 90 RAD conversion projects. HUD officials told us they are developing procedures for performing compliance reviews—such as developing a mechanism to review a sample of logs on a periodic basis—but they have not yet done so because they have been focusing on developing procedures for activities that present a high risk to the program as described in the following section. HUD has not established a time frame for developing these procedures. However, HUD officials indicated that they plan to select resident logs for review based on risk of noncompliance and do not plan to analyze program-wide information currently collected in the public housing and Section 8 databases for program monitoring. HUD officials also noted that that PD&R is planning to track a sample of residents through its evaluation of the program, which we previously mentioned. While HUD has decided to rely on resident logs because of the difficulty of tracking household information across its program databases, using resident logs to assess the effects of the RAD program on residents has limitations. While the resident logs would contain detailed household information, they were not required prior to November 2016 and may not contain information on households converted before that date (RAD conversions started in 2013). HUD’s public housing and Section 8 databases contain information on such households. Second, as previously mentioned, HUD plans to review resident logs only when there is a risk of noncompliance, but they collect household information in their databases on a rolling basis. Standards for Internal Control in the Federal Government require agencies to use quality information to achieve their objectives, and obtain and evaluate relevant and reliable data in a timely manner for use in effective monitoring. Without a comprehensive review of household information—one based on information in HUD data systems as well as resident logs—HUD cannot reasonably assess the effects of ongoing and completed RAD conversions on residents and compliance with resident safeguards, as discussed in the next section. HUD has not yet developed monitoring procedures for certain resident safeguards under the RAD program. RAD requirements include those intended to ensure that residents whose units are converted through RAD are informed about the conversion process; can continue to live in a converted property following RAD conversion; are afforded certain protections carried over from the public housing are afforded a phase-in of any rent increases under Section 8 program requirements. Currently, based on HUD notice requirements, PHAs must document compliance with three safeguards (PHA plan amendments, resident notification, and procedural rights) in their RAD application and other conversion paperwork. For example, PHAs must submit comprehensive written responses to resident comments received in connection with the required resident meetings with their RAD application. For one safeguard, PHAs are not required to report to HUD but must retain documentation of compliance to be made available to HUD as part of the monitoring for the program. For others, the HUD notice does not specify reporting and monitoring requirements. Based on our review of files for selected conversions, which we previously discussed, we found PHAs generally submitted documentation of their efforts to inform residents about RAD conversion, such as providing evidence to HUD of meetings with residents and written responses to resident questions as required. However, the specific documents for these requirements were not available from HUD in all cases. HUD’s review of amendments to PHA plans was documented in all but one of the conversions we reviewed. Documentation requirements for resident relocations have changed since RAD was introduced, which made the documentation more difficult to assess. HUD developed and started implementing procedures in October 2017 that require owners to certify and provide data supporting compliance with the resident right-to-return requirements. For example, owners must certify the number of residents who exercised their right to return to a converted property compared with the number of residents who did not return. HUD is also developing standard operating procedures to review each conversion for compliance with RAD relocation provisions. Specifically, the procedures would describe the review steps required at different stages of the conversion process, a process for identifying risks, and how to address instances of noncompliance with RAD requirements. Additionally, HUD noted that they have 2 compliance reviews under way including 1 involving a set of HUD requirements that affect relocations of more than 1 year and the limited compliance review of 90 projects that we previously described. HUD officials noted that they are developing additional guidance in other areas. First, HUD officials indicated that as part of an overall update of RAD standard operating procedures, they are developing additional protocols on resident notification and how residents’ comments are addressed through conversion planning. Second, the agency had not been consistently collecting required documentation on “house rules,” which describe the conditions and procedures for evicting residents and terminating assistance at RAD PBRA properties, so it has developed and implemented additional legal review procedures as part of the implementation of RAD resident eviction and grievance procedural rights requirements. According to HUD officials, they have been focusing primarily on right-to-return and relocation requirements because they represent areas of highest risk. HUD has not developed separate monitoring procedures for other resident safeguards—the phase-in of tenant rent increases, resident representation through tenant organizations, and choice mobility requirements. However, HUD officials told us that they plan to assess how administrative data can be used to monitor choice mobility as part of the planning for a separate PD&R evaluation of this safeguard. HUD officials also indicated that there are procedures for residents to report complaints to HUD if resident representation and organization requirements are not met. Standards for Internal Control in the Federal Government require agencies to implement control activities through documented policies and procedures to provide reasonable assurance that agency objectives will be achieved. These standards also require agencies to design procedures to achieve goals and objectives, and identify, analyze, and respond to risks related to achieving the defined objectives. Table 1 includes a description and information on implementation of resident safeguards that most directly affect residents’ experience with the conversion process and ability to live at the property following conversion. Appendix III describes these and other RAD resident safeguards. HUD officials indicated that the safeguards for the phase-in of tenant rent increases, resident representation, procedural rights, and choice mobility presented a lower risk than the right-to-return requirements, so they were a lower priority, and in some cases were addressed through general monitoring of the Section 8 program. For choice mobility options, HUD indicated that its data systems are not designed to track whether residents are able to exercise these options, such as tracking whether residents left a property to exercise choice mobility or for other reasons. All but two of the resident safeguards do not take effect until after a property has been converted and is part of the Section 8 program. For example, residents are only eligible to use vouchers through choice mobility after they have lived in the converted property for 1 or 2 years depending on the assistance contract involved (PBV or PBRA). Moreover, certain RAD safeguards are not typically available for Section 8 residents. For example, RAD establishes resident representation provisions and procedural rights that are more in line with public housing rather than Section 8 requirements. While HUD has indicated that the Section 8 program has experience administering different types of assistance contracts, RAD nonetheless creates separate requirements for certain provisions from the public housing and Section 8 programs. As previously mentioned, RAD conversions have been completed at an increasing pace in the last 5 years. However, because HUD has not yet developed separate monitoring procedures for certain requirements—the phase-in of tenant rent increases, resident representation through tenant organizations, and choice mobility requirements, many of which take effect after a conversion—and without using all available household data, the agency will not be able to reasonably ensure that these safeguards were implemented. Residents who participated in our focus groups expressed some concerns about information they received on RAD conversions, communications opportunities, and the relocation process. Residents indicated that they were notified about RAD conversion in a variety of ways. Residents in 5 of 14 focus groups found the information presented to them on RAD to be helpful. Residents in 7 of 14 focus groups indicated that the information they received was not helpful. Across these focus groups, a range of concerns was expressed, including that the information provided was not always clear or reflective of the final changes resulting from RAD conversion, and that the PHA and management were not always forthcoming with information about the RAD changes. Residents in some focus groups also indicated that they were not involved in the RAD conversion. Residents in 5 of 14 groups indicated that they were not given the opportunity to provide input into the RAD changes, while residents in 6 of 14 groups indicated that their concerns were not addressed and their suggestions were not incorporated. Residents also described problems with relocations. Some of the concerns expressed by resident focus groups on relocation related to the location of the temporary units (3 of 14 focus groups), the timing of relocation or amount of notice given (7 of 14 focus groups), and moving issues (such as items damaged during moves). Residents were asked to describe ways in which RAD conversion improved or harmed their living conditions. Residents in several focus groups indicated that RAD improved their living conditions, including both the condition (7 of 14 focus groups) and appearance of their units or the property in which they lived (6 of 14 focus groups). Some of the changes residents liked included the installation of new appliances, mold and pest removal, and safety and energy efficiency improvements. However, residents in several of the focus groups identified problems with their living conditions following RAD conversion. The problems residents identified included security concerns (10 of 14 focus groups); renovations that were of poor quality (6 of 14 focus groups); and other problems with the units (10 of 14 focus groups), such as pest problems; decreased amenities (8 of 14 focus groups), such as the removal of common areas or in-unit washing machines; and issues with property management (11 of 14 focus groups). For example, in several instances, residents stated that new managers or owners in place following RAD conversion were not responsive to their needs or concerns. During our site visits, residents described other experiences with RAD conversion. Residents in all of the groups identified being notified about RAD. Residents in 9 of 14 focus groups indicated that their rent was the same following RAD conversion. Residents in a few focus groups indicated that their rent had increased because of changes in their income or conversion from a flat rent. However, residents in a few focus groups experienced challenges in how their income was certified for the purpose of calculating rents, such as problems with requests for information (2 of 14 focus groups) and other issues with the process (4 of 14 focus groups). For example, residents reported having to provide the same paperwork multiple times. No instances in which residents were permanently involuntarily displaced were reported. One resident organization expressed concerns about fewer eviction protections and resident representation after RAD conversion. We spoke with 18 PHAs, some of which cited benefits as well as several challenges of RAD participation and some noted HUD responsiveness to their circumstances and concerns. According to many of the PHAs we spoke with, benefits of participating in the RAD program included reducing administrative requirements in Section 8 programs and opening avenues for additional sources of funding. In particular, many of the PHAs noted that RAD allowed them to access tax credit equity and other funding to complete the bulk of their repairs and renovations at once. Over half of the PHAs we spoke with also found HUD to be flexible and responsive to individual PHA circumstances. The majority of PHAs we spoke with indicated that remaining in the public housing program was not tenable because funding for the public housing program was not enough to meet their long-term capital needs. PHAs we contacted also noted several challenges of participating in RAD: financing constraints, timing challenges, and evolving requirements. Financing constraints. Some PHAs noted that program rent requirements can limit PHA participation in RAD. Each year, HUD calculates a contract rent—the total rent for a unit, including operating subsidy and resident contribution. PHAs must use the contract rent to calculate Section 8 subsidies for properties converting under RAD. According to HUD and several PHAs, contract rents for RAD-converted Section 8 units are lower than rents in traditional Section 8 assisted units, and are almost always lower than market-rate rents. Several PHAs and HUD officials have described the difficulty of converting units from the public housing program with this rent limitation. For example, when the cost of needed rehabilitation or construction is high, low allowable contract rents might not be sufficient to access appropriate capital for the conversion. In certain localities, PHAs have found solutions to augment rents and have used RAD flexibilities to allow them to convert and plan for operating expenses. For example, the PHA in Tacoma, Washington, used the Moving to Work program flexibilities to increase contract rents and housing officials in San Francisco used an allowable procedure to transfer RAD assistance from converted buildings to properties throughout its portfolio (each is a blend of traditional project-based vouchers with higher contract rents and RAD assistance). In Montgomery County, Maryland, the PHA similarly included RAD assistance in some mixed-finance properties that contain other high-rent subsidies and market-rate rents. Timing challenges. Some PHAs said they faced major challenges in coordinating RAD timelines with HUD, lenders, or other parties or with the requirements of the LIHTC process. HUD officials acknowledged that PHAs with more complex transactions, including those involved in the LIHTC process, struggle to implement their conversion plans within RAD time frames. HUD officials noted that because there is a statutory cap on the number of units that can be converted under RAD, they have established time frames to stay under the cap and ensure that PHAs that are planning to convert are ready to participate in the program. Additionally, according to HUD, it has made technical assistance available to all PHAs that receive a Commitment to enter into a Housing Assistance Payment contract during the RAD process to help ensure their readiness for RAD closing and to meet remaining conversion deadlines. On the other hand, some PHAs expressed concern to us about delays in the conversion process that put them at risk for missing state LIHTC deadlines. HUD officials described putting conversions on a fast-track on a case-by-case basis to meet LIHTC deadlines. For example, in one case a PHA relocated residents before closing and without HUD approval. HUD required the PHA to fund an escrow account until it was able to determine any payments that might need to be made to residents and any other necessary corrective action. This was done so that HUD could look into the issue while mitigating additional harm to the residents and continuing to move the PHA toward closing and aligned with tax credit application deadlines. The timing of conversion can also create gaps in the payment of Section 8 funds to PHAs. Section 8 funding should begin in January of the year following conversion. PHAs rely on annual public housing subsidies for the conversion year—public housing program funds are paid to PHAs annually and are not recaptured by HUD following RAD conversion. However, according to some PHAs we interviewed, Section 8 funding did not begin on time. For example, in Baltimore, Maryland, subsidy flow after conversion had not begun as of June of the following year. HUD officials told us inadequate guidance from HUD and confusion from PHAs regarding the necessary steps to request payment in a timely manner have been the major cause of the problems. HUD has tried to remedy delays and updated its notice to provide clearer guidance on the timing of subsidy flow around the time of conversion to Section 8. Moreover, HUD officials indicated that there has been confusion among PHAs on how to request funds, so HUD is currently revising and updating the guidance on steps PHAs must take to request payment under the PBRA program. HUD officials also indicated that it has begun monitoring whether new participants are taking the steps needed well before their first request for funding. Some PHAs we contacted also mentioned difficulty in coordinating with HUD on fulfilling internal RAD requirements and reviews. According to some, the different offices involved in RAD conversions within HUD were not well aligned and had different interpretations of the rules. For example, some RAD conversions require a civil rights review by HUD’s Office of Fair Housing and Equal Opportunity Office, including those transactions that require new construction or resident relocations. Some PHAs indicated that such reviews occurred too late in the conversion process even after other HUD offices had approved the conversion. HUD officials acknowledge that different HUD offices have different objectives in the RAD process. HUD officials indicated that the agency is trying to coordinate more effectively among these offices and streamline the conversion process as much as possible. Evolving requirements. While the majority of PHAs with which we spoke said that HUD provided clear, sufficient, and timely information, some PHAs noted that it also was challenging to adapt to evolving requirements. Some PHAs noted that as HUD identified problems in the early years of the program, it would change the guidance in response. For example, HUD officials explained that it had clarified fair housing review requirements in response to PHA concerns that the fair housing review occurred too late in the process and could affect successful conversion of projects. The most recent RAD notice (effective January 2017) is the third version since 2013 and revisions have involved substantial changes. For example, this notice provided PHAs with greater flexibilities on the funding sources they can use to raise initial contract rents and the ways they can demonstrate ownership and control of a converted property. In addition, HUD introduced a notice in November 2016 to strengthen resident protections. Some PHAs told us they found the pace or timing of the evolving requirements difficult to manage and also noted confusion about conversion instructions and guidance due to changing requirements. For example, one PHA indicated that the agency had problems reporting information into a new RAD data field in HUD’s Voucher Management System because there was no guidance at the time on how to complete this field. However, HUD has since included additional instructions in the user’s manual that became effective in April 2017. The Committee has included language to establish procedures that will ensure that public housing remains a public asset in the that event that the project experiences problems, such as default or foreclosure. In each RAD conversion, HUD and the property owner execute a use agreement, which specifies affordability and use restrictions for the property. The use agreement generally exists concurrently with the HAP contract, which is executed to govern the provision of either the PBRA or PBV subsidy for the unit. The use agreement must be recorded in a superior position to new or existing financing or other encumbrances on the converted property. Under a Section 8 HAP contract, residents pay 30 percent of adjusted household income. In the absence of the HAP contract, the use agreement is set up to control the amount paid: If the HAP contract is removed due to breach, noncompliance, or insufficiency of appropriations, under the use agreement new households in all units previously covered under the HAP contract must have incomes at or below 80 percent of the area median income for households of the size occupying an appropriately sized unit for their family size at the time of admission, and rents may not exceed 30 percent of 80 percent of area median income for the remainder of the term of the use agreement. For new residents at or below 80 percent of the area median income, under the use agreement the resident rent contribution without a HAP contract generally would be higher than that paid under a HAP contract, which is based on household income instead of the universally determined area median income. Although the use agreement maintains some level of affordability, the owner receives no subsidy under PBRA or PBV without a HAP contract and resident rent contribution is not tied to individual household income but rather based on a universal area income calculation (see fig. 3). According to HUD officials, other program requirements support the goal of long-term preservation: HAP contracts are executed for 20 years for PBRA or 15–20 years for PBV properties and compliance with all affordability requirements in the HAP and statute and regulation governing the PBRA and PBV programs must be maintained while the contract is in force. According to the authorizing statute, PHAs (for PBV contracts) and HUD (for PBRA contracts) shall offer and project owners shall accept a renewal contract at the expiration of the initial HAP contract and at each subsequent renewal. Each renewal contract will be subject to a RAD use agreement, governing the use of the property consistent with HUD requirements. According to the RAD notice, the project owner also is to establish and maintain a replacement reserve to aid in funding extraordinary maintenance and repair and replacement of capital items. The reserve account must be built up to and maintained at a level determined by HUD to be sufficient to meet projected requirements. According to HUD officials, during the conversion, HUD staff review each capital needs assessment to try to determine whether a property’s capital needs can be addressed over the forthcoming 20-year period. We reviewed 31 completed conversion files, the set of documentation required by HUD to enable a PHA to convert units from public housing to a Section 8 subsidy, and associated RAD contracts. In each file, key contractual protections appeared consistent with program requirements. Specifically, in all cases executed use agreements (which included requirements to limit residency eligibility to households making less than 80 percent of area median income) were included and not altered from the HUD template. In most files we reviewed, we found foreclosure riders were included and that they stated that use agreements would survive foreclosure, meaning that any new owners would take ownership subject to the agreements. Executed HAP contracts, requiring that residents’ contributions be set at 30 percent of adjusted household income, also were present in all files we reviewed. According to HUD officials, PHAs, and two housing groups we spoke with, provisions in the RAD use agreement to keep units affordable appear to be strong, with use and affordability protections designed to survive foreclosure, but the strength of provisions cannot yet be fully determined because the provisions have not yet been tested in foreclosure proceedings or in courts. According to HUD officials, as of October 2017 no RAD properties had entered foreclosure. The RAD authorizing statute requires that ownership be transferred to a capable public entity or, if not one, a capable entity as determined by HUD, or if necessary to fulfill LIHTC requirements for the property, to a HUD-approved for-profit entity (provided the PHA retained sufficient interest in the property). HUD also subjects any subsequent transfer of the property to HUD review and requires the successor ownership to meet these same requirements. As stated in the use agreement, a lien holder must give HUD notice prior to declaring a default and provide HUD concurrent notice with any written filing of foreclosure (providing that the foreclosure sale must not be sooner than 60 days after the notice), but the use agreement does not prohibit a lien holder from foreclosing on the lien or accepting a deed in lieu of foreclosure. The RAD use agreement, which is recorded superior to other liens and places use and affordability restrictions on the property, survives foreclosure. With or without a HAP contract in place, the lender or new owner must maintain the units for low- income households according to the terms of the use agreement. Therefore, according to HUD officials, the lender or new owner has an incentive to identify an appropriate owner and secure HUD approval to avoid a default under the HAP contract, which provides a Section 8 subsidy to the owner. That is, if no HAP contract were in place, the owner would collect only the tenant rent contribution (30 percent of 80 percent of area median income), rather than the tenant rent contribution plus the subsidy. HUD has discretion to enforce or waive certain use and affordability protections. According to the authorizing statute, in the case of foreclosure, bankruptcy, or termination and transfer of assistance for material violation or substantial default, the priority for ownership or control must be provided to a capable public entity, or, if no such entity can be found, to a capable entity as determined by the Secretary of HUD. Additionally, the statute allows the transfer of property to for-profit entities to facilitate the use of LIHTC financing, with requirements to maintain the PHA’s interest, which was discussed above. As of September 30, 2017, about 40 percent of RAD conversions involved LIHTC financing. According to the RAD notice, in the event of a default of a property’s use agreement or HAP contract, HUD may terminate the HAP contract and transfer assistance to another location to retain affordable units. HUD will determine the appropriate location and owner entity for the transferred assistance consistent with statutory goals and requirements for RAD. The RAD use agreement will remain in effect even in the case of abatement or termination of the HAP contract for the term the contract would have run, unless HUD agreed differently in writing. In this case, the RAD notice limits HUD discretion to terminate the use agreement to only cases involving a transfer of assistance to another property. HUD has not yet developed procedures to monitor RAD projects for risks to long-term affordability of units, including default or foreclosure. HUD officials described an ongoing effort to develop oversight procedures it would need to reasonably ensure compliance with RAD agreements and avoid risks to long-term affordability once conversions closed and units moved to Section 8 but, as previously discussed, the agency has not yet completed this effort or fully implemented a monitoring system. HUD officials told us they also planned to develop protocols to more closely monitor properties at risk of foreclosure, including developing indicators, procedures, roles, and responsibilities within HUD, but they have not finalized the design of procedures or fully implemented them. To develop protocols, HUD created an asset management working group in September 2016. The officials also stressed that no one can take possession of or foreclose on a property without HUD involvement and approval. For example, HUD officials said they expect few foreclosures among RAD-converted properties because lenders tend to communicate with the agency early so that it can become involved to prevent foreclosure. HUD officials pointed to a robust structure to oversee program properties in the PBRA program, but stated PBV property oversight continues to be developed by the Office of Public and Indian Housing. According to Standards for Internal Control in the Federal Government, agencies should design procedures to achieve goals and objectives, such as the preservation of unit affordability, and respond to risks, in this case the risk of default or foreclosure or noncompliance with program requirements. Additionally, management should identify, analyze, and respond to risks related to achieving its goals and objectives. According to HUD officials, the agency had not yet fully developed and implemented oversight procedures for postconversion monitoring because since 2012, the agency has focused on RAD start-up and review and oversight procedures for the conversion process. HUD officials also said that many projects would receive ongoing monitoring from other parties, which also could serve as a safeguard for unit affordability and help ensure the appropriate financial and physical condition of the property after RAD conversion. For example, just under half of all RAD properties use LIHTC financing as part of financing packages, which can also include local and state bonds. According to HUD officials, oversight by tax credit allocating agencies, investors, and lenders, while not alone sufficient, helps secure affordable units in a property for the long-term. However, tax credit allocating agencies, investors, and lenders are not signatories to the HAP contract or use agreement and have no formal role in reasonably ensuring that properties meet requirements exclusive to RAD. Although other entities may exercise some oversight of properties, by not developing and implementing procedures for ongoing oversight, HUD in its role as program administrator will not be able to reasonably ensure that properties adhere to requirements or meet basic program goals. Furthermore, without such monitoring HUD would be limited in its ability to identify and assist with properties at risk of foreclosure. RAD was created to demonstrate the feasibility of converting public housing units to other rental assistance programs to help preserve affordable rental units and address the significant backlog of capital needs in the public housing program. However, demonstrating the feasibility of RAD conversion is contingent on collecting and assessing quality information about the conversion projects. HUD has an opportunity to improve the demonstration’s metrics. For instance, implementing robust postclosing oversight and collecting information on financial outcomes upon completion of construction would not only improve HUD’s oversight capabilities but also allow it to report quality information. Moreover, limitations in HUD’s methodology for calculating leverage ratios for RAD may obscure the effect of funding sources used to help fund RAD conversions, potentially under- or over-reporting the program’s capital leveraging. By collecting comprehensive information on final (postcompletion) financing sources and costs and developing quality metrics, HUD would be better positioned to more accurately report the results of the demonstration program. Additionally, a focus on the conversion process itself (and less on its results), and limitations in HUD’s data have contributed to limited monitoring by HUD in other areas. Specifically, by not developing and implementing monitoring procedures to assess the effect of RAD on residents HUD cannot ensure compliance with resident safeguards. Further, HUD collects and maintains household data for the public housing and Section 8 programs, yet it does not systematically use this information to ensure that resident safeguards are in place. Finally, HUD could benefit from additional procedures to assess RAD properties for risks to long-term preservation to be able to respond to property default or foreclosure. We are making the following five recommendations to HUD: HUD’s Assistant Secretary for Housing should include provisions in its postclosing monitoring procedures to collect comprehensive high quality data on financial outcomes upon completion of construction, which could include requiring third-party certification of and collecting supporting documentation for all financing sources and costs. (Recommendation 1) HUD’s Assistant Secretary for Housing should improve the accuracy of RAD leverage metrics—such as better selecting inputs to the leverage ratio calculation and clearly identifying what the leverage ratio measures—and calculate a private-sector leverage ratio. (Recommendation 2) HUD’s Assistant Secretary for Housing should prioritize the development and implementation of monitoring procedures to ensure that resident safeguards are implemented. (Recommendation 3) HUD’s Assistant Secretary for Housing should determine how it can use available program-wide data from public housing and Section 8 databases, in addition to resident logs, for analysis of the use and enforcement of RAD resident protections. (Recommendation 4) HUD’s Assistant Secretary for Housing should prioritize the development and implementation of procedures to assess risks to the preservation of unit affordability. (Recommendation 5) We provided a draft of this report to HUD for comment. HUD provided written comments on the draft report, which are summarized below and reproduced in appendix IV. HUD also provided technical comments, which we incorporated as appropriate. In its comment letter, HUD stated that it agreed with our findings that HUD can improve metrics used to assess program impact and build on existing oversight structures. HUD described actions it intends to take to implement our recommendations to the extent possible and consistent with resource limitations. More specifically, HUD agreed with our first recommendation to ensure it collects comprehensive quality data on financial outcomes in its postclosing monitoring procedures (which could include supporting documentation for all financing sources and costs). HUD agreed it should routinely collect an updated list of funding sources and uses and related documentation when projects had cost overruns or other significant changes. HUD intends to review and revise, as appropriate, required postcompletion certifications. HUD added that in most cases, funding sources and uses do not materially change between closing and construction completion. HUD stated that securing the postclosing information in such cases might be of minimal benefit relative to the additional reporting burden. However, it is not clear how HUD would determine if projects had significant changes in costs or uses because HUD lacks postcompletion information that would show the magnitude of changes. In relation to reporting burden, HUD already has implemented procedures to collect limited financial information following the completion of construction in October 2017. We believe any additional reporting would not be disproportionate to the benefits of improving HUD's oversight capabilities through project completion and enhancing its reporting to more accurately reflect the results of the demonstration program. For our second recommendation to improve the accuracy of RAD leverage metrics and calculate a private-sector leverage ratio, HUD agreed that RAD leverage metrics can be improved. HUD will ensure that the private-sector leverage ratio required by statute is clearly identified and included in its RAD evaluation. HUD also intends to identify a small number of relevant leverage ratios with distinct methodologies and will routinely publish these ratios with clear identification and explanations. In relation to our finding of misidentified funding sources, HUD plans to re- examine its chart of accounts and review prior transaction records to address errors and properly classify transaction sources. In response to our third recommendation to prioritize the development and implementation of monitoring procedures for resident safeguards, HUD agreed that it is important to better document and expedite development and implementation of monitoring procedures. HUD also agreed that additional monitoring was needed to ensure the right of residents to request and move with a tenant-based voucher after a period of residency (choice-mobility). HUD noted that its Office of Policy Development and Research is seeking funding for additional research on RAD with a focus on the use and effect of choice-mobility options, which would inform HUD's monitoring efforts. Finally, while HUD said that we did not find the safeguards to be weak or inadequate, we did not perform an audit designed to assess the safeguards and therefore cannot opine on their adequacy. On the basis of our findings, we found that HUD’s implementation of these safeguards could be strengthened. Regarding our fourth recommendation that HUD determine how it can use available program-wide data and resident logs for analysis of RAD resident protections, HUD agreed to examine how it could use its existing data systems to further enhance its monitoring efforts. HUD added that the systems have limitations, so that the agency also uses other mechanisms to track and monitor implementation of resident protections. For our fifth recommendation to prioritize the development and implementation of procedures to assess risks to the preservation of unit affordability, HUD agreed that it is important to assess and mitigate risks to unit affordability. HUD stated that it employs robust underwriting standards prior to permitting conversion, and relies on existing procedures to conduct ongoing oversight of Project-Based Rental Assistance (PBRA) properties, which we discussed in the draft. However, as we noted, HUD has not yet developed procedures to more closely monitor RAD properties at risk of foreclosure, though it plans to establish indicators of foreclosure risk and oversight roles and responsibilities within HUD. HUD said that since the summer of 2017, it has been evaluating what additional oversight procedures might be needed for RAD Project-Based Voucher properties. HUD also described plans to augment its existing oversight procedures to preserve affordable units in the event of foreclosure by developing protocols in the following areas: transfer of property ownership to a capable entity, transfer of the rental assistance to another site, and protection of residents in the event a Housing Assistance Payment contract was terminated. As agreed with your office, unless you publicly announce the contents of this report earlier, we plan no further distribution until 30 days from the report date. At that time, we will send copies to the Secretary of Housing and Urban Development and other interested parties. In addition, the report will be available at no charge on the GAO website at http://www.gao.gov. If you or your staff have any questions about this report, please contact me at (202) 512-8678 or garciadiazd@gao.gov. Contact points for our Offices of Congressional Relations and Public Affairs are listed on the last page of this report. GAO staff who made major contributions to this report are listed in appendix IV. This report examines aspects of the Department of Housing and Urban Development’s (HUD) Rental Assistance Demonstration (RAD) program. More specifically, this report addresses (1) HUD’s assessment of the physical and financial outcomes of RAD conversion to date; (2) how RAD conversions affected residents and what safeguards were in place to protect them, including while temporarily relocated and during conversion; (3) what challenges, if any, public housing agencies (PHA) faced in implementing RAD; and (4) the extent to which RAD provisions are designed to help preserve the long-term affordability of units. To address all four objectives, we analyzed agency documentation and interviewed officials from HUD. The documentation we reviewed included policies and procedures for RAD; manuals describing HUD data systems; draft policies and procedures for implementing postclosing oversight; and reports on RAD performance. We interviewed HUD headquarters officials from the Office of Recapitalization within the Office of Housing, which oversees the administration of RAD, and the Office of Policy Development and Research (PD&R). We also interviewed PHA officials and developers involved in RAD transactions, as well as selected experts and other stakeholders to obtain their perspectives on RAD. Additionally, we conducted a literature search to identify publications related to RAD. We visited a nonprobability sample of eight PHAs in Maricopa County, Arizona; Alameda County, California; Montgomery County, Maryland; and in the cities of San Francisco, California; Baltimore, Maryland; New Bern, North Carolina; El Paso, Texas; and Tacoma, Washington, to observe housing units before, during, or after renovation when possible as well as common areas that had planned or undergone renovation. We selected sites to include varying PHA sizes, RAD subsidy types, planned rehabilitation and resident relocation, numbers and sizes of RAD transactions, closing dates, constructions costs, and geographic locations across the United States. At each site, we conducted semistructured interviews with PHA officials and, when available, developers (5 sites). We also conducted one or two focus-group interviews with groups of 6– 15 residents who lived at the converted properties to obtain their perspectives and experiences. In each location, we asked the PHAs to invite residents to participate in the focus groups based on their availability. We also met with the Resident Advisory Board in each location that had one. For 7 of 8 site visits, we selected two RAD properties to conduct resident focus groups (in Alameda County, California we held one focus group). We conducted a content analysis based on resident focus group interviews to describe resident experiences and the RAD program’s effects on residents. Utilizing the selection criteria noted above, we conducted semistructured telephonic interviews with an additional nonprobability sample of 10 PHAs in Fresno, California; Fort Collins, Colorado; Dekalb County, Georgia; Chicago, Illinois; Ypsilanti, Michigan; Cuyahoga County, Ohio; Philadelphia; Pennsylvania; Spartanburg, South Carolina; McKinney, Texas; and Yakima, Washington. Because we selected a non-probability sample of PHAs to visit and interview, the information we obtained cannot be generalized more broadly to all PHAs. However, it provides context on RAD particularly on implementation challenges and perspectives on physical and financial impacts, long-term affordability, and resident protections. We also selected the following 11 individuals and organizations as experts and stakeholders: 1. Council of Large Public Housing Authorities 2. National Association of Housing and Redevelopment Officials 3. Center on Budget and Policy Priorities 4. Public Housing Authorities Directors Association 5. National Housing Law Project 6. Community Legal Services of Philadelphia 7. Maryland Legal Aid 8. Disability Rights Maryland 9. Jaime Alison Lee, Associate Professor of Law and Director, Community Development Clinic, University of Baltimore School of Law 10. Yumiko Aratani, Assistant Professor, Columbia University Mailman 11. University of California, Berkeley, Terner Center for Housing We interviewed experts and stakeholders on resident impacts and implementation challenges associated with RAD. The entities may not represent all views on these topics, but their views provide insights on RAD. To select these individuals and groups, we met with three major PHA associations and two resident advocacy groups, and asked for referrals for organizations or individuals with expertise in RAD. We also selected a nonprobability, random sample of 31 RAD conversion files to review. Utilizing HUD RAD Resource Desk data, we randomly selected 31 RAD files for properties that had closed conversion as of June 30, 2017 and that planned to incur construction costs. We used the files to help us determine physical changes to RAD conversions and the impacts of RAD on residents through, for example, relocation. We excluded RAD conversions with no construction costs from the random sample because they would not have physical changes and no resident relocation would occur before or during our review. To address our first objective on the physical and financial outcomes of RAD conversion to date and how HUD measured these outcomes, we first obtained and analyzed HUD data on RAD conversions since RAD’s authorization (from fiscal years 2013 through 2017). We assessed the reliability of these data by reviewing system documentation, interviewing knowledgeable officials about system controls, and conducting electronic testing. We determined that the data were sufficiently reliable for the purposes of describing rehabilitation and new construction in RAD projects and evaluating RAD leveraging metrics. We included in our analysis all RAD conversions that were active or closed. We used these data to determine the number of closed RAD conversions, associated financial sources and uses, subsidy types, and type of construction (rehabilitation, new construction, and no rehabilitation or new construction). In addition, during our interviews with PHAs and developers, we obtained their perspectives on potential contributing factors to financial decisions and type of construction pursued through RAD conversion. As noted earlier, we also reviewed 31 randomly selected files of converted properties with construction costs to describe property physical changes in RAD conversions. Furthermore, we reviewed HUD documents, such as HUD and PD&R evaluations, publications, and policies and procedures to gain additional context for how HUD measures RAD outcomes. We also interviewed HUD officials, including PD&R and Office of Recapitalization officials, on RAD data and metrics, as well as other performance monitoring activities. We further analyzed data from the HUD RAD Resource Desk to determine how these data support HUD’s metrics and performance monitoring activities. As previously mentioned, we determined that these HUD data were sufficiently reliable for the purposes of this report. Specifically, we assessed and calculated RAD leverage ratio and construction activity. We assessed HUD’s performance monitoring activities and reporting against the RAD authorizing statute, Standards for Internal Control in the Federal Government. To recalculate estimates of the RAD leverage metric, we obtained documentation from the Office of Recapitalization to review the methodology used to calculate their most recent leverage ratio. We aligned the methodology they provided with RAD Resource Desk Transaction Log data that was downloaded on August 7, 2017. We replicated HUD’s methodology and matched the data utilized with the descriptors from the Transaction Log. To isolate financial sources and manually adjust the “other source” data, we compiled matched descriptors and funding amounts and categorized each observation based on the funding source description, as a federal source, state/county/city source, or PHA source, among others. For additional information and results, see appendix II. To determine how RAD affected residents in converted units, we analyzed HUD public housing and Section 8 household data before and after conversion (demographic characteristics of residents and changes in rent, income, and location). Specifically, we examined data from 2013— when the first transactions closed—through June 30, 2017. HUD compiled and provided custom extracts of data on households in RAD- converted properties from the Inventory Management System/Public and Indian Housing Information Center (IMS/PIC) (public housing and Section 8 PBV) and Tenant Rental Assistance Certification System (Section 8 PBRA). We assessed the reliability of the data extracts provided by HUD by (1) performing electronic testing of required data elements, (2) reviewing existing information about the data and the system that produced them, and (3) interviewing agency officials knowledgeable about the data. We determined the data on PBV households were sufficiently reliable for the purposes of our reporting objectives, but that the data on PBRA households was not sufficiently reliable for purposes of describing some characteristics of RAD households. For example, in trying to determine participation in the RAD program by year, we received several thousand PBRA entries that preceded the establishment of the RAD program. Moreover, as we previously mentioned, the postconversion household data for PBRA conversions is in a separate data system, so some variables, such as those related to race, ethnicity, rent, and income, differ from the other household data for that program. Because of these limitations, the data for PBRA households were not reliable for purposes of comparing RAD household characteristics before and after conversion as we had intended. To describe safeguards for residents and help ascertain how HUD implemented protections, we reviewed legal protections and requirements in HUD notices, reviewed selected conversion files, and interviewed HUD officials about monitoring and compliance processes. Finally, as previously described, we held focus groups with residents to better understand any effects on their living conditions and quality of life. To determine challenges PHAs faced in implementing RAD, we reviewed HUD guidance and related documents for PHAs in the program. We also interviewed eight PHAs during our site visits and spoke with another 10 PHAs by telephone about the benefits and challenges of participating in the RAD program. To examine provisions designed to help preserve long-term affordability of units, we reviewed the RAD authorizing statute and amendments and HUD notices and interviewed HUD staff to verify our understanding of agency affordability protections. For a sample of 31 randomly selected properties, we examined templates for contractual agreements for RAD closings and analyzed closing documents and contracts to determine if agreements matched program requirements. We interviewed HUD staff and staff of 18 PHAs to obtain viewpoints on the potential strengths or weaknesses of preservation in the case of default or foreclosure. We conducted this performance audit from February 2016 to February 2018 in accordance with generally accepted government auditing standards. Those standards require that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions based on our audit objectives. We believe that the evidence obtained provides a reasonable basis for our findings and conclusions based on our audit objectives. The Department of Housing and Urban Development’s (HUD) Office of Recapitalization collects financial sources and use data from Rental Assistance Demonstration (RAD) participants. Table 2 lists the financial source fields collected by HUD. Table 3 lists the financial cost fields collected by HUD. Table 4 provides additional financial source detail pertaining to HUD’s leverage ratio calculation. Table 5 and Table 6 show the total financial source amounts collected by HUD. Specifically, Table 5 shows total financial source amounts prior to recategorization, while Table 6 shows total financial source amounts after manual adjustments. Manual adjustments included isolating funding source observations in “other funding” fields 1-6 and incorporating them into existing fields, as appropriate. Table 7 replicates HUD’s methodology for calculating the RAD leverage metrics after manual adjustments in HUD data. See Table 4, above, to compare changes in each category. Table 8 recalculates the leverage ratio by deducting federal sources as leveraged sources. Table 9 recalculates the leverage ratio by deducting public sources as leveraged sources (compare to Table 8 above). The Rental Assistance Demonstration (RAD) program has numerous requirements intended to ensure residents whose units are converted through RAD receive certain protections. The following is a description of these safeguards and their reporting and monitoring requirements. The Government Accountability Office, the audit, evaluation, and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO’s commitment to good government is reflected in its core values of accountability, integrity, and reliability. The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO’s website (https://www.gao.gov). Each weekday afternoon, GAO posts on its website newly released reports, testimony, and correspondence. To have GAO e-mail you a list of newly posted products, go to https://www.gao.gov and select “E-mail Updates.” The price of each GAO publication reflects GAO’s actual cost of production and distribution and depends on the number of pages in the publication and whether the publication is printed in color or black and white. Pricing and ordering information is posted on GAO’s website, https://www.gao.gov/ordering.htm. Place orders by calling (202) 512-6000, toll free (866) 801-7077, or TDD (202) 512-2537. Orders may be paid for using American Express, Discover Card, MasterCard, Visa, check, or money order. Call for additional information. Connect with GAO on Facebook, Flickr, Twitter, and YouTube. Subscribe to our RSS Feeds or E-mail Updates. Listen to our Podcasts. Visit GAO on the web at https://www.gao.gov. James-Christian Blockwood, Managing Director, spel@gao.gov, (202) 512-4707 U.S. Government Accountability Office, 441 G Street NW, Room 7814, Washington, DC 20548 Please Print on Recycled Paper. In addition to the individual named above, Paul Schmidt (Assistant Director), Julie Trinder-Clements (Analyst in Charge), Meghana Acharya, Enyinnaya David Aja, Alyssia Borsella, Juan J. Garcia, Ron La Due Lake, Amanda Miller, Marc Molino, Barbara Roesmann, Jessica Sandler, MaryLynn Sergent, Rachel Stoiko, and William Woods made major contributions to this report.

 

 Report 2:
Agencies generally acquire equipment from commercial vendors and through GSA, which contracts for the equipment from commercial vendors. In acquiring heavy equipment from a commercial vendor or GSA, agencies can purchase or lease the equipment. Generally, agencies use the term “lease” to refer to acquisitions that are time-limited and therefore distinct from purchases. The term “lease” is used to refer to both long-term and short-term leases. For example, the three agencies we reviewed in-depth use the term “rental” to refer to short-term leases of varying time periods. According to Air Force officials, they define rentals as leases that are less than 120 days while FWS and NPS officials said they generally use the term rental to refer to leases that are a year or less. For the purposes of this report, we use the term “rental” to refer to short-term leases defined as rentals by the agency and “long-term lease” to refer to a lease that is not considered a rental by the agency. (See fig. 1.) In 2013, GSA began offering heavy equipment through its Short-Term Rental program, which had previously been limited to passenger vehicles, in part to eliminate ownership and maintenance cost for infrequently used heavy equipment. Under this program, agencies can request a short-term equipment rental (less than a year) from GSA, and GSA will work with a network of commercial vendors to provide the requested heavy equipment. Unlike for some other types of federal property, there are no central reporting requirements for agencies’ inventories of heavy equipment. However, each federal agency is required to maintain inventory controls for its property, which includes heavy equipment. Agencies maintain inventory data through the use of agency-specific databases, and each agency can set its own requirements for what data are required and how these data are maintained. For example, while an agency may choose to maintain data in a headquarters database, it could also choose to maintain data at the local level. As another example, an agency may decide to track and maintain data on the utilization of its heavy equipment (such as the hours used) or may choose not to have such data or require any particular utilization levels. The Federal Acquisition Regulation (FAR) governs the acquisition process of executive branch agencies when acquiring certain goods and services, including heavy equipment. Under the FAR, agencies should consider whether to lease equipment instead of purchasing it based on several factors. Specifically, the FAR provides that agency officials should evaluate cost and other factors by conducting a “lease-versus-purchase” analysis before acquiring heavy equipment. Additionally, DOD’s regulations require its component agencies to prepare a justification supporting lease-versus-purchase decisions if the equipment is to be leased for more than 60 days. Twenty agencies reported data on their owned heavy equipment, including the (1) number, (2) types, (3) acquisition year, and (4) location of agencies’ owned heavy equipment in their inventories as of June 2017. The 20 agencies reported owning over 136,000 heavy equipment items. DOD reported owning most of this heavy equipment—over 100,000 items, about 74 percent. (See app. I for more information on agencies’ ownership of these items.) The Department of Agriculture reported owning the second highest number of heavy equipment items—almost 9,000 items, about 6 percent. (See fig. 2.) Four agencies—the Nuclear Regulatory Commission, the Department of Housing and Urban Development, the Office of Personnel Management, and the Agency for International Development—reported owning five or fewer heavy equipment items each. The 20 agencies reported owning various types of heavy equipment, such as cranes, backhoes, and road maintenance equipment in five categories: (1) construction, mining, excavating, and highway maintenance equipment; (2) airfield-specialized trucks and trailers; (3) self-propelled warehouse trucks and tractors; (4) tractors; and (5) soil preparation and harvesting equipment. Thirty-eight percent (almost 52,000 items) were in the construction, mining, excavating, and highway maintenance category (see fig. 3). Fifteen of the 20 agencies reported owning at least some items in this category. Twenty-four percent (over 33,000 items) were in the airfield- specialized trucks and trailers category, generally used to service and re-position aircraft on runways. DOD reported owning 99 percent (over 32,000) of these items, while 9 other agencies, including the Department of Labor and the National Aeronautics and Space Administration, reported owning the other one percent (317 items). Twenty-two percent (over 29,000 items) were in the self-propelled warehouse trucks and tractors category, which includes equipment such as forklift trucks. All 20 agencies reported owning at least one item in this category, and five agencies—the Agency for International Development, Department of Housing and Urban Development, the Environmental Protection Agency, the Nuclear Regulatory Commission, and the Office of Personnel Management—reported owning only items in this category. (For additional information on agencies’ ownership of heavy equipment in various categories, see app. I.) The twenty agencies reported acquiring their owned heavy equipment between 1944 and 2017, with an average of about 13 years since acquisition (see fig. 4). One heavy equipment manager we interviewed reported that a dump truck can last 10 to 15 years, whereas other types of equipment can last for decades if regularly used and well-maintained. The 20 agencies reported that over 117,000 heavy equipment items (86 percent) were located within the United States or its territories. Of these, about one-fifth (over 26,000) were located in California and Virginia, the two states with the most heavy equipment (see fig. 5). Of the equipment located outside of the United States and its territories, 94 percent was owned by the Department of Defense. The rest was owned by the Department of State (714 items in 141 countries from Afghanistan to Zimbabwe) and the National Science Foundation (237 items in areas such as Antarctica). The twenty agencies reported spending over $7.4 billion in 2016 dollars to acquire the heavy equipment they own (see table 1). However, actual spending was higher because this inflation-adjusted figure excludes over 37,000 heavy equipment items for which the agencies did not report acquisition cost or acquisition year, or both. Without this information, we could not determine the inflation-adjusted cost and therefore did not include the cost of these items in our calculation. The Army owns almost all of these items, having not reported acquisition cost or acquisition year, or both, for 36,589 heavy equipment items because, according to Army officials, the data were not available centrally but may have been available at individual Army units and would have been resource- intensive to obtain. The heavy equipment items reported by the 20 agencies ranged in acquisition cost from zero dollars to over $2 million in 2016 dollars, with an average acquisition cost in 2016 dollars of about $78,000, excluding assets with a reported acquisition cost of $0. Of the items which we adjusted to 2016 dollars and for which non-zero acquisition costs were provided: 94 percent cost less than $250,000 and accounted for 57 percent of the total adjusted acquisition costs (See fig. 6.) 6 percent of items cost more than $250,000 and accounted for 43 percent of the adjusted acquisition costs. (See fig. 6.) High-cost items included a $779,000 hydraulic crane acquired by the National Aeronautics and Space Administration in 1997 ($1.2 million in 2016 dollars), a $1.4 million ultra-deep drilling simulator acquired by the Department of Energy in 2009 ($1.6 million in 2016 dollars), and several $2.2 million well-drilling machines acquired by the Air Force in 2013 ($2.3 million in 2016 dollars). In calendar years 2012 through 2016, the Air Force, FWS, and NPS purchased almost 3,500 pieces of heavy equipment through GSA and private vendors at a total cost of about $360 million to support mission needs. (See table 2.) These agencies also spent over $5 million on long- term leases and rentals during this time period. The Air Force spent over $300 million to purchase over 2,600 heavy equipment assets in calendar years 2012 through 2016 that were used to support and maintain its bases globally. For example, according to Air Force officials, heavy equipment is often used to maintain runways and service and reposition aircraft on runways. While the majority of Air Force heavy equipment purchased in this time period is located in the United States, 41 percent of this heavy equipment is located outside the United States and its territories in 17 foreign countries to support global military bases. The Air Force could not provide complete information on its heavy equipment leases for fiscal years 2012 through 2016. Specifically, the Air Force provided data on 33 commercial heavy equipment leases that were ongoing as of August 2017 but could not provide cost data for these leases because this information is not tracked centrally. Additionally, the Air Force could not provide any data on leases that occurred previously because, according to Air Force officials, lease records are removed from the Air Force database upon termination of the lease. Officials said that rentals are generally handled locally and obtaining complete data would require a data call to over 300 base contracting offices. Air Force officials stated that rentals are generally used in unique situations involving short- term needs such as responding to natural disasters. For example, following Hurricane Sandy, staff at Langley Air Force Base in Virginia used rental equipment to clean up and repair the base. Although Air Force did not provide complete information on rentals, data we obtained from GSA’s Short-Term Rental program indicated that Air Force rented heavy equipment in 46 transactions not reflected in the Air Force data we received totaling over $3.7 million since GSA began offering heavy equipment through its Short-Term Rental program, which had previously been limited to passenger vehicles, in part program in 2013. FWS spent over $32 million to purchase 348 heavy equipment assets from calendar years 2012 through 2016. FWS used its heavy equipment to maintain refuge areas throughout the United States and its territories, including maintaining roads and nature trails. FWS also used heavy equipment to respond to inclement weather and natural disasters. Most of the heavy equipment items purchased by FWS were in the construction, mining, excavating, and highway maintenance equipment category and include items such as excavators, which were used for moving soil, supplies, and other resources. FWS officials reported that they did not have any long-term leases for any heavy equipment in fiscal years 2012 through 2016 because they encourage equipment sharing and rentals to avoid long-term leases whenever possible. FWS officials provided data on 228 rentals for this time period with a total cost of over $1 million. Information regarding these rentals is contained in an Interior-wide property management system, the Financial Business Management System (FBMS). FWS officials told us that they have not rented heavy equipment through GSA’s program because they have found lower prices through local equipment rental companies. NPS spent over $27 million to purchase 471 heavy equipment assets from calendar years 2012 through 2016. NPS uses heavy equipment— located throughout the United States and its territories—to maintain national parks and respond to inclement weather and natural disasters. For example, NPS used heavy equipment such as dump trucks, snow plows, road graders, and wheel loaders to clear and salt the George Washington Memorial Parkway in Washington, D.C., following snow and ice storms. Most of the heavy equipment items purchased by NPS were in the construction, mining, excavating, and highway maintenance equipment category and include items such as excavators, which are used for moving soil, supplies, and other resources. NPS reported spending about $360,000 on 230 long-term leases and rentals in fiscal years 2012 through 2016, not including rentals through GSA’s Short-Term Rental program, which had previously been limited to passenger vehicles, in part program. As with FWS, NPS leases and rentals are contained in FBMS, which is Interior’s property management system. Data we obtained from GSA’s Short-Term Rental program, which had previously been limited to passenger vehicles, in part program indicated that NPS rented heavy equipment in 26 transactions totaling over $200,000 since GSA began offering heavy equipment through its Short-Term Rental program, which had previously been limited to passenger vehicles, in part program in 2013, for a potential total cost of over $560,000 for these long-term leases and rentals. As mentioned earlier, the FAR provides that executive branch agencies seeking to acquire equipment should consider whether it is more economical to lease equipment rather than purchase it and identifies factors agencies should consider in this analysis, such as estimated length of the period that the equipment is to be used, the extent of use in that time period, and maintenance costs. This analysis is commonly referred to as a lease-versus-purchase analysis. While the FAR does not specifically require that agencies document their lease-versus-purchase analyses, according to federal internal control standards, management should clearly document all transactions and other significant events in a manner that allows the documentation to be readily available for examination and also communicate quality information to enable staff to complete their responsibilities. As discussed below, we found that most acquisitions we reviewed from FWS, NPS, and the Air Force did not contain any documentation of a lease-versus-purchase analysis. Specifically, officials were unable to provide documentation of a lease-versus-purchase analysis for six of the eight acquisitions we reviewed. FWS officials were able to provide documentation for the other two. Officials told us that a lease-versus- purchase analysis was not conducted for five of the six acquisitions and did not know if such analysis was conducted for the other acquisition. According to agency officials, the main reason why analyses were not conducted or documented for these six acquisitions is that the circumstances in which such analyses were to be performed or documented were not always clear to FWS, NPS, and Air Force officials. In addition to the FAR, Interior has agency guidance stating that bureaus should conduct and document lease-versus-purchase analyses. This July 2013 guidance—that FWS and NPS are to follow—states that requesters of equipment valued at $15,000 or greater should perform a lease-versus- purchase analysis when requesting heavy equipment. According to the guidance, this analysis should address criteria in the FAR and include a discussion of the financial and operating advantages of alternate approaches that would help contracting officials determine the final appropriate acquisition method. At the time the guidance was issued, Interior also provided a lease-versus-purchase analysis tool to aid officials in conducting this analysis. Additionally, in April 2016, Interior issued a policy to implement the July 2013 guidance. The 2016 policy clarifies that program offices are required to complete Interior’s lease-versus-purchase analysis tool and provide the completed analysis to the relevant contracting officer. Within Interior, bureaus are responsible for ensuring that procurement requirements are met, including the requirements and directives outlined in Interior’s 2013 guidance and 2016 policy on lease-versus-purchase analyses, according to agency officials. Within FWS, local procurement specialists prepare procurement requests and ensure that procurement requirements are met and that all viable options have been considered. Regional equipment managers review these procurement requests, decide whether to purchase or lease the requested equipment, and prepare the lease-versus-purchase analysis tool if the procurement specialist has indicated that it is required. Within NPS, local procurement specialists are responsible for ensuring that all procurements adhere to relevant requirements and directives, including documenting the lease- versus-purchase analysis. Of the three FWS heavy equipment acquisitions we reviewed for which the 2013 Interior guidance was applicable, one included a completed lease-versus-purchase analysis tool; one documented the rationale for purchasing rather than leasing, although it did not include Interior’s lease- versus-purchase analysis tool; and one did not include any documentation related to a lease-versus-purchase analysis. (See table 3.) Regarding the acquisition for which no documentation of a lease-versus- purchase analysis was provided—a 12-month lease of an excavator and associated labor costs for over $19,000—FWS officials initially told us that a lease-versus-purchase analysis was not required because the equipment lease was less than $15,000, and Interior’s guidance required a lease-versus-purchase analysis for procurements of equipment valued at $15,000 or greater. However, we found the guidance did not specify whether the $15,000 threshold includes the cost of labor. We also found that Interior’s guidance did not specify if a lease-versus-purchase analysis was required if the total cost of a rental is less than the purchase price. FWS officials acknowledged that Interior guidance is not clear and that it would be helpful for Interior to clarify whether these leases require a lease-versus-purchase analysis. NPS officials were unable to provide documentation of a lease-versus- purchase analysis for the single heavy equipment acquisition we reviewed—the purchase of a wheeled tractor in 2015 for $43,177. According to these officials, they could not do so because of personnel turnover in the contracting office that would have documented the analysis. In addition, they told us that they believe that such analyses are not always completed for heavy equipment acquisitions because responsibility for completing these analyses is unclear. Specifically, they told us that it was unclear whether the responsibility lies with the official requesting the equipment, the contracting personnel who facilitate the acquisition, or the property personnel who manage inventory data. However, when we discussed our findings with Interior and NPS officials, NPS officials were made aware of the 2016 Interior policy that specifically requires program offices—the officials requesting the equipment—to complete the lease-versus-purchase analysis and provide documentation of this analysis to the contracting officer. As a result, NPS officials told us at the end of our review that program office officials will now be required to complete the lease-versus-purchase analysis tool and document this analysis. According to Air Force officials responsible for managing heavy equipment, financial or budget personnel at individual bases are responsible for conducting lease-versus-purchase analyses, also called economic analyses, to support purchase and lease requests. Air Force fleet officials told us that they then review these requests from a fleet perspective, considering factors such as whether the cost information provided in the request is from a reputable source, expected maintenance costs, and whether a requesting base has the capability to maintain the requested equipment. However, they said they do not check to ensure that a lease-versus-purchase analysis was completed or review the analysis. Equipment rentals can be approved at individual bases. In our review of four Air Force heavy equipment acquisitions, we found no instances in which Air Force officials documented a lease-versus- purchase analysis (see table 4). For the acquisitions that we reviewed, Air Force officials told us they did not believe a lease-versus-purchase analysis was required because the new equipment was either replacing old equipment that was previously approved or could be deployed. Accordingly, the Air Force purchased two forklifts in 2013 without conducting lease-versus-purchase analyses because the forklifts were replacing old forklifts that were authorized in 1997 and 2005. Furthermore, Air Force officials told us that both of these forklifts could be deployed and indicated that lease-versus-purchase analyses are not required for deployable equipment. However, the Air Force does not have guidance that describes the circumstances that require either a lease-versus-purchase analysis or documentation of the rationale for not completing such analysis. Although we identified several instances in which officials in the three selected agencies did not document lease-versus-purchase analyses, officials from these agencies stated that they consider mission needs and equipment availability, among other factors, when making these decisions. For example, Air Force officials told us following Hurricane Sandy, staff at Langley Air Force Base in Virginia used rental equipment to clean and repair the base because the equipment was needed immediately to ensure the base could meet its mission. Moreover, availability of heavy equipment for lease or rental, which can be affected by factors such as geography and competition for equipment, is a key consideration. For example, FWS officials told us that the specialized heavy equipment sometimes needed may not be available for long-term lease or rent in remote areas such as Alaska and the Midway Islands, so the agency purchases the equipment. In addition, some agency officials told us that they may purchase heavy equipment even if that equipment is needed only sporadically if there is likely to be high demand for rental equipment. For example, following inclement weather or a natural disaster, demand for certain heavy equipment rentals can be high and equipment may not be available to rent when it is needed. While we recognize that mission needs and other factors are important considerations, without greater clarity regarding when to conduct or document lease-versus-purchase analyses, officials at FWS, NPS, and Air Force may not be conducting such analyses when appropriate and may not always make the best acquisition decisions. These agencies could be overspending on leased equipment that would be more cost- effective if purchased or overspending to purchase equipment when it would be more cost-effective to lease or rent. Moreover, without documenting decisions on whether to purchase or lease equipment, they lack information that could be used to inform future acquisition decisions for similar types of equipment or projects. Air Force guidance requires that fleet managers collect utilization data for both vehicles and heavy equipment items, such as the number of hours used, miles traveled, and maintenance costs. The Air Force provided us with utilization data for over 18,000 heavy equipment items and uses such data to inform periodic base validations. Specifically, Air Force officials said that every 3 to 5 years each Air Force base reviews the on- base equipment to ensure that the installation has the appropriate heavy equipment to complete its mission and reviews utilization data to identify items that are underutilized. If heavy equipment is considered underutilized, the equipment is relocated—either moved to another location or sent to the Defense Logistics Agency for reuse or transfer to another agency. According to Air Force officials the Air Force has relocated over 700 heavy equipment items based on the results of the validation process and other factors such as replacing older items and agency needs since 2014. Similarly, FWS guidance for managing heavy equipment utilization sets forth minimum utilization hours for certain types of heavy equipment and describes requirements for reporting utilization data. FWS provided us with utilization data on over 3,000 heavy equipment items. According to officials, condition assessments of heavy equipment are required by FWS guidance every 3 to 5 years. According to FWS officials, condition assessments inform regional-level decision making about whether to move equipment to another FWS location or dispose of the equipment. In contrast, NPS does not require the collection of utilization data to evaluate heavy equipment use and does not have guidance for managing heavy equipment utilization. However, NPS officials told us that they recognize the need for such guidance. NPS officials shared with us draft guidance that they have developed, which would require collection of utilization data for heavy equipment such as hours or days of usage each month. According to NPS officials, they plan to send the guidance to the NPS policy office for final review in March 2018. Until this guidance is completed and published, NPS is taking interim actions to manage the utilization of its heavy equipment. For example, NPS officials stated that they have asked NPS locations to collect and post monthly utilization data, discussed the collection of utilization data at fleet meetings, and distributed job aids to support this effort. During the course of our review, NPS officials provided us with some utilization data for about 1,400 of the more than 2,400 NPS heavy equipment items. Specifically, for the 1,459 heavy equipment items for which NPS provided utilization data, 541 items had utilization data for each month. For the remaining 918 items, utilization data were reported for some, but not all months. The federal government has spent billions of dollars to acquire heavy equipment. There is no requirement that agencies report on the inventory of this equipment, as there is no standard definition of heavy equipment. When deciding how to acquire this equipment, agencies’ should conduct a lease-versus-purchase analysis as provided in the FAR, which is a critical mechanism to ensure agencies are acquiring the equipment in the most cost-effective manner. Because FWS, NPS and the Air Force were unclear when such an analysis was required, they did not consistently conduct or document analyses of whether it was more economical to purchase or lease heavy equipment. In the absence of clarity on the circumstances in which lease-versus-purchase analyses for heavy equipment acquisitions are to be conducted and documented, the agencies may not be spending funds on heavy equipment cost- effectively. We are making two recommendations—one to the Air Force and one to the Department of the Interior. The Secretary of the Air Force should develop guidance to clarify the circumstances in which lease-versus-purchase analyses for heavy equipment acquisitions are to be conducted and documented. (Recommendation 1) The Secretary of the Interior should further clarify in guidance the circumstances in which lease-versus-purchase analyses for heavy equipment acquisitions are to be conducted and documented. (Recommendation 2) We provided a draft of this report to the Departments of Agriculture, Defense, Energy, Homeland Security, Housing and Urban Development, the Interior, Justice, Labor, State, and Veterans Affairs; General Services Administration; National Aeronautics and Space Administration; National Science Foundation; Nuclear Regulatory Commission; Office of Personnel Management; and U.S. Agency for International Development. The departments of Agriculture, Energy, Homeland Security, Housing and Urban Development, Justice, State and Veterans Affairs, as well as the General Services Administration, National Aeronautics and Space Administration, National Science Foundation, Nuclear Regulatory Commission, Office of Personnel Management; and U.S. Agency for International Development did not have comments. The Department of Labor provided technical comments, which we incorporated as appropriate. In written comments, reproduced in appendix III, the Department of Defense stated that it concurred with our recommendation and plans to issue a bulletin to Air Force contracting officials. In written comments, reproduced in appendix IV, the Department of the Interior stated that it concurred with our recommendation and plans to implement it. If you or members of your staff have any questions about this report, please contact me at (202) 512-2834 or RectanusL@gao.gov. Contact points for our Offices of Congressional Relations and Public Affairs may be found on the last page of this report. Major contributors to this report are listed in appendix V. Specialized Trucks and Trailers 37 . Self-Propelled Warehouse Trucks and Tractors 1,733 3 . . . . . . . . . . . . . . . . . . . Specialized Trucks and Trailers 7 . Self-Propelled Warehouse Trucks and Tractors 2,925 134 . . . . . . . . . . . . . . . . . . Specialized Trucks and Trailers . Self-Propelled Warehouse Trucks and Tractors 146 . . . . . . 7 . . . - 109 . . . Self-Propelled Warehouse Trucks and Tractors 575 64 40 . . . . . . . . . . . 4 . . . . . . . . . Nuclear Regulatory Commission Office of Personnel Management Social Security Administration United States Agency for International Development Grand Total . . . . This report addresses: (1) the number, type, and cost of heavy equipment items that are owned by the 24 CFO Act agencies; (2) the heavy equipment items selected agencies have recently acquired and how selected agencies decided to purchase or lease this equipment; and (3) how selected agencies manage the utilization of their heavy equipment. To identify the number, type, and cost of heavy equipment owned by federal agencies, we first interviewed officials at the General Services Administration to determine whether there were government-wide reporting requirements for owned heavy equipment and learned that there are no such requirements. We then obtained and analyzed data on agencies’ spending on equipment purchases and leases from the Federal Procurement Data System–Next Generation (FPDS-NG), which contains government-wide data on agencies’ contracts. However, in reviewing the data available and identifying issues with the reliability of the data, we determined that data on contracts would not be sufficient to answer the question of what heavy equipment the 24 CFO Act agencies own. We therefore conducted a data collection effort to obtain heavy equipment inventory information from the 24 CFO Act agencies, which are the Departments of Agriculture, Commerce, Defense, Education, Energy, Health and Human Services, Homeland Security, Housing and Urban Development, the Interior, Justice, Labor, State, Transportation, the Treasury, and Veterans Affairs; Environmental Protection Agency; General Services Administration; National Aeronautics and Space Administration; National Science Foundation; Nuclear Regulatory Commission; Office of Personnel Management; Small Business Administration; Social Security Administration; and Agency for International Development. Because there is no generally accepted definition of heavy equipment, we identified 12 federal supply classes in which the majority of items are self- propelled equipment but not passenger vehicles or items that are specific to combat and tactical purposes, as these items are generally not considered to be heavy equipment. (See table 5.) We then vetted the appropriateness of these selected supply classes with Interior, FWS, NPS, and Air Force agency officials, as well as with representatives from a fleet management consultancy and a rental company, and they generally agreed that items in selected federal supply classes are considered heavy equipment. Federal supply classes are used in FPDS- NG and are widely used in agencies’ inventory systems. Overall, about 90 percent of the heavy equipment items that agencies reported were assigned a federal supply class in the agency’s inventory data. In discussing heavy equipment categories in the report, we use the category titles below. To identify points of contact at the 24 CFO Act agencies, we obtained GSA’s list of contact information for agencies’ national utilization officers, who are agency property officers who coordinate with GSA. As a preliminary step, we contacted these individuals at each of the 24 CFO Act agencies and asked them to either confirm that they were the appropriate contacts or provide contact information for the appropriate contact and to inform us if they do not own heavy equipment. Officials at 4 agencies—Department of Education, Department of the Treasury, General Services Administration, and Small Business Administration— indicated that the agency did not own any items in the relevant federal supply classes. Officials at 16 of these agencies indicated that they would be able to respond on a departmental level because the relevant inventory data are maintained centrally, while officials at 4 agencies indicated that we would need to obtain responses from officials at some other level because the relevant inventory data are not maintained centrally. (See table 7 for a list of organizations within the 20 CFO Act agencies that indicated they own relevant equipment and responded to our data collection effort.) After identifying contacts responsible for agencies’ heavy-equipment inventory data, we prepared data collection instruments for requesting information on heavy equipment and tested these documents with representatives from 4 of the 20 CFO Act agencies that indicated they own heavy equipment to ensure that the documents were clear and logical and that respondents would be able to provide the requested data and answer the questions without undue burden. These agency representatives were selected to provide a variety of spending on federal supply group 38 equipment as reported in FPDS-NG, civilian and military agencies, and different levels at which the agency would be responding to the data collection effort (e.g., at the departmental level or at a sub- departmental level). Our data collection instrument requested the following data on respondent organizations’ owned assets in 12 federal supply classes as of June 2017: Respondents provided data on original acquisition costs in nominal terms, with some acquisitions occurring over 50 years ago. In order to provide a fixed point of reference for appropriate comparison, we present in our report inflation-adjusted acquisition costs using calendar year 2016 as the reference. To adjust these dollar amounts for inflation, we used the Bureau of Labor Statistic’s Producer Price Index by Commodity for Machinery and Equipment: Construction Machinery and Equipment (WPU112), compiled by the Federal Reserve Bank of St. Louis. We conducted the data collection effort from July 2017 through October 2017 and received responses from all 20 agencies that indicated they own heavy equipment. In order to assess the reliability of agencies’ reported data, we collected and reviewed agencies’ responses regarding descriptions of their inventory systems, frequency of data entry, agency uses of the data, and agencies’ opinions on potential limitations of the use of their data in our analysis. We conducted some data cleaning, which included examining the data for obvious errors and eliminating outliers. We did not verify the data or responses received; the results of our data collection effort are used only for descriptive purposes and are not generalizable beyond the 24 CFO Act agencies. Based on the steps we took, we found these data to be sufficiently reliable for our purposes. To determine the heavy equipment items that selected agencies recently acquired and how these agencies decided whether to purchase or lease this equipment, we first used data from the FPDS-NG to identify agencies that appeared to have the highest obligations for construction or heavy equipment, or both, and used this information, along with other factors, to select DOD and Interior. At the time, in the absence of a generally accepted definition of heavy equipment, we reviewed data related to federal supply group 38—construction, mining, excavating, and highway maintenance equipment—because (1) we had not yet defined heavy equipment for the purposes of our review; (2) agency officials had told us that most of what could be considered heavy equipment was in this federal supply group; and (3) our analysis of data from usaspending.gov showed that about 80 percent of spending on items that may be considered heavy equipment were in this federal supply group. In meeting with officials at these departments, we learned that agencies within each department manage heavy equipment independently, so we requested current inventory data for Interior bureaus and the DOD military departments and selected three agencies that had among the largest inventories of construction and/or heavy equipment at the time, among other criteria: the U.S. Air Force (Air Force); the Fish and Wildlife Service (FWS); and the National Park Service (NPS). We then used information from our data collection effort—which included the number, type, cost, acquisition year and other data elements—to determine heavy equipment items that these agencies acquired during 2012 through 2016. We interviewed agency officials to determine what lease data were available from the three selected agencies. We assessed the reliability of these data with agency official interviews and reviewed the data for completeness and potential outliers. We determined that the data provided were sufficiently reliable for the purposes of documenting leased and rental heavy equipment. We also obtained data from GSA’s Short- Term Rental program, which had previously been limited to passenger vehicles, in part program for August 2012, when the first item was rented under this program, to February 2017, when GSA provided the data. We used these data to identify selected agencies’ rentals of heavy equipment through GSA’s Short-Term Rental program, which had previously been limited to passenger vehicles, in part program and associated costs. We interviewed officials from GSA’s Short-Term Rental program to discuss the program history as well as the reliability of their data on these rented heavy equipment items. We determined that the data were sufficiently reliable for our purposes. To determine how the three selected agencies decide whether to purchase or lease heavy equipment, we interviewed fleet and property managers at these selected agencies and asked them to describe their process for making these decisions as well as to identify relevant federal and agency regulations and guidance. We reviewed relevant federal and agency regulations and guidance regarding how agencies should make these decisions, including: Federal Acquisition Regulation, Office of Management Budget’s A-94, Guidelines and Discount Rates for Benefit- Cost Analysis of Federal Programs, Defense Federal Acquisition Regulation Supplement, Air Force Manual 65-506, Air Force Guidance Memorandum to Air Force Instruction 65-501, and Interior’s Guidance On Lease Versus Purchase Analysis and Capital Lease Determination for Equipment Leases. We also reviewed the Standards for Internal Control in the Federal Government for guidance on documentation as well as past GAO work that reviewed agencies’ lease-versus-purchase analyses. To determine whether the three selected federal agencies documented lease-versus-purchase decisions for selected acquisitions and adhered to relevant agency guidance, we selected and reviewed a non-generalizable sample of 10 heavy equipment acquisitions—two purchases each from the Air Force, FWS, and NPS, and two leases each from the Air Force and FWS. Specifically, we used inventory data obtained through our data collection effort, described above, to randomly select two heavy equipment purchases from each selected agency using the following criteria: calendar years 2012 through 2016; the two federal supply classes most prevalent in each selected agency’s heavy equipment inventory, as determined by the data collection effort described above; and for NPS and FWS, acquisition costs of over $15,000. In addition, we used lease data provided by the Air Force and FWS to randomly selected two heavy equipment leases per agency. Because NPS could not provide data on heavy equipment leases, we did not select or review any NPS lease decisions. To select the Air Force and FWS leases we used the following criteria: fiscal years 2012 through 2016; for the Air Force, which included federal supply classes in the lease data provided, the two federal supply classes most prevalent in the lease data and for FWS, which did not include federal supply class in the lease data provided, the two federal supply classes most prevalent in the purchase data; and for FWS, leases over $15,000. After selecting these acquisitions, we determined that one FWS lease and one NPS purchase we selected pre-dated Interior’s 2013 guidance on lease-versus-purchase analysis and excluded these acquisitions from our analysis for a total of eight acquisitions. In reviewing agencies’ documentation related to these acquisitions, we developed a data collection instrument to assess the extent to which agencies documented lease-versus-purchase analyses and, in the case of FWS and NPS, adhered to relevant Interior guidance. We supplemented our review of these acquisition decisions with additional information by interviewing officials at the three selected agencies and requesting additional information to understand specific circumstances surrounding each procurement. Our findings are not generalizable across the federal government or within each selected department. To determine how selected agencies manage heavy equipment utilization, we interviewed officials at the three selected agencies to identify departmental and agency-specific guidance and policies and to determine whether utilization requirements exist. We reviewed guidance identified by these officials, including Interior and Air Force vehicle guidance, both of which apply to heavy equipment, and FWS’s Heavy Equipment Utilization and Replacement Handbook. We also compared their practices to relevant Standards for Internal Control in the Federal Government. For the selected agencies with guidance for managing heavy equipment—Air Force and FWS—we reviewed the guidance to determine if and how selected agencies measured and documented heavy equipment utilization. For example, we reviewed whether selected agencies developed reports for managing heavy equipment utilization such as Air Force validation reports and FWS conditional assessment reports. We also reviewed Air Force, FWS, and NPS utilization data for heavy equipment but we did not independently calculate or verify the utilization rate for individual heavy equipment items because each heavy equipment item (backhoe, forklift, tractor, etc.,) has different utilization requirements depending on various factors such as the brand, model, or age of equipment. However, we did request information about agency procedures to develop and verify utilization rates. We assessed the reliability of the utilization data with agency official interviews and a review of the data for completeness and potential outliers. We determined that the data were sufficiently reliable for the purposes of providing evidence of utilization data collection for heavy equipment assets. We also visited the NPS George Washington Memorial Parkway to interview equipment maintenance officials regarding the procurement and management of heavy equipment and to document photos of heavy equipment. We selected this site because of its range of heavy equipment and close proximity to the Capital region. We conducted this performance audit from October 2016 to February 2018 in accordance with generally accepted government auditing standards. Those standards require that we plan and perform the audit to obtain sufficient, appropriate evidence to provide a reasonable basis for our findings and conclusions based on our audit objectives. We believe that the evidence obtained provides a reasonable basis for our findings and conclusions based on our audit objectives. In addition to the individual named above, John W. Shumann (Assistant Director), Rebecca Rygg (Analyst in Charge), Nelsie Alcoser, Melissa Bodeau, Terence Lam, Ying Long, Josh Ormond, Kelly Rubin, Crystal Wesco, and Elizabeth Wood made key contributions to this report.

Question: Write a one-page summary of the report 1.

Answer: HUD administers the Public Housing program, which provides federally assisted rental units to low-income households through PHAs. In 2010, HUD estimated its aging public housing stock had $25.6 billion in unmet capital needs. To help address these needs, the RAD program was authorized in fiscal year 2012. RAD allows PHAs to move (convert) properties in the public housing program to Section 8 rental assistance programs, and retain property ownership or transfer it to other entities. The conversion enables PHAs to access additional funding, including investor equity, generally not available for public housing properties. GAO was asked to review public housing conversions under RAD and any impact on residents. This report addresses, among other objectives, HUD's (1) assessment of conversion outcomes; (2) oversight of resident safeguards; and (3) provisions to help preserve the long-term affordability of units. GAO analyzed data on RAD conversions through fiscal year 2017; reviewed a sample of randomly selected, nongeneralizable RAD property files; and interviewed HUD officials, PHAs, developers, academics, and affected residents. The Department of Housing and Urban Development (HUD) put procedures in place to evaluate and monitor the impact of conversion of public housing properties under the Rental Assistance Demonstration (RAD) program. RAD's authorizing legislation requires HUD to assess and publish findings about the amount of private-sector leveraging. HUD uses a variety of metrics to measure conversion outcomes. But, the metric HUD uses to measure private-sector leveraging—the share of private versus public funding for construction or rehabilitation of assisted housing—has limitations. For example, HUD's leveraging ratio counts some public resources as leveraged private-sector investment and does not use final (post-completion) data. As a result, HUD's ability to accurately assess private-sector leveraging is limited. HUD does not systematically use its data systems to track effects of RAD conversions on resident households (such as changes in rent and income, or relocation) or monitor use of all resident safeguards. Rather, since 2016, HUD has required public housing agencies (PHA) or other post-conversion owners to maintain resident logs and collect such information. But the resident logs do not contain historical program information. HUD has not developed a process for systematically reviewing information from its data systems and resident logs on an ongoing basis. HUD has been developing procedures to monitor compliance with some resident safeguards—such as the right to return to a converted property—and begun a limited review of compliance with these safeguards. However, HUD has not yet developed a process for monitoring other safeguards—such as access to other housing voucher options. Federal internal control standards require agencies to use quality information to achieve objectives, and obtain and evaluate relevant and reliable data in a timely manner for use in effective monitoring. Without a comprehensive review of household information and procedures for fully monitoring all resident safeguards, HUD cannot fully assess the effects of RAD on residents. RAD authorizing legislation and the program's use agreements (contracts with property owners) contain provisions intended to help ensure the long-term availability of affordable units, but the provisions have not been tested in situations such as foreclosure. For example, use agreements between HUD and property owners specify affordability and use restrictions that according to the contract would survive a default or foreclosure. HUD officials stated that HUD intends to develop procedures to identify and respond to risks to long-term affordability, including default or foreclosure in RAD properties. However, HUD has not yet done so. According to federal internal control standards, agencies should identify, analyze, and respond to risks related to achieving goals and objectives. Procedures that address oversight of affordability requirements would better position HUD to help ensure RAD conversions comply with program requirements, detect potential foreclosure and other risks, and take corrective actions. GAO makes five recommendations to HUD intended to improve leveraging metrics, monitoring of the use and enforcement of resident safeguards, and compliance with RAD requirements. HUD agreed with our recommendations to improve metrics and build on existing oversight.