Many USDA lenders are unfamiliar with these structures and may be reluctant to finance their purchase. Borrowers may also experience added difficulty when seeking a USDA construction loan to build a new barndominium, as some USDA lenders, including Neighbors Bank, do not offer this loan type.