No, unfortunately, you cannot. The VA loan is secured by a mortgage on all 5 acres of property; you received the loan based on having 5 acres to provide security for the loan. You cannot reduce the lender's security--you cannot reduce the property securng the loan by 1/5th, thereby reducing the  lender's rights.