An easy way to do this would be to enforce strict limits on the percentage of voucher tenants allowed in any one building.
There are to be limitations on voucher tenants in the building.