No. If you don't have their ABN, the ATO allows a full address (instead of a ABN) for Tax Invoices over $1000.
If the tax invoice is for taxable sales over $1,000 they will need to show the buyer’s identity OR ABN.
Source: https://www.ato.gov.au/Business/GST/Tax-invoices/