You require an apostille for the certificate of residence to provide proof of paying tax when conducting business outside the UK.
The apostille also entitles the company to gain relief for double taxation.
If the business has already paid the tax, the firm may be entitled to a refund from the tax office.