No, you do not need to attach your tax certificate to your return. You simply have to keep it in case the tax administration asks for it as part of an audit.