No, you need not carry the physical hard copy of the document. As per the IT Act, a digital car insurance policy stored in DigiLocker is considered at par with the physical hard copy of the document.