No. You need not bring the card with you always. Only your Aadhaar number is needed to complete your verification.