Cherry pick `NIM supporting changes for nemo.export for NeMo 2.0 (11488)` into `r2.1.0`
State: closed | Pull request: yes
Labels: name: cherry-pick

name: Run CICD

name: skip-docs

beep boop [🤖]: Hi @janekl 👋,
    
    we've cherry picked #11488 into  for you! 🚀
    
    Please review and approve this cherry pick by your convenience!

<!-- pylint-output-strict-mode-false -->

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module nemo.deploy.deploy_pytriton
nemo/deploy/deploy_pytriton.py:53:0: C0301: Line too long (132/119) (line-too-long)
nemo/deploy/deploy_pytriton.py:83:0: C0301: Line too long (126/119) (line-too-long)
************* Module nemo.export.trt_llm.converter.model_to_trt_llm_ckpt
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:55:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:61:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:69:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:86:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:101:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:111:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:115:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:130:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:294:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:301:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:308:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:509:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.export.trt_llm.nemo_ckpt_loader.nemo_file
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:44:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:73:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:80:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:96:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:104:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:114:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:120:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:125:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:136:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:167:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:174:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:188:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:192:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:201:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:226:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:237:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:258:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:313:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:431:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:515:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:519:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:530:0: C0115: Missing class docstring (missing-class-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:542:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:582:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:619:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:632:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:27:0: W0611: Unused import tensorstore (unused-import)
************* Module scripts.deploy.nlp.deploy_triton
scripts/deploy/nlp/deploy_triton.py:393:0: C0301: Line too long (121/119) (line-too-long)
scripts/deploy/nlp/deploy_triton.py:30:0: C0115: Missing class docstring (missing-class-docstring)
scripts/deploy/nlp/deploy_triton.py:49:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:259:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:370:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:377:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module export_to_trt_llm
scripts/export/export_to_trt_llm.py:25:0: C0115: Missing class docstring (missing-class-docstring)
scripts/export/export_to_trt_llm.py:29:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/export/export_to_trt_llm.py:156:0: C0116: Missing function or method docstring (missing-function-docstring)

-----------------------------------
Your code has been rated at 9.69/10
```

---

Thank you for improving NeMo's documentation!

<!-- pylint-output-strict-mode-false -->

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module nemo.deploy.deploy_pytriton
nemo/deploy/deploy_pytriton.py:53:0: C0301: Line too long (132/119) (line-too-long)
nemo/deploy/deploy_pytriton.py:83:0: C0301: Line too long (126/119) (line-too-long)
************* Module nemo.export.trt_llm.converter.model_to_trt_llm_ckpt
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:55:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:61:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:69:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:86:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:101:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:111:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:115:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:130:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:294:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:301:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:308:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/converter/model_to_trt_llm_ckpt.py:509:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.export.trt_llm.nemo_ckpt_loader.nemo_file
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:44:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:73:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:80:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:96:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:104:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:114:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:120:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:125:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:136:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:167:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:174:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:188:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:192:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:201:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:226:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:237:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:258:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:313:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:431:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:515:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:519:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:530:0: C0115: Missing class docstring (missing-class-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:542:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:582:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:619:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:632:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/export/trt_llm/nemo_ckpt_loader/nemo_file.py:27:0: W0611: Unused import tensorstore (unused-import)
************* Module scripts.deploy.nlp.deploy_triton
scripts/deploy/nlp/deploy_triton.py:393:0: C0301: Line too long (121/119) (line-too-long)
scripts/deploy/nlp/deploy_triton.py:30:0: C0115: Missing class docstring (missing-class-docstring)
scripts/deploy/nlp/deploy_triton.py:49:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:259:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:370:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/deploy/nlp/deploy_triton.py:377:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module export_to_trt_llm
scripts/export/export_to_trt_llm.py:25:0: C0115: Missing class docstring (missing-class-docstring)
scripts/export/export_to_trt_llm.py:29:0: C0116: Missing function or method docstring (missing-function-docstring)
scripts/export/export_to_trt_llm.py:156:0: C0116: Missing function or method docstring (missing-function-docstring)

-----------------------------------
Your code has been rated at 9.69/10
```

---

Thank you for improving NeMo's documentation!

Already merged cherrypick in different PR