Bringing `speechllm-develop` features into `main`
State: closed | Pull request: yes
Labels: name: core

name: TTS

name: ASR

name: NLP

name: Speaker Tasks

name: CI

name: common

name: Multi Modal

name: audio

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# GitHub Actions CI

The Jenkins CI system has been replaced by GitHub Actions self-hosted runners.

The GitHub Actions CI will run automatically when the "Run CICD" label is added to the PR.
To re-run CI remove and add the label again.
To run CI on an untrusted fork, a NeMo user with write access must first click "Approve and run".

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)


<!-- pylint-output-strict-mode-true -->

beep boop 🤖: 🚨 The following files must be fixed before merge!

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module run_helper
examples/asr/run_helper.py:87:0: C0301: Line too long (137/119) (line-too-long)
examples/asr/run_helper.py:159:0: C0301: Line too long (131/119) (line-too-long)
examples/asr/run_helper.py:29:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/run_helper.py:48:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/run_helper.py:62:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/run_helper.py:86:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/run_helper.py:102:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/run_helper.py:128:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module speech_pretraining.downstream.speech_classification_mfa_train
examples/asr/speech_pretraining/downstream/speech_classification_mfa_train.py:58:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/asr/speech_pretraining/downstream/speech_classification_mfa_train.py:86:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module speech_pretraining.masked_token_pred_pretrain
examples/asr/speech_pretraining/masked_token_pred_pretrain.py:51:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module auto_config
examples/llm/auto_configurator/auto_config.py:28:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/auto_configurator/auto_config.py:38:0: C0115: Missing class docstring (missing-class-docstring)
examples/llm/auto_configurator/auto_config.py:47:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/auto_configurator/auto_config.py:69:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/auto_configurator/auto_config.py:105:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/auto_configurator/auto_config.py:16:0: W0611: Unused import os (unused-import)
************* Module hf
examples/llm/peft/hf.py:25:0: C0301: Line too long (184/119) (line-too-long)
examples/llm/peft/hf.py:76:0: C0301: Line too long (162/119) (line-too-long)
examples/llm/peft/hf.py:21:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module custom_recipe
examples/llm/pretrain/custom_recipe.py:21:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/pretrain/custom_recipe.py:33:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module default_executor
examples/llm/pretrain/default_executor.py:52:0: C0301: Line too long (120/119) (line-too-long)
examples/llm/pretrain/default_executor.py:22:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/pretrain/default_executor.py:36:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/pretrain/default_executor.py:95:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/sft/hf.py:74:0: C0301: Line too long (162/119) (line-too-long)
examples/llm/sft/hf.py:26:0: C0115: Missing class docstring (missing-class-docstring)
examples/llm/sft/hf.py:39:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/llm/sft/hf.py:23:0: W0611: Unused ModelCallback imported from nemo.lightning.pytorch.callbacks (unused-import)
************* Module export_salm
examples/multimodal/speech_llm/export/export_salm.py:20:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module extract_salm_weights
examples/multimodal/speech_llm/export/extract_salm_weights.py:33:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:88:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:97:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:105:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:114:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:129:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/multimodal/speech_llm/export/extract_salm_weights.py:151:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module megatron_gpt_drop_layers
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:74:0: C0301: Line too long (218/119) (line-too-long)
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:163:0: C0301: Line too long (192/119) (line-too-long)
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:52:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:100:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:114:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/megatron_gpt_drop_layers.py:43:0: W0611: Unused open_dict imported from omegaconf (unused-import)
************* Module megatron_gpt_prune
examples/nlp/language_modeling/megatron_gpt_prune.py:55:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/megatron_gpt_prune.py:75:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/megatron_gpt_prune.py:16:0: W0611: Unused import torch (unused-import)
************* Module upcycle_dense_to_moe
examples/nlp/language_modeling/upcycle_dense_to_moe.py:36:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/upcycle_dense_to_moe.py:53:0: C0116: Missing function or method docstring (missing-function-docstring)
examples/nlp/language_modeling/upcycle_dense_to_moe.py:61:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module megatron_t5_speechllm
examples/tts/speechllm/megatron_t5_speechllm.py:26:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module megatron_t5_speechllm_inference
examples/tts/speechllm/megatron_t5_speechllm_inference.py:25:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.data.ssl_dataset
nemo/collections/asr/data/ssl_dataset.py:227:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/asr/data/ssl_dataset.py:546:0: C0301: Line too long (175/119) (line-too-long)
nemo/collections/asr/data/ssl_dataset.py:559:0: C0301: Line too long (128/119) (line-too-long)
nemo/collections/asr/data/ssl_dataset.py:642:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/asr/data/ssl_dataset.py:649:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/asr/data/ssl_dataset.py:39:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/data/ssl_dataset.py:50:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/data/ssl_dataset.py:295:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/data/ssl_dataset.py:355:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/data/ssl_dataset.py:446:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/data/ssl_dataset.py:479:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/data/ssl_dataset.py:498:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/data/ssl_dataset.py:531:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/data/ssl_dataset.py:587:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/data/ssl_dataset.py:623:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.modules.ssl_modules.augmentation
nemo/collections/asr/modules/ssl_modules/augmentation.py:51:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/asr/modules/ssl_modules/augmentation.py:55:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/asr/modules/ssl_modules/augmentation.py:59:0: C0301: Line too long (146/119) (line-too-long)
nemo/collections/asr/modules/ssl_modules/augmentation.py:23:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/ssl_modules/augmentation.py:62:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/ssl_modules/augmentation.py:69:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/ssl_modules/augmentation.py:149:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/ssl_modules/augmentation.py:252:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.modules.ssl_modules.masking
nemo/collections/asr/modules/ssl_modules/masking.py:192:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/ssl_modules/masking.py:195:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/modules/ssl_modules/masking.py:198:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.modules.ssl_modules.multi_layer_feat
nemo/collections/asr/modules/ssl_modules/multi_layer_feat.py:148:0: C0301: Line too long (136/119) (line-too-long)
nemo/collections/asr/modules/ssl_modules/multi_layer_feat.py:27:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/ssl_modules/multi_layer_feat.py:84:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/modules/ssl_modules/multi_layer_feat.py:160:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.asr.modules.ssl_modules.quantizers
nemo/collections/asr/modules/ssl_modules/quantizers.py:24:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.asr.parts.submodules.wfst_decoder
nemo/collections/asr/parts/submodules/wfst_decoder.py:187:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:191:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:195:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:199:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:310:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:322:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:334:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:346:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:350:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/submodules/wfst_decoder.py:575:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.asr.parts.utils.wfst_utils
nemo/collections/asr/parts/utils/wfst_utils.py:1305:0: C0301: Line too long (142/119) (line-too-long)
nemo/collections/asr/parts/utils/wfst_utils.py:116:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:993:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:1009:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:1079:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:1084:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:1088:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/asr/parts/utils/wfst_utils.py:1092:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.audio.parts.submodules.flow
nemo/collections/audio/parts/submodules/flow.py:192:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/audio/parts/submodules/flow.py:196:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.audio.parts.submodules.transformerunet
nemo/collections/audio/parts/submodules/transformerunet.py:128:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/audio/parts/submodules/transformerunet.py:155:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/audio/parts/submodules/transformerunet.py:168:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.common.parts.run_utils
nemo/collections/common/parts/run_utils.py:70:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/common/parts/run_utils.py:81:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/common/parts/run_utils.py:35:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:379:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:408:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/common/parts/run_utils.py:412:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:416:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:420:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:424:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:444:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:521:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:572:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/common/parts/run_utils.py:18:0: W0611: Unused import subprocess (unused-import)
************* Module nemo.collections.diffusion.encoders.conditioner
nemo/collections/diffusion/encoders/conditioner.py:22:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/encoders/conditioner.py:35:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:39:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:43:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:70:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:128:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:133:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:164:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/encoders/conditioner.py:180:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/encoders/conditioner.py:185:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.flux_infer
nemo/collections/diffusion/flux_infer.py:26:0: C0301: Line too long (188/119) (line-too-long)
nemo/collections/diffusion/flux_infer.py:24:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.models.dit.dit_attention
nemo/collections/diffusion/models/dit/dit_attention.py:353:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_attention.py:355:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_attention.py:15:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_attention.py:211:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_attention.py:332:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.models.dit.dit_embeddings
nemo/collections/diffusion/models/dit/dit_embeddings.py:141:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_embeddings.py:147:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_embeddings.py:173:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_embeddings.py:178:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_embeddings.py:183:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_embeddings.py:16:0: W0611: Unused import math (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:17:0: W0611: Unused Dict imported from typing (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:17:0: W0611: Unused Literal imported from typing (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:17:0: W0611: Unused Optional imported from typing (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:19:0: W0611: Unused numpy imported as np (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:21:0: W0611: Unused torch.nn.functional imported as F (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:24:0: W0611: Unused Rearrange imported from einops.layers.torch (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:26:0: W0611: Unused get_pos_emb_on_this_cp_rank imported from megatron.core.models.common.embeddings.rotary_pos_embedding (unused-import)
nemo/collections/diffusion/models/dit/dit_embeddings.py:28:0: W0611: Unused nn imported from torch (unused-import)
************* Module nemo.collections.diffusion.models.dit.dit_layer_spec
nemo/collections/diffusion/models/dit/dit_layer_spec.py:194:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:234:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:249:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:268:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:288:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:306:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:362:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:396:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:416:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:549:0: C0301: Line too long (127/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:552:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:53:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:59:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:65:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:74:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:108:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:112:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:116:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:120:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:132:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:138:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:157:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:221:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:383:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:482:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:565:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:623:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:643:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:675:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:736:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:775:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:800:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:826:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:845:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:21:0: W0611: Unused rearrange imported from einops (unused-import)
nemo/collections/diffusion/models/dit/dit_layer_spec.py:22:0: W0611: Unused jit_fuser imported from megatron.core.jit (unused-import)
************* Module nemo.collections.diffusion.models.dit.dit_model
nemo/collections/diffusion/models/dit/dit_model.py:111:0: C0301: Line too long (156/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_model.py:115:0: C0301: Line too long (134/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_model.py:117:0: C0301: Line too long (157/119) (line-too-long)
nemo/collections/diffusion/models/dit/dit_model.py:40:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_model.py:44:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/dit/dit_model.py:53:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_model.py:71:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit/dit_model.py:20:0: W0611: Unused torch.nn.functional imported as F (unused-import)
************* Module nemo.collections.diffusion.models.dit_llama.dit_llama_layer_spec
nemo/collections/diffusion/models/dit_llama/dit_llama_layer_spec.py:76:0: C0301: Line too long (138/119) (line-too-long)
nemo/collections/diffusion/models/dit_llama/dit_llama_layer_spec.py:103:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/diffusion/models/dit_llama/dit_llama_layer_spec.py:119:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/diffusion/models/dit_llama/dit_llama_layer_spec.py:88:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/dit_llama/dit_llama_layer_spec.py:195:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.models.dit_llama.dit_llama_model
nemo/collections/diffusion/models/dit_llama/dit_llama_model.py:25:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.diffusion.models.flux.layers
nemo/collections/diffusion/models/flux/layers.py:37:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/layers.py:44:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/layers.py:54:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/layers.py:61:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/layers.py:119:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/layers.py:135:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/layers.py:147:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/layers.py:169:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.models.flux.model
nemo/collections/diffusion/models/flux/model.py:35:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/model.py:51:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/model.py:112:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.models.flux.pipeline
nemo/collections/diffusion/models/flux/pipeline.py:64:0: C0301: Line too long (159/119) (line-too-long)
nemo/collections/diffusion/models/flux/pipeline.py:34:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:49:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:68:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:156:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:221:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:226:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/flux/pipeline.py:27:0: W0611: Unused FluxParams imported from nemo.collections.diffusion.models.flux.model (unused-import)
************* Module nemo.collections.diffusion.models.model
nemo/collections/diffusion/models/model.py:312:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/models/model.py:334:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.sampler.edm.edm
nemo/collections/diffusion/sampler/edm/edm.py:24:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/sampler/edm/edm.py:36:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/sampler/edm/edm.py:49:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/sampler/edm/edm.py:55:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/sampler/edm/edm.py:90:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.sampler.edm.edm_pipeline
nemo/collections/diffusion/sampler/edm/edm_pipeline.py:20:0: W0611: Unused rearrange imported from einops (unused-import)
************* Module nemo.collections.diffusion.sampler.flow_matching.flow_match_euler_discrete
nemo/collections/diffusion/sampler/flow_matching/flow_match_euler_discrete.py:56:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/diffusion/sampler/flow_matching/flow_match_euler_discrete.py:152:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/sampler/flow_matching/flow_match_euler_discrete.py:196:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.train
nemo/collections/diffusion/train.py:223:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/train.py:258:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.utils.flux_ckpt_converter
nemo/collections/diffusion/utils/flux_ckpt_converter.py:138:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.utils.flux_pipeline_utils
nemo/collections/diffusion/utils/flux_pipeline_utils.py:25:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.diffusion.utils.mcore_parallel_utils
nemo/collections/diffusion/utils/mcore_parallel_utils.py:25:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/utils/mcore_parallel_utils.py:31:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/utils/mcore_parallel_utils.py:46:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/utils/mcore_parallel_utils.py:60:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/utils/mcore_parallel_utils.py:65:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.vae.autoencoder
nemo/collections/diffusion/vae/autoencoder.py:25:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/autoencoder.py:42:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:47:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/autoencoder.py:120:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:148:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/autoencoder.py:227:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:263:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/autoencoder.py:269:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:278:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/autoencoder.py:316:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:321:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:325:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:328:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/autoencoder.py:21:0: W0611: Unused AttnBlock imported from nemo.collections.diffusion.vae.blocks (unused-import)
************* Module nemo.collections.diffusion.vae.blocks
nemo/collections/diffusion/vae/blocks.py:28:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:32:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/blocks.py:53:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:74:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/blocks.py:81:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:96:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/blocks.py:104:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:114:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/blocks.py:126:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:140:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:144:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/blocks.py:152:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/diffusion/vae/blocks.py:172:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.diffusion.vae.diffusers_vae
nemo/collections/diffusion/vae/diffusers_vae.py:20:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/diffusion/vae/diffusers_vae.py:26:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.data.hf_dataset
nemo/collections/llm/gpt/data/hf_dataset.py:21:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/data/hf_dataset.py:51:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/data/hf_dataset.py:77:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/data/hf_dataset.py:87:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.data.packed_sequence
nemo/collections/llm/gpt/data/packed_sequence.py:94:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/llm/gpt/data/packed_sequence.py:89:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.llm.gpt.model.gemma2
nemo/collections/llm/gpt/model/gemma2.py:156:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/llm/gpt/model/gemma2.py:157:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/llm/gpt/model/gemma2.py:233:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/llm/gpt/model/gemma2.py:234:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/llm/gpt/model/gemma2.py:37:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:47:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:74:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:84:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:94:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:103:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:128:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:149:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:164:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:170:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:207:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/gemma2.py:226:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:241:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/gemma2.py:245:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.hf_auto_model_for_causal_lm
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:26:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:34:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:58:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:69:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:72:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:89:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:101:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:115:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/hf_auto_model_for_causal_lm.py:126:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.nemotron
nemo/collections/llm/gpt/model/nemotron.py:38:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:67:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:79:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:91:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:103:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:115:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:126:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:138:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:159:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/nemotron.py:177:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/nemotron.py:183:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/nemotron.py:216:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/nemotron.py:234:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/nemotron.py:252:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/nemotron.py:256:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.qwen2
nemo/collections/llm/gpt/model/qwen2.py:38:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:56:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:65:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:74:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:84:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:95:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:107:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:127:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/qwen2.py:143:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/qwen2.py:149:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/qwen2.py:175:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/qwen2.py:194:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/qwen2.py:211:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/qwen2.py:215:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.ssm
nemo/collections/llm/gpt/model/ssm.py:190:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/llm/gpt/model/ssm.py:193:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/llm/gpt/model/ssm.py:194:0: C0301: Line too long (151/119) (line-too-long)
nemo/collections/llm/gpt/model/ssm.py:195:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/llm/gpt/model/ssm.py:39:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:51:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:89:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:110:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:127:8: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:131:12: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:134:12: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:155:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:203:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:216:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/ssm.py:221:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:235:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:249:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:263:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:277:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:291:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/ssm.py:306:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.llm.gpt.model.starcoder
nemo/collections/llm/gpt/model/starcoder.py:37:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder.py:57:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder.py:65:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder.py:79:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder.py:99:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder.py:123:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder.py:129:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder.py:160:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder.py:179:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder.py:201:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder.py:205:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.gpt.model.starcoder2
nemo/collections/llm/gpt/model/starcoder2.py:37:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:59:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:70:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:81:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:91:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:105:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:125:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:146:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:152:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:184:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:203:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:222:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/starcoder2.py:226:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.hf_auto_model_for_causal_lm
nemo/collections/llm/recipes/hf_auto_model_for_causal_lm.py:103:0: C0301: Line too long (162/119) (line-too-long)
nemo/collections/llm/recipes/hf_auto_model_for_causal_lm.py:154:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/llm/recipes/hf_auto_model_for_causal_lm.py:193:0: C0301: Line too long (121/119) (line-too-long)
************* Module nemo.collections.llm.recipes.llama3_70b_16k
nemo/collections/llm/recipes/llama3_70b_16k.py:76:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/llm/recipes/llama3_70b_16k.py:22:0: W0611: Unused finetune imported from nemo.collections.llm.api (unused-import)
nemo/collections/llm/recipes/llama3_70b_16k.py:24:0: W0611: Unused SquadDataModule imported from nemo.collections.llm.gpt.data.squad (unused-import)
************* Module nemo.collections.llm.recipes.llama3_70b_64k
nemo/collections/llm/recipes/llama3_70b_64k.py:76:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/llm/recipes/llama3_70b_64k.py:22:0: W0611: Unused finetune imported from nemo.collections.llm.api (unused-import)
************* Module nemo.collections.llm.recipes.mamba2_130m
nemo/collections/llm/recipes/mamba2_130m.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_1_3b
nemo/collections/llm/recipes/mamba2_1_3b.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_2_7b
nemo/collections/llm/recipes/mamba2_2_7b.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_370m
nemo/collections/llm/recipes/mamba2_370m.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_780m
nemo/collections/llm/recipes/mamba2_780m.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_8b
nemo/collections/llm/recipes/mamba2_8b.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mamba2_hybrid_8b
nemo/collections/llm/recipes/mamba2_hybrid_8b.py:288:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/llm/recipes/mamba2_hybrid_8b.py:38:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.mixtral_8x7b_16k
nemo/collections/llm/recipes/mixtral_8x7b_16k.py:22:0: W0611: Unused finetune imported from nemo.collections.llm.api (unused-import)
nemo/collections/llm/recipes/mixtral_8x7b_16k.py:24:0: W0611: Unused SquadDataModule imported from nemo.collections.llm.gpt.data.squad (unused-import)
************* Module nemo.collections.llm.recipes.mixtral_8x7b_64k
nemo/collections/llm/recipes/mixtral_8x7b_64k.py:22:0: W0611: Unused finetune imported from nemo.collections.llm.api (unused-import)
************* Module nemo.collections.llm.recipes.optim.sgd
nemo/collections/llm/recipes/optim/sgd.py:23:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/recipes/optim/sgd.py:49:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.precision.mixed_precision
nemo/collections/llm/recipes/precision/mixed_precision.py:23:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/recipes/precision/mixed_precision.py:35:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.recipes.tp_overlap_configs.userbuffers
nemo/collections/llm/recipes/tp_overlap_configs/userbuffers.py:19:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/recipes/tp_overlap_configs/userbuffers.py:24:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/recipes/tp_overlap_configs/userbuffers.py:34:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/recipes/tp_overlap_configs/userbuffers.py:42:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/recipes/tp_overlap_configs/userbuffers.py:50:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.llm.t5.data.core
nemo/collections/llm/t5/data/core.py:25:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/core.py:32:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.t5.data.fine_tuning
nemo/collections/llm/t5/data/fine_tuning.py:34:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:40:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:44:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:46:0: C0301: Line too long (127/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:48:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:49:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:50:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/llm/t5/data/fine_tuning.py:97:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:110:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:118:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:126:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:158:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:162:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/fine_tuning.py:166:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.t5.data.mock
nemo/collections/llm/t5/data/mock.py:33:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/t5/data/mock.py:71:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/mock.py:82:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/mock.py:87:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/mock.py:92:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.t5.data.pre_training
nemo/collections/llm/t5/data/pre_training.py:300:0: C0301: Line too long (124/119) (line-too-long)
nemo/collections/llm/t5/data/pre_training.py:307:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/llm/t5/data/pre_training.py:164:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/pre_training.py:221:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/pre_training.py:224:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/pre_training.py:227:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/pre_training.py:244:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/pre_training.py:297:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.t5.data.squad
nemo/collections/llm/t5/data/squad.py:33:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/llm/t5/data/squad.py:34:0: C0301: Line too long (123/119) (line-too-long)
nemo/collections/llm/t5/data/squad.py:38:0: C0301: Line too long (129/119) (line-too-long)
nemo/collections/llm/t5/data/squad.py:39:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/llm/t5/data/squad.py:103:0: C0301: Line too long (125/119) (line-too-long)
nemo/collections/llm/t5/data/squad.py:78:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/data/squad.py:154:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.collections.llm.t5.model.t5
nemo/collections/llm/t5/model/t5.py:45:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:98:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:111:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:123:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:135:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:143:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/t5/model/t5.py:174:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:229:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/t5/model/t5.py:238:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/t5/model/t5.py:246:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/t5/model/t5.py:264:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:268:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:291:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:294:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:297:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:301:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:306:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:327:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:334:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/t5/model/t5.py:37:4: W0611: Unused import transformer_engine (unused-import)
************* Module base_config
nemo/collections/llm/tools/auto_configurator/core/base_config.py:78:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/base_config.py:123:0: C0301: Line too long (132/119) (line-too-long)
************* Module calculate_performance
nemo/collections/llm/tools/auto_configurator/core/calculate_performance.py:182:0: C0301: Line too long (172/119) (line-too-long)
************* Module training_config
nemo/collections/llm/tools/auto_configurator/core/training_config.py:39:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/training_config.py:828:0: C0301: Line too long (131/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/training_config.py:257:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/tools/auto_configurator/core/training_config.py:571:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/tools/auto_configurator/core/training_config.py:711:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module utils
nemo/collections/llm/tools/auto_configurator/core/utils.py:34:0: C0301: Line too long (151/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/utils.py:396:0: C0301: Line too long (168/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/utils.py:401:0: C0301: Line too long (175/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/utils.py:465:0: C0301: Line too long (128/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/utils.py:468:0: C0301: Line too long (149/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/core/utils.py:60:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module auto_configurator.runner
nemo/collections/llm/tools/auto_configurator/runner.py:64:0: C0301: Line too long (130/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/runner.py:65:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/runner.py:66:0: C0301: Line too long (126/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/runner.py:69:0: C0301: Line too long (141/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/runner.py:70:0: C0301: Line too long (141/119) (line-too-long)
nemo/collections/llm/tools/auto_configurator/runner.py:20:0: W0611: Unused GPTModel imported from nemo.collections.llm (unused-import)
************* Module nemo.collections.multimodal.data.energon.base
nemo/collections/multimodal/data/energon/base.py:83:0: C0301: Line too long (151/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:84:0: C0301: Line too long (204/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:114:0: C0301: Line too long (120/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:169:0: C0301: Line too long (140/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:177:0: C0301: Line too long (153/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:207:0: C0301: Line too long (144/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:277:0: C0301: Line too long (150/119) (line-too-long)
nemo/collections/multimodal/data/energon/base.py:289:0: C0301: Line too long (127/119) (line-too-long)
************* Module nemo.collections.multimodal.data.energon.config
nemo/collections/multimodal/data/energon/config.py:22:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/multimodal/data/energon/config.py:29:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/multimodal/data/energon/config.py:60:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.multimodal.data.energon.conversation
nemo/collections/multimodal/data/energon/conversation.py:32:0: C0301: Line too long (158/119) (line-too-long)
************* Module nemo.collections.multimodal.data.energon.sample_encoder
nemo/collections/multimodal/data/energon/sample_encoder.py:51:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:52:0: C0301: Line too long (154/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:58:0: C0301: Line too long (153/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:73:0: C0301: Line too long (127/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:215:0: C0301: Line too long (169/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:336:0: C0301: Line too long (127/119) (line-too-long)
nemo/collections/multimodal/data/energon/sample_encoder.py:25:0: C0115: Missing class docstring (missing-class-docstring)
************* Module nemo.collections.multimodal.data.energon.task_encoder
nemo/collections/multimodal/data/energon/task_encoder.py:51:0: C0301: Line too long (176/119) (line-too-long)
nemo/collections/multimodal/data/energon/task_encoder.py:62:0: C0301: Line too long (122/119) (line-too-long)
nemo/collections/multimodal/data/energon/task_encoder.py:63:0: C0301: Line too long (138/119) (line-too-long)
************* Module nemo.collections.multimodal.data.neva.neva_energon_dataset
nemo/collections/multimodal/data/neva/neva_energon_dataset.py:154:0: C0301: Line too long (133/119) (line-too-long)
nemo/collections/multimodal/data/neva/neva_energon_dataset.py:188:0: C0301: Line too long (121/119) (line-too-long)
nemo/collections/multimodal/data/neva/neva_energon_dataset.py:240:0: C0301: Line too long (144/119) (line-too-long)
nemo/collections/multimodal/data/neva/neva_energon_dataset.py:51:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/multimodal...*[Comment body truncated]*

Broken diff due to mix of merge and rebase, closing