renwei2024/nemo-github-issues huggingface dataset:
bugs
State: closed | Pull request: yes
Labels: name: bug

name: stale

name: ASR

Signed-off-by: Dima Rekesh <drekesh@nvidia.com>

# What does this PR do ?
Fixes the bug / ensures that Concat dataset feature supports tarred datasets.

Add a one line overview of what this PR aims to accomplish.
The tarred_audio_filepaths parameter could be a list such that each dataset that the Concat dataset is 
comprised of could have a different set of audio filepaths

**Collection**: [Note which collection this PR will affect]
ASR 

# Changelog 
- Add specific line by line info of high level changes in this PR.
audio_to_text_dataset is patched to process the list of audio filepaths

# Usage
* You can potentially add a usage example below
* No change

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ X] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Move Attention and MLP classes to a separate file in Megatron transformers
State: closed | Pull request: yes
Labels: name: NLP

# What does this PR do ?

Moves the attention and mlp classes to a separate file to avoid clutter in transformer.py

**Collection**: NLP

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Set sync_batch_comm=False in prompt learning and inference
State: closed | Pull request: yes
Labels: name: bug

name: cherry-pick

name: NLP

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Sets sync_batch_comm=False for prompt-learning and inference.

**Collection**: NLP

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Radtts 1.13
State: closed | Pull request: yes
Labels: name: TTS

# What does this PR do ?

Cherry pick of #5358 from main.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
JOC Optimization in FastPitch
State: closed | Pull request: yes
Labels: name: TTS

Signed-off-by: subhankar-ghosh <subhankar2321@gmail.com>

# What does this PR do ?

Adds JoC Optimizations in FastPitch
1) Correcting dimensions, it will give wrong results in case of >1 attention heads in `nemo/collections/tts/modules/transformer.py`
2) Optimized implementation of `mas_width1` method in `nemo/collections/tts/helpers/helpers.py`
3) Converted `attn` to `log attn` in `binarize_attention_parallel` and corresponding changes in aligner loss.

**Collection**: [Note which collection this PR will affect]

TTS

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [x] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Set sync_batch_comm=False in prompt learning and inference
State: closed | Pull request: yes
Labels: name: bug

name: NLP

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Sets sync_batch_comm=False for prompt-learning and inference.

**Collection**: NLP

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Add interface for making amax reduction optional for FP8
State: closed | Pull request: yes
Labels: name: NLP

Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

# What does this PR do ?

Adds interface in NeMo to use Transformer Engine's optional amax reduction feature. Previously, TE would always reduce amaxes by default during fp8 training (across the `fp8_group` specified in `fp8_autocast` API).
Fix Conformer Export in 1.13.0 (cherry-pick from main)
State: closed | Pull request: yes

Signed-off-by: Vahid <vnoroozi@nvidia.com>

# What does this PR do ?
Cherry-pick from #5242 to 1.13.0 to fix Conformer export https://github.com/NVIDIA/NeMo/issues/5436

Add a one line overview of what this PR aims to accomplish.

**Collection**: [asr]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [x] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Create codeql.yml
State: closed | Pull request: yes

Signed-off-by: Somshubra Majumdar <titu1994@gmail.com>

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Fix setting up of `ReduceLROnPlateau` learning rate scheduler
State: closed | Pull request: yes
Labels: name: bug

# What does this PR do ?

Fix setting up of `ReduceLROnPlateau` learning rate scheduler.

**Collection**: core

Steps to reproduce
```bash
git clone https://github.com/NVIDIA/NeMo.git
cd NeMo
git checkout fix/reduce_on_plateau_r1.11.0
git checkout r1.11.0 -- nemo/core/optim/lr_scheduler.py nemo/core/config/schedulers.py
pytest tests/core/test_optimizers_schedulers.py
```


# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [x] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [x] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Add Beam Search support to ASR transcribe()
State: closed | Pull request: yes
Labels: name: feature

name: ASR

# What does this PR do ?

Add high level API for beam search using model.transcribe() and beam search strategy.
Currently only supports DeepSpeed beam search library, eventually can support more advanced libraries
like pyctcdecode.

**Collection**: [ASR]

# Changelog 
- Adds AbstractBeamCTCInfer and BeamCTCInfer classes to support beam search strategy
- Updated CTCDecoding and CTCBPEDecoding classes to support beam search strategy
- Adds tests for CTC Decoding classes

# Usage


``` python

import nemo.collections.asr as nemo_asr

filepath = "/media/smajumdar/data/Datasets/Librispeech/LibriSpeech/test-other-processed/367-130732-0008.wav"
kenlm_path = "/media/smajumdar/data/Datasets/ASR_SET_LM/ASR_SET_3.0/lm"

model = nemo_asr.models.ASRModel.from_pretrained('stt_en_conformer_ctc_large')  # type: nemo_asr.models.EncDecCTCModelBPE

# Create default decoding config
model.change_decoding_strategy(None)

# Update decoding config for beam search
decoding_cfg = model.cfg.decoding
decoding_cfg.strategy = "beam"
decoding_cfg.beam.beam_size = 128
decoding_cfg.beam.return_best_hypothesis = False
decoding_cfg.beam.beam_alpha = 1.0
decoding_cfg.beam.beam_beta = 0.0
decoding_cfg.beam.kenlm_path = kenlm_path

# Prepare beam search decoding strategy
model.change_decoding_strategy(decoding_cfg)

# Transcribe speech with beam search
hypothesis = model.transcribe([filepath], return_hypotheses=True)
print("Num hypothesis per sample :", len(hypothesis[0]))
print("Result type :", hypothesis[0][0].__class__.__name__)
for candidate in range(len(hypothesis[0])):
    print(f"Beam Search {candidate + 1} :", hypothesis[0][candidate].text, hypothesis[0][candidate].score)

```

# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [x] Did you write any new necessary tests?
- [x] Did you add or update any necessary documentation?
- [x] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [x] New Feature
- [ ] Bugfix
- [ ] Documentation
Fix for getting tokenizer in character-based ASR models when using tarred dataset
State: closed | Pull request: yes

# What does this PR do ?

This PR fixes getting tokenizer in character-based ASR models when using tarred dataset

**Collection**: ASR

# Changelog 
- This PR removed passing `self.tokenizer` to `get_concat_tarred_dataset()` or `get_tarred_dataset()`
  - Because character-based ASR models don't use tokenizers, `self.tokenizer` raises the following error:
```
Traceback (most recent call last):
  File "/workspace/asr/korean/./speech_to_text_rnnt.py", line 85, in main
    asr_model = EncDecRNNTModel(cfg=cfg.model, trainer=trainer)
  File "/workspace/NeMo/nemo/collections/asr/models/rnnt_models.py", line 53, in __init__
    super().__init__(cfg=cfg, trainer=trainer)
  File "/workspace/NeMo/nemo/core/classes/modelPT.py", line 132, in __init__
    self.setup_training_data(self._cfg.train_ds)
  File "/workspace/NeMo/nemo/collections/asr/models/rnnt_models.py", line 563, in setup_training_data
    self._train_dl = self._setup_dataloader_from_config(config=train_data_config)
  File "/workspace/NeMo/nemo/collections/asr/models/rnnt_models.py", line 509, in _setup_dataloader_from_config
    tokenizer=self.tokenizer,
  File "/usr/local/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1207, in __getattr__
    raise AttributeError("'{}' object has no attribute '{}'".format(
AttributeError: 'EncDecRNNTModel' object has no attribute 'tokenizer'
```

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [X] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Adding core functions for online diarizer
State: closed | Pull request: yes
Labels: name: Speaker Tasks

# What does this PR do ?

Adding core classes and functions for online diarizer

**Collection**: [Note which collection this PR will affect]
ASR

# Changelog 

- Creating online_diarizer.py as opposed to clustering_diarizer.py
--- OnlineDiarizer() class is added. This is a launcher class for load models and modules for online diarization.
- Adding torch.jit.scripted segmentation functions/classes in speaker_utils.py
--- OnlineSegmentor() class is added for torch.jit.script export purpose
- Adding online clustering functions/classes in nmesc_clustering.py
---- OnlineSpeakerClustering() class is added
- Unit tests (test_diar_utils.py) for segment merging, label matching, online clustering


# Usage

These functions are not yet executable.


# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [x] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [x] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Refactor/unify ASR offline and buffered inference
State: closed | Pull request: yes
Labels: name: ASR

Signed-off-by: fayejf <fayejf07@gmail.com>

# What does this PR do ?

Refactor/unify ASR offline and buffered inference

**Collection**: ASR

# Changelog 
1. Clean `transcribe_speech.py` by moving resuable functions to `trancribe_utils.py`
2. Unify `speech_to_text_buffered_infer_rnnt.py` and `speech_to_text_buffered_infer_ctc.py` to have the same input format and behavior as `transcribe_speech.py` including 

> 1. Unify the input format and inconsistent variable names such as `chunk_len_in_secs` and `chunk_len_in_ms`
> 2. support no groundtruth 'txt' condition and audio_dir condition, 
> 3. Modify and move `get_wer_feat` in  `speech_to_text_buffered_infer_rnnt.py` and `get_wer_feat` in  `speech_to_text_buffered_infer_ctc.py` to  `get_buffered_pred_feat_rnnt` and `get_buffered_pred_feat` in `transcribe_utils.py `
> 4. remove WER calculation in above scripts.
> 5. Write all information presented in input manifest to output manifest.

# Usage
* See headers in each example scripts

# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [x] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [x] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Standalone diarization+ASR evaluation script
State: closed | Pull request: yes
Labels: name: feature

name: ASR

name: Speaker Tasks

# What does this PR do ?

Add a standalone diarization-ASR evaluation transcript.
This script was build at the request for testing ASR+diarization with already extracted files.

Adding diar_infer_general.yaml (VAD optimized for multilingual ASR dataset, diarization optimized on DIHARD dev set)

**Collection**: [Note which collection this PR will affect]

ASR 
# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
python eval_diar_with_asr.py \
 --hyp_rttm_list="/path/to/hypothesis_rttm_filepaths.list" \
 --ref_rttm_list="/path/to/reference_rttm_filepaths.list" \
 --ref_ctm_list="/path/to/reference_ctm_filepaths.list" \
 --hyp_ctm_list="/path/to/hypothesis_ctm_filepaths.list" \
 --root_path="/path/to/output/directory"
```

# Before your PR is "Ready for review"
**Pre checks**:
- [x] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [x] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [x] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?
Anyone belongs to ASR

# Additional Information
* Related to # (issue)
conformer export problems 
State: closed | Pull request: no
Labels: name: bug

**Describe the bug**
Trying to export conformer to TorchScript, using `model.export('conformer.pt')` and [/scripts/export.py](https://github.com/NVIDIA/NeMo/blob/main/scripts/export.py). Getting error:
`RuntimeError: Type 'Tuple[Tensor, Tensor, NoneType, NoneType]' cannot be traced. Only Tensors and (possibly nested) Lists, Dicts, and Tuples of Tensors can be traced`

This is true for conformer trained on the Nemo version 1.12.
But everything is ok with exporting old version of conformer (trained on Nemo 1.10) and with that Nemo version installed.
[ITN] fix year date graph, cardinals extension for hundreds
State: closed | Pull request: yes

# What does this PR do ?

Extention of English ITN rules for cardinal to support hundreds by @lociko

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ X] New Feature
- [ X] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Revert workaround for T5 that sets number of workers to 0 & sync_batch_comm=False
State: closed | Pull request: yes
Labels: name: cherry-pick

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Reverts a workaround that needed workers to be 0

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
[TTS] remove useless logic for set_tokenizer.
State: closed | Pull request: yes

Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com>

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Disable sync_batch_comm in validation_step for GPT
State: closed | Pull request: yes
Labels: name: cherry-pick

name: NLP

# What does this PR do ?

With sync_batch_comm=True in validation step we sometimes get CUDA errors while running validation.

**Collection**: NLP
# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Fix GPT generation when using sentencepiece tokenizer
State: closed | Pull request: yes
Labels: name: cherry-pick

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Fixes GPT text generation when using a sentencepiece tokenizer.

**Collection**: NLP

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
disable pc test
State: closed | Pull request: yes
Labels: name: cherry-pick

name: NLP

name: CI

Signed-off-by: ekmb <ebakhturina@nvidia.com>

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
disable pc test
State: closed | Pull request: yes

Signed-off-by: ekmb <ebakhturina@nvidia.com>

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Remove pc test
State: closed | Pull request: yes

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Fixing bug in Megatron BERT when loss mask is all zeros
State: closed | Pull request: yes

Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>

# What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Megatron Export Update
State: closed | Pull request: yes
Labels: name: cherry-pick

Signed-off-by: David Mosallanezhad <dmosallanezh@nvidia.com>

# What does this PR do ?

Updates export process for Megatron-based models

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Changed ORT optimization due to a bug in onnxruntime (https://github.com/microsoft/onnxruntime/issues/12579)

# Usage

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [X] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [X] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Temporary hard code fix in PTL for CUDA Error
State: closed | Pull request: yes
Labels: name: cherry-pick

# What does this PR do ?

Temporary hard code fix in PTL for CUDA Error. Only modify Dockerfile.

# Changelog 
- Two `sed` lines in dockerfile

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Temporary hard code fix in PTL for CUDA Error
State: closed | Pull request: yes

# What does this PR do ?

Temporary hard code fix in PTL for CUDA Error. Only modify Dockerfile.

# Changelog 
- Two `sed` lines in dockerfile

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Revert workaround for T5 that sets number of workers to 0 & sync_batch_comm=False
State: closed | Pull request: yes

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Reverts a workaround that needed workers to be 0

**Collection**: [Note which collection this PR will affect]

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
problem of univnet and onnx 
State: closed | Pull request: no
Labels: name: bug

name: TTS

Hi. I have trained univnet model and i want to export it to onnx. but i got this error . what should i do?

`
torch.onnx.errors.SymbolicValueError: Unsupported: ONNX export of operator Unfold, input size not accessible. Please feel free to request support or submit a pull request on PyTorch GitHub: https://github.com/pytorch/pytorch/issues  [Caused by the value '381 defined in (%381 : Float(*, *, *, strides=[65600, 2050, 1], requires_grad=0, device=cuda:0) = onnx::Pad[mode="constant"](%output, %379, %380), scope: nemo.collections.tts.models.univnet.UnivNetModel::/nemo.collections.tts.modules.univnet_modules.Generator::generator/nemo.collections.tts.modules.univnet_modules.LVCBlock::res_stack.0
`
Fix activation checkpoint args for T5
State: closed | Pull request: yes
Labels: name: cherry-pick

Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca>

# What does this PR do ?

Fixes args that were not present in the T5 configs for activation checkpointing

**Collection**: NLP

# Changelog 
- Add specific line by line info of high level changes in this PR.

# Usage
* You can potentially add a usage example below

```python
# Add a code snippet demonstrating how to use this 
```

# Before your PR is "Ready for review"
**Pre checks**:
- [ ] Make sure you read and followed [Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md)
- [ ] Did you write any new necessary tests?
- [ ] Did you add or update any necessary documentation?
- [ ] Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  - [ ] Reviewer: Does the PR have correct import guards for all optional libraries?
  
**PR Type**:
- [ ] New Feature
- [ ] Bugfix
- [ ] Documentation

If you haven't finished some of the above items you can still open "Draft" PR.


## Who can review?

Anyone in the community is free to review the PR once the checks have passed. 
[Contributor guidelines](https://github.com/NVIDIA/NeMo/blob/main/CONTRIBUTING.md) contains specific people who can review PRs to various areas.

# Additional Information
* Related to # (issue)
Draft: Add support for modeling words in kenLM for subword models.
State: closed | Pull request: yes
Labels: name: stale

# What does this PR do ?

Add support for modeling words in kenLM for subword models.

**Collection**: ASR

# Changelog 
- Add support for modeling words in kenLM for subword models.
- Add missing dependency to beam search installation.

# Usage
NA

**PR Type**:
- [X] New Feature
- [ ] Bugfix
- [ ] Documentation

## Who can review?

Finally, this is a draft. I am going to check with the effected party that these changes will work for them. Then maybe someone like @VahidooX can take a look.

# Additional Information
One commit message describes this in detail. Pasting here:

Previously, NeMo did not support beam search with a KenLM language
model trained on words when using a subword acoustic model. Rather, it
forces KenLM to model subpiece units instead. This caused problems for
a customer using https://github.com/nvidia-riva/riva-asrlib-decoder,
which does support this out of the box.

Adding --encoding_level_override=char enables this behavior. It is an
opt-in behavior.

There are very other additions here to make training KenLM models more
flexible:

- I add "--skip_symbols" to the "lmplz" call. Sometimes training data
can have "
" or "
" in it, which can cause a crash, unless you
trun this flag on. Always turning on the flag has no bad effects and
is backwards compatible.

- I add support for lmplz's "-T" option. This is useful if you are
working on a machine where "/tmp", the default directory, is small.

- I added "--limit_vocab_file". It speeds up training when you happen
to have a training file that has a lot of out of your vocabulary of interest
(e.g., scraped from webpages).

I disable forcibly deleting the arpa file created by lmplz. You need
to keep this if you are using a WFST decoder.