Out of Date Apex Version
State: closed | Pull request: no
Labels: name: bug

**Describe the bug**

The Apex install git version is out of Date. 

https://github.com/NVIDIA/NeMo/blob/4833347105b5ec8526ae182cd2e1011b091ea89d/nemo/core/optim/distributed_adam.py#L19-L23

The file tried to load `_coalescing_manager_append_work` but the git version of Apex does not have this.

Code in Apex
```python
# Add args to coalescing manager if using PyTorch <=1.13.1
from torch.distributed.distributed_c10d import _coalescing_manager
if 'device' not in inspect.signature(_coalescing_manager).parameters.keys():
    _coalescing_manager_nodevice = _coalescing_manager
    @contextlib.contextmanager
    def _coalescing_manager(group, device, reqs):
        with _coalescing_manager_nodevice(group, reqs):
            yield
```


**Steps/Code to reproduce bug**
1. Install apex following instruction
2. try import `MegatronDistributedFusedAdam`
```python
        from nemo.core.optim.distributed_adam import MegatronDistributedFusedAdam
```

**Expected behavior**
Warning of no distributed_fused_adam

```
Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0]
Type 'copyright', 'credits' or 'license' for more information
IPython 8.14.0 -- An enhanced Interactive Python. Type '?' for help.

In [1]:  from nemo.core.optim.distributed_adam import MegatronDistributedFusedAdam
[2023-08-14 14:44:05,627] [INFO] [real_accelerator.py:133:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[NeMo W 2023-08-14 14:44:13 optimizers:65] Could not import distributed_fused_adam optimizer from Apex
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ in <module>:1                                                                                    │
│                                                                                                  │
│ /PATH_OF_MY_WORKSPACE/NeMo/nemo/core/optim/distributed_adam.py:19 in <module>               │
│                                                                                                  │
│    16 import itertools                                                                           │
│    17                                                                                            │
│    18 import torch                                                                               │
│ ❱  19 from apex.contrib.optimizers.distributed_fused_adam import (                               │
│    20 │   DistributedFusedAdam,                                                                  │
│    21 │   _coalescing_manager,                                                                   │
│    22 │   _coalescing_manager_append_work,                                                       │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
ImportError: cannot import name '_coalescing_manager_append_work' from 'apex.contrib.optimizers.distributed_fused_adam' 

```

**Environment overview (please complete the following information)**

 - Environment location: Bare-metal
 - Method of NeMo install: pip install from source.

**Environment details**


**Additional context**
None