Bump pytorch-lightning from 1.5.10 to 1.6.0 in /requirements
State: closed | Pull request: yes

Bumps [pytorch-lightning](https://github.com/PyTorchLightning/pytorch-lightning) from 1.5.10 to 1.6.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/PyTorchLightning/pytorch-lightning/releases">pytorch-lightning's releases</a>.</em></p>
<blockquote>
<h2>PyTorch Lightning 1.6: Support Intel's Habana Accelerator, New efficient DDP strategy (Bagua), Manual Fault-tolerance, Stability and Reliability.</h2>
<p>The core team is excited to announce the PyTorch Lightning 1.6 release ⚡</p>
<ul>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/blob/HEAD/#highlights">Highlights</a></li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/blob/HEAD/#bc-changes">Backward Incompatible Changes</a></li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/blob/HEAD/#changelog">Full Changelog</a></li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/blob/HEAD/#contributors">Contributors</a></li>
</ul>
<p><!-- raw HTML omitted --><!-- raw HTML omitted --></p>
<h2>Highlights</h2>
<p>PyTorch Lightning 1.6 is the work of 99 contributors who have worked on features, bug-fixes, and documentation for a total of over 750 commits since 1.5. This is our most active release yet. Here are some highlights:</p>
<h3>Introducing Intel's Habana Accelerator</h3>
<p>Lightning 1.6 now supports the Habana® framework, which includes Gaudi® AI training processors. Their heterogeneous architecture includes a cluster of fully programmable Tensor Processing Cores (TPC) along with its associated development tools and libraries and a configurable Matrix Math engine.</p>
<p>You can leverage the <a href="https://pytorch-lightning.readthedocs.io/en/stable/accelerators/hpu.html">Habana</a> hardware to accelerate your Deep Learning training workloads simply by passing:</p>
<pre lang="python"><code>trainer = pl.Trainer(accelerator=&quot;hpu&quot;)
<h1>single Gaudi training</h1>
<p>trainer = pl.Trainer(accelerator=&quot;hpu&quot;, devices=1)</p>
<h1>distributed training with 8 Gaudi</h1>
<p>trainer = pl.Trainer(accelerator=&quot;hpu&quot;, devices=8)
</code></pre></p>
<h3>The Bagua Strategy</h3>
<p>The <a href="https://pytorch-lightning.readthedocs.io/en/stable/accelerators/gpu.html#bagua">Bagua Strategy</a> is a deep learning acceleration framework that supports multiple, advanced distributed training algorithms with state-of-the-art system relaxation techniques. Enabling <a href="https://github.com/BaguaSys/bagua">Bagua</a>, which can be considerably faster than vanilla PyTorch DDP, is as simple as:</p>
<pre lang="python"><code>trainer = pl.Trainer(strategy=&quot;bagua&quot;)
<h1>or to choose a custom algorithm</h1>
<p>trainer = pl.Trainer(strategy=BaguaStrategy(algorithm=&quot;gradient_allreduce&quot;)  # default
</code></pre></p>
<h3>Towards stable Accelerator, Strategy, and Plugin APIs</h3>
<p>The <code>Accelerator</code>, <code>Strategy</code>, and <code>Plugin</code> APIs are a core part of PyTorch Lightning. They're where all the distributed boilerplate lives, and we're constantly working to improve both them and the overall PyTorch Lightning platform experience.</p>
<p>In this release, we've made some large changes to achieve that goal. Not to worry, though! The only users affected by these changes are those who use custom implementations of Accelerator and Strategy (<code>TrainingTypePlugin</code>) as well as certain Plugins. In particular, we want to highlight the following changes:</p>
<ul>
<li>All <code>TrainingTypePlugin</code>s have been renamed to <code>Strategy</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11120">#11120</a>). Strategy is a more appropriate name because it encompasses more than simply training communcation. This change is now aligned with the changes we implemented in 1.5, which introduced the new <a href="https://github.com/PyTorchLightning/pytorch-lightning/releases/tag/1.5.0#strategy-and-devices"><code>strategy</code> and <code>devices</code> flags to the Trainer</a>.</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a href="https://github.com/PyTorchLightning/pytorch-lightning/blob/master/CHANGELOG.md">pytorch-lightning's changelog</a>.</em></p>
<blockquote>
<h2>[1.6.0] - 2022-03-29</h2>
<h3>Added</h3>
<ul>
<li>Allow logging to an existing run ID in MLflow with <code>MLFlowLogger</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/12290">#12290</a>)</li>
<li>Enable gradient accumulation using Horovod's <code>backward_passes_per_step</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11911">#11911</a>)</li>
<li>Add new <code>DETAIL</code> log level to provide useful logs for improving monitoring and debugging of batch jobs (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11008">#11008</a>)</li>
<li>Added a flag <code>SLURMEnvironment(auto_requeue=True|False)</code> to control whether Lightning handles the requeuing (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10601">#10601</a>)</li>
<li>Fault Tolerant Manual
<ul>
<li>Add <code>_Stateful</code> protocol to detect if classes are stateful (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10646">#10646</a>)</li>
<li>Add <code>_FaultTolerantMode</code> enum used to track different supported fault tolerant modes (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10645">#10645</a>)</li>
<li>Add a <code>_rotate_worker_indices</code> utility to reload the state according the latest worker (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10647">#10647</a>)</li>
<li>Add stateful workers (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10674">#10674</a>)</li>
<li>Add an utility to collect the states across processes (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10639">#10639</a>)</li>
<li>Add logic to reload the states across data loading components (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10699">#10699</a>)</li>
<li>Cleanup some fault tolerant utilities (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10703">#10703</a>)</li>
<li>Enable Fault Tolerant Manual Training (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10707">#10707</a>)</li>
<li>Broadcast the <code>_terminate_gracefully</code> to all processes and add support for DDP (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10638">#10638</a>)</li>
</ul>
</li>
<li>Added support for re-instantiation of custom (subclasses of) <code>DataLoaders</code> returned in the <code>*_dataloader()</code> methods, i.e., automatic replacement of samplers now works with custom types of <code>DataLoader</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10680">#10680</a>)</li>
<li>Added a function to validate if fault tolerant training is supported. (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10465">#10465</a>)</li>
<li>Added a private callback to manage the creation and deletion of fault-tolerance checkpoints (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11862">#11862</a>)</li>
<li>Show a better error message when a custom <code>DataLoader</code> implementation is not well implemented and we need to reconstruct it (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10719">#10719</a>)</li>
<li>Show a better error message when frozen dataclass is used as a batch (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10927">#10927</a>)</li>
<li>Save the <code>Loop</code>'s state by default in the checkpoint (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10784">#10784</a>)</li>
<li>Added <code>Loop.replace</code> to easily switch one loop for another (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10324">#10324</a>)</li>
<li>Added support for <code>--lr_scheduler=ReduceLROnPlateau</code> to the <code>LightningCLI</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10860">#10860</a>)</li>
<li>Added <code>LightningCLI.configure_optimizers</code> to override the <code>configure_optimizers</code> return value (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10860">#10860</a>)</li>
<li>Added <code>LightningCLI(auto_registry)</code> flag to register all subclasses of the registerable components automatically (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/12108">#12108</a>)</li>
<li>Added a warning that shows when <code>max_epochs</code> in the <code>Trainer</code> is not set (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10700">#10700</a>)</li>
<li>Added support for returning a single Callback from <code>LightningModule.configure_callbacks</code> without wrapping it into a list (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11060">#11060</a>)</li>
<li>Added <code>console_kwargs</code> for <code>RichProgressBar</code> to initialize inner Console (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10875">#10875</a>)</li>
<li>Added support for shorthand notation to instantiate loggers with the <code>LightningCLI</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11533">#11533</a>)</li>
<li>Added a <code>LOGGER_REGISTRY</code> instance to register custom loggers to the <code>LightningCLI</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11533">#11533</a>)</li>
<li>Added info message when the <code>Trainer</code> arguments <code>limit_*_batches</code>, <code>overfit_batches</code>, or <code>val_check_interval</code> are set to <code>1</code> or <code>1.0</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11950">#11950</a>)</li>
<li>Added a <code>PrecisionPlugin.teardown</code> method (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10990">#10990</a>)</li>
<li>Added <code>LightningModule.lr_scheduler_step</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/10249">#10249</a>)</li>
<li>Added support for no pre-fetching to <code>DataFetcher</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11606">#11606</a>)</li>
<li>Added support for optimizer step progress tracking with manual optimization (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11848">#11848</a>)</li>
<li>Return the output of the <code>optimizer.step</code>. This can be useful for <code>LightningLite</code> users, manual optimization users, or users overriding <code>LightningModule.optimizer_step</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11711">#11711</a>)</li>
<li>Teardown the active loop and strategy on exception (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11620">#11620</a>)</li>
<li>Added a <code>MisconfigurationException</code> if user provided <code>opt_idx</code> in scheduler config doesn't match with actual optimizer index of its respective optimizer (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11247">#11247</a>)</li>
<li>Added a <code>loggers</code> property to <code>Trainer</code> which returns a list of loggers provided by the user (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11683">#11683</a>)</li>
<li>Added a <code>loggers</code> property to <code>LightningModule</code> which retrieves the <code>loggers</code> property from <code>Trainer</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11683">#11683</a>)</li>
<li>Added support for DDP when using a <code>CombinedLoader</code> for the training data (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11648">#11648</a>)</li>
<li>Added a warning when using <code>DistributedSampler</code> during validation/testing (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11479">#11479</a>)</li>
<li>Added support for <code>Bagua</code> training strategy (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11146">#11146</a>)</li>
<li>Added support for manually returning a <code>poptorch.DataLoader</code> in a <code>*_dataloader</code> hook (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/12116">#12116</a>)</li>
<li>Added <code>rank_zero</code> module to centralize utilities (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11747">#11747</a>)</li>
<li>Added a <code>_Stateful</code> support for <code>LightningDataModule</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11637">#11637</a>)</li>
<li>Added <code>_Stateful</code> support for <code>PrecisionPlugin</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/pull/11638">#11638</a>)</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/44e3edbf7a3fffd3069e2bc24c6ee143de79944b"><code>44e3edb</code></a> Cleanup CHANGELOG (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12507">#12507</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/e3893b9eca33496f4af0b5581fe222594a236900"><code>e3893b9</code></a> Merge pull request <a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12509">#12509</a> from RobertLaurella/patch-1</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/041da417db26a7d9de723f25866e5d8e38fe2039"><code>041da41</code></a> Remove TPU Availability check from parse devices (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12326">#12326</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/4fe0076a1ad05efd2385ab6e6827ecfbf7520bb9"><code>4fe0076</code></a> Prepare for the 1.6.0 release</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/17215ed91b7fafed0594304a752f2f8e3590e998"><code>17215ed</code></a> Fix titles capitalization in docs</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/a775804b4027a0038997f228e85184ea18ba4c3d"><code>a775804</code></a> Update Plugins doc (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12440">#12440</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/71e25f39d9a3e2cf3870d522c88705ea18dcdae8"><code>71e25f3</code></a> Update CI in README.md (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12495">#12495</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/c6cb6341e7e319191a83aa52bbbd4448ba0a372f"><code>c6cb634</code></a> Add usage of Jupyter magic command for loggers (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12333">#12333</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/42169a23a06197b68460d2629b650ed8228fcd18"><code>42169a2</code></a> Add typing to <code>LightningModule.trainer</code> (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12345">#12345</a>)</li>
<li><a href="https://github.com/PyTorchLightning/pytorch-lightning/commit/2de6a9bbbff44398f868a1594ed5a42bc726d872"><code>2de6a9b</code></a> Fix warning message formatting in save_hyperparameters (<a href="https://github-redirect.dependabot.com/PyTorchLightning/pytorch-lightning/issues/12498">#12498</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/PyTorchLightning/pytorch-lightning/compare/1.5.10...1.6.0">compare view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=pytorch-lightning&package-manager=pip&previous-version=1.5.10&new-version=1.6.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
- `@dependabot use these labels` will set the current labels as the default for future PRs for this repo and language
- `@dependabot use these reviewers` will set the current reviewers as the default for future PRs for this repo and language
- `@dependabot use these assignees` will set the current assignees as the default for future PRs for this repo and language
- `@dependabot use this milestone` will set the current milestone as the default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/NVIDIA/NeMo/network/alerts).

</details>