PyTorch Mobile: current status

r9y9: <p>I noticed that <a href="https://github.com/pytorch/ios-demo-app" class="inline-onebox" rel="noopener nofollow ugc">GitHub - pytorch/ios-demo-app: PyTorch iOS examples</a> and <a href="https://github.com/pytorch/android-demo-app" class="inline-onebox" rel="noopener nofollow ugc">GitHub - pytorch/android-demo-app: PyTorch android examples of usage in applications</a> had been recently archived, but couldn’t find relevant discussions on GitHub and this forum. I wonder if pytorch mobile (<a href="https://pytorch.org/mobile/home/" class="inline-onebox" rel="noopener nofollow ugc">Home | PyTorch</a>) will continue its development, or should we use onnx/onnxruntime instead?</p>
<p>Best,<br>
Ryuichi</p>

Cyrill: <p><a class="mention" href="/u/ptrblck">@ptrblck</a> could you shed some light on a recent development? The Pytorch Mobile iOS and Android Demo apps have been archived, with no communication at all about reasons. This move raises concerns about the future of TorchScript.</p>
<p>Hower, based on what I’ve read in another post here <a href="https://discuss.pytorch.org/t/consequences-of-pytorch-2-0-on-libtorch/167576">Consequences of PyTorch 2.0 on libtorch?</a>:</p>
<blockquote>
<p>[TorchScript] is not deprecated. We are not actively developing torchscript, but it will be supported for the foreseeable future, and you’ll be able to use torchscript based backends behind dynamo.</p>
</blockquote>

ptrblck: <p>I’m not involved in PyTorch Mobile development and don’t know what their support and roadmap is.<br>
Generally, I would be careful with TorchScript dependencies as it’s in “maintenance” mode and I would not expect to see major improvements or fixes anymore, as <code>torch.compile</code> is being prioritized.</p>

Cyrill: <p>Alright thank you for the insights.</p>

kimishpatel: <p>Hi,<br>
So PyTorch mobile, via lite interpreter that is based on torchscript, is also in maintenance mode. There is very limited work being done on it atm. We are actively working on our new stack for edge, called ExecuTorch, that was released in PyTorch conference 23. Typing from phone so cannot fine and paste links. But will update later.</p>

ptrblck: <p><a href="https://pytorch.org/executorch/stable/demo-apps-ios.html">This link</a> is showing a demo of ExecuTorch in case you were looking for this one.</p>

reuben: <p>Hi all.</p>
<p>Could you clarify what “in maintenance mode” means? The LibTorch-Lite Cocoapod is no longer being published, the org.pytorch:pytorch_android_lite package on Maven Central is no longer being published, and there are no official docs on how to build the missing packages that I can find.</p>
<p>ExecuTorch only works with a smaller set of operators, so if one is trying to do inference with a more complicated model (e.g. a beam search decoder), should they focus on ONNX rather than trying to revive LibTorch by hand?</p>

ptrblck: <aside class="quote no-group" data-username="reuben" data-post="7" data-topic="192040">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/reuben/48/8490_2.png" class="avatar"> reuben:</div>
<blockquote>
<p>Could you clarify what “in maintenance mode” means?</p>
</blockquote>
</aside>
<aside class="quote no-group" data-username="ptrblck" data-post="3" data-topic="192040">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/48/1823_2.png" class="avatar"> ptrblck:</div>
<blockquote>
<p>I would be careful with TorchScript dependencies as it’s in “maintenance” mode and I would not expect to see major improvements or fixes anymore</p>
</blockquote>
</aside>
<p>It would mean that no resources will be spent on improving or fixing <code>TorchScript</code> anymore. With that being said, I’m sure exceptions can be made depending on the scope of a regression, but eventually it comes down to the code owner’s decision.</p>

Cagatay_Bilgin: <p>Check out <a href="https://github.com/pytorch/executorch" class="inline-onebox" rel="noopener nofollow ugc">GitHub - pytorch/executorch: On-device AI across mobile, embedded and edge for PyTorch</a> and join our discord channel at<br>
<a href="https://discord.gg/Wyn9PWqP" class="inline-onebox" rel="noopener nofollow ugc">PyTorch Edge</a> . We discuss a lot of the plans openly there.</p>