opened
nightlessbaron
username_0
## 🚀 Feature
<!-- A clear and concise description of the feature proposal -->
Adding DataParallel method for CPU

## Motivation

<!-- Please outline the motivation for the proposal. Is your feature request related to a problem? e.g., I'm always frustrated when [...]. If this is related to another GitHub issue, please link here too -->
Recently, I have been working on few-shot learning and meta-learning models which in particular need small datasets. Let's take MAML for example. We have scope for parallelizing the inner loop and data parallelism seemed to be the answer for that. While, using GPUs does the work, we can also make use of CPUs for the same, as the data is sufficiently small.

## Pitch

<!-- A clear and concise description of what you want to happen. -->
My question is, is it worth looking into adding an option for CPUs in DataParallel module along with GPUs?
DataParallel on CPU
issue
created
agolynski
username_1
@username_0 Would https://pytorch.org/docs/stable/multiprocessing.html work for your usecase or you are proposing PT to have data parallel wrapper for this?
comment