Repository: pytorch
Issue: Inconsistency between GPU memory usage in torch.cuda.memory_summary and nvidia-smi
Labels: module: cuda,module: memory usage,triaged

## 🐛 Bug

I want to increase the batch size of my model but find the memory easily filled. However when I look at the numbers of the memory, it's not consistent between memory_summary and nvidia-smi.

The run-out-of-memory error says
```
Tried to allocate 156.00 MiB (GPU 0; 10.91 GiB total capacity; 5.68 GiB already allocated; 100.81 MiB free; 5.75 GiB reserved in total by PyTorch)
```

When I reduced the batch size a little bit, the memory_summary says
```
|===========================================================================|
|                  PyTorch CUDA memory summary, device ID 0                 |
|---------------------------------------------------------------------------|
|            CUDA OOMs: 0            |        cudaMalloc retries: 1         |
|===========================================================================|
|        Metric         | Cur Usage  | Peak Usage | Tot Alloc  | Tot Freed  |
|---------------------------------------------------------------------------|
| Allocated memory      |  183578 KB |    5260 MB |  149119 MB |  148940 MB |
|---------------------------------------------------------------------------|
| Active memory         |  183578 KB |    5260 MB |  149119 MB |  148940 MB |
|---------------------------------------------------------------------------|
| GPU reserved memory   |    5660 MB |    5778 MB |   10090 MB |    4430 MB |
|---------------------------------------------------------------------------|
| Non-releasable memory |  185062 KB |    1127 MB |   69225 MB |   69044 MB |
|---------------------------------------------------------------------------|
| Allocations           |     745    |     970    |   12603    |   11858    |
|---------------------------------------------------------------------------|
| Active allocs         |     745    |     970    |   12603    |   11858    |
|---------------------------------------------------------------------------|
| GPU reserved segments |      91    |      99    |     178    |      87    |
|---------------------------------------------------------------------------|
| Non-releasable allocs |      71    |      96    |    6859    |    6788    |
|===========================================================================|
```



<details>
<summary> Full output from another run </summary>

```
|===========================================================================|
|                  PyTorch CUDA memory summary, device ID 0                 |
|---------------------------------------------------------------------------|
|            CUDA OOMs: 0            |        cudaMalloc retries: 1         |
|===========================================================================|
|        Metric         | Cur Usage  | Peak Usage | Tot Alloc  | Tot Freed  |
|---------------------------------------------------------------------------|
| Allocated memory      |  184407 KB |    5294 MB |  149144 MB |  148964 MB |
|       from large pool |  132343 KB |    5252 MB |  148289 MB |  148160 MB |
|       from small pool |   52064 KB |      58 MB |     855 MB |     804 MB |
|---------------------------------------------------------------------------|
| Active memory         |  184407 KB |    5294 MB |  149144 MB |  148964 MB |
|       from large pool |  132343 KB |    5252 MB |  148289 MB |  148160 MB |
|       from small pool |   52064 KB |      58 MB |     855 MB |     804 MB |
|---------------------------------------------------------------------------|
| GPU reserved memory   |    5652 MB |    5946 MB |   10300 MB |    4648 MB |
|       from large pool |    5592 MB |    5916 MB |   10220 MB |    4628 MB |
|       from small pool |      60 MB |      60 MB |      80 MB |      20 MB |
|---------------------------------------------------------------------------|
| Non-releasable memory |   87977 KB |    1050 MB |   69597 MB |   69511 MB |
|       from large pool |   86793 KB |    1044 MB |   68629 MB |   68544 MB |
|       from small pool |    1184 KB |      11 MB |     967 MB |     966 MB |
|---------------------------------------------------------------------------|
| Allocations           |     745    |     970    |   12603    |   11858    |
|       from large pool |      40    |     161    |    4561    |    4521    |
|       from small pool |     705    |     812    |    8042    |    7337    |
|---------------------------------------------------------------------------|
| Active allocs         |     745    |     970    |   12603    |   11858    |
|       from large pool |      40    |     161    |    4561    |    4521    |
|       from small pool |     705    |     812    |    8042    |    7337    |
|---------------------------------------------------------------------------|
| GPU reserved segments |      92    |      99    |     179    |      87    |
|       from large pool |      62    |      84    |     139    |      77    |
|       from small pool |      30    |      30    |      40    |      10    |
|---------------------------------------------------------------------------|
| Non-releasable allocs |      72    |      95    |    6793    |    6721    |
|       from large pool |       7    |      55    |    2653    |    2646    |
|       from small pool |      65    |      76    |    4140    |    4075    |
|===========================================================================|
```

</details>

while at the same time, nvidia-smi reports
```
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 435.21       Driver Version: 435.21       CUDA Version: 10.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 108...  Off  | 00000000:65:00.0  On |                  N/A |
| 15%   56C    P2    75W / 250W |  10769MiB / 11175MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      1038      G   /usr/lib/xorg/Xorg                           357MiB |
|    0      1469      G   /usr/bin/kwin_x11                            174MiB |
|    0      1481      G   /usr/bin/plasmashell                          51MiB |
|    0     11082      G   ...uest-channel-token=16035913727769776697   244MiB |
|    0     15152      G   /usr/bin/plasma-discover                       2MiB |
|    0     21828      G   /usr/bin/plasma-discover                       2MiB |
|    0     24945      C   /home/jacobz/.conda/envs/lidar/bin/python   9729MiB |
|    0     27180      G   ...uest-channel-token=13034544221347569047    43MiB |
|    0     30029      G   ...AAAAAAAAAAAACAAAAAAAAAA= --shared-files   159MiB |
+-----------------------------------------------------------------------------+
```


So it seems to me that the whole process takes ~10000MB memory, but only ~5000MB are actually used by pytorch, the rest of the memory is just "allocated" but not used? I have struggling throught this for weeks and I haven't found anyway to solve this.

I found a similar issue #35901, but in my case I don't have any really large tensors. I can post the memory profiling result during several iterations using [this tool](https://github.com/Oldpan/Pytorch-Memory-Utils):

<details> 
  <summary> Tensors list </summary>

```
GPU Memory Track | 24-Apr-20-15:18:50 | Total Used Memory:1749.5 Mb

+ | 1 * Size:(3, 3, 3, 16, 32)    | Memory: 0.0552 M | <class 'torch.nn.parameter.Parameter'>
+ | 53 * Size:(64,)                | Memory: 0.0135 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(27922, 3)           | Memory: 0.3350 M | <class 'torch.Tensor'>
+ | 54 * Size:(128,)               | Memory: 0.0276 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(29179,)             | Memory: 0.1167 M | <class 'torch.Tensor'>
+ | 1 * Size:(6, 768, 1, 1)       | Memory: 0.0184 M | <class 'torch.nn.parameter.Parameter'>
+ | 14 * Size:(16,)                | Memory: 0.0008 M | <class 'torch.Tensor'>
+ | 1 * Size:(3, 3, 3, 128, 16)   | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(19841, 2)           | Memory: 0.1587 M | <class 'torch.Tensor'>
+ | 1 * Size:(256, 256, 4, 4)     | Memory: 4.1943 M | <class 'torch.nn.parameter.Parameter'>
+ | 19 * Size:(32,)                | Memory: 0.0024 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(41332,)             | Memory: 0.1653 M | <class 'torch.Tensor'>
+ | 1 * Size:(18216, 2)           | Memory: 0.1457 M | <class 'torch.Tensor'>
+ | 1 * Size:(38917, 10)          | Memory: 1.5566 M | <class 'torch.Tensor'>
+ | 1 * Size:(17986, 2)           | Memory: 0.1438 M | <class 'torch.Tensor'>
+ | 1 * Size:(20172,)             | Memory: 0.0806 M | <class 'torch.Tensor'>
+ | 5 * Size:(88, 100, 1, 1, 2)   | Memory: 0.3520 M | <class 'torch.Tensor'>
+ | 1 * Size:(17986,)             | Memory: 0.0719 M | <class 'torch.Tensor'>
+ | 1 * Size:(3, 3, 3, 16, 16)    | Memory: 0.0276 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(128, 256, 1, 1)     | Memory: 0.1310 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(34479, 10)          | Memory: 1.3791 M | <class 'torch.Tensor'>
+ | 1 * Size:(128, 256, 2, 2)     | Memory: 0.5242 M | <class 'torch.nn.parameter.Parameter'>
+ | 5 * Size:(88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(22664, 3)           | Memory: 0.2719 M | <class 'torch.Tensor'>
+ | 25 * Size:(256,)               | Memory: 0.0255 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(64, 3, 3, 3)        | Memory: 0.0069 M | <class 'torch.nn.parameter.Parameter'>
+ | 5 * Size:(256, 256, 3, 3)     | Memory: 11.796 M | <class 'torch.nn.parameter.Parameter'>
+ | 2 * Size:(3, 3, 3, 32, 32)    | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(3, 1, 1, 64, 64)    | Memory: 0.0491 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(14,)                | Memory: 5.6e-0 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(256, 128, 3, 3)     | Memory: 1.1796 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(27715, 3)           | Memory: 0.3325 M | <class 'torch.Tensor'>
+ | 1 * Size:(29179, 3)           | Memory: 0.3501 M | <class 'torch.Tensor'>
+ | 1 * Size:(22883,)             | Memory: 0.0915 M | <class 'torch.Tensor'>
+ | 1 * Size:(27922,)             | Memory: 0.1116 M | <class 'torch.Tensor'>
+ | 1 * Size:(22883, 3)           | Memory: 0.2745 M | <class 'torch.Tensor'>
+ | 1 * Size:(37605, 10)          | Memory: 1.5042 M | <class 'torch.Tensor'>
+ | 1 * Size:(40302,)             | Memory: 0.1612 M | <class 'torch.Tensor'>
+ | 19 * Size:(32,)                | Memory: 0.0024 M | <class 'torch.Tensor'>
+ | 1 * Size:(19841,)             | Memory: 0.0793 M | <class 'torch.Tensor'>
+ | 1 * Size:(128, 128)           | Memory: 0.0655 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(38917,)             | Memory: 0.1556 M | <class 'torch.Tensor'>
+ | 10 * Size:(128, 128, 3, 3)     | Memory: 5.8982 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(32, 32)             | Memory: 0.0040 M | <class 'torch.nn.parameter.Parameter'>
+ | 53 * Size:(64,)                | Memory: 0.0135 M | <class 'torch.Tensor'>
+ | 1 * Size:(18765,)             | Memory: 0.0750 M | <class 'torch.Tensor'>
+ | 1 * Size:(34479,)             | Memory: 0.1379 M | <class 'torch.Tensor'>
+ | 1 * Size:(27715,)             | Memory: 0.1108 M | <class 'torch.Tensor'>
+ | 1 * Size:(20172, 2)           | Memory: 0.1613 M | <class 'torch.Tensor'>
+ | 1 * Size:(37605,)             | Memory: 0.1504 M | <class 'torch.Tensor'>
+ | 1 * Size:(14, 768, 1, 1)      | Memory: 0.0430 M | <class 'torch.nn.parameter.Parameter'>
+ | 33 * Size:()                   | Memory: 0.0001 M | <class 'torch.Tensor'>
+ | 1 * Size:(3, 3, 3, 32, 64)    | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'>
+ | 25 * Size:(256,)               | Memory: 0.0255 M | <class 'torch.Tensor'>
+ | 7 * Size:(3, 3, 3, 64, 64)    | Memory: 3.0965 M | <class 'torch.nn.parameter.Parameter'>
+ | 54 * Size:(128,)               | Memory: 0.0276 M | <class 'torch.Tensor'>
+ | 1 * Size:(40302, 10)          | Memory: 1.6120 M | <class 'torch.Tensor'>
+ | 1 * Size:(22664,)             | Memory: 0.0906 M | <class 'torch.Tensor'>
+ | 1 * Size:(64, 64, 3, 3)       | Memory: 0.1474 M | <class 'torch.nn.parameter.Parameter'>
+ | 14 * Size:(16,)                | Memory: 0.0008 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(6,)                 | Memory: 2.4e-0 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(16, 10)             | Memory: 0.0006 M | <class 'torch.nn.parameter.Parameter'>
+ | 5 * Size:(3, 375, 1242)       | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(41332, 10)          | Memory: 1.6532 M | <class 'torch.Tensor'>
+ | 1 * Size:(18765, 2)           | Memory: 0.1501 M | <class 'torch.Tensor'>
+ | 1 * Size:(18216,)             | Memory: 0.0728 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:1749.5 Mb

+ | 1 * Size:(94980, 3)           | Memory: 1.1397 M | <class 'torch.Tensor'>
+ | 1 * Size:(94980,)             | Memory: 0.3799 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(192635, 10)         | Memory: 7.7054 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(130363, 4)          | Memory: 2.0858 M | <class 'torch.Tensor'>
+ | 1 * Size:(130363,)            | Memory: 0.5214 M | <class 'torch.Tensor'>
+ | 1 * Size:(192635,)            | Memory: 0.7705 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:6974.6 Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:6976.7 Mb

+ | 1 * Size:(18232, 2)           | Memory: 0.1458 M | <class 'torch.Tensor'>
+ | 1 * Size:(18232,)             | Memory: 0.0729 M | <class 'torch.Tensor'>
+ | 1 * Size:(19154, 2)           | Memory: 0.1532 M | <class 'torch.Tensor'>
+ | 1 * Size:(18142,)             | Memory: 0.0725 M | <class 'torch.Tensor'>
+ | 1 * Size:(26561, 3)           | Memory: 0.3187 M | <class 'torch.Tensor'>
+ | 1 * Size:(28865, 3)           | Memory: 0.3463 M | <class 'torch.Tensor'>
+ | 1 * Size:(37101, 10)          | Memory: 1.4840 M | <class 'torch.Tensor'>
+ | 1 * Size:(37162, 10)          | Memory: 1.4864 M | <class 'torch.Tensor'>
+ | 1 * Size:(28865,)             | Memory: 0.1154 M | <class 'torch.Tensor'>
+ | 1 * Size:(39015,)             | Memory: 0.1560 M | <class 'torch.Tensor'>
+ | 1 * Size:(38664,)             | Memory: 0.1546 M | <class 'torch.Tensor'>
+ | 1 * Size:(30824, 3)           | Memory: 0.3698 M | <class 'torch.Tensor'>
+ | 1 * Size:(24021,)             | Memory: 0.0960 M | <class 'torch.Tensor'>
+ | 1 * Size:(29454,)             | Memory: 0.1178 M | <class 'torch.Tensor'>
+ | 1 * Size:(18473,)             | Memory: 0.0738 M | <class 'torch.Tensor'>
+ | 1 * Size:(37101,)             | Memory: 0.1484 M | <class 'torch.Tensor'>
+ | 1 * Size:(24021, 3)           | Memory: 0.2882 M | <class 'torch.Tensor'>
+ | 1 * Size:(26561,)             | Memory: 0.1062 M | <class 'torch.Tensor'>
+ | 1 * Size:(29454, 3)           | Memory: 0.3534 M | <class 'torch.Tensor'>
+ | 1 * Size:(17017,)             | Memory: 0.0680 M | <class 'torch.Tensor'>
+ | 1 * Size:(19154,)             | Memory: 0.0766 M | <class 'torch.Tensor'>
+ | 1 * Size:(40063,)             | Memory: 0.1602 M | <class 'torch.Tensor'>
+ | 1 * Size:(40063, 10)          | Memory: 1.6025 M | <class 'torch.Tensor'>
+ | 1 * Size:(18142, 2)           | Memory: 0.1451 M | <class 'torch.Tensor'>
+ | 1 * Size:(37162,)             | Memory: 0.1486 M | <class 'torch.Tensor'>
+ | 1 * Size:(18473, 2)           | Memory: 0.1477 M | <class 'torch.Tensor'>
+ | 1 * Size:(39015, 10)          | Memory: 1.5606 M | <class 'torch.Tensor'>
+ | 1 * Size:(38664, 10)          | Memory: 1.5465 M | <class 'torch.Tensor'>
+ | 1 * Size:(17017, 2)           | Memory: 0.1361 M | <class 'torch.Tensor'>
+ | 1 * Size:(30824,)             | Memory: 0.1232 M | <class 'torch.Tensor'>
- | 1 * Size:(94980,)             | Memory: 0.3799 M | <class 'torch.Tensor'> 
- | 1 * Size:(22883,)             | Memory: 0.0915 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(130363, 4)          | Memory: 2.0858 M | <class 'torch.Tensor'> 
- | 1 * Size:(29179,)             | Memory: 0.1167 M | <class 'torch.Tensor'> 
- | 1 * Size:(27922, 3)           | Memory: 0.3350 M | <class 'torch.Tensor'> 
- | 1 * Size:(27922,)             | Memory: 0.1116 M | <class 'torch.Tensor'> 
- | 1 * Size:(22883, 3)           | Memory: 0.2745 M | <class 'torch.Tensor'> 
- | 1 * Size:(37605, 10)          | Memory: 1.5042 M | <class 'torch.Tensor'> 
- | 1 * Size:(40302,)             | Memory: 0.1612 M | <class 'torch.Tensor'> 
- | 1 * Size:(19841, 2)           | Memory: 0.1587 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(19841,)             | Memory: 0.0793 M | <class 'torch.Tensor'> 
- | 1 * Size:(38917,)             | Memory: 0.1556 M | <class 'torch.Tensor'> 
- | 1 * Size:(130363,)            | Memory: 0.5214 M | <class 'torch.Tensor'> 
- | 1 * Size:(41332,)             | Memory: 0.1653 M | <class 'torch.Tensor'> 
- | 1 * Size:(18216, 2)           | Memory: 0.1457 M | <class 'torch.Tensor'> 
- | 1 * Size:(38917, 10)          | Memory: 1.5566 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(20172,)             | Memory: 0.0806 M | <class 'torch.Tensor'> 
- | 1 * Size:(17986, 2)           | Memory: 0.1438 M | <class 'torch.Tensor'> 
- | 1 * Size:(94980, 3)           | Memory: 1.1397 M | <class 'torch.Tensor'> 
- | 1 * Size:(17986,)             | Memory: 0.0719 M | <class 'torch.Tensor'> 
- | 1 * Size:(18765,)             | Memory: 0.0750 M | <class 'torch.Tensor'> 
- | 1 * Size:(34479,)             | Memory: 0.1379 M | <class 'torch.Tensor'> 
- | 1 * Size:(34479, 10)          | Memory: 1.3791 M | <class 'torch.Tensor'> 
- | 1 * Size:(27715,)             | Memory: 0.1108 M | <class 'torch.Tensor'> 
- | 1 * Size:(20172, 2)           | Memory: 0.1613 M | <class 'torch.Tensor'> 
- | 1 * Size:(37605,)             | Memory: 0.1504 M | <class 'torch.Tensor'> 
- | 1 * Size:(40302, 10)          | Memory: 1.6120 M | <class 'torch.Tensor'> 
- | 1 * Size:(22664,)             | Memory: 0.0906 M | <class 'torch.Tensor'> 
- | 1 * Size:(22664, 3)           | Memory: 0.2719 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(192635, 10)         | Memory: 7.7054 M | <class 'torch.Tensor'> 
- | 1 * Size:(18765, 2)           | Memory: 0.1501 M | <class 'torch.Tensor'> 
- | 1 * Size:(192635,)            | Memory: 0.7705 M | <class 'torch.Tensor'> 
- | 1 * Size:(41332, 10)          | Memory: 1.6532 M | <class 'torch.Tensor'> 
- | 1 * Size:(27715, 3)           | Memory: 0.3325 M | <class 'torch.Tensor'> 
- | 1 * Size:(18216,)             | Memory: 0.0728 M | <class 'torch.Tensor'> 
- | 1 * Size:(29179, 3)           | Memory: 0.3501 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(91018, 3)           | Memory: 1.0922 M | <class 'torch.Tensor'>
+ | 1 * Size:(139725,)            | Memory: 0.5589 M | <class 'torch.Tensor'>
+ | 1 * Size:(192005, 10)         | Memory: 7.6802 M | <class 'torch.Tensor'>
+ | 1 * Size:(139725, 4)          | Memory: 2.2356 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(192005,)            | Memory: 0.7680 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(91018,)             | Memory: 0.3640 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 8 * Size:(1,)                 | Memory: 3.2e-0 M | <class 'torch.Tensor'>
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(37963, 10)          | Memory: 1.5185 M | <class 'torch.Tensor'>
+ | 1 * Size:(18958, 2)           | Memory: 0.1516 M | <class 'torch.Tensor'>
+ | 1 * Size:(35020, 10)          | Memory: 1.4008 M | <class 'torch.Tensor'>
+ | 1 * Size:(30883,)             | Memory: 0.1235 M | <class 'torch.Tensor'>
+ | 1 * Size:(25413,)             | Memory: 0.1016 M | <class 'torch.Tensor'>
+ | 1 * Size:(39898,)             | Memory: 0.1595 M | <class 'torch.Tensor'>
+ | 1 * Size:(37648, 10)          | Memory: 1.5059 M | <class 'torch.Tensor'>
+ | 1 * Size:(39898, 10)          | Memory: 1.5959 M | <class 'torch.Tensor'>
+ | 1 * Size:(19102, 2)           | Memory: 0.1528 M | <class 'torch.Tensor'>
+ | 1 * Size:(18958,)             | Memory: 0.0758 M | <class 'torch.Tensor'>
+ | 1 * Size:(39849,)             | Memory: 0.1593 M | <class 'torch.Tensor'>
+ | 1 * Size:(39849, 10)          | Memory: 1.5939 M | <class 'torch.Tensor'>
+ | 1 * Size:(16082,)             | Memory: 0.0643 M | <class 'torch.Tensor'>
+ | 1 * Size:(31749, 3)           | Memory: 0.3809 M | <class 'torch.Tensor'>
+ | 1 * Size:(22577,)             | Memory: 0.0903 M | <class 'torch.Tensor'>
+ | 1 * Size:(37963,)             | Memory: 0.1518 M | <class 'torch.Tensor'>
+ | 1 * Size:(17851, 2)           | Memory: 0.1428 M | <class 'torch.Tensor'>
+ | 1 * Size:(16082, 2)           | Memory: 0.1286 M | <class 'torch.Tensor'>
+ | 1 * Size:(19102,)             | Memory: 0.0764 M | <class 'torch.Tensor'>
+ | 1 * Size:(22577, 3)           | Memory: 0.2709 M | <class 'torch.Tensor'>
+ | 1 * Size:(37648,)             | Memory: 0.1505 M | <class 'torch.Tensor'>
+ | 1 * Size:(30883, 3)           | Memory: 0.3705 M | <class 'torch.Tensor'>
+ | 1 * Size:(35020,)             | Memory: 0.1400 M | <class 'torch.Tensor'>
+ | 1 * Size:(19328, 2)           | Memory: 0.1546 M | <class 'torch.Tensor'>
+ | 1 * Size:(25857, 3)           | Memory: 0.3102 M | <class 'torch.Tensor'>
+ | 1 * Size:(19328,)             | Memory: 0.0773 M | <class 'torch.Tensor'>
+ | 1 * Size:(25857,)             | Memory: 0.1034 M | <class 'torch.Tensor'>
+ | 1 * Size:(31749,)             | Memory: 0.1269 M | <class 'torch.Tensor'>
+ | 1 * Size:(17851,)             | Memory: 0.0714 M | <class 'torch.Tensor'>
+ | 1 * Size:(25413, 3)           | Memory: 0.3049 M | <class 'torch.Tensor'>
- | 1 * Size:(91018, 3)           | Memory: 1.0922 M | <class 'torch.Tensor'> 
- | 1 * Size:(18232, 2)           | Memory: 0.1458 M | <class 'torch.Tensor'> 
- | 1 * Size:(18232,)             | Memory: 0.0729 M | <class 'torch.Tensor'> 
- | 1 * Size:(19154, 2)           | Memory: 0.1532 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(18142,)             | Memory: 0.0725 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(26561, 3)           | Memory: 0.3187 M | <class 'torch.Tensor'> 
- | 1 * Size:(28865, 3)           | Memory: 0.3463 M | <class 'torch.Tensor'> 
- | 1 * Size:(37101, 10)          | Memory: 1.4840 M | <class 'torch.Tensor'> 
- | 1 * Size:(37162, 10)          | Memory: 1.4864 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(28865,)             | Memory: 0.1154 M | <class 'torch.Tensor'> 
- | 1 * Size:(39015,)             | Memory: 0.1560 M | <class 'torch.Tensor'> 
- | 1 * Size:(38664,)             | Memory: 0.1546 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(24021,)             | Memory: 0.0960 M | <class 'torch.Tensor'> 
- | 1 * Size:(91018,)             | Memory: 0.3640 M | <class 'torch.Tensor'> 
- | 1 * Size:(30824, 3)           | Memory: 0.3698 M | <class 'torch.Tensor'> 
- | 1 * Size:(29454,)             | Memory: 0.1178 M | <class 'torch.Tensor'> 
- | 1 * Size:(18473,)             | Memory: 0.0738 M | <class 'torch.Tensor'> 
- | 1 * Size:(37101,)             | Memory: 0.1484 M | <class 'torch.Tensor'> 
- | 1 * Size:(24021, 3)           | Memory: 0.2882 M | <class 'torch.Tensor'> 
- | 1 * Size:(192005, 10)         | Memory: 7.6802 M | <class 'torch.Tensor'> 
- | 1 * Size:(26561,)             | Memory: 0.1062 M | <class 'torch.Tensor'> 
- | 1 * Size:(29454, 3)           | Memory: 0.3534 M | <class 'torch.Tensor'> 
- | 1 * Size:(17017,)             | Memory: 0.0680 M | <class 'torch.Tensor'> 
- | 1 * Size:(19154,)             | Memory: 0.0766 M | <class 'torch.Tensor'> 
- | 1 * Size:(40063,)             | Memory: 0.1602 M | <class 'torch.Tensor'> 
- | 1 * Size:(40063, 10)          | Memory: 1.6025 M | <class 'torch.Tensor'> 
- | 1 * Size:(18142, 2)           | Memory: 0.1451 M | <class 'torch.Tensor'> 
- | 1 * Size:(37162,)             | Memory: 0.1486 M | <class 'torch.Tensor'> 
- | 1 * Size:(18473, 2)           | Memory: 0.1477 M | <class 'torch.Tensor'> 
- | 1 * Size:(39015, 10)          | Memory: 1.5606 M | <class 'torch.Tensor'> 
- | 1 * Size:(139725,)            | Memory: 0.5589 M | <class 'torch.Tensor'> 
- | 1 * Size:(38664, 10)          | Memory: 1.5465 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(139725, 4)          | Memory: 2.2356 M | <class 'torch.Tensor'> 
- | 1 * Size:(192005,)            | Memory: 0.7680 M | <class 'torch.Tensor'> 
- | 1 * Size:(17017, 2)           | Memory: 0.1361 M | <class 'torch.Tensor'> 
- | 1 * Size:(30824,)             | Memory: 0.1232 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(91321, 3)           | Memory: 1.0958 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(136479, 4)          | Memory: 2.1836 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(91321,)             | Memory: 0.3652 M | <class 'torch.Tensor'>
+ | 1 * Size:(136479,)            | Memory: 0.5459 M | <class 'torch.Tensor'>
+ | 1 * Size:(190378, 10)         | Memory: 7.6151 M | <class 'torch.Tensor'>
+ | 1 * Size:(190378,)            | Memory: 0.7615 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 12 * Size:(1,)                 | Memory: 4.8e-0 M | <class 'torch.Tensor'>
- | 8 * Size:(1,)                 | Memory: 3.2e-0 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(26185,)             | Memory: 0.1047 M | <class 'torch.Tensor'>
+ | 1 * Size:(17942, 2)           | Memory: 0.1435 M | <class 'torch.Tensor'>
+ | 1 * Size:(16376, 2)           | Memory: 0.1310 M | <class 'torch.Tensor'>
+ | 1 * Size:(38214,)             | Memory: 0.1528 M | <class 'torch.Tensor'>
+ | 1 * Size:(18598, 2)           | Memory: 0.1487 M | <class 'torch.Tensor'>
+ | 1 * Size:(37021, 10)          | Memory: 1.4808 M | <class 'torch.Tensor'>
+ | 1 * Size:(25573, 3)           | Memory: 0.3068 M | <class 'torch.Tensor'>
+ | 1 * Size:(25427,)             | Memory: 0.1017 M | <class 'torch.Tensor'>
+ | 1 * Size:(27068, 3)           | Memory: 0.3248 M | <class 'torch.Tensor'>
+ | 1 * Size:(23936, 3)           | Memory: 0.2872 M | <class 'torch.Tensor'>
+ | 1 * Size:(17710, 2)           | Memory: 0.1416 M | <class 'torch.Tensor'>
+ | 1 * Size:(27068,)             | Memory: 0.1082 M | <class 'torch.Tensor'>
+ | 1 * Size:(34811,)             | Memory: 0.1392 M | <class 'torch.Tensor'>
+ | 1 * Size:(37021,)             | Memory: 0.1480 M | <class 'torch.Tensor'>
+ | 1 * Size:(16872,)             | Memory: 0.0674 M | <class 'torch.Tensor'>
+ | 1 * Size:(26185, 3)           | Memory: 0.3142 M | <class 'torch.Tensor'>
+ | 1 * Size:(23936,)             | Memory: 0.0957 M | <class 'torch.Tensor'>
+ | 1 * Size:(25427, 3)           | Memory: 0.3051 M | <class 'torch.Tensor'>
+ | 1 * Size:(18598,)             | Memory: 0.0743 M | <class 'torch.Tensor'>
+ | 1 * Size:(35160,)             | Memory: 0.1406 M | <class 'torch.Tensor'>
+ | 1 * Size:(25573,)             | Memory: 0.1022 M | <class 'torch.Tensor'>
+ | 1 * Size:(17942,)             | Memory: 0.0717 M | <class 'torch.Tensor'>
+ | 1 * Size:(38902, 10)          | Memory: 1.5560 M | <class 'torch.Tensor'>
+ | 1 * Size:(16376,)             | Memory: 0.0655 M | <class 'torch.Tensor'>
+ | 1 * Size:(38902,)             | Memory: 0.1556 M | <class 'torch.Tensor'>
+ | 1 * Size:(38214, 10)          | Memory: 1.5285 M | <class 'torch.Tensor'>
+ | 1 * Size:(34811, 10)          | Memory: 1.3924 M | <class 'torch.Tensor'>
+ | 1 * Size:(35160, 10)          | Memory: 1.4064 M | <class 'torch.Tensor'>
+ | 1 * Size:(16872, 2)           | Memory: 0.1349 M | <class 'torch.Tensor'>
+ | 1 * Size:(17710,)             | Memory: 0.0708 M | <class 'torch.Tensor'>
- | 1 * Size:(37963, 10)          | Memory: 1.5185 M | <class 'torch.Tensor'> 
- | 1 * Size:(18958, 2)           | Memory: 0.1516 M | <class 'torch.Tensor'> 
- | 1 * Size:(35020, 10)          | Memory: 1.4008 M | <class 'torch.Tensor'> 
- | 1 * Size:(30883,)             | Memory: 0.1235 M | <class 'torch.Tensor'> 
- | 1 * Size:(136479, 4)          | Memory: 2.1836 M | <class 'torch.Tensor'> 
- | 1 * Size:(39898,)             | Memory: 0.1595 M | <class 'torch.Tensor'> 
- | 1 * Size:(37648, 10)          | Memory: 1.5059 M | <class 'torch.Tensor'> 
- | 1 * Size:(25413,)             | Memory: 0.1016 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(39898, 10)          | Memory: 1.5959 M | <class 'torch.Tensor'> 
- | 1 * Size:(19102, 2)           | Memory: 0.1528 M | <class 'torch.Tensor'> 
- | 1 * Size:(190378, 10)         | Memory: 7.6151 M | <class 'torch.Tensor'> 
- | 1 * Size:(18958,)             | Memory: 0.0758 M | <class 'torch.Tensor'> 
- | 1 * Size:(39849, 10)          | Memory: 1.5939 M | <class 'torch.Tensor'> 
- | 1 * Size:(39849,)             | Memory: 0.1593 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(16082,)             | Memory: 0.0643 M | <class 'torch.Tensor'> 
- | 1 * Size:(31749, 3)           | Memory: 0.3809 M | <class 'torch.Tensor'> 
- | 1 * Size:(22577,)             | Memory: 0.0903 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(91321, 3)           | Memory: 1.0958 M | <class 'torch.Tensor'> 
- | 1 * Size:(37963,)             | Memory: 0.1518 M | <class 'torch.Tensor'> 
- | 1 * Size:(17851, 2)           | Memory: 0.1428 M | <class 'torch.Tensor'> 
- | 1 * Size:(16082, 2)           | Memory: 0.1286 M | <class 'torch.Tensor'> 
- | 1 * Size:(19102,)             | Memory: 0.0764 M | <class 'torch.Tensor'> 
- | 1 * Size:(22577, 3)           | Memory: 0.2709 M | <class 'torch.Tensor'> 
- | 1 * Size:(37648,)             | Memory: 0.1505 M | <class 'torch.Tensor'> 
- | 1 * Size:(30883, 3)           | Memory: 0.3705 M | <class 'torch.Tensor'> 
- | 1 * Size:(190378,)            | Memory: 0.7615 M | <class 'torch.Tensor'> 
- | 1 * Size:(35020,)             | Memory: 0.1400 M | <class 'torch.Tensor'> 
- | 1 * Size:(19328, 2)           | Memory: 0.1546 M | <class 'torch.Tensor'> 
- | 1 * Size:(25857, 3)           | Memory: 0.3102 M | <class 'torch.Tensor'> 
- | 1 * Size:(19328,)             | Memory: 0.0773 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(25857,)             | Memory: 0.1034 M | <class 'torch.Tensor'> 
- | 1 * Size:(31749,)             | Memory: 0.1269 M | <class 'torch.Tensor'> 
- | 1 * Size:(91321,)             | Memory: 0.3652 M | <class 'torch.Tensor'> 
- | 1 * Size:(17851,)             | Memory: 0.0714 M | <class 'torch.Tensor'> 
- | 1 * Size:(25413, 3)           | Memory: 0.3049 M | <class 'torch.Tensor'> 
- | 1 * Size:(136479,)            | Memory: 0.5459 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(87498, 3)           | Memory: 1.0499 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(87498,)             | Memory: 0.3499 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(128189,)            | Memory: 0.5127 M | <class 'torch.Tensor'>
+ | 1 * Size:(184108, 10)         | Memory: 7.3643 M | <class 'torch.Tensor'>
+ | 1 * Size:(128189, 4)          | Memory: 2.0510 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(184108,)            | Memory: 0.7364 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 16 * Size:(1,)                 | Memory: 6.4e-0 M | <class 'torch.Tensor'>
- | 12 * Size:(1,)                 | Memory: 4.8e-0 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(26959, 3)           | Memory: 0.3235 M | <class 'torch.Tensor'>
+ | 1 * Size:(26959,)             | Memory: 0.1078 M | <class 'torch.Tensor'>
+ | 1 * Size:(38918,)             | Memory: 0.1556 M | <class 'torch.Tensor'>
+ | 1 * Size:(40922,)             | Memory: 0.1636 M | <class 'torch.Tensor'>
+ | 1 * Size:(28273, 3)           | Memory: 0.3392 M | <class 'torch.Tensor'>
+ | 1 * Size:(38932, 10)          | Memory: 1.5572 M | <class 'torch.Tensor'>
+ | 1 * Size:(40605, 10)          | Memory: 1.6242 M | <class 'torch.Tensor'>
+ | 1 * Size:(40922, 10)          | Memory: 1.6368 M | <class 'torch.Tensor'>
+ | 1 * Size:(19588, 2)           | Memory: 0.1567 M | <class 'torch.Tensor'>
+ | 1 * Size:(28215, 3)           | Memory: 0.3385 M | <class 'torch.Tensor'>
+ | 1 * Size:(28215,)             | Memory: 0.1128 M | <class 'torch.Tensor'>
+ | 1 * Size:(19078,)             | Memory: 0.0763 M | <class 'torch.Tensor'>
+ | 1 * Size:(18222, 2)           | Memory: 0.1457 M | <class 'torch.Tensor'>
+ | 1 * Size:(19992,)             | Memory: 0.0799 M | <class 'torch.Tensor'>
+ | 1 * Size:(38918, 10)          | Memory: 1.5567 M | <class 'torch.Tensor'>
+ | 1 * Size:(40605,)             | Memory: 0.1624 M | <class 'torch.Tensor'>
+ | 1 * Size:(40123, 10)          | Memory: 1.6049 M | <class 'torch.Tensor'>
+ | 1 * Size:(28273,)             | Memory: 0.1130 M | <class 'torch.Tensor'>
+ | 1 * Size:(19516, 2)           | Memory: 0.1561 M | <class 'torch.Tensor'>
+ | 1 * Size:(19588,)             | Memory: 0.0783 M | <class 'torch.Tensor'>
+ | 1 * Size:(27987, 3)           | Memory: 0.3358 M | <class 'torch.Tensor'>
+ | 1 * Size:(19516,)             | Memory: 0.0780 M | <class 'torch.Tensor'>
+ | 1 * Size:(38932,)             | Memory: 0.1557 M | <class 'torch.Tensor'>
+ | 1 * Size:(27987,)             | Memory: 0.1119 M | <class 'torch.Tensor'>
+ | 1 * Size:(28147,)             | Memory: 0.1125 M | <class 'torch.Tensor'>
+ | 1 * Size:(28147, 3)           | Memory: 0.3377 M | <class 'torch.Tensor'>
+ | 1 * Size:(19992, 2)           | Memory: 0.1599 M | <class 'torch.Tensor'>
+ | 1 * Size:(19078, 2)           | Memory: 0.1526 M | <class 'torch.Tensor'>
+ | 1 * Size:(40123,)             | Memory: 0.1604 M | <class 'torch.Tensor'>
+ | 1 * Size:(18222,)             | Memory: 0.0728 M | <class 'torch.Tensor'>
- | 1 * Size:(26185,)             | Memory: 0.1047 M | <class 'torch.Tensor'> 
- | 1 * Size:(17942, 2)           | Memory: 0.1435 M | <class 'torch.Tensor'> 
- | 1 * Size:(38214,)             | Memory: 0.1528 M | <class 'torch.Tensor'> 
- | 1 * Size:(16376, 2)           | Memory: 0.1310 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(18598, 2)           | Memory: 0.1487 M | <class 'torch.Tensor'> 
- | 1 * Size:(37021, 10)          | Memory: 1.4808 M | <class 'torch.Tensor'> 
- | 1 * Size:(25573, 3)           | Memory: 0.3068 M | <class 'torch.Tensor'> 
- | 1 * Size:(128189, 4)          | Memory: 2.0510 M | <class 'torch.Tensor'> 
- | 1 * Size:(25427,)             | Memory: 0.1017 M | <class 'torch.Tensor'> 
- | 1 * Size:(27068, 3)           | Memory: 0.3248 M | <class 'torch.Tensor'> 
- | 1 * Size:(23936, 3)           | Memory: 0.2872 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(17710, 2)           | Memory: 0.1416 M | <class 'torch.Tensor'> 
- | 1 * Size:(27068,)             | Memory: 0.1082 M | <class 'torch.Tensor'> 
- | 1 * Size:(34811,)             | Memory: 0.1392 M | <class 'torch.Tensor'> 
- | 1 * Size:(37021,)             | Memory: 0.1480 M | <class 'torch.Tensor'> 
- | 1 * Size:(26185, 3)           | Memory: 0.3142 M | <class 'torch.Tensor'> 
- | 1 * Size:(16872,)             | Memory: 0.0674 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(23936,)             | Memory: 0.0957 M | <class 'torch.Tensor'> 
- | 1 * Size:(87498, 3)           | Memory: 1.0499 M | <class 'torch.Tensor'> 
- | 1 * Size:(18598,)             | Memory: 0.0743 M | <class 'torch.Tensor'> 
- | 1 * Size:(25427, 3)           | Memory: 0.3051 M | <class 'torch.Tensor'> 
- | 1 * Size:(35160,)             | Memory: 0.1406 M | <class 'torch.Tensor'> 
- | 1 * Size:(25573,)             | Memory: 0.1022 M | <class 'torch.Tensor'> 
- | 1 * Size:(128189,)            | Memory: 0.5127 M | <class 'torch.Tensor'> 
- | 1 * Size:(17942,)             | Memory: 0.0717 M | <class 'torch.Tensor'> 
- | 1 * Size:(38902, 10)          | Memory: 1.5560 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(16376,)             | Memory: 0.0655 M | <class 'torch.Tensor'> 
- | 1 * Size:(38902,)             | Memory: 0.1556 M | <class 'torch.Tensor'> 
- | 1 * Size:(38214, 10)          | Memory: 1.5285 M | <class 'torch.Tensor'> 
- | 1 * Size:(184108, 10)         | Memory: 7.3643 M | <class 'torch.Tensor'> 
- | 1 * Size:(34811, 10)          | Memory: 1.3924 M | <class 'torch.Tensor'> 
- | 1 * Size:(35160, 10)          | Memory: 1.4064 M | <class 'torch.Tensor'> 
- | 1 * Size:(16872, 2)           | Memory: 0.1349 M | <class 'torch.Tensor'> 
- | 1 * Size:(87498,)             | Memory: 0.3499 M | <class 'torch.Tensor'> 
- | 1 * Size:(184108,)            | Memory: 0.7364 M | <class 'torch.Tensor'> 
- | 1 * Size:(17710,)             | Memory: 0.0708 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:6972.8 Mb

+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(199500, 10)         | Memory: 7.98 M | <class 'torch.Tensor'>
+ | 1 * Size:(139581,)            | Memory: 0.5583 M | <class 'torch.Tensor'>
+ | 1 * Size:(139581, 4)          | Memory: 2.2332 M | <class 'torch.Tensor'>
+ | 1 * Size:(96396, 3)           | Memory: 1.1567 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(96396,)             | Memory: 0.3855 M | <class 'torch.Tensor'>
+ | 1 * Size:(199500,)            | Memory: 0.798 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:7570.5 Mb

+ | 20 * Size:(1,)                 | Memory: 7.9999 M | <class 'torch.Tensor'>
- | 16 * Size:(1,)                 | Memory: 6.4e-0 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:7570.5 Mb

+ | 1 * Size:(37771,)             | Memory: 0.1510 M | <class 'torch.Tensor'>
+ | 1 * Size:(26063, 3)           | Memory: 0.3127 M | <class 'torch.Tensor'>
+ | 1 * Size:(17259,)             | Memory: 0.0690 M | <class 'torch.Tensor'>
+ | 1 * Size:(24367,)             | Memory: 0.0974 M | <class 'torch.Tensor'>
+ | 1 * Size:(33813, 10)          | Memory: 1.3525 M | <class 'torch.Tensor'>
+ | 1 * Size:(18375, 2)           | Memory: 0.147 M | <class 'torch.Tensor'>
+ | 1 * Size:(17345, 2)           | Memory: 0.1387 M | <class 'torch.Tensor'>
+ | 1 * Size:(18375,)             | Memory: 0.0735 M | <class 'torch.Tensor'>
+ | 1 * Size:(23888, 3)           | Memory: 0.2866 M | <class 'torch.Tensor'>
+ | 1 * Size:(15083, 2)           | Memory: 0.1206 M | <class 'torch.Tensor'>
+ | 1 * Size:(33813,)             | Memory: 0.1352 M | <class 'torch.Tensor'>
+ | 1 * Size:(39497, 10)          | Memory: 1.5798 M | <class 'torch.Tensor'>
+ | 1 * Size:(39497,)             | Memory: 0.1579 M | <class 'torch.Tensor'>
+ | 1 * Size:(39044, 10)          | Memory: 1.5617 M | <class 'torch.Tensor'>
+ | 1 * Size:(37771, 10)          | Memory: 1.5108 M | <class 'torch.Tensor'>
+ | 1 * Size:(26063,)             | Memory: 0.1042 M | <class 'torch.Tensor'>
+ | 1 * Size:(39044,)             | Memory: 0.1561 M | <class 'torch.Tensor'>
+ | 1 * Size:(18662,)             | Memory: 0.0746 M | <class 'torch.Tensor'>
+ | 1 * Size:(17345,)             | Memory: 0.0693 M | <class 'torch.Tensor'>
+ | 1 * Size:(23888,)             | Memory: 0.0955 M | <class 'torch.Tensor'>
+ | 1 * Size:(18662, 2)           | Memory: 0.1492 M | <class 'torch.Tensor'>
+ | 1 * Size:(29591,)             | Memory: 0.1183 M | <class 'torch.Tensor'>
+ | 1 * Size:(15083,)             | Memory: 0.0603 M | <class 'torch.Tensor'>
+ | 1 * Size:(24367, 3)           | Memory: 0.2924 M | <class 'torch.Tensor'>
+ | 1 * Size:(26637,)             | Memory: 0.1065 M | <class 'torch.Tensor'>
+ | 1 * Size:(26637, 3)           | Memory: 0.3196 M | <class 'torch.Tensor'>
+ | 1 * Size:(36731,)             | Memory: 0.1469 M | <class 'torch.Tensor'>
+ | 1 * Size:(17259, 2)           | Memory: 0.1380 M | <class 'torch.Tensor'>
+ | 1 * Size:(36731, 10)          | Memory: 1.4692 M | <class 'torch.Tensor'>
+ | 34 * Size:()                   | Memory: 0.0001 M | <class 'torch.Tensor'>
+ | 1 * Size:(29591, 3)           | Memory: 0.3550 M | <class 'torch.Tensor'>
- | 1 * Size:(26959, 3)           | Memory: 0.3235 M | <class 'torch.Tensor'> 
- | 1 * Size:(26959,)             | Memory: 0.1078 M | <class 'torch.Tensor'> 
- | 1 * Size:(38918,)             | Memory: 0.1556 M | <class 'torch.Tensor'> 
- | 1 * Size:(40922,)             | Memory: 0.1636 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 20 * Size:(1,)                 | Memory: 7.9999 M | <class 'torch.Tensor'> 
- | 1 * Size:(28273, 3)           | Memory: 0.3392 M | <class 'torch.Tensor'> 
- | 1 * Size:(38932, 10)          | Memory: 1.5572 M | <class 'torch.Tensor'> 
- | 1 * Size:(19588, 2)           | Memory: 0.1567 M | <class 'torch.Tensor'> 
- | 1 * Size:(40922, 10)          | Memory: 1.6368 M | <class 'torch.Tensor'> 
- | 1 * Size:(199500, 10)         | Memory: 7.98 M | <class 'torch.Tensor'> 
- | 1 * Size:(139581, 4)          | Memory: 2.2332 M | <class 'torch.Tensor'> 
- | 1 * Size:(40605, 10)          | Memory: 1.6242 M | <class 'torch.Tensor'> 
- | 1 * Size:(28215, 3)           | Memory: 0.3385 M | <class 'torch.Tensor'> 
- | 1 * Size:(199500,)            | Memory: 0.798 M | <class 'torch.Tensor'> 
- | 1 * Size:(28215,)             | Memory: 0.1128 M | <class 'torch.Tensor'> 
- | 1 * Size:(19078,)             | Memory: 0.0763 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(18222, 2)           | Memory: 0.1457 M | <class 'torch.Tensor'> 
- | 1 * Size:(19992,)             | Memory: 0.0799 M | <class 'torch.Tensor'> 
- | 1 * Size:(38918, 10)          | Memory: 1.5567 M | <class 'torch.Tensor'> 
- | 1 * Size:(40605,)             | Memory: 0.1624 M | <class 'torch.Tensor'> 
- | 1 * Size:(40123, 10)          | Memory: 1.6049 M | <class 'torch.Tensor'> 
- | 1 * Size:(28273,)             | Memory: 0.1130 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(19516, 2)           | Memory: 0.1561 M | <class 'torch.Tensor'> 
- | 1 * Size:(19588,)             | Memory: 0.0783 M | <class 'torch.Tensor'> 
- | 1 * Size:(27987, 3)           | Memory: 0.3358 M | <class 'torch.Tensor'> 
- | 1 * Size:(19516,)             | Memory: 0.0780 M | <class 'torch.Tensor'> 
- | 33 * Size:()                   | Memory: 0.0001 M | <class 'torch.Tensor'> 
- | 1 * Size:(139581,)            | Memory: 0.5583 M | <class 'torch.Tensor'> 
- | 1 * Size:(38932,)             | Memory: 0.1557 M | <class 'torch.Tensor'> 
- | 1 * Size:(96396, 3)           | Memory: 1.1567 M | <class 'torch.Tensor'> 
- | 1 * Size:(27987,)             | Memory: 0.1119 M | <class 'torch.Tensor'> 
- | 1 * Size:(28147,)             | Memory: 0.1125 M | <class 'torch.Tensor'> 
- | 1 * Size:(96396,)             | Memory: 0.3855 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(28147, 3)           | Memory: 0.3377 M | <class 'torch.Tensor'> 
- | 1 * Size:(19992, 2)           | Memory: 0.1599 M | <class 'torch.Tensor'> 
- | 1 * Size:(19078, 2)           | Memory: 0.1526 M | <class 'torch.Tensor'> 
- | 1 * Size:(40123,)             | Memory: 0.1604 M | <class 'torch.Tensor'> 
- | 1 * Size:(18222,)             | Memory: 0.0728 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:5481.7 Mb

+ | 1 * Size:(86724, 3)           | Memory: 1.0406 M | <class 'torch.Tensor'>
+ | 1 * Size:(86724,)             | Memory: 0.3468 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(130546,)            | Memory: 0.5221 M | <class 'torch.Tensor'>
+ | 67 * Size:()                   | Memory: 0.0002 M | <class 'torch.Tensor'>
+ | 1 * Size:(186856, 10)         | Memory: 7.4742 M | <class 'torch.Tensor'>
+ | 1 * Size:(186856,)            | Memory: 0.7474 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(130546, 4)          | Memory: 2.0887 M | <class 'torch.Tensor'>
- | 34 * Size:()                   | Memory: 0.0001 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:10550.5Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:10554.7Mb

+ | 1 * Size:(37014,)             | Memory: 0.1480 M | <class 'torch.Tensor'>
+ | 1 * Size:(28149,)             | Memory: 0.1125 M | <class 'torch.Tensor'>
+ | 1 * Size:(28965,)             | Memory: 0.1158 M | <class 'torch.Tensor'>
+ | 1 * Size:(27602,)             | Memory: 0.1104 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 256, 1, 1)     | Memory: 0.3932 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(64, 3, 3, 3)        | Memory: 0.0207 M | <class 'torch.Tensor'>
+ | 3 * Size:(6,)                 | Memory: 7.2e-0 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 3, 3, 128, 16)   | Memory: 0.6635 M | <class 'torch.Tensor'>
+ | 3 * Size:(256, 256, 4, 4)     | Memory: 12.582 M | <class 'torch.Tensor'>
+ | 1 * Size:(25891, 3)           | Memory: 0.3106 M | <class 'torch.Tensor'>
+ | 1 * Size:(40273,)             | Memory: 0.1610 M | <class 'torch.Tensor'>
+ | 59 * Size:(256,)               | Memory: 0.0604 M | <class 'torch.Tensor'>
+ | 6 * Size:(3, 3, 3, 32, 32)    | Memory: 0.6635 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(6,)                 | Memory: 7.2e-0 M | <class 'torch.nn.parameter.Parameter'>
+ | 115 * Size:(64,)                | Memory: 0.0294 M | <class 'torch.Tensor'>
+ | 1 * Size:(18964, 2)           | Memory: 0.1517 M | <class 'torch.Tensor'>
+ | 1 * Size:(28149, 3)           | Memory: 0.3377 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 1, 1, 64, 64)    | Memory: 0.1474 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(14,)                | Memory: 0.0001 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(256, 128, 3, 3)     | Memory: 3.5389 M | <class 'torch.nn.parameter.Parameter'>
+ | 30 * Size:(128, 128, 3, 3)     | Memory: 17.694 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(39489,)             | Memory: 0.1579 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 128)           | Memory: 0.1966 M | <class 'torch.Tensor'>
+ | 30 * Size:(16,)                | Memory: 0.0019 M | <class 'torch.Tensor'>
+ | 1 * Size:(17651,)             | Memory: 0.0706 M | <class 'torch.Tensor'>
+ | 21 * Size:(3, 3, 3, 64, 64)    | Memory: 9.2897 M | <class 'torch.Tensor'>
+ | 3 * Size:(14, 768, 1, 1)      | Memory: 0.1290 M | <class 'torch.Tensor'>
+ | 1 * Size:(27705,)             | Memory: 0.1108 M | <class 'torch.Tensor'>
+ | 1 * Size:(18897, 2)           | Memory: 0.1511 M | <class 'torch.Tensor'>
+ | 3 * Size:(6, 768, 1, 1)       | Memory: 0.0552 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(20099, 2)           | Memory: 0.1607 M | <class 'torch.Tensor'>
+ | 1 * Size:(39513,)             | Memory: 0.1580 M | <class 'torch.Tensor'>
+ | 59 * Size:(256,)               | Memory: 0.0604 M | <class 'torch.nn.parameter.Parameter'>
+ | 115 * Size:(64,)                | Memory: 0.0294 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(32, 32)             | Memory: 0.0122 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 3, 3, 16, 16)    | Memory: 0.0829 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 256, 1, 1)     | Memory: 0.3932 M | <class 'torch.Tensor'>
+ | 3 * Size:(64, 3, 3, 3)        | Memory: 0.0207 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(3, 3, 3, 16, 32)    | Memory: 0.1658 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(64, 64, 3, 3)       | Memory: 0.4423 M | <class 'torch.Tensor'>
+ | 3 * Size:(16, 10)             | Memory: 0.0019 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(37418,)             | Memory: 0.1496 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 3, 3, 128, 16)   | Memory: 0.6635 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(256, 256, 4, 4)     | Memory: 12.582 M | <class 'torch.nn.parameter.Parameter'>
+ | 41 * Size:(32,)                | Memory: 0.0052 M | <class 'torch.Tensor'>
+ | 15 * Size:(256, 256, 3, 3)     | Memory: 35.389 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(37418, 10)          | Memory: 1.4967 M | <class 'torch.Tensor'>
+ | 1 * Size:(17360, 2)           | Memory: 0.1388 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 3, 3, 32, 64)    | Memory: 0.6635 M | <class 'torch.Tensor'>
+ | 3 * Size:(3, 3, 3, 16, 16)    | Memory: 0.0829 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(6, 768, 1, 1)       | Memory: 0.0552 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 256, 2, 2)     | Memory: 1.5728 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(3, 1, 1, 64, 64)    | Memory: 0.1474 M | <class 'torch.Tensor'>
+ | 30 * Size:(16,)                | Memory: 0.0019 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(18964,)             | Memory: 0.0758 M | <class 'torch.Tensor'>
+ | 41 * Size:(32,)                | Memory: 0.0052 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(37014, 10)          | Memory: 1.4805 M | <class 'torch.Tensor'>
+ | 6 * Size:(3, 3, 3, 32, 32)    | Memory: 0.6635 M | <class 'torch.Tensor'>
+ | 3 * Size:(16, 10)             | Memory: 0.0019 M | <class 'torch.Tensor'>
+ | 1 * Size:(39513, 10)          | Memory: 1.5805 M | <class 'torch.Tensor'>
+ | 1 * Size:(17360,)             | Memory: 0.0694 M | <class 'torch.Tensor'>
+ | 21 * Size:(3, 3, 3, 64, 64)    | Memory: 9.2897 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(256, 128, 3, 3)     | Memory: 3.5389 M | <class 'torch.Tensor'>
+ | 118 * Size:(128,)               | Memory: 0.0604 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 128)           | Memory: 0.1966 M | <class 'torch.nn.parameter.Parameter'>
+ | 30 * Size:(128, 128, 3, 3)     | Memory: 17.694 M | <class 'torch.Tensor'>
+ | 15 * Size:(256, 256, 3, 3)     | Memory: 35.389 M | <class 'torch.Tensor'>
+ | 1 * Size:(25891,)             | Memory: 0.1035 M | <class 'torch.Tensor'>
+ | 3 * Size:(128, 256, 2, 2)     | Memory: 1.5728 M | <class 'torch.Tensor'>
+ | 1 * Size:(39489, 10)          | Memory: 1.5795 M | <class 'torch.Tensor'>
+ | 1 * Size:(40273, 10)          | Memory: 1.6109 M | <class 'torch.Tensor'>
+ | 3 * Size:(32, 32)             | Memory: 0.0122 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(3, 3, 3, 32, 64)    | Memory: 0.6635 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(27602, 3)           | Memory: 0.3312 M | <class 'torch.Tensor'>
+ | 118 * Size:(128,)               | Memory: 0.0604 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(14,)                | Memory: 0.0001 M | <class 'torch.Tensor'>
+ | 1 * Size:(28965, 3)           | Memory: 0.3475 M | <class 'torch.Tensor'>
+ | 3 * Size:(64, 64, 3, 3)       | Memory: 0.4423 M | <class 'torch.nn.parameter.Parameter'>
+ | 3 * Size:(3, 3, 3, 16, 32)    | Memory: 0.1658 M | <class 'torch.Tensor'>
+ | 1 * Size:(27705, 3)           | Memory: 0.3324 M | <class 'torch.Tensor'>
+ | 1 * Size:(20099,)             | Memory: 0.0803 M | <class 'torch.Tensor'>
+ | 1 * Size:(17651, 2)           | Memory: 0.1412 M | <class 'torch.Tensor'>
+ | 3 * Size:(14, 768, 1, 1)      | Memory: 0.1290 M | <class 'torch.nn.parameter.Parameter'>
+ | 1 * Size:(18897,)             | Memory: 0.0755 M | <class 'torch.Tensor'>
- | 1 * Size:(86724, 3)           | Memory: 1.0406 M | <class 'torch.Tensor'> 
- | 1 * Size:(17259,)             | Memory: 0.0690 M | <class 'torch.Tensor'> 
- | 1 * Size:(37771,)             | Memory: 0.1510 M | <class 'torch.Tensor'> 
- | 1 * Size:(26063, 3)           | Memory: 0.3127 M | <class 'torch.Tensor'> 
- | 1 * Size:(24367,)             | Memory: 0.0974 M | <class 'torch.Tensor'> 
- | 1 * Size:(3, 3, 3, 16, 32)    | Memory: 0.0552 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(33813, 10)          | Memory: 1.3525 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 53 * Size:(64,)                | Memory: 0.0135 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(18375, 2)           | Memory: 0.147 M | <class 'torch.Tensor'> 
- | 54 * Size:(128,)               | Memory: 0.0276 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(186856, 10)         | Memory: 7.4742 M | <class 'torch.Tensor'> 
- | 1 * Size:(6, 768, 1, 1)       | Memory: 0.0184 M | <class 'torch.nn.parameter.Parameter'> 
- | 14 * Size:(16,)                | Memory: 0.0008 M | <class 'torch.Tensor'> 
- | 19 * Size:(32,)                | Memory: 0.0024 M | <class 'torch.Tensor'> 
- | 1 * Size:(17345, 2)           | Memory: 0.1387 M | <class 'torch.Tensor'> 
- | 1 * Size:(3, 3, 3, 128, 16)   | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(256, 256, 4, 4)     | Memory: 4.1943 M | <class 'torch.nn.parameter.Parameter'> 
- | 19 * Size:(32,)                | Memory: 0.0024 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(128, 128)           | Memory: 0.0655 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(18375,)             | Memory: 0.0735 M | <class 'torch.Tensor'> 
- | 1 * Size:(23888, 3)           | Memory: 0.2866 M | <class 'torch.Tensor'> 
- | 1 * Size:(15083, 2)           | Memory: 0.1206 M | <class 'torch.Tensor'> 
- | 10 * Size:(128, 128, 3, 3)     | Memory: 5.8982 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(33813,)             | Memory: 0.1352 M | <class 'torch.Tensor'> 
- | 1 * Size:(39497, 10)          | Memory: 1.5798 M | <class 'torch.Tensor'> 
- | 1 * Size:(39497,)             | Memory: 0.1579 M | <class 'torch.Tensor'> 
- | 1 * Size:(32, 32)             | Memory: 0.0040 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(39044, 10)          | Memory: 1.5617 M | <class 'torch.Tensor'> 
- | 53 * Size:(64,)                | Memory: 0.0135 M | <class 'torch.Tensor'> 
- | 1 * Size:(86724,)             | Memory: 0.3468 M | <class 'torch.Tensor'> 
- | 1 * Size:(37771, 10)          | Memory: 1.5108 M | <class 'torch.Tensor'> 
- | 1 * Size:(128, 256, 1, 1)     | Memory: 0.1310 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(26063,)             | Memory: 0.1042 M | <class 'torch.Tensor'> 
- | 1 * Size:(39044,)             | Memory: 0.1561 M | <class 'torch.Tensor'> 
- | 1 * Size:(3, 3, 3, 16, 16)    | Memory: 0.0276 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(18662,)             | Memory: 0.0746 M | <class 'torch.Tensor'> 
- | 1 * Size:(17345,)             | Memory: 0.0693 M | <class 'torch.Tensor'> 
- | 1 * Size:(14, 768, 1, 1)      | Memory: 0.0430 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(18662, 2)           | Memory: 0.1492 M | <class 'torch.Tensor'> 
- | 1 * Size:(23888,)             | Memory: 0.0955 M | <class 'torch.Tensor'> 
- | 1 * Size:(128, 256, 2, 2)     | Memory: 0.5242 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(130546,)            | Memory: 0.5221 M | <class 'torch.Tensor'> 
- | 1 * Size:(3, 3, 3, 32, 64)    | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'> 
- | 25 * Size:(256,)               | Memory: 0.0255 M | <class 'torch.Tensor'> 
- | 7 * Size:(3, 3, 3, 64, 64)    | Memory: 3.0965 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(186856,)            | Memory: 0.7474 M | <class 'torch.Tensor'> 
- | 54 * Size:(128,)               | Memory: 0.0276 M | <class 'torch.Tensor'> 
- | 25 * Size:(256,)               | Memory: 0.0255 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(29591,)             | Memory: 0.1183 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(64, 3, 3, 3)        | Memory: 0.0069 M | <class 'torch.nn.parameter.Parameter'> 
- | 5 * Size:(256, 256, 3, 3)     | Memory: 11.796 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(64, 64, 3, 3)       | Memory: 0.1474 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(24367, 3)           | Memory: 0.2924 M | <class 'torch.Tensor'> 
- | 1 * Size:(26637,)             | Memory: 0.1065 M | <class 'torch.Tensor'> 
- | 1 * Size:(6,)                 | Memory: 2.4e-0 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(15083,)             | Memory: 0.0603 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 14 * Size:(16,)                | Memory: 0.0008 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(16, 10)             | Memory: 0.0006 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(26637, 3)           | Memory: 0.3196 M | <class 'torch.Tensor'> 
- | 2 * Size:(3, 3, 3, 32, 32)    | Memory: 0.2211 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(3, 1, 1, 64, 64)    | Memory: 0.0491 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(14,)                | Memory: 5.6e-0 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(36731,)             | Memory: 0.1469 M | <class 'torch.Tensor'> 
- | 1 * Size:(17259, 2)           | Memory: 0.1380 M | <class 'torch.Tensor'> 
- | 1 * Size:(256, 128, 3, 3)     | Memory: 1.1796 M | <class 'torch.nn.parameter.Parameter'> 
- | 1 * Size:(36731, 10)          | Memory: 1.4692 M | <class 'torch.Tensor'> 
- | 1 * Size:(29591, 3)           | Memory: 0.3550 M | <class 'torch.Tensor'> 
- | 1 * Size:(130546, 4)          | Memory: 2.0887 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:9546.0 Mb

+ | 1 * Size:(193707,)            | Memory: 0.7748 M | <class 'torch.Tensor'>
+ | 1 * Size:(92971,)             | Memory: 0.3718 M | <class 'torch.Tensor'>
+ | 1 * Size:(193707, 10)         | Memory: 7.7482 M | <class 'torch.Tensor'>
+ | 1 * Size:(92971, 3)           | Memory: 1.1156 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(138312, 4)          | Memory: 2.2129 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(138312,)            | Memory: 0.5532 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:10607.3Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:10611.5Mb

+ | 1 * Size:(36717,)             | Memory: 0.1468 M | <class 'torch.Tensor'>
+ | 1 * Size:(19210, 2)           | Memory: 0.1536 M | <class 'torch.Tensor'>
+ | 1 * Size:(36717, 10)          | Memory: 1.4686 M | <class 'torch.Tensor'>
+ | 1 * Size:(18381,)             | Memory: 0.0735 M | <class 'torch.Tensor'>
+ | 1 * Size:(24627, 3)           | Memory: 0.2955 M | <class 'torch.Tensor'>
+ | 1 * Size:(29208,)             | Memory: 0.1168 M | <class 'torch.Tensor'>
+ | 1 * Size:(23815, 3)           | Memory: 0.2857 M | <class 'torch.Tensor'>
+ | 1 * Size:(29208, 3)           | Memory: 0.3504 M | <class 'torch.Tensor'>
+ | 1 * Size:(40894,)             | Memory: 0.1635 M | <class 'torch.Tensor'>
+ | 1 * Size:(25200,)             | Memory: 0.1008 M | <class 'torch.Tensor'>
+ | 1 * Size:(18381, 2)           | Memory: 0.1470 M | <class 'torch.Tensor'>
+ | 1 * Size:(18557,)             | Memory: 0.0742 M | <class 'torch.Tensor'>
+ | 1 * Size:(38388,)             | Memory: 0.1535 M | <class 'torch.Tensor'>
+ | 1 * Size:(38346,)             | Memory: 0.1533 M | <class 'torch.Tensor'>
+ | 1 * Size:(38346, 10)          | Memory: 1.5338 M | <class 'torch.Tensor'>
+ | 1 * Size:(27808, 3)           | Memory: 0.3336 M | <class 'torch.Tensor'>
+ | 1 * Size:(17403, 2)           | Memory: 0.1392 M | <class 'torch.Tensor'>
+ | 1 * Size:(17403,)             | Memory: 0.0696 M | <class 'torch.Tensor'>
+ | 1 * Size:(25200, 3)           | Memory: 0.3024 M | <class 'torch.Tensor'>
+ | 1 * Size:(19210,)             | Memory: 0.0768 M | <class 'torch.Tensor'>
+ | 1 * Size:(39401, 10)          | Memory: 1.5760 M | <class 'torch.Tensor'>
+ | 1 * Size:(39401,)             | Memory: 0.1576 M | <class 'torch.Tensor'>
+ | 1 * Size:(27808,)             | Memory: 0.1112 M | <class 'torch.Tensor'>
+ | 1 * Size:(18557, 2)           | Memory: 0.1484 M | <class 'torch.Tensor'>
+ | 1 * Size:(18715, 2)           | Memory: 0.1497 M | <class 'torch.Tensor'>
+ | 1 * Size:(40894, 10)          | Memory: 1.6357 M | <class 'torch.Tensor'>
+ | 1 * Size:(23815,)             | Memory: 0.0952 M | <class 'torch.Tensor'>
+ | 1 * Size:(38388, 10)          | Memory: 1.5355 M | <class 'torch.Tensor'>
+ | 1 * Size:(18715,)             | Memory: 0.0748 M | <class 'torch.Tensor'>
+ | 1 * Size:(24627,)             | Memory: 0.0985 M | <class 'torch.Tensor'>
- | 1 * Size:(37014, 10)          | Memory: 1.4805 M | <class 'torch.Tensor'> 
- | 1 * Size:(39489,)             | Memory: 0.1579 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(39513, 10)          | Memory: 1.5805 M | <class 'torch.Tensor'> 
- | 1 * Size:(17360,)             | Memory: 0.0694 M | <class 'torch.Tensor'> 
- | 1 * Size:(37014,)             | Memory: 0.1480 M | <class 'torch.Tensor'> 
- | 1 * Size:(17651,)             | Memory: 0.0706 M | <class 'torch.Tensor'> 
- | 1 * Size:(37418,)             | Memory: 0.1496 M | <class 'torch.Tensor'> 
- | 1 * Size:(28149,)             | Memory: 0.1125 M | <class 'torch.Tensor'> 
- | 1 * Size:(193707,)            | Memory: 0.7748 M | <class 'torch.Tensor'> 
- | 1 * Size:(92971,)             | Memory: 0.3718 M | <class 'torch.Tensor'> 
- | 1 * Size:(37418, 10)          | Memory: 1.4967 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(25891,)             | Memory: 0.1035 M | <class 'torch.Tensor'> 
- | 1 * Size:(28965,)             | Memory: 0.1158 M | <class 'torch.Tensor'> 
- | 1 * Size:(17360, 2)           | Memory: 0.1388 M | <class 'torch.Tensor'> 
- | 1 * Size:(27705,)             | Memory: 0.1108 M | <class 'torch.Tensor'> 
- | 1 * Size:(27602,)             | Memory: 0.1104 M | <class 'torch.Tensor'> 
- | 1 * Size:(18897, 2)           | Memory: 0.1511 M | <class 'torch.Tensor'> 
- | 1 * Size:(138312,)            | Memory: 0.5532 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(20099, 2)           | Memory: 0.1607 M | <class 'torch.Tensor'> 
- | 1 * Size:(92971, 3)           | Memory: 1.1156 M | <class 'torch.Tensor'> 
- | 1 * Size:(40273, 10)          | Memory: 1.6109 M | <class 'torch.Tensor'> 
- | 1 * Size:(39513,)             | Memory: 0.1580 M | <class 'torch.Tensor'> 
- | 1 * Size:(27602, 3)           | Memory: 0.3312 M | <class 'torch.Tensor'> 
- | 1 * Size:(18964,)             | Memory: 0.0758 M | <class 'torch.Tensor'> 
- | 1 * Size:(28965, 3)           | Memory: 0.3475 M | <class 'torch.Tensor'> 
- | 1 * Size:(25891, 3)           | Memory: 0.3106 M | <class 'torch.Tensor'> 
- | 1 * Size:(40273,)             | Memory: 0.1610 M | <class 'torch.Tensor'> 
- | 1 * Size:(193707, 10)         | Memory: 7.7482 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(18964, 2)           | Memory: 0.1517 M | <class 'torch.Tensor'> 
- | 1 * Size:(28149, 3)           | Memory: 0.3377 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(138312, 4)          | Memory: 2.2129 M | <class 'torch.Tensor'> 
- | 1 * Size:(27705, 3)           | Memory: 0.3324 M | <class 'torch.Tensor'> 
- | 1 * Size:(20099,)             | Memory: 0.0803 M | <class 'torch.Tensor'> 
- | 1 * Size:(17651, 2)           | Memory: 0.1412 M | <class 'torch.Tensor'> 
- | 1 * Size:(39489, 10)          | Memory: 1.5795 M | <class 'torch.Tensor'> 
- | 1 * Size:(18897,)             | Memory: 0.0755 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:10884.1Mb

+ | 1 * Size:(193746, 10)         | Memory: 7.7498 M | <class 'torch.Tensor'>
+ | 1 * Size:(92266, 3)           | Memory: 1.1071 M | <class 'torch.Tensor'>
+ | 1 * Size:(130658,)            | Memory: 0.5226 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(130658, 4)          | Memory: 2.0905 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(193746,)            | Memory: 0.7749 M | <class 'torch.Tensor'>
+ | 1 * Size:(92266,)             | Memory: 0.3690 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:10884.1Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:10884.1Mb

+ | 1 * Size:(30793,)             | Memory: 0.1231 M | <class 'torch.Tensor'>
+ | 1 * Size:(19021,)             | Memory: 0.0760 M | <class 'torch.Tensor'>
+ | 1 * Size:(26592, 3)           | Memory: 0.3191 M | <class 'torch.Tensor'>
+ | 1 * Size:(18138,)             | Memory: 0.0725 M | <class 'torch.Tensor'>
+ | 1 * Size:(26315, 3)           | Memory: 0.3157 M | <class 'torch.Tensor'>
+ | 1 * Size:(26739,)             | Memory: 0.1069 M | <class 'torch.Tensor'>
+ | 1 * Size:(17909,)             | Memory: 0.0716 M | <class 'torch.Tensor'>
+ | 1 * Size:(38213,)             | Memory: 0.1528 M | <class 'torch.Tensor'>
+ | 1 * Size:(15783, 2)           | Memory: 0.1262 M | <class 'torch.Tensor'>
+ | 1 * Size:(30793, 3)           | Memory: 0.3695 M | <class 'torch.Tensor'>
+ | 1 * Size:(37381, 10)          | Memory: 1.4952 M | <class 'torch.Tensor'>
+ | 1 * Size:(26592,)             | Memory: 0.1063 M | <class 'torch.Tensor'>
+ | 1 * Size:(24259,)             | Memory: 0.0970 M | <class 'torch.Tensor'>
+ | 1 * Size:(37341, 10)          | Memory: 1.4936 M | <class 'torch.Tensor'>
+ | 1 * Size:(35837,)             | Memory: 0.1433 M | <class 'torch.Tensor'>
+ | 1 * Size:(26315,)             | Memory: 0.1052 M | <class 'torch.Tensor'>
+ | 1 * Size:(18138, 2)           | Memory: 0.1451 M | <class 'torch.Tensor'>
+ | 1 * Size:(18788,)             | Memory: 0.0751 M | <class 'torch.Tensor'>
+ | 1 * Size:(26739, 3)           | Memory: 0.3208 M | <class 'torch.Tensor'>
+ | 1 * Size:(17909, 2)           | Memory: 0.1432 M | <class 'torch.Tensor'>
+ | 1 * Size:(37381,)             | Memory: 0.1495 M | <class 'torch.Tensor'>
+ | 1 * Size:(15783,)             | Memory: 0.0631 M | <class 'torch.Tensor'>
+ | 1 * Size:(19021, 2)           | Memory: 0.1521 M | <class 'torch.Tensor'>
+ | 1 * Size:(35837, 10)          | Memory: 1.4334 M | <class 'torch.Tensor'>
+ | 1 * Size:(18788, 2)           | Memory: 0.1503 M | <class 'torch.Tensor'>
+ | 1 * Size:(37341,)             | Memory: 0.1493 M | <class 'torch.Tensor'>
+ | 1 * Size:(39839,)             | Memory: 0.1593 M | <class 'torch.Tensor'>
+ | 1 * Size:(24259, 3)           | Memory: 0.2911 M | <class 'torch.Tensor'>
+ | 1 * Size:(39839, 10)          | Memory: 1.5935 M | <class 'torch.Tensor'>
+ | 1 * Size:(38213, 10)          | Memory: 1.5285 M | <class 'torch.Tensor'>
- | 1 * Size:(36717,)             | Memory: 0.1468 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(19210, 2)           | Memory: 0.1536 M | <class 'torch.Tensor'> 
- | 1 * Size:(92266,)             | Memory: 0.3690 M | <class 'torch.Tensor'> 
- | 1 * Size:(36717, 10)          | Memory: 1.4686 M | <class 'torch.Tensor'> 
- | 1 * Size:(18381,)             | Memory: 0.0735 M | <class 'torch.Tensor'> 
- | 1 * Size:(24627, 3)           | Memory: 0.2955 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(29208,)             | Memory: 0.1168 M | <class 'torch.Tensor'> 
- | 1 * Size:(23815, 3)           | Memory: 0.2857 M | <class 'torch.Tensor'> 
- | 1 * Size:(29208, 3)           | Memory: 0.3504 M | <class 'torch.Tensor'> 
- | 1 * Size:(130658, 4)          | Memory: 2.0905 M | <class 'torch.Tensor'> 
- | 1 * Size:(40894,)             | Memory: 0.1635 M | <class 'torch.Tensor'> 
- | 1 * Size:(25200,)             | Memory: 0.1008 M | <class 'torch.Tensor'> 
- | 1 * Size:(18381, 2)           | Memory: 0.1470 M | <class 'torch.Tensor'> 
- | 1 * Size:(193746,)            | Memory: 0.7749 M | <class 'torch.Tensor'> 
- | 1 * Size:(18557,)             | Memory: 0.0742 M | <class 'torch.Tensor'> 
- | 1 * Size:(38388,)             | Memory: 0.1535 M | <class 'torch.Tensor'> 
- | 1 * Size:(38346,)             | Memory: 0.1533 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(193746, 10)         | Memory: 7.7498 M | <class 'torch.Tensor'> 
- | 1 * Size:(130658,)            | Memory: 0.5226 M | <class 'torch.Tensor'> 
- | 1 * Size:(38346, 10)          | Memory: 1.5338 M | <class 'torch.Tensor'> 
- | 1 * Size:(27808, 3)           | Memory: 0.3336 M | <class 'torch.Tensor'> 
- | 1 * Size:(17403, 2)           | Memory: 0.1392 M | <class 'torch.Tensor'> 
- | 1 * Size:(17403,)             | Memory: 0.0696 M | <class 'torch.Tensor'> 
- | 1 * Size:(25200, 3)           | Memory: 0.3024 M | <class 'torch.Tensor'> 
- | 1 * Size:(19210,)             | Memory: 0.0768 M | <class 'torch.Tensor'> 
- | 1 * Size:(39401, 10)          | Memory: 1.5760 M | <class 'torch.Tensor'> 
- | 1 * Size:(39401,)             | Memory: 0.1576 M | <class 'torch.Tensor'> 
- | 1 * Size:(27808,)             | Memory: 0.1112 M | <class 'torch.Tensor'> 
- | 1 * Size:(18557, 2)           | Memory: 0.1484 M | <class 'torch.Tensor'> 
- | 1 * Size:(92266, 3)           | Memory: 1.1071 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(18715, 2)           | Memory: 0.1497 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(40894, 10)          | Memory: 1.6357 M | <class 'torch.Tensor'> 
- | 1 * Size:(23815,)             | Memory: 0.0952 M | <class 'torch.Tensor'> 
- | 1 * Size:(38388, 10)          | Memory: 1.5355 M | <class 'torch.Tensor'> 
- | 1 * Size:(18715,)             | Memory: 0.0748 M | <class 'torch.Tensor'> 
- | 1 * Size:(24627,)             | Memory: 0.0985 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11020.4Mb

+ | 1 * Size:(89639, 3)           | Memory: 1.0756 M | <class 'torch.Tensor'>
+ | 1 * Size:(134698, 4)          | Memory: 2.1551 M | <class 'torch.Tensor'>
+ | 1 * Size:(134698,)            | Memory: 0.5387 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(188611,)            | Memory: 0.7544 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(89639,)             | Memory: 0.3585 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(188611, 10)         | Memory: 7.5444 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11020.1Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11020.1Mb

+ | 1 * Size:(27541, 3)           | Memory: 0.3304 M | <class 'torch.Tensor'>
+ | 1 * Size:(17743,)             | Memory: 0.0709 M | <class 'torch.Tensor'>
+ | 1 * Size:(29670,)             | Memory: 0.1186 M | <class 'torch.Tensor'>
+ | 1 * Size:(26787,)             | Memory: 0.1071 M | <class 'torch.Tensor'>
+ | 1 * Size:(39321,)             | Memory: 0.1572 M | <class 'torch.Tensor'>
+ | 1 * Size:(29670, 3)           | Memory: 0.3560 M | <class 'torch.Tensor'>
+ | 1 * Size:(27541,)             | Memory: 0.1101 M | <class 'torch.Tensor'>
+ | 1 * Size:(18945, 2)           | Memory: 0.1515 M | <class 'torch.Tensor'>
+ | 1 * Size:(40143,)             | Memory: 0.1605 M | <class 'torch.Tensor'>
+ | 1 * Size:(17775, 2)           | Memory: 0.1422 M | <class 'torch.Tensor'>
+ | 1 * Size:(37775, 10)          | Memory: 1.511 M | <class 'torch.Tensor'>
+ | 1 * Size:(17900, 2)           | Memory: 0.1432 M | <class 'torch.Tensor'>
+ | 1 * Size:(27559,)             | Memory: 0.1102 M | <class 'torch.Tensor'>
+ | 1 * Size:(37597,)             | Memory: 0.1503 M | <class 'torch.Tensor'>
+ | 1 * Size:(17900,)             | Memory: 0.0716 M | <class 'torch.Tensor'>
+ | 1 * Size:(17775,)             | Memory: 0.0711 M | <class 'torch.Tensor'>
+ | 1 * Size:(36049, 10)          | Memory: 1.4419 M | <class 'torch.Tensor'>
+ | 1 * Size:(17743, 2)           | Memory: 0.1419 M | <class 'torch.Tensor'>
+ | 1 * Size:(27559, 3)           | Memory: 0.3307 M | <class 'torch.Tensor'>
+ | 1 * Size:(39321, 10)          | Memory: 1.5728 M | <class 'torch.Tensor'>
+ | 1 * Size:(26768,)             | Memory: 0.1070 M | <class 'torch.Tensor'>
+ | 1 * Size:(18470, 2)           | Memory: 0.1477 M | <class 'torch.Tensor'>
+ | 1 * Size:(37597, 10)          | Memory: 1.5038 M | <class 'torch.Tensor'>
+ | 1 * Size:(26787, 3)           | Memory: 0.3214 M | <class 'torch.Tensor'>
+ | 1 * Size:(36049,)             | Memory: 0.1441 M | <class 'torch.Tensor'>
+ | 1 * Size:(37775,)             | Memory: 0.1511 M | <class 'torch.Tensor'>
+ | 1 * Size:(18470,)             | Memory: 0.0738 M | <class 'torch.Tensor'>
+ | 1 * Size:(18945,)             | Memory: 0.0757 M | <class 'torch.Tensor'>
+ | 1 * Size:(40143, 10)          | Memory: 1.6057 M | <class 'torch.Tensor'>
+ | 1 * Size:(26768, 3)           | Memory: 0.3212 M | <class 'torch.Tensor'>
- | 1 * Size:(30793,)             | Memory: 0.1231 M | <class 'torch.Tensor'> 
- | 1 * Size:(19021,)             | Memory: 0.0760 M | <class 'torch.Tensor'> 
- | 1 * Size:(26592, 3)           | Memory: 0.3191 M | <class 'torch.Tensor'> 
- | 1 * Size:(18138,)             | Memory: 0.0725 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(26315, 3)           | Memory: 0.3157 M | <class 'torch.Tensor'> 
- | 1 * Size:(26739,)             | Memory: 0.1069 M | <class 'torch.Tensor'> 
- | 1 * Size:(17909,)             | Memory: 0.0716 M | <class 'torch.Tensor'> 
- | 1 * Size:(89639, 3)           | Memory: 1.0756 M | <class 'torch.Tensor'> 
- | 1 * Size:(134698, 4)          | Memory: 2.1551 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(38213,)             | Memory: 0.1528 M | <class 'torch.Tensor'> 
- | 1 * Size:(89639,)             | Memory: 0.3585 M | <class 'torch.Tensor'> 
- | 1 * Size:(15783, 2)           | Memory: 0.1262 M | <class 'torch.Tensor'> 
- | 1 * Size:(30793, 3)           | Memory: 0.3695 M | <class 'torch.Tensor'> 
- | 1 * Size:(37381, 10)          | Memory: 1.4952 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(26592,)             | Memory: 0.1063 M | <class 'torch.Tensor'> 
- | 1 * Size:(24259,)             | Memory: 0.0970 M | <class 'torch.Tensor'> 
- | 1 * Size:(37341, 10)          | Memory: 1.4936 M | <class 'torch.Tensor'> 
- | 1 * Size:(35837,)             | Memory: 0.1433 M | <class 'torch.Tensor'> 
- | 1 * Size:(188611, 10)         | Memory: 7.5444 M | <class 'torch.Tensor'> 
- | 1 * Size:(134698,)            | Memory: 0.5387 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(26315,)             | Memory: 0.1052 M | <class 'torch.Tensor'> 
- | 1 * Size:(18138, 2)           | Memory: 0.1451 M | <class 'torch.Tensor'> 
- | 1 * Size:(18788,)             | Memory: 0.0751 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(26739, 3)           | Memory: 0.3208 M | <class 'torch.Tensor'> 
- | 1 * Size:(188611,)            | Memory: 0.7544 M | <class 'torch.Tensor'> 
- | 1 * Size:(17909, 2)           | Memory: 0.1432 M | <class 'torch.Tensor'> 
- | 1 * Size:(37381,)             | Memory: 0.1495 M | <class 'torch.Tensor'> 
- | 1 * Size:(15783,)             | Memory: 0.0631 M | <class 'torch.Tensor'> 
- | 1 * Size:(19021, 2)           | Memory: 0.1521 M | <class 'torch.Tensor'> 
- | 1 * Size:(35837, 10)          | Memory: 1.4334 M | <class 'torch.Tensor'> 
- | 1 * Size:(18788, 2)           | Memory: 0.1503 M | <class 'torch.Tensor'> 
- | 1 * Size:(37341,)             | Memory: 0.1493 M | <class 'torch.Tensor'> 
- | 1 * Size:(39839,)             | Memory: 0.1593 M | <class 'torch.Tensor'> 
- | 1 * Size:(24259, 3)           | Memory: 0.2911 M | <class 'torch.Tensor'> 
- | 1 * Size:(39839, 10)          | Memory: 1.5935 M | <class 'torch.Tensor'> 
- | 1 * Size:(38213, 10)          | Memory: 1.5285 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11020.1Mb

+ | 1 * Size:(190885, 10)         | Memory: 7.6354 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(90833, 3)           | Memory: 1.0899 M | <class 'torch.Tensor'>
+ | 1 * Size:(190885,)            | Memory: 0.7635 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(90833,)             | Memory: 0.3633 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(138325,)            | Memory: 0.5533 M | <class 'torch.Tensor'>
+ | 1 * Size:(138325, 4)          | Memory: 2.2132 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11020.1Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11020.1Mb

+ | 1 * Size:(27681, 3)           | Memory: 0.3321 M | <class 'torch.Tensor'>
+ | 1 * Size:(27681,)             | Memory: 0.1107 M | <class 'torch.Tensor'>
+ | 1 * Size:(17209,)             | Memory: 0.0688 M | <class 'torch.Tensor'>
+ | 1 * Size:(38607,)             | Memory: 0.1544 M | <class 'torch.Tensor'>
+ | 1 * Size:(18458,)             | Memory: 0.0738 M | <class 'torch.Tensor'>
+ | 1 * Size:(17209, 2)           | Memory: 0.1376 M | <class 'torch.Tensor'>
+ | 1 * Size:(17842,)             | Memory: 0.0713 M | <class 'torch.Tensor'>
+ | 1 * Size:(18399,)             | Memory: 0.0735 M | <class 'torch.Tensor'>
+ | 1 * Size:(37599, 10)          | Memory: 1.5039 M | <class 'torch.Tensor'>
+ | 1 * Size:(27349,)             | Memory: 0.1093 M | <class 'torch.Tensor'>
+ | 1 * Size:(38784, 10)          | Memory: 1.5513 M | <class 'torch.Tensor'>
+ | 1 * Size:(37462, 10)          | Memory: 1.4984 M | <class 'torch.Tensor'>
+ | 1 * Size:(38784,)             | Memory: 0.1551 M | <class 'torch.Tensor'>
+ | 1 * Size:(27349, 3)           | Memory: 0.3281 M | <class 'torch.Tensor'>
+ | 1 * Size:(28254,)             | Memory: 0.1130 M | <class 'torch.Tensor'>
+ | 1 * Size:(37785, 10)          | Memory: 1.5114 M | <class 'torch.Tensor'>
+ | 1 * Size:(37785,)             | Memory: 0.1511 M | <class 'torch.Tensor'>
+ | 1 * Size:(24283,)             | Memory: 0.0971 M | <class 'torch.Tensor'>
+ | 1 * Size:(17374,)             | Memory: 0.0694 M | <class 'torch.Tensor'>
+ | 1 * Size:(37462,)             | Memory: 0.1498 M | <class 'torch.Tensor'>
+ | 1 * Size:(18399, 2)           | Memory: 0.1471 M | <class 'torch.Tensor'>
+ | 1 * Size:(17374, 2)           | Memory: 0.1389 M | <class 'torch.Tensor'>
+ | 1 * Size:(28254, 3)           | Memory: 0.3390 M | <class 'torch.Tensor'>
+ | 1 * Size:(24283, 3)           | Memory: 0.2913 M | <class 'torch.Tensor'>
+ | 1 * Size:(29659, 3)           | Memory: 0.3559 M | <class 'torch.Tensor'>
+ | 1 * Size:(18458, 2)           | Memory: 0.1476 M | <class 'torch.Tensor'>
+ | 1 * Size:(38607, 10)          | Memory: 1.5442 M | <class 'torch.Tensor'>
+ | 1 * Size:(17842, 2)           | Memory: 0.1427 M | <class 'torch.Tensor'>
+ | 1 * Size:(29659,)             | Memory: 0.1186 M | <class 'torch.Tensor'>
+ | 1 * Size:(37599,)             | Memory: 0.1503 M | <class 'torch.Tensor'>
- | 1 * Size:(27541, 3)           | Memory: 0.3304 M | <class 'torch.Tensor'> 
- | 1 * Size:(17743,)             | Memory: 0.0709 M | <class 'torch.Tensor'> 
- | 1 * Size:(29670,)             | Memory: 0.1186 M | <class 'torch.Tensor'> 
- | 1 * Size:(26787,)             | Memory: 0.1071 M | <class 'torch.Tensor'> 
- | 1 * Size:(190885,)            | Memory: 0.7635 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(39321,)             | Memory: 0.1572 M | <class 'torch.Tensor'> 
- | 1 * Size:(29670, 3)           | Memory: 0.3560 M | <class 'torch.Tensor'> 
- | 1 * Size:(27541,)             | Memory: 0.1101 M | <class 'torch.Tensor'> 
- | 1 * Size:(138325, 4)          | Memory: 2.2132 M | <class 'torch.Tensor'> 
- | 1 * Size:(18945, 2)           | Memory: 0.1515 M | <class 'torch.Tensor'> 
- | 1 * Size:(40143,)             | Memory: 0.1605 M | <class 'torch.Tensor'> 
- | 1 * Size:(17775, 2)           | Memory: 0.1422 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(37775, 10)          | Memory: 1.511 M | <class 'torch.Tensor'> 
- | 1 * Size:(17900, 2)           | Memory: 0.1432 M | <class 'torch.Tensor'> 
- | 1 * Size:(27559,)             | Memory: 0.1102 M | <class 'torch.Tensor'> 
- | 1 * Size:(37597,)             | Memory: 0.1503 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(138325,)            | Memory: 0.5533 M | <class 'torch.Tensor'> 
- | 1 * Size:(17900,)             | Memory: 0.0716 M | <class 'torch.Tensor'> 
- | 1 * Size:(17775,)             | Memory: 0.0711 M | <class 'torch.Tensor'> 
- | 1 * Size:(36049, 10)          | Memory: 1.4419 M | <class 'torch.Tensor'> 
- | 1 * Size:(17743, 2)           | Memory: 0.1419 M | <class 'torch.Tensor'> 
- | 1 * Size:(90833, 3)           | Memory: 1.0899 M | <class 'torch.Tensor'> 
- | 1 * Size:(27559, 3)           | Memory: 0.3307 M | <class 'torch.Tensor'> 
- | 1 * Size:(39321, 10)          | Memory: 1.5728 M | <class 'torch.Tensor'> 
- | 1 * Size:(26768,)             | Memory: 0.1070 M | <class 'torch.Tensor'> 
- | 1 * Size:(18470, 2)           | Memory: 0.1477 M | <class 'torch.Tensor'> 
- | 1 * Size:(37597, 10)          | Memory: 1.5038 M | <class 'torch.Tensor'> 
- | 1 * Size:(26787, 3)           | Memory: 0.3214 M | <class 'torch.Tensor'> 
- | 1 * Size:(36049,)             | Memory: 0.1441 M | <class 'torch.Tensor'> 
- | 1 * Size:(90833,)             | Memory: 0.3633 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(190885, 10)         | Memory: 7.6354 M | <class 'torch.Tensor'> 
- | 1 * Size:(37775,)             | Memory: 0.1511 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(18945,)             | Memory: 0.0757 M | <class 'torch.Tensor'> 
- | 1 * Size:(40143, 10)          | Memory: 1.6057 M | <class 'torch.Tensor'> 
- | 1 * Size:(18470,)             | Memory: 0.0738 M | <class 'torch.Tensor'> 
- | 1 * Size:(26768, 3)           | Memory: 0.3212 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11156.5Mb

+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(89282,)             | Memory: 0.3571 M | <class 'torch.Tensor'>
+ | 1 * Size:(137226, 4)          | Memory: 2.1956 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(89282, 3)           | Memory: 1.0713 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(190237,)            | Memory: 0.7609 M | <class 'torch.Tensor'>
+ | 1 * Size:(137226,)            | Memory: 0.5489 M | <class 'torch.Tensor'>
+ | 1 * Size:(190237, 10)         | Memory: 7.6094 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11156.5Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11156.5Mb

+ | 1 * Size:(18598, 2)           | Memory: 0.1487 M | <class 'torch.Tensor'>
+ | 1 * Size:(40468, 10)          | Memory: 1.6187 M | <class 'torch.Tensor'>
+ | 1 * Size:(20104, 2)           | Memory: 0.1608 M | <class 'torch.Tensor'>
+ | 1 * Size:(37089, 10)          | Memory: 1.4835 M | <class 'torch.Tensor'>
+ | 1 * Size:(20104,)             | Memory: 0.0804 M | <class 'torch.Tensor'>
+ | 1 * Size:(27345,)             | Memory: 0.1093 M | <class 'torch.Tensor'>
+ | 1 * Size:(39403,)             | Memory: 0.1576 M | <class 'torch.Tensor'>
+ | 1 * Size:(39403, 10)          | Memory: 1.5761 M | <class 'torch.Tensor'>
+ | 1 * Size:(17266, 2)           | Memory: 0.1381 M | <class 'torch.Tensor'>
+ | 1 * Size:(26553,)             | Memory: 0.1062 M | <class 'torch.Tensor'>
+ | 1 * Size:(39227,)             | Memory: 0.1569 M | <class 'torch.Tensor'>
+ | 1 * Size:(17266,)             | Memory: 0.0690 M | <class 'torch.Tensor'>
+ | 1 * Size:(39227, 10)          | Memory: 1.5690 M | <class 'torch.Tensor'>
+ | 1 * Size:(25173,)             | Memory: 0.1006 M | <class 'torch.Tensor'>
+ | 1 * Size:(18007,)             | Memory: 0.0720 M | <class 'torch.Tensor'>
+ | 1 * Size:(29058, 3)           | Memory: 0.3486 M | <class 'torch.Tensor'>
+ | 1 * Size:(25173, 3)           | Memory: 0.3020 M | <class 'torch.Tensor'>
+ | 1 * Size:(25796,)             | Memory: 0.1031 M | <class 'torch.Tensor'>
+ | 1 * Size:(18598,)             | Memory: 0.0743 M | <class 'torch.Tensor'>
+ | 1 * Size:(40468,)             | Memory: 0.1618 M | <class 'torch.Tensor'>
+ | 1 * Size:(18513,)             | Memory: 0.0740 M | <class 'torch.Tensor'>
+ | 1 * Size:(25796, 3)           | Memory: 0.3095 M | <class 'torch.Tensor'>
+ | 1 * Size:(18007, 2)           | Memory: 0.1440 M | <class 'torch.Tensor'>
+ | 1 * Size:(36930,)             | Memory: 0.1477 M | <class 'torch.Tensor'>
+ | 1 * Size:(29058,)             | Memory: 0.1162 M | <class 'torch.Tensor'>
+ | 1 * Size:(37089,)             | Memory: 0.1483 M | <class 'torch.Tensor'>
+ | 1 * Size:(26553, 3)           | Memory: 0.3186 M | <class 'torch.Tensor'>
+ | 1 * Size:(27345, 3)           | Memory: 0.3281 M | <class 'torch.Tensor'>
+ | 1 * Size:(18513, 2)           | Memory: 0.1481 M | <class 'torch.Tensor'>
+ | 1 * Size:(36930, 10)          | Memory: 1.4772 M | <class 'torch.Tensor'>
- | 1 * Size:(27681, 3)           | Memory: 0.3321 M | <class 'torch.Tensor'> 
- | 1 * Size:(137226, 4)          | Memory: 2.1956 M | <class 'torch.Tensor'> 
- | 1 * Size:(27681,)             | Memory: 0.1107 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(17209,)             | Memory: 0.0688 M | <class 'torch.Tensor'> 
- | 1 * Size:(190237, 10)         | Memory: 7.6094 M | <class 'torch.Tensor'> 
- | 1 * Size:(89282,)             | Memory: 0.3571 M | <class 'torch.Tensor'> 
- | 1 * Size:(38607,)             | Memory: 0.1544 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(89282, 3)           | Memory: 1.0713 M | <class 'torch.Tensor'> 
- | 1 * Size:(18458,)             | Memory: 0.0738 M | <class 'torch.Tensor'> 
- | 1 * Size:(17209, 2)           | Memory: 0.1376 M | <class 'torch.Tensor'> 
- | 1 * Size:(17842,)             | Memory: 0.0713 M | <class 'torch.Tensor'> 
- | 1 * Size:(190237,)            | Memory: 0.7609 M | <class 'torch.Tensor'> 
- | 1 * Size:(18399,)             | Memory: 0.0735 M | <class 'torch.Tensor'> 
- | 1 * Size:(37599, 10)          | Memory: 1.5039 M | <class 'torch.Tensor'> 
- | 1 * Size:(137226,)            | Memory: 0.5489 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(27349,)             | Memory: 0.1093 M | <class 'torch.Tensor'> 
- | 1 * Size:(38784, 10)          | Memory: 1.5513 M | <class 'torch.Tensor'> 
- | 1 * Size:(37462, 10)          | Memory: 1.4984 M | <class 'torch.Tensor'> 
- | 1 * Size:(38784,)             | Memory: 0.1551 M | <class 'torch.Tensor'> 
- | 1 * Size:(27349, 3)           | Memory: 0.3281 M | <class 'torch.Tensor'> 
- | 1 * Size:(28254,)             | Memory: 0.1130 M | <class 'torch.Tensor'> 
- | 1 * Size:(37785, 10)          | Memory: 1.5114 M | <class 'torch.Tensor'> 
- | 1 * Size:(37785,)             | Memory: 0.1511 M | <class 'torch.Tensor'> 
- | 1 * Size:(24283,)             | Memory: 0.0971 M | <class 'torch.Tensor'> 
- | 1 * Size:(17374,)             | Memory: 0.0694 M | <class 'torch.Tensor'> 
- | 1 * Size:(37462,)             | Memory: 0.1498 M | <class 'torch.Tensor'> 
- | 1 * Size:(18399, 2)           | Memory: 0.1471 M | <class 'torch.Tensor'> 
- | 1 * Size:(17374, 2)           | Memory: 0.1389 M | <class 'torch.Tensor'> 
- | 1 * Size:(28254, 3)           | Memory: 0.3390 M | <class 'torch.Tensor'> 
- | 1 * Size:(29659, 3)           | Memory: 0.3559 M | <class 'torch.Tensor'> 
- | 1 * Size:(24283, 3)           | Memory: 0.2913 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(18458, 2)           | Memory: 0.1476 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(38607, 10)          | Memory: 1.5442 M | <class 'torch.Tensor'> 
- | 1 * Size:(17842, 2)           | Memory: 0.1427 M | <class 'torch.Tensor'> 
- | 1 * Size:(29659,)             | Memory: 0.1186 M | <class 'torch.Tensor'> 
- | 1 * Size:(37599,)             | Memory: 0.1503 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 1 * Size:(92488, 3)           | Memory: 1.1098 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(133925,)            | Memory: 0.5357 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(133925, 4)          | Memory: 2.1428 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(193117,)            | Memory: 0.7724 M | <class 'torch.Tensor'>
+ | 1 * Size:(92488,)             | Memory: 0.3699 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(193117, 10)         | Memory: 7.7246 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 1 * Size:(38592,)             | Memory: 0.1543 M | <class 'torch.Tensor'>
+ | 1 * Size:(27714, 3)           | Memory: 0.3325 M | <class 'torch.Tensor'>
+ | 1 * Size:(26703, 3)           | Memory: 0.3204 M | <class 'torch.Tensor'>
+ | 1 * Size:(19088,)             | Memory: 0.0763 M | <class 'torch.Tensor'>
+ | 1 * Size:(17419, 2)           | Memory: 0.1393 M | <class 'torch.Tensor'>
+ | 1 * Size:(17832,)             | Memory: 0.0713 M | <class 'torch.Tensor'>
+ | 1 * Size:(28364,)             | Memory: 0.1134 M | <class 'torch.Tensor'>
+ | 1 * Size:(38496, 10)          | Memory: 1.5398 M | <class 'torch.Tensor'>
+ | 1 * Size:(17832, 2)           | Memory: 0.1426 M | <class 'torch.Tensor'>
+ | 1 * Size:(38496,)             | Memory: 0.1539 M | <class 'torch.Tensor'>
+ | 1 * Size:(17419,)             | Memory: 0.0696 M | <class 'torch.Tensor'>
+ | 1 * Size:(39996, 10)          | Memory: 1.5998 M | <class 'torch.Tensor'>
+ | 1 * Size:(37194,)             | Memory: 0.1487 M | <class 'torch.Tensor'>
+ | 1 * Size:(18410,)             | Memory: 0.0736 M | <class 'torch.Tensor'>
+ | 1 * Size:(27511,)             | Memory: 0.1100 M | <class 'torch.Tensor'>
+ | 1 * Size:(19222, 2)           | Memory: 0.1537 M | <class 'torch.Tensor'>
+ | 1 * Size:(27714,)             | Memory: 0.1108 M | <class 'torch.Tensor'>
+ | 1 * Size:(37194, 10)          | Memory: 1.4877 M | <class 'torch.Tensor'>
+ | 1 * Size:(26703,)             | Memory: 0.1068 M | <class 'torch.Tensor'>
+ | 1 * Size:(27171,)             | Memory: 0.1086 M | <class 'torch.Tensor'>
+ | 1 * Size:(39996,)             | Memory: 0.1599 M | <class 'torch.Tensor'>
+ | 1 * Size:(39933,)             | Memory: 0.1597 M | <class 'torch.Tensor'>
+ | 1 * Size:(27171, 3)           | Memory: 0.3260 M | <class 'torch.Tensor'>
+ | 1 * Size:(27511, 3)           | Memory: 0.3301 M | <class 'torch.Tensor'>
+ | 1 * Size:(19088, 2)           | Memory: 0.1527 M | <class 'torch.Tensor'>
+ | 1 * Size:(28364, 3)           | Memory: 0.3403 M | <class 'torch.Tensor'>
+ | 1 * Size:(39933, 10)          | Memory: 1.5973 M | <class 'torch.Tensor'>
+ | 1 * Size:(18410, 2)           | Memory: 0.1472 M | <class 'torch.Tensor'>
+ | 1 * Size:(19222,)             | Memory: 0.0768 M | <class 'torch.Tensor'>
+ | 1 * Size:(38592, 10)          | Memory: 1.5436 M | <class 'torch.Tensor'>
- | 1 * Size:(133925,)            | Memory: 0.5357 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(18598, 2)           | Memory: 0.1487 M | <class 'torch.Tensor'> 
- | 1 * Size:(40468, 10)          | Memory: 1.6187 M | <class 'torch.Tensor'> 
- | 1 * Size:(20104, 2)           | Memory: 0.1608 M | <class 'torch.Tensor'> 
- | 1 * Size:(37089, 10)          | Memory: 1.4835 M | <class 'torch.Tensor'> 
- | 1 * Size:(20104,)             | Memory: 0.0804 M | <class 'torch.Tensor'> 
- | 1 * Size:(27345,)             | Memory: 0.1093 M | <class 'torch.Tensor'> 
- | 1 * Size:(39403,)             | Memory: 0.1576 M | <class 'torch.Tensor'> 
- | 1 * Size:(39403, 10)          | Memory: 1.5761 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(17266, 2)           | Memory: 0.1381 M | <class 'torch.Tensor'> 
- | 1 * Size:(133925, 4)          | Memory: 2.1428 M | <class 'torch.Tensor'> 
- | 1 * Size:(26553,)             | Memory: 0.1062 M | <class 'torch.Tensor'> 
- | 1 * Size:(39227,)             | Memory: 0.1569 M | <class 'torch.Tensor'> 
- | 1 * Size:(17266,)             | Memory: 0.0690 M | <class 'torch.Tensor'> 
- | 1 * Size:(39227, 10)          | Memory: 1.5690 M | <class 'torch.Tensor'> 
- | 1 * Size:(92488,)             | Memory: 0.3699 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(25173,)             | Memory: 0.1006 M | <class 'torch.Tensor'> 
- | 1 * Size:(18007,)             | Memory: 0.0720 M | <class 'torch.Tensor'> 
- | 1 * Size:(29058, 3)           | Memory: 0.3486 M | <class 'torch.Tensor'> 
- | 1 * Size:(25173, 3)           | Memory: 0.3020 M | <class 'torch.Tensor'> 
- | 1 * Size:(25796,)             | Memory: 0.1031 M | <class 'torch.Tensor'> 
- | 1 * Size:(18598,)             | Memory: 0.0743 M | <class 'torch.Tensor'> 
- | 1 * Size:(92488, 3)           | Memory: 1.1098 M | <class 'torch.Tensor'> 
- | 1 * Size:(40468,)             | Memory: 0.1618 M | <class 'torch.Tensor'> 
- | 1 * Size:(18513,)             | Memory: 0.0740 M | <class 'torch.Tensor'> 
- | 1 * Size:(25796, 3)           | Memory: 0.3095 M | <class 'torch.Tensor'> 
- | 1 * Size:(193117, 10)         | Memory: 7.7246 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(18007, 2)           | Memory: 0.1440 M | <class 'torch.Tensor'> 
- | 1 * Size:(36930,)             | Memory: 0.1477 M | <class 'torch.Tensor'> 
- | 1 * Size:(29058,)             | Memory: 0.1162 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(37089,)             | Memory: 0.1483 M | <class 'torch.Tensor'> 
- | 1 * Size:(26553, 3)           | Memory: 0.3186 M | <class 'torch.Tensor'> 
- | 1 * Size:(27345, 3)           | Memory: 0.3281 M | <class 'torch.Tensor'> 
- | 1 * Size:(193117,)            | Memory: 0.7724 M | <class 'torch.Tensor'> 
- | 1 * Size:(18513, 2)           | Memory: 0.1481 M | <class 'torch.Tensor'> 
- | 1 * Size:(36930, 10)          | Memory: 1.4772 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'>
+ | 1 * Size:(91971,)             | Memory: 0.3678 M | <class 'torch.Tensor'>
+ | 1 * Size:(194211,)            | Memory: 0.7768 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'>
+ | 1 * Size:(91971, 3)           | Memory: 1.1036 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'>
+ | 1 * Size:(194211, 10)         | Memory: 7.7684 M | <class 'torch.Tensor'>
+ | 1 * Size:(137463, 4)          | Memory: 2.1994 M | <class 'torch.Tensor'>
+ | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'>
+ | 1 * Size:(137463,)            | Memory: 0.5498 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'>

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

+ | 1 * Size:(19977,)             | Memory: 0.0799 M | <class 'torch.Tensor'>
+ | 1 * Size:(40896,)             | Memory: 0.1635 M | <class 'torch.Tensor'>
+ | 1 * Size:(17532,)             | Memory: 0.0701 M | <class 'torch.Tensor'>
+ | 1 * Size:(24722, 3)           | Memory: 0.2966 M | <class 'torch.Tensor'>
+ | 1 * Size:(38909,)             | Memory: 0.1556 M | <class 'torch.Tensor'>
+ | 1 * Size:(28464, 3)           | Memory: 0.3415 M | <class 'torch.Tensor'>
+ | 1 * Size:(40881, 10)          | Memory: 1.6352 M | <class 'torch.Tensor'>
+ | 1 * Size:(23644,)             | Memory: 0.0945 M | <class 'torch.Tensor'>
+ | 1 * Size:(32048, 10)          | Memory: 1.2819 M | <class 'torch.Tensor'>
+ | 1 * Size:(32048,)             | Memory: 0.1281 M | <class 'torch.Tensor'>
+ | 1 * Size:(24722,)             | Memory: 0.0988 M | <class 'torch.Tensor'>
+ | 1 * Size:(28806, 3)           | Memory: 0.3456 M | <class 'torch.Tensor'>
+ | 1 * Size:(40881,)             | Memory: 0.1635 M | <class 'torch.Tensor'>
+ | 1 * Size:(23644, 3)           | Memory: 0.2837 M | <class 'torch.Tensor'>
+ | 1 * Size:(19834, 2)           | Memory: 0.1586 M | <class 'torch.Tensor'>
+ | 1 * Size:(28806,)             | Memory: 0.1152 M | <class 'torch.Tensor'>
+ | 1 * Size:(19834,)             | Memory: 0.0793 M | <class 'torch.Tensor'>
+ | 1 * Size:(28464,)             | Memory: 0.1138 M | <class 'torch.Tensor'>
+ | 1 * Size:(16842, 2)           | Memory: 0.1347 M | <class 'torch.Tensor'>
+ | 1 * Size:(19977, 2)           | Memory: 0.1598 M | <class 'torch.Tensor'>
+ | 1 * Size:(16842,)             | Memory: 0.0673 M | <class 'torch.Tensor'>
+ | 1 * Size:(38851, 10)          | Memory: 1.5540 M | <class 'torch.Tensor'>
+ | 1 * Size:(24060, 3)           | Memory: 0.2887 M | <class 'torch.Tensor'>
+ | 1 * Size:(38851,)             | Memory: 0.1554 M | <class 'torch.Tensor'>
+ | 1 * Size:(18869, 2)           | Memory: 0.1509 M | <class 'torch.Tensor'>
+ | 1 * Size:(24060,)             | Memory: 0.0962 M | <class 'torch.Tensor'>
+ | 1 * Size:(38909, 10)          | Memory: 1.5563 M | <class 'torch.Tensor'>
+ | 1 * Size:(17532, 2)           | Memory: 0.1402 M | <class 'torch.Tensor'>
+ | 1 * Size:(18869,)             | Memory: 0.0754 M | <class 'torch.Tensor'>
+ | 1 * Size:(40896, 10)          | Memory: 1.6358 M | <class 'torch.Tensor'>
- | 1 * Size:(38592,)             | Memory: 0.1543 M | <class 'torch.Tensor'> 
- | 1 * Size:(27714, 3)           | Memory: 0.3325 M | <class 'torch.Tensor'> 
- | 1 * Size:(26703, 3)           | Memory: 0.3204 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 6, 100, 88)      | Memory: 1.056 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 14, 100, 88)     | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(19088,)             | Memory: 0.0763 M | <class 'torch.Tensor'> 
- | 1 * Size:(17419, 2)           | Memory: 0.1393 M | <class 'torch.Tensor'> 
- | 1 * Size:(17832,)             | Memory: 0.0713 M | <class 'torch.Tensor'> 
- | 1 * Size:(28364,)             | Memory: 0.1134 M | <class 'torch.Tensor'> 
- | 1 * Size:(38496, 10)          | Memory: 1.5398 M | <class 'torch.Tensor'> 
- | 1 * Size:(17832, 2)           | Memory: 0.1426 M | <class 'torch.Tensor'> 
- | 1 * Size:(38496,)             | Memory: 0.1539 M | <class 'torch.Tensor'> 
- | 1 * Size:(17419,)             | Memory: 0.0696 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2) | Memory: 0.352 M | <class 'torch.Tensor'> 
- | 1 * Size:(194211, 10)         | Memory: 7.7684 M | <class 'torch.Tensor'> 
- | 1 * Size:(39996, 10)          | Memory: 1.5998 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 3, 375, 1242)    | Memory: 27.945 M | <class 'torch.Tensor'> 
- | 1 * Size:(37194,)             | Memory: 0.1487 M | <class 'torch.Tensor'> 
- | 1 * Size:(18410,)             | Memory: 0.0736 M | <class 'torch.Tensor'> 
- | 1 * Size:(27511,)             | Memory: 0.1100 M | <class 'torch.Tensor'> 
- | 1 * Size:(19222, 2)           | Memory: 0.1537 M | <class 'torch.Tensor'> 
- | 1 * Size:(27714,)             | Memory: 0.1108 M | <class 'torch.Tensor'> 
- | 1 * Size:(37194, 10)          | Memory: 1.4877 M | <class 'torch.Tensor'> 
- | 1 * Size:(26703,)             | Memory: 0.1068 M | <class 'torch.Tensor'> 
- | 1 * Size:(194211,)            | Memory: 0.7768 M | <class 'torch.Tensor'> 
- | 1 * Size:(27171,)             | Memory: 0.1086 M | <class 'torch.Tensor'> 
- | 1 * Size:(39996,)             | Memory: 0.1599 M | <class 'torch.Tensor'> 
- | 1 * Size:(91971, 3)           | Memory: 1.1036 M | <class 'torch.Tensor'> 
- | 1 * Size:(137463, 4)          | Memory: 2.1994 M | <class 'torch.Tensor'> 
- | 1 * Size:(39933,)             | Memory: 0.1597 M | <class 'torch.Tensor'> 
- | 1 * Size:(27171, 3)           | Memory: 0.3260 M | <class 'torch.Tensor'> 
- | 1 * Size:(27511, 3)           | Memory: 0.3301 M | <class 'torch.Tensor'> 
- | 4 * Size:(1,)                 | Memory: 1.6e-0 M | <class 'torch.Tensor'> 
- | 1 * Size:(5, 88, 100, 1, 1, 2, 7) | Memory: 2.464 M | <class 'torch.Tensor'> 
- | 1 * Size:(91971,)             | Memory: 0.3678 M | <class 'torch.Tensor'> 
- | 1 * Size:(19088, 2)           | Memory: 0.1527 M | <class 'torch.Tensor'> 
- | 1 * Size:(28364, 3)           | Memory: 0.3403 M | <class 'torch.Tensor'> 
- | 1 * Size:(137463,)            | Memory: 0.5498 M | <class 'torch.Tensor'> 
- | 1 * Size:(39933, 10)          | Memory: 1.5973 M | <class 'torch.Tensor'> 
- | 1 * Size:(18410, 2)           | Memory: 0.1472 M | <class 'torch.Tensor'> 
- | 1 * Size:(19222,)             | Memory: 0.0768 M | <class 'torch.Tensor'> 
- | 1 * Size:(38592, 10)          | Memory: 1.5436 M | <class 'torch.Tensor'> 

At __mp_main__ <module>: line 374                    Total Used Memory:11292.8Mb

``` 

</details>

I also want to mention another phenomenon I found. During my training process, I have a validation step, if I add validation after each epoch of training, the memory cost will almost be doubled! Even if I use the same network object, I just call `net.eval()` and the forward function. So I have to reduce batch_size if I enable validation. Is this problem caused by my incorrect usage or something related to pytorch memory management? I also tried [pytorch_lightning](https://github.com/PyTorchLightning/pytorch-lightning) to avoid hand written validation loop, I still have the same issue!

Thanks for your help in advance!

## To Reproduce

Unfortunately I cannot provide the code I use...

## Environment

```
[pip] numpy==1.18.1
[pip] pytorch-lightning==0.7.1
[pip] pytorch-memlab==0.1.0
[pip] torch==1.4.0
[pip] torch-scatter==2.0.4
[pip] torchvision==0.5.0
[conda] blas                      1.0                         mkl  
[conda] cudatoolkit               10.1.243             h6bb024c_0  
[conda] cudatoolkit-dev           10.1.243             h516909a_3    conda-forge
[conda] mkl                       2020.0                      166  
[conda] mkl-include               2020.0                      166  
[conda] mkl-service               2.3.0            py37he904b0f_0  
[conda] mkl_fft                   1.0.15           py37ha843d7b_0  
[conda] mkl_random                1.1.0            py37hd6b4f25_0  
[conda] numpy                     1.18.1           py37h4f9e942_0  
[conda] numpy-base                1.18.1           py37hde5b4d6_1  
[conda] pytorch                   1.4.0           py3.7_cuda10.1.243_cudnn7.6.3_0    pytorch
[conda] pytorch-lightning         0.7.1                    pypi_0    pypi
[conda] pytorch-memlab            0.1.0                    pypi_0    pypi
[conda] torch-scatter             2.0.4                     dev_0    <develop>
[conda] torchsnooper              0.8                      pypi_0    pypi
[conda] torchvision               0.5.0                py37_cu101    pytorch
```
Also note that I use this sparse convolution library: [spconv](https://github.com/traveller59/spconv)


cc @ngimel