"resume from checkpoint" lead to CUDA out of memory
When I use “resume from checkpoint”,
there is a “CUDA out of memory” problem,
when using torch.load(), set "map location" to "cpu" can solve this problem,
in "resume from checkpoint" scenario, what should I do?
I solved the problem after setting the strategy to 'ddp'.