question: "resume from checkpoint" lead to CUDA out of memory
context: When I use “resume from checkpoint”,
  there is a “CUDA out of memory” problem,
  when using torch.load(), set "map location" to "cpu" can solve this problem,
  in "resume from checkpoint" scenario, what should I do?
answer: I solved the problem after setting the strategy to 'ddp'.