opened
GeKeShi
username_0
I need to test my gradients compression algorithm, but the tutorial does not include level3, would you give me some instruction, thank you!
How can I benchmark the gradients compression method in Deep500?
issue
created
tbennun
username_1
I would start with the distributed training sample: https://github.com/deep500/deep500/blob/master/samples/distributed_training.py

and extending the `DistributedOptimizer` class with your logic, wrapping around an existing optimizer (as in the sample).
comment
created
GeKeShi
username_0
Do you mean that I can not test my gradients compression method in this version? If I implement the compression algorithm in communication.py, in which I change the tensor communicated with MPI, is it a solution?
comment
created
GeKeShi
username_0
For example, How can I test SparCML in Deep500? Thank you!
comment