cuda_max_global_memory_usage_ratio is set to 0.8 by default
Reporting average learning rates when training