Accelerate has its own logging utility to handle logging while in a distributed system.
To utilize this replace cases of
- import logging + from accelerate.logging import get_logger - logger = logging.getLogger(__name__) + logger = get_logger(__name__)
accelerate.logging.get_logger< source >
( name: str )
name that can handle multiprocessing.
If a log should be called on all processes, pass