Make sure you have a unique handler for each logging destination and remove any pre-existing handlers before setting up new ones.