We should store the old logger and change back in an ensure block