Remove original logger.
Fix a bug when shutdown application.