Remove test-logger.c

All test cases use logger now, so we do not need another test case to
test logger functionality.