Fix FluentLoggerFactory fails to hold FluentLogger(s) over GC

For https://github.com/fluent/fluent-logger-java/issues/37