Improve loader manager with weak reference.