Fix concurrency issue in lifetime manager.

Change-Id: I6b5688f5362fbf5591c84c78f56e4a682cb95587