Fix concurrency issue in lifetime manager.

Change-Id: Ib002c6075328fe391041c3aec7622f3bb7a4ce59