Eliminate previous pointers in LexicalUnitImpl (#13630).

Change-Id: I21b28485722541b3555d63a85051fff7aeaa15f7