Before revision:  Their weight vectors are dense entity representations produced by encoding entity  information such as  descriptions.
After revision:  Their weight vectors are dense entity representations produced by encoding entity information such as their descriptions.