Before revision:  However, this limits the usability of a practical solution. To overcome this limitation, we use one of state-of-the-art architecture- TransformerXL. Instead of rule-based extraction, our framework leverages the rich contextual encoding which allows us to process a larger range (diverse) of possible natural language descriptions.
After revision:  In the second stage, we generate a 3D scene based on the generated encoding. Our neural architecture exploits state-of-the-art language model as encoder to leverage rich contextual encoding which allows us to process a larger range (diverse) of possible natural language descriptions.