Question: Do they use pretrained word representations in their neural network models?
Answer: No