Question: Do the use word embeddings alone or they replace some previous features of the model with word embeddings?
Answer: They use it as addition to previous model - they add new edge between words if word embeddings are similar.