Question: How do they combine a deep learning model with a knowledge base?
Answer: Entities from a deep learning model are linked to the related entities from a knowledge base by a lookup.
Alternative answer: ELMo embeddings are then used with a residual LSTM to learn informative morphological representations from the character sequence of each token