Question: How does their model differ from BERT?
Answer: Their model does not differ from BERT.