Question: Did they compare to Transformer based large language models?
Answer: No