Question: What are improvements for these two approaches relative to ELMo-only baselines?
Answer: only modest gains on three of the four downstream tasks
Alternative answer:  the performance differences across all tasks are small enough