Question: How much F1 was improved after adding skip connections?
Answer: Simple Skip improves F1 from 74.34 to 74.81
Transformer Skip improes F1 from 74.34 to 74.95