  We describe our straight-forward approach for Tasks 5 and 6 of 2021 Social
Media Mining for Health Applications (SMM4H) shared tasks. Our system is based
on fine-tuning Distill- BERT on each task, as well as first fine-tuning the
model on the other task. We explore how much fine-tuning is necessary for
accurately classifying tweets as containing self-reported COVID-19 symptoms
(Task 5) or whether a tweet related to COVID-19 is self-reporting, non-personal
reporting, or a literature/news mention of the virus (Task 6).
