In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

[Q]: FastTextBIBREF4: It uses bag of words and bag of n-grams as features for text classification, capturing partial information about the local word order efficiently. BiLSTM: Unlike feedforward neural networks, recurrent neural networks like BiLSTMs use memory based on history information to learn long-distance features and then predict the output. We use a two-layer BiLSTM architecture with GloVe word embeddings as a strong RNN baseline. BERT BIBREF5: It is a contextualized word representation model that uses bidirectional transformers, pretrained on a large $3.3B$ word corpus. We use the $BERT_{large}$ model finetuned on the training dataset.
Question: What is the baseline for the experiments?
[A]: FastText BiLSTM BERT

[Q]: The basic concept is to use a phone-discriminative model to produce frame-level phonetic features, and then use these features to enhance RNN LID systems that were originally built with raw acoustic features. The initial step is therefore feature combination, with the phonetic feature used as auxiliary information to assist acoustic RNN LID. This is improved further, as additional research identified that a simpler model using only the phonetic feature as the RNN LID input provides even better performance. We call this RNN model based on phonetic features the phonetic temporal neural LID approach, or PTN LID. As well as having a simplified model structure, the PTN offers deeper insight into the LID task by rediscovering the value of the phonetic temporal property in language discrimination.
Question: What is the main contribution of the paper?
[A]: Proposing an improved RNN model, the phonetic temporal neural LID approach, based on phonetic features that results in better performance

[Q]: In Figure FIGREF28, we show some examples of the annotation results in CORD-19-NER. We can see that our distantly- or weakly supervised methods achieve high quality recognizing the new entity types, requiring only several seed examples as the input. For example, we recognized "SARS-CoV-2" as the "CORONAVIRUS" type, "bat" and "pangolins" as the "WILDLIFE" type and "Van der Waals forces" as the "PHYSICAL_SCIENCE" type. This NER annotation results help downstream text mining tasks in discovering the origin and the physical nature of the virus. Our NER methods are domain-independent that can be applied to corpus in different domains. In addition, we show another example of NER annotation on New York Times with our system in Figure FIGREF29.

In Figure FIGREF30, we show the comparison of our annotation results with existing NER/BioNER systems. In Figure FIGREF30, we can see that only our method can identify "SARS-CoV-2" as a coronavirus. In Figure FIGREF30, we can see that our method can identify many more entities such as "pylogenetic" as a evolution term and "bat" as a wildlife. In Figure FIGREF30, we can also see that our method can identify many more entities such as "racism" as a social behavior. In summary, our distantly- and weakly-supervised NER methods are reliable for high-quality entity recognition without requiring human effort for training data annotation.
Question: Did they experiment with the dataset?
[A]:
Yes