Detailed Instructions: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: Through the experiments, we empirically studied our analysis on DIRL and the effectiveness of our proposed solution in dealing with the problem it suffered from. In addition, we studied the impact of each step described in SECREF10 and SECREF14 to our proposed solution, respectively. To performe the study, we carried out performance comparison between the following models:

SO: the source-only model trained using source domain labeled data without any domain adaptation.

CMD: the centre-momentum-based domain adaptation model BIBREF3 of the original DIRL framework that implements $\mathcal {L}_{inv}$ with $ ext{CMD}_K$.

DANN: the adversarial-learning-based domain adaptation model BIBREF2 of the original DIRL framework that implements $\mathcal {L}_{inv}$ with $ ext{JSD}(
m {P}_S,
m {P}_T)$.

$ ext{CMD}^\dagger $: the weighted version of the CMD model that only applies the first step (described in SECREF10) of our proposed method.

$ ext{DANN}^\dagger $: the weighted version of the DANN model that only applies the first step of our proposed method.

$ ext{CMD}^{\dagger \dagger }$: the weighted version of the CMD model that applies both the first and second (described in SECREF14) steps of our proposed method.

$ ext{DANN}^{\dagger \dagger }$: the weighted version of the DANN model that applies both the first and second steps of our proposed method.

$ ext{CMD}^{*}$: a variant of $ ext{CMD}^{\dagger \dagger }$ that assigns $\mathbf {w}^*$ (estimate from target labeled data) to $\mathbf {w}$ and fixes this value during model training.

$ ext{DANN}^{*}$: a variant of $ ext{DANN}^{\dagger \dagger }$ that assigns $\mathbf {w}^*$ to $\mathbf {w}$ and fixes this value during model training. We conducted experiments on the Amazon reviews dataset BIBREF9, which is a benchmark dataset in the cross-domain sentiment analysis field. From this dataset, we constructed 12 binary-class cross-domain sentiment analysis tasks: B$
ightarrow $D, B$
ightarrow $E, B$
ightarrow $K, D$
ightarrow $B, D$
ightarrow $E, D$
ightarrow $K, E$
ightarrow $B, E$
ightarrow $D, E$
ightarrow $K, K$
ightarrow $B, K$
ightarrow $D, K$
ightarrow $E. We additionally constructed 12 multi-class cross-domain sentiment classification tasks. Tasks were designed to distinguish reviews of 1 or 2 stars (class 1) from those of 4 stars (class 2) and those of 5 stars (class 3). Table TABREF27 shows model performance on the 12 binary-class cross-domain tasks. From this table, we can obtain the following observations.
Question: How is DIRL evaluated?
A:
Through the experiments, we empirically studied our analysis on DIRL and the effectiveness of our proposed solution in dealing with the problem it suffered from.