P AIRWISE A DVERSARIAL T RAINING FOR U NSUPERVISED C LASS - IMBALANCED D OMAIN A DAPTATION
Anonymous authors
Paper under double-blind review
A BSTRACT
Unsupervised domain adaptation (UDA) has become an appealing approach for knowledge transfer from a labeled source domain to an unlabeled target domain.
However, when the classes in source and target domains are imbalanced, most existing UDA methods experience signiﬁcant performance drop, as the decision boundary usually favors the majority classes.
Some recent class-imbalanced domain adaptation (CDA) methods aim to tackle the challenge of biased label distribution by exploiting pseudo-labeled target data during training process.
However, these methods still suffer from the issues with unreliable pseudo labels and error accumulation during training.
In this paper, we propose a pairwise adversarial training approach for class-imbalanced domain adaptation.
Unlike conventional adversarial training in which the adversarial samples are obtained from the (cid:96) p ball of the original data, we generate adversarial samples from the interpolated line of the aligned pairwise samples from source domain and target domain.
Experimental results and ablation studies show that our method achieves considerable improvements on benchmarks compared with the state-of-art CDA methods.
‘ I NTRODUCTION
Unsupervised domain adaptation (UDA) aims to achieve knowledge transfer from a labeled source domain to an unlabelled target domain.
Recent years have witnessed the signiﬁcant progress of
UDA based on deep neural networks (Pei et al., 2018; Cui et al., 2020; Hu et al., 2020;
Na et al., 2021; Liang et al., 2020).
Most of existing UDA methods assume that only covariate shift occurs in the source domain and target domain, while the label distributions in two domains are identical.
However, this assumption may not hold in real-world applications.
For instance, in wild-life pictures, the commonly seen animals such as rabbit and deer appear more frequently than the rare animal such as panda and crocodile.
Public datasets such as DomainNet (Peng et al., 2019) and and MSCOCO (Lin et al., 2014) exhibit imbalanced class distribution.
Figure 1 illustrates the imbalanced label distributions in the Real domain and Sketch domain from the DomainNet dataset.
To address the issue of imbalanced label distributions in domain adaptation, some recent studies (Tan et al., 2020;
Wu et al., 2019; Jiang et al., 2020) try to jointly model the conditional feature distribution shift and label distribution shift (LDS).
This problem is referred to as Classimbalanced Domain Adaptation (CDA).
Let x
and y denote the samples and labels, respectively.
p and q separately represent the probability distribution of source domain and target domain.
The common assumptions in
UDA involve the covariate shift (i.e., p ( x ) (cid:54) =
q ( x ) ) and identical label distribution (
i.e., p ( y ) =
q ( y ) ).
In CDA, however, apart from the covariate shift, both the conditional feature shift and label shift exist, i.e., p ( x | y )
(cid:54) =
q ( x | y ) , p ( y ) (cid:54) =
q ( y ) .
CDA is a more challenging task than UDA.
Recent studies (Tan et al., 2020) have demonstrated that the mainstream UDA methods will suffer signiﬁcant performance drop, as the classiﬁer will favor the majority classes.
Only a few CDA approaches have been proposed by far.
In Tan et al.
(2020), the negative effect of label shift is reduced by exploiting the pseudo labelled target samples via self-training.
Jiang et al.
(2020) use an implicit sampling method based on pseudo labels to align the joint distribution between features and labels.
However, one critical problem of these methods is that the pseudo labels are likely to suffer from ill-calibrated probabilities (Guo et al., 2017), and thus the unreliable pseudo labels will cause error accumulation during the training process, which will largely degrade the model performance.
Augmenting training data has been proven as an effective strategy to tackle the issue of biased label distributions in class-imbalance learning (Chawla et al., 2002; Chou et al., 2020).
In addition to the traditional data augmentation techniques, adversarial training is also capable of generating semantically meaningful synthetic samples that help enhance the robustness of models.
However, these approaches only consider a single domain, and they cannot be directly applied to solve the CDA problem.
In this paper, we propose a pairwise adversarial training (PAT) approach that augments training data for class-imbalanced domain adaptation.
Unlike conventional adversarial training in which the adversarial samples are obtained from the (cid:96) p ball of the original data, we obtain the semantic adversarial samples from the interpolated line of the aligned pair-wise samples from source domain and target domain.
Moreover, a class-imbalanced semantic centroid alignment strategy is designed to explicitly align the source and target domains in the feature space.
The main contributions of this paper are three-fold.
(1) We propose a novel pairwise adversarial training approach that generates adversarial samples from pairs of samples across the source and target domains, and further exploits these samples to augment training data.
(2) We propose a new optimization algorithm to solve pairwise adversarial training problem.
(3) We conduct extensive evaluations on benchmark datasets, and results show that our approach obtains competing performance compared with state-of-art CDA methods.
R ELATED W ORK
In this section, we brieﬂy introduce three relevant research topics, including unsupervised domain adaptation, class-imbalanced domain adaptation and adversarial training.
Unsupervised Domain Adaptation .
In recent years, unsupervised domain adaption (UDA) has attracted increasing attention.
Existing UDA methods could be roughly categorized into two groups, including the discrepancy-based methods and adversarial-based methods.
The discrepancy-based methods usually align source and target feature distributions in the embedding space using various statistical distance metrics, such as Maximum Mean Discrepancy (MMD) (Long et al., 2016; 2017; Kang et al., 2019), Correlation Alignment (CORAL) (Sun & Saenko, 2016), and Wasserstein distance (Lee & Raginsky, 2018;
Shen et al., 2018; Balaji et al., 2019).
On the other hand, the adversarial-based methods focus on learning domain invariant features via domain adversarial training (Ganin et al., 2016; Shu et al., 2018;
Pei et al., 2018;
Saito et al., 2018; Deng et al., 2019; Yu et al., 2019).
Recently, Zhang et al.
(2019) proposed the margin disparity discrepancy (MDD) to measure the discrepancy of two domains with generalization bounds.
This theory is tailored into an adversarial learning algorithm for domain adaptation.
Unlike other adversarial learning based UDA methods that align two domains by confusing a domain discriminator, MDD aligns two domains by minimizing the maximum margin disparity discrepancy of an optimal classiﬁer f and an auxiliary classiﬁer f (cid:48) .
The optimization problem of MDD is formulated as:
[Equation]
where ε is the classiﬁcation loss on the source domain and D γ measures the discrepancy of source domain and target domain.
Speciﬁcally,
[Equation] [Equation]
L is cross-entropy function, and L (cid:48)
( f (cid:48) ( ψ ( x t )) , f ( ψ ( x t )))
= log(1 − σ y (cid:48)
( f (cid:48) ( ψ ( x t ))) .
y (cid:48) is the pseudo label generated from an optimal classiﬁer.
MDD is the backbone of our method.
Class-imbalanced Domain Adaptation .
As a branch of domain adaptation, the class-imbalanced domain adaptation (CDA) aims to deal with data with biased class distribution.
Tan et al.
(2020) might be the ﬁrst one to investigate the CDA problem, and they exploited the pseudo labelled target data to reduce the negative effect of label shift.
Wu et al.
(2019) proposed the asymmetrically-relaxed distances as replacement of the standard ones under biased label distribution.
Jiang et al.
(2020) adopted the implicit sampling strategy to ensure class alignment at the minibatch level.
Prabhu et al.
(2021) avoided the use of highly unreliable pseudo labels by assessing the reliability of target data with predictive consistency under random image transformations.
Our method refrains from the exploitation of pseudo labeled target data directly in the training process, while reducing the effect of biased label shift by incorporating the semantic adversarial samples into the training process.
Adversarial Training .
Adversarial training (AT) (Szegedy et al., 2014; Goodfellow et al., 2015) is an effective regularization method for enhancing the robustness and generalization ability of deep learning models.
In particular, adversarial samples are incorporated in the model training process, which are intentionally designed to deceive the deep learning model by adding small perturbation on the original data.
Furthermore, virtual adversarial training (VAT) has been proposed (Miyato et al., 2018), which seeks the adversarial direction for regularization without using label information.
Both
AT and VAT have been employed to tackle the standard UDA problems Shu et al.
However, to the best of our knowledge, our work is the ﬁrst attempt to address the class-imbalanced domain adaptation problem using adversarial training.
P ROPOSED A PPROACH
In this section, we ﬁrst give the problem deﬁnition of CDA, and then present the details of the proposed pairwise adversarial training approach.
Finally, we introduce how to integrate the pairwise adversarial training with MDD to address the CDA problem.
3. P ROBLEM D EFINITION
In class-imbalanced domain adaptation, both the source and target domains suffer from label distribution shift.
We are given a source domain D s = { ( x si , y si ) }
N s i =1 with N s labelled samples and a target domain D t = { x ti } N t
i =1 with N t unlabelled samples.
Each domain contains K classes, and the class label is denoted as y s ∈ { 0 , 1 , 2 , ..., K − 1 } .
Let p and q denote the probability distributions of the source domain and target domain, respectively.
We assume that both the covariate shift (i.e., p ( x ) (cid:54) =
q ( x ) ) and label distribution shift (i.e., p ( y ) (cid:54) =
q ( y ) and p ( x | y ) (cid:54) =
q ( x | y ) ) exist in two domains.
Our goal is to train a model that can learn domain invariant features, reduce the gap between source and target domains, and mitigate the label distribution shift.
The model typically consists of a feature extractor ψ : X → Z and a classiﬁer f : Z → Y that aims to minimize the target risk.
3. P AIRWISE A DVERSARIAL T RAINING (PAT)
We investigate how to mitigate the challenging issue of label distribution shift in CDA, as illustrated in Figure 1.
Previous studies (Tan et al., 2020) found that when the source domain is imbalanced, the model performance on target domains will be signiﬁcantly dropped, especially when the target domain is also imbalanced.
An intuitive solution is to augment the training data in two domains, such that the model training would not be dominated by the majority classes in either domain.
However, this task is not trivial, considering the mixed effects of domain gap and imbalanced class distributions.
Inspired by adversarial training, we aim to create adversarial samples to augment training data.
In adversarial training, the adversarial samples will be exploited to enhance the robustness and generalization ability of model.
The loss function of adversarial training is:
[Equation]
where δ ∗ := arg max
[Equation]
where x is the original sample, y is the ground-truth label of x , θ refers to model parameters, and δ is the perturbation added to x .
The existing adversarial training methods could not be directly used to tackle the CDA problem for two reasons.
First, existing methods simply generate adversarial samples within the neighborhood of the original samples, but they could not mitigate the gap between source and target domains.
Second, existing methods treat majority classes and minority classes equally, so they are unable to address the class imbalance issue.
In this paper, we propose pairwise adversarial training that generates adversarial samples from the linear interpolation of source and target samples and meanwhile reduces the domain discrepancy.
In the following, we will introduce two key components of PAT, including the generation of interpolated adversarial samples and semantic centroid alignment.
3.2. I NTERPOLATED A DVERSARIAL S AMPLE G ENERATION
As shown in Figure 2, we will generate adversarial samples on the interpolated line from a source sample to a target sample of the same class.
The interpolated adversarial samples (IAS) should have the same semantic meaning as their corresponding source/target sample pair, although they are not perfectly aligned with the original samples.
We explicitly address the data imbalance issue in the source domain by exploiting interpolated adversarial samples and aligning the source and target domains.
As a result, the generalization ability of the unbiased model will be improved and the data imbalance issue in the target domain could be implicitly addressed.
For the k th class, the interpolated adversarial samples can be deﬁned as:
[Equation]
where x i ∈ R C
× H × W , λ is the coefﬁcient measuring the contributing weights of the source sample and target sample.
ˆ y ti is the pseudo label of the target sample which is generated from the backbone domain adaptation model (e.g., the optimal classiﬁer f in MDD).
It is used for match of the corresponding source sample.
In our work, though the pseudo labels might be incorrect, our PAT method will not suffer from the potential error accumulation issue.
First, we choose the target samples with high conﬁdence.
Second, even if the pseudo label is incorrect, there is still a chance that the interpolated adversarial sample will be generated within the boundary as expected.
Speciﬁcally, the misclassiﬁed target samples often appear near the decision boundary.
So, even if the target sample is from a different class, the adversarial sample generated from the pair of source sample and target sample may not violate the decision boundary.
Finally, the adversarial samples in our approach are generated dynamically, and the adverse effect of bad adversarial samples could be mitigated.
Then, the generation of interpolated adversarial samples could be achieved by solving the following optimization problem:
[Equation]
where
[Equation]
In Eq.
(7), the outer minimization problem involves a standard cross-entropy loss function, i.e.,
[Equation]
where ψ : X → Z denotes a feature extractor, f : Z → Y denotes a classiﬁer, and σ is the softmax function.
For the inner maximization problem, we use a modiﬁed cross-entropy function proposed by Goodfellow et al.
The modiﬁed loss function can alleviate the problem of gradient exploding or vanishing when the entropy loss is maximized.
The loss function of the inner maximization problem is written as:
[Equation]
Several optimization algorithms, such as the fast gradient sign method (Goodfellow et al., 2015) and projected gradient descent (Madry et al., 2018), have been commonly used for adversarial training.
However, these algorithms aim to obtain the adversarial samples in the (cid:96) ∞ ball of the original samples, which cannot be directly applied to solving our problem.
In our case, the interpolated adversarial samples are conﬁned on the interpolated line of source data and target data.
We propose a new optimization algorithm to solve the inner maximization optimization in Eq.
We initialize the interpolated adversarial samples with random λ and update them by back propagation in each iteration.
The main procedures of our algorithm are summarized in Algorithm 1.
si mini batch do
P y then
Initialize λ converges end if end for
Generating interpolated samples has been explored in literature, such as mix-up (Chou et al., 2020) and its variants.
However, mix-up based methods and our method have signiﬁcant differences.
First, mix-up based methods focus on the single-domain classiﬁcation or standard domain-adaptation problems, while our method focuses on the data imbalance problem in domain adaptation.
Second, the ideas for generating samples and labels in mix-up and our method are different.
Mix-up creates virtual samples and their labels from two randomly chosen samples.
While in our method, an adversarial sample is generated using a pair of samples from two domains with the same label.
Third, mix-up needs to manually deﬁne a hyper-parameter to control the strength of interpolation.
However, in our method, the parameter for controlling the strength of interpolation is adaptively updated along with adversarial training.
3.2. C LASS -I MBALANCED S EMANTIC C ENTROID A LIGNMENT
generation of
Without careful control of the generation mechanism, the interpolated adversarial samples may not alleviate the issue of imbalanced class distribution.
Moreover, although the interpolated adversarial samples bridge the source and target domains to some extent, the discrepancy between source and target domains is not explicitly reduced.
To address these issues, we propose to explicitly align the source and target domains with imbalanced class distributions using two strategies.
First, we propose a strategy to guide the generation of interpolated adversarial samples.
For training samples in each mini-batch from the source domain, they should not have the equal opportunity to generate interpolated adversarial samples.
Since the decision boundary usually favors the majority classes, the probability of generating adversarial samples for minority classes should be larger than that for majority classes.
For the k -th class, we set a probability threshold P k as follows:
[Equation]
where n k is the number of the samples from the k th class.
n max = max k { n k } Kk =1 , and (cid:15) is the bias.
For a speciﬁc class, if a random number r ∈ [0 , 1) is larger than the corresponding threshold, the adversarial samples will be generated, as shown in Algorithm 1.
We also adopt class-balanced sampling on the source data to alleviate the biased occurrence of the majority classes.
Speciﬁcally, each class will be selected with an equal chance, in order to reduce the model prediction bias towards the majority classes.
Second, we incorporate the moving average centroid alignment (Xie et al., 2018) to align the conditional feature distributions of source and target domains by explicitly matching the centroids of two domains.
As illustrated in Figure 3, without centroid alignment, the adversarial samples may be generated from a pair of samples in which one of the samples is misaligned to other classes, thus making the embedding of adversarial samples fall out of the decision boundary.
With centroid alignment, we can eliminate the occurrence of such out-of-bound adversarial samples, and the interpolated adversarial samples could provide meaningful support for the minority class in the target domain.
The loss function of moving average centroid alignment is deﬁned as L CA =
(cid:80) Kk =1 dist ( C sk , C tk ) , where
C sk and C tk denote the centroids of the k th class in the source domain and target domain, respectively.
dist () can be implemented by the Euclidean distance or cosine distance.
3. PAT FOR C LASS I MBALANCED D OMAIN A DAPTATION
The proposed PAT approach could be integrated with many existing domain adaptation frameworks to enhance their performance on class-imbalanced data.
In this paper, we adopt MDD (Zhang et al., 2019) as an example backbone model and showcase how to integrated PAT with it.
The MDD framework consists of a feature extractor G , an optimal classiﬁer F , and an auxiliary classiﬁer F (cid:48) .
The loss function of MDD is introduced in Eq.
(1) and Eq.
Adversarial samples designed to maximize the modiﬁed cross-entropy function L (cid:48) CE are generated from the pair of source data and target data.
Finally, the overall loss function of our framework is:
[Equation]
where α and β are two trade-off parameters.
EXPERIMENTS 4. EXPERIMENTAL SETTINGS
Ofﬁce-31 is a widely used benchmark image dataset for domain adaptation (Saenko et al., 2010).
It contains 31 classes in three domains: Amazon ( A ), Dslr ( D ) and Webcam ( W ).
The standard Ofﬁce-31 doesn’t exhibit obvious label distribution shift (LDS), so a new imbalanced Ofﬁce-31 is created by sampling from standard ones as suggested by Tan et al.
The distribution conforms to Paredo distribution (Reed, 2001) and follows the R eversely-unbalanced
S ource and U nbalanced T arget (RS-UT) protocol.
Both the source domain and target domain have shifted label distributions, and the label distribution of source domain is a reversed version of that of target domain.
Ofﬁce-Home is a large benchmark dataset containing 65 classes of objects commonly found in ofﬁce and home scenarios (Venkateswara et al., 2017).
It has four domains: Real-World ( Rw ), Clipart
[Table]
[Table]
( Cl ), Product ( Pr ) and Art ( Ar ).
In our experiments, we use the existing imbalanced Ofﬁce-Home with RS-UT distributions generated in Tan et al.
(2020) to train and test our approach.
Since there are very limited samples in the art ( Ar ) domain, we only conduct domain adaptation tasks on the other three domains.
DomainNet is a large-scale benchmark dataset for domain adaptation (Peng et al., 2019).
Since there are mislabeled samples in some classes and domains, we follow Tan et al.
(2020) and adopt only 40 common classes from four domains: Real ( R ), Clipart ( C ), Painting ( P ), and Sketch ( S ).
Different from Ofﬁce-31 and Ofﬁce-Home, the selected samples in DomainNet already exhibit obvious label distribution shift in the source domain and target domain.
So there is no need to sample this dataset again.
Figure 5 illustrates the label distributions of imbalanced Ofﬁce and imbalanced Ofﬁce-Home datasets.
We use PyTorch to implement our approach.
We train our model with the mini-batch SGD, a Nesterov momentum of 0.9, and a weight decay of 0.0005.
The learning rate of classiﬁers is 10 times larger than that of feature extractor, and all the learning rates are adjusted by every iteration.
In order to obtain the interpolated adversarial sample from a pair of source sample and target sample from the same class, we utilize a memory pool to store the pseudo labels of all the target data.
The pseudo labels are updated in every iteration.
Note that we utilize a class-balanced sampler on the source data, which can be referred to as N-way (number of classes per batch) and K-shot (number of examples per class).
The coefﬁcient α is set to 0.5 and β is set to 0.05 for all the experiments.
Following existing work on CDA, we adopt the per-class mean accuracy as our evaluation metric.
All the experiments are implemented on Nvidia RTX
A5000 platform.
[Table] [Table]
4. COMPARISON WITH STATE - OF - ART CDA METHODS
We compare our approach with several state-of-art methods for class imbalanced domain adaptation.
The baseline methods can be divided into two categories.
The ﬁrst category of methods are specifically designed to solve the CDA problem, including Sentry (Prabhu et al., 2021), MDD+implicit
Jiang et al.
(2020), COAL (Tan et al., 2020), and F-DANN (Wu et al., 2019).
The second category of methods aim to solve the standard unsupervised domain adaptation problem, including the
InstaPBM (Li et al., 2020) and BSP (Chen et al., 2019).
Table 1 shows the per-class average accuracy and overall average accuracy of our approach and baselines on the imbalanced Ofﬁce-Home dataset.
The results of the baseline are cited from Prabhu et al.
Our proposed model achieves the best results in 4 out of 6 tasks.
The accuracies of our approach in these 4 tasks are more than 3% higher than the second-best results.
In addition, our model obtains the second-best results in the Rw → CL and Pr → Cl tasks.
Overall, our method achieves the highest average accuracy (i.e., 66.07%) among all the compared methods.
We also investigate the class-speciﬁc accuracy of MDD (Zhang et al., 2019) and our method on minority classes, in order to understand how well our method addresses the data imbalance issue.
Tableshows that our PAT method can signiﬁcantly boost the performance on the minority classes from the imbalanced Ofﬁce-Home dataset.
Table 2 shows the per-class average accuracies of our approach and baselines on the DomainNet dataset.
Our approach achieves the best results in 4 tasks and second-best results in 8 tasks.
In
R → S, P → S and S → P, our model can achieve 76.08%, 75.46%, which are 1.65% and 1.48% higher than the second-best results, respectively.
Though in some tasks our results are lower than Sentry (Prabhu et al., 2021), the overall average accuracy of our approach is comparable to that of Sentry.
We manually sample the standard Ofﬁce-31 dataset and construct the imbalanced Ofﬁce-31 dataset, in which the label distribution conforms to the Paredo distribution (Reed, 2001).
We compare our model with current state-of-art methods that focus on the CDA problem.
Among all the 6 tasks, our model achieves best results in 4 tasks.
In these tasks, our results are 3.82%, 2.41%, 3.28% and 3.77% higher than the second best results.
In the D → W and W → D tasks, the performance of our approach are only 0.12% and 0.32% less than the best results.
4. ABLATION STUDIES
We further investigate the performance of our approach from several aspects.
First, we evaluate the contribution of each component in the loss function.
Second, we evaluate the sensitivity of the model to the change of the hyper-parameters.
Third, we evaluate the performance of our method on the standard unsupervised domain adaptation problem.
We have also evaluated: (1) the effect of the number of the iteration in the inner maximization of PAT; and (2) the integration of PAT and other domain adaptation methods including CDAN, CDANE and Sentry, and reported the results in the Appendix due to space limit.
[Table] [Table]
The proposed pairwise adversarial training approach includes two major components, i
[Table]
e., interpolated adversarial samples (IAS) and centroid alignment (CA).
We choose three tasks from each of the three datasets separately.
Table 5 shows the performance of our backbone model MDD, Ours w/o IAS, Ours w/o CA, and our full model on the imbalanced Ofﬁce-Home dataset.
Detailed results on the other two datasets are provided in the Appendix.
Ours w/o IAS and Ours w/o CA consistently achieve better performance than the baseline model MDD, which validates the effectiveness of both methods in dealing with the biased label distribution shift.
Our full model further improves the classiﬁcation accuracy, demonstrating the complementary roles of pairwise adversarial samples and centroid alignment in our approach.
[Figure]
Furthermore, we evaluate the sensitivity of our model to the change of two hyperparameters α and β .
In particular, we ﬁrst set β to 0.05 and choose α from [0 , 2 . 5] .
Then, α is set to 0.5, and β is chosen from [0 , 0 . 25] .
Figure 6 shows the per-class average accuracy of our model when varying the hyper-parameter values.
It shows that our model is not very sensitive to the settings of hyper-parameters in a relatively wide range.
Finally, we evaluate our method in the standard UDA setting, by comparing the results against the baseline MDD (Zhang et al., 2019) on the standard Ofﬁce-Home dataset.
The results from
Table 6 shows that the classiﬁcation accuracy in all the four tasks are improved after incorporating our interpolation method, which proves the effectiveness of our method in unsupervised domain adaptation problem.
C ONCLUSION
In this paper, we propose a pairwise adversarial training approach to tackle the class-imbalanced unsupervised domain adaptation (CDA) problem.
Our approach generates interpolated adversarial samples across source and target domains.
In order to alleviate the biased label distribution shift issue, we use the interpolated adversarial samples to augment the training data (especially the minority classes) and meanwhile adopt the centroid alignment strategy to explicitly align source and target domains.
Experimental results on three CDA benchmark datasets show that, our approach yields competing performance compared with state-of-art CDA methods.
A A PPENDIX
We evaluate the effect of the number of iterations of the inner maximization in pairwise adversarial training.
We choose Rw → Pr from Ofﬁce-Home, R → C from DomainNet and A → W from Ofﬁceas our evaluation tasks.
The results are illustrated in Figure 7.
It shows that the performance of our approach will generally increase with more iterations.
At some points the performance experiences the slight ﬂuctuation.
Though performance reaches the maximum value at iteration of 12, it is relatively time-consuming in the training process.
Table 7 and Table 8 show the per-class average accuracy of MDD, Ours w/o IAS, Ours w/o CA, and our full model on three tasks from the DomainNet dataset and Ofﬁce-31 dataset, respectively.
The results demonstrate the effectiveness of two major components (i
[Table]
e., interpolated adversarial samples and centroid alignment) in our approach.
[Table] [Table]
[Table] [Table] [Table] Furthermore, as our PAT method is an independent module, which could be combined with other domain alignment techniques such as CDAN and Sentry.
We integrate PAT with CDAN and CDANE, and report the experimental results on the RS-UT Ofﬁce-Home dataset in Table 9. Results show that our PAT module could signiﬁcantly improve the performance: 54.07% → 60.38% for CDAN, and 55.70% → 62.61% for CDANE. The results in Table 10 further validate that our PAT method could boost the performance of the state-of-the-art CDA method Sentry.
[Table] [Table]