Efficient and Effective Augmentation Strategy for Adversarial Training
Abstract
Adversarial training of Deep Neural Networks is known to be significantly more data-hungry when compared to standard training.
Furthermore, complex data augmentations such as AutoAugment, which have led to substantial gains in standard training of image classifiers, have not been successful with Adversarial Training.
We first explain this contrasting behavior by viewing augmentation during training as a problem of domain generalization, and further propose Diverse Augmentationbased Joint Adversarial Training (DAJAT) to use data augmentations effectively in adversarial training.
We aim to handle the conflicting goals of enhancing the diversity of the training dataset and training with data that is close to the test distribution by using a combination of simple and complex augmentations with separate batch normalization layers during training.
We further utilize the popular JensenShannon divergence loss to encourage the joint learning of the diverse augmentations , thereby allowing simple augmentations to guide the learning of complex ones.
Lastly, to improve the computational efficiency of the proposed method, we propose and utilize a two-step defense, Ascending Constraint Adversarial Training (ACAT), that uses an increasing epsilon schedule and weight-space smoothing to prevent gradient masking.
The proposed method DAJAT achieves substantially better robustness-accuracy trade-off when compared to existing methods on the
RobustBench Leaderboard on ResNet-18 and WideResNet-34-10.
The code for implementing DAJAT is available here: https://github.com/val-iisc/DAJAT .
Introduction
Deep Neural Network (DNN) based image classifiers are vulnerable to crafted imperceptible perturbations known as Adversarial Attacks [45] that can flip the predictions of the model to unrelated classes leading to disastrous implications.
Adversarial Training [17, 31, 57] has been the most successful defense strategy, where a model is explicitly trained to be robust in the presence of such attacks.
While early defenses focused on designing suitable loss functions for training, subsequent works [33, 38] showed that with careful hyperparameter tuning, even the two most popular methods PGD-AT [31] and TRADES [57] yield comparable performance, highlighting the saturation in performance with respect to changes in the training loss.
Schmidt et al.
[39] observed that adversarial training has a large sample complexity and further gains require the use of additional training data.
Subsequent works [7, 19] indeed used additional data whose distribution is close to that of the original dataset in order to obtain performance gains.
The availability of large amounts of relevant data is impractical to assume, leading to an exploration towards augmentations based on Generative Adversarial Networks [16] and Diffusion based models [23, 19].
However, the use of such generative models incurs an ∗ Equal Contribution.
[Figure]
additional training cost and suffers from limited diversity in low-data regimes and in datasets with high-resolution images
A simple and efficient solution to improve the diversity of training data in standard Empirical Risk
Minimization (ERM) based training has been the use of random transformations such as rotation, color jitter, and variations in contrast, sharpness and brightness [28, 10, 11], which can change images significantly in input space while belonging to the same class as the original image.
However, prior works have surprisingly found that such augmentations, that cause large changes in the input distribution, do not help adversarial training [38, 18, 44].
This limits the augmentations in adversarial training to simple ones - zero padding followed by random crop, and horizontal flip [38, 33, 18] - which may not be able to fill in the large data requirement of Adversarial Training.
In this work, we firstly analyze the reasons for this contrasting trend between Standard and Adversarial
Training, and further show that it is indeed possible to utilize complex augmentations effectively in Adversarial training as well , by jointly training on simple and complex data augmentations using separate batch-normalization layers for each type, as shown in Fig.1.
While complex augmentations increase the data diversity resulting in better generalization, simple augmentations ensure that the model specializes on the training data distribution as well.
We further minimize the Jenson-Shannon divergence between the softmax outputs of various augmentations to enable the simple augmentations to guide the learning of complex ones.
In order to improve the computational efficiency of the proposed method, we use two attack steps (instead of 10) during training.
By progressively increasing the magnitude of perturbations and performing smoothing in weight space, we show that it is indeed possible to improve the stability of training.
Our contributions are listed below:
• We analyze the reasons for the failure of strong data augmentations in adversarial training by viewing augmentation during training as a domain generalization problem, and further propose Diverse Augmentation based Joint Adversarial Training (DAJAT) to utilize data augmentations effectively in Adversarial training.
The proposed approach can be integrated with many augmentations and adversarial training methods to obtain performance gains.
• We propose and integrate DAJAT with an efficient 2-step defense strategy, Ascending Constraint Adversarial Training (ACAT) that uses linearly increasing ε schedule, cosine learning rate and weight-space smoothing to prevent gradient masking and improve convergence.
• We obtain improved robustness and large gains in standard accuracy on multiple datasets (CIFAR-10, CIFAR-100, ImageNette) and model architectures (RN-18, WRN-34-10).
We obtain remarkable gains in a low data scenario (CIFAR-100, Imagenette) where data augmentations are most effective.
On CIFAR-100, we outperform all existing methods on the RobustBench leaderboard [9] with the same model architecture.
Related Works
We discuss various existing strategies for improving the Adversarial robustness of Deep Networks.
Adversarial Training (AT): Goodfellow et al.
[17] proposed FGSM-AT where single-step adversarial samples were used for training.
However, these models were susceptible to gradient masking [34], where the local loss landscape becomes convoluted leading to the generation of weaker single-step attacks during training.
This leads to a false sense of security against single-step attacks, while the models are still susceptible to stronger multi-step attacks such as PGD [31].
PGD-AT [31, 38] used multi-step attacks in a similar adversarial training formulation to obtain robust models that stood the test of time against several attacks [3, 8, 42].
TRADES [57] explicitly optimizes the trade-off between the accuracy on natural and adversarial examples by minimizing the cross-entropy loss on natural images along with the Kullback-Leibler (KL) divergence between the predictions of adversarial and clean images.
In the proposed defense, we use the base loss from TRADES-AT [57].
Several works have explored the use of auxiliary techniques in AT such as weight-space smoothing [26, 50], architectural changes [18, 53] and increasing the diversity of training data by using additional natural and synthetic data [39, 7, 18, 37].
Increasing the diversity of training data achieves significant performance gains since the sample complexity of adversarial training is known to be high [39].
Augmentations in Adversarial Training: While data augmentations such as contrast, sharpness and brightness adjustments are known to improve performance in the standard training regime, they have not led to substantial gains in adversarial training.
AutoAugment [10] uses Proximal Policy
Optimization to find the set of policies that can yield optimal performance on a given dataset.
Contrary to prior works [38, 18], we show that the policies that are optimized for standard training indeed yield a boost in performance of adversarial training as well, when used in the proposed training framework.
In a recent work, Rebuffi et al.
[37] show that it is possible to obtain substantial gains in robust accuracy by using spatial composition based augmentations such as CutMix [54] and CutOut [13] that preserve low-level features of the image.
Cutmix replaces part of an image with another and also combines the output softmax vectors in the same ratio, while CutOut blanks out a random area of an image.
The authors hypothesize that the augmentations used in Adversarial training need to preserve low-level features, which severely limits the possibilities for mitigating the large sample complexity in adversarial training.
We show that by using the proposed approach DAJAT, it is indeed possible to use augmentations such as color jitter, contrast, sharpness and brightness adjustments that significantly change the low level statistics of images (Ref: Appendix-B).
Preliminaries: Notation and Threat Model
We consider the Adversarial Robustness of DNN based image classifiers.
An input image is denoted as x ∈ X and the corresponding ground truth label as y ∈ [0 , 1] .
We denote a simple transformation of x obtained using Pad, Crop and Horizontal flip (Pad+Crop+HFlip, referred to as Base augmentations) by x base and other transformations of x by the respective subscript.
For example, x auto refers to the image x being transformed by AutoAugment (AA) [10] followed by the base augmentations.
The function mapping of the classifier C from input space X to the softmax vectors is denoted using f θ ( . ) , where θ denotes the network parameters.
Adversarial examples corresponding to the images x , x base and x auto are denoted using ˜ x , ˜ x base and ˜ x auto respectively.
We consider the ℓ ∞ norm based threat model, where ˜ x is a valid perturbation within ε if it belongs to the set
A ε ( x ) = { ˜ x : || ˜ x − x || ∞ ≤ ε } .
Motivation: Role of Augmentations in Neural Network Training
In this section, we first explore the contrasting factors that influence the training of neural networks when data is augmented (Sec.4.1), and further delve into the specifics of adversarial training which make it challenging to obtain gains using complex data augmentations (Sec.4.2).
4.1 Impact of Augmentations in Neural Network Training
Conjecture-1:
We hypothesize that the role of data augmentations in the training of Neural Networks is influenced by the following contrasting factors:
(i)
Reduced overfitting due to an increase in diversity of the augmented dataset, leading to better generalization of the network to the test set.
(ii) Larger domain shift between the augmented data distribution and the test data distribution, leading to a drop in performance on the test set.
(iii) Capacity of the Neural Network in being able to generalize well to the augmented data distribution and the unaugmented data distribution for the given task
Justification: The training of Neural Networks using augmented data can be considered as a problem of domain generalization, where the network is trained on a source domain (augmented data) and is
[Table]
expected to generalize to a target domain (test data).
We use the theoretical formulation by Ben-David et al.
[4] shown below to justify the respective claims in Conjecture-1:
[Equation]
(i)
The use of a more diverse or larger source dataset reduces overfitting, improving the performance of the network on the source distribution.
From Eq.1, expected error on the target distribution ϵ t (test set in this case) is upper bounded by the expected error on the source distribution ϵ s (augmented dataset) along with other terms.
Therefore, improved performance on the augmented distribution can improve the performance on the test set as well.
(ii)
The expected error on the target distribution ϵ t is upper bounded by the distribution shift between the source and target distributions 12 d F ∆ F ( s, t ) along with other terms.
Therefore, a larger domain shift between the augmented and test data distributions can indeed limit the performance gains on the test set.
(iii)
The constant λ in Eq.1 measures the risk of the optimal joint classifier: λ = min f ∈F ϵ s ( f ) + ϵ t ( f ) .
Neural Networks
with a higher capacity can minimize the expected risk on the source set ϵ
s
and the risk of the optimal joint classifier effectively.
Therefore, capacity of the Neural Network and
complexity
of the
task
influence the gains that can be obtained using
augmentations
4.2 Analysing the role of Augmentations in Adversarial Training
We analyse the trade-off between the factors described in Conjecture-1 for adversarial training when compared to standard ERM training.
In addition to the goal of improving accuracy on clean samples, adversarial training aims to achieve local smoothness of the loss landscape as well.
Hence, the complexity of Adversarial Training is higher than that of standard ERM training, making it important to use larger model capacities to obtain gains using data augmentations (based on Conjecture-1 (iii)).
This justifies the gains obtained by Rebuffi et al.
[37] on the WRN-70-16 architecture by using
CutMix based augmentations (2.9% higher robust accuracy and 1.23% higher clean accuracy).
The same method does not obtain significant gains on smaller architectures such as ResNet-18 where a 1.76% boost in robust accuracy is accompanied by a 2.55% drop in clean accuracy.
Secondly, while the distribution shift between augmented data and test data ( 12 d F ∆ F ( s, t ) ) may be sufficiently low for natural images leading to improved generalization to test set (Conjecture-1(i,ii)), the same may not be true for adversarial images.
There is a large difference between the augmented data and test data in pixel space, although they may be similar in feature space.
Since adversarial attacks perturb images in pixel space, the distribution shift between the corresponding perturbations widens further as shown in Fig.7, 8 and 9.
Based on Conjecture-1(ii), unless this difference is accounted for, complex augmentations cannot improve the performance of adversarial training.
(Ref.
Appendix-B).
This trend has also been observed empirically by Rebuffi et al.
[37], based on which they conclude that the augmentations designed for robustness need to preserve low-level features.
We present the performance of Adversarial Training by using either Base augmentations (Pad+Crop,
Flip) or AutoAugment [10] during training and inference on the CIFAR-10 dataset using ResNetand WideResNet-34-10 architectures in Table-1.
Firstly, we note that by using AutoAugment during training alone, robust accuracy on the test set drops by ∼ 1 .
5 − 2% which is as observed in prior work [18].
Secondly, the clean and robust accuracy drop by ∼ 6 .
5% when augmented images are used for both training and testing, highlighting the complexity of the learning task.
We present additional results by training without any augmentations, and by training using a combination of both augmentations in every minibatch in Table-15.
We note that the use of Base Augmentations alone (Pad+Crop+HFlip) still gives the best overall performance on the unaugmented test set.
Proposed Method 5.1 Background
We briefly discuss the TRADES-AWP defense [57, 50], which is the base algorithm used in DAJAT.
[Equation]
Firstly, an adversarial attack is generated by maximizing the KL divergence between the softmax predictions of the clean and adversarial examples iteratively for 10 attack steps.
An Adversarial
Weight Perturbation (AWP) step additionally perturbs the weights of the model to maximize the overall loss in weight-space.
The weight perturbations are constrained in the feasible region M ( θ ) such that for a given layer l ,
||
ˆ θ l || ≤ γ · ||
θ l || .
The overall training loss is a combination of Crossentropy loss on clean samples and the KL divergence term.
The latter is weighted by a factor β that controls the robustness-accuracy trade-off.
Training the model using Adversarial Weight Perturbations leads to smoothing of loss surface in the weight space, resulting in better generalization [50, 44].
5.2 Diverse Augmentation based Joint Adversarial Training (DAJAT)
As discussed in Section-4, the use of augmentations in training can be viewed as a problem of domain generalization, where performance on the source distribution or augmented dataset is crucial towards improving the performance on the target distribution or test set.
Since adversarial training is inherently challenging, for limited model capacity, it is difficult to obtain good performance on the training data that is transformed using complex augmentations.
Moreover, the large distribution shift between augmented data and test data, specifically with respect to low-level statistics, results in poor generalization of robust accuracy to the test set.
To mitigate these challenges, we propose the combined use of simple and complex augmentations during training, so that the model can benefit from the diversity introduced by complex augmentations, while also specializing on the original data distribution that is similar to the simple augmentations.
We propose to use separate batch normalization layers for simple and complex augmentations, so as to offset the shift in distribution between the two kinds of augmentations.
In our main approach, we propose to use Pad and Crop followed by Horizontal Flip (Pad+Crop+HFlip) as the Simple augmentations, and Autoaugment followed by Pad+Crop+HFlip as the complex augmentations.
We justify the choice of this augmentation pipeline in Appendix-B.3.
Motivated by AugMix [22], we additionally minimize the Jenson-Shannon (JS) divergence between the softmax outputs of different augmentations, so as to allow the simple augmentations to guide the learning of complex ones.
We present the training loss L DAJAT of the proposed method, Diverse
Augmentation based Joint Adversarial Training (DAJAT) below in Eq.5:
[Equation]
[Equation] [Equation]
Adversarial attacks are generated individually for each augmentation by maximizing the respective
KL divergence term of the TRADES loss shown in Eq.3.
To improve training efficiency, we compute ˜ x using two attack steps with a step-size of ε .
We use a combination of a linearly increasing schedule of ε , cosine learning rate schedule and model weight-averaging [26] to improve the stability and performance of adversarial training (Details in Sec.5.4).
The DAJAT loss (Eq.5) is a combination of the TRADES 2-step loss on each of the augmentations x base and x auto(t) , along with an adversarial weight perturbation step on the loss corresponding to the base augmentations alone to reduce computational cost.
For every batch normalization layer, two sets of running statistics and affine parameters are maintained and used for simple and complex augmentations respectively (Ref: Algorithm-1).
While we use AutoAugment in our main approach, we show in Table-6 that the proposed approach works well with other augmentations as well.
The role of the base (primary) augmentations is primarily to learn the batch normalization layers that would be used during inference time, and to provide better supervision for the training of complex augmentations using the JS divergence term.
The role of the complex (secondary) augmentations is to enhance the diversity of the training dataset.
Therefore we use a single primary augmentation and multiple instances of the secondary augmentation.
We find that the gains in performance saturate with the addition of more instances of secondary augmentation, and therefore recommend the use of a single base augmentation and two instances of secondary augmentation for the best performance-accuracy trade-off.
We note from
Table-2 and Appendix-F.6 that in this setting, the computational efficiency of the proposed method is better than the TRADES-AWP [57, 50] defense, while achieving considerable performance gains.
5.3 Split Batch Normalization Layers for Different Augmentations
A Batch Normalization (BN) layer [25] is implemented as follows on a given feature map g ( x i ) of an input image x
i : ˆ g ( x i ) =
g ( x i ) − µ σ · γ + β .
Here, µ and σ denote the mean and standard deviation of the current mini-batch during training.
During inference, these are set to the running mean and variance computed during training.
γ and β constitute parameters of the network that are trained.
Prior works use separate batch normalization layers to improve the performance of standard [52, 49, 32] and adversarial training [51, 48], in both supervised [52, 49, 32, 51, 48] and self-supervised settings [27, 15].
The proposed defense DAJAT uses separate batch normalization layers for simple and complex augmentations as discussed in the previous section.
We do not use separate batch normalization for clean and adversarial images here.
In DAJAT, we maintain two sets of BN statistics µ and σ , and two sets of affine parameters, β and γ for every BN layer.
We plot the cosine similarity between the BN layers corresponding to Base augmentations and AutoAugment across different layers on a WideResNet-34-10 model trained using
DAJAT on CIFAR-10 in Fig.2.
While the mean and variance are relatively more similar across most of the layers (0-30 in x-axis), we note significant differences in the γ and β values, specifically in the initial layers.
We present a detailed study on the importance of having separate running statistics and affine parameters in Appendix-C, and conclude that our method works effectively by separating either the running statistics or affine parameters alone as well.
However, it works best by using a combination of both (Table-11).
We further note that very small differences in running statistics (as seen in Fig.2 and 11) can also result in noteworthy performance gains.
Finally, we find that the use of a single batch-norm layer for both augmentations degrades results significantly.
Therefore, the use of different parameters for each augmentation type ensures that the function mapping differs for each augmentation, thereby effectively offsetting the large differences in low level statistics.
5.4 Ascending Constraint Adversarial Training (ACAT)
In this section, we discuss the methods incorporated to improve the training efficiency of DAJAT in greater detail.
We apply these methods to the TRADES-AWP defense to independently analyse their impact, and term the proposed defense as Ascending Constraint Adversarial Training (ACAT).
We aim to improve the training efficiency by reducing the number of attack steps of the base defense from 10 to 2.
We use two attack steps for training since it is known to be more stable when compared to single-step adversarial training, while still being computationally efficient [43].
As shown in Fig.3, naively reducing the number of attack steps to 2 in TRADES-AWP AT (Fixed constraint AT) causes a drop in clean and robust accuracy.
While the drop is larger at higher training ε , a drop in clean accuracy is seen at ε = 8 / 255 as well.
Further, the large robustness gap between last and best epochs indicates that the training stability deteriorates towards the end of training.
The instability of TRADES-AWP AT at ε = 8 / 255 is higher for larger model capacities (WideResNet-34-10) as discussed in Appendix-E.1.
[Figure]
Curriculum learning approaches [41, 6] have been used to improve robustness-accuracy trade-off in adversarial training.
Prior works [40, 1] also show that training convergence at large ε bounds can be improved by linearly increasing ε as training progresses.
Inspired by this, we propose to linearly increase ε alongside a cosine learning rate schedule and weight-space smoothing for improving the stability and convergence of training (Ref: Algorithm-2).
The use of a lower learning rate at larger ε improves training stability.
As shown in Fig.3 and Table-13, the performance and stability of the
ACAT are significantly better when compared to the TRADES-AWP 2-step baseline, specifically at larger perturbation bounds and higher model capacities, at the same computational cost.
The proposed defense maintains a good clean accuracy at all the training ε values considered, and has < 0 .
1% robustness difference between last and best epochs.
We thus show that even without modifying the training loss function it is possible to obtain significant gains in the stability and performance of 2-step adversarial training by using the proposed Ascending
Constraint Adversarial Training.
The proposed method can indeed improve the performance of other defenses such as GAT [42] and NuAT [43] as well, as shown in Table-14.
Analysis of the proposed ACAT defense:
Conjecture-2: We hypothesize that given a Neural Network f θ ε that minimizes the TRADES loss [57] within a maximum perturbation radius of ε , and has sufficient smoothness in weight space within an ℓ 2 radius ψ around θ ε , there exist ε ′ >
ε and a model f θ ε ′
where || θ ε ′ − θ ε || ≤ ψ , such that f θ ε ′ has a lower TRADES loss within ε ′ when compared to f θ ε .
Justification presented in Section-E.3.
Based on Conjecture-2, by selecting a small enough learning rate η and large enough ψ , it is possible to move towards a better solution w.r.t.
the TRADES loss at ε ′ .
The smoothness of loss surface further ensures that the gradients at ε ′ are bounded with a low magnitude, preventing the onset of catastrophic overfitting, which is known to be associated with large magnitude gradients [30].
This motivates the proposed approach ACAT that effectively combines an increasing ε schedule, cosine learning rate schedule that allows low learning rates at larger ε values, and adversarial weight perturbation to ensure smoothness in the loss surface.
Stability improvements obtained using ACAT:
We consider an extreme case of using single-step attacks for training, to demonstrate the stability improvements obtained using ACAT.
We consider a checkpoint obtained at ε = 7 .
25 / 255 while training using the proposed ACAT defense on CIFARdataset for a WideResNet-34-10 architecture.
We use this model as an initialization and perform single-step adversarial training using the TRADES-AWP training objective at ε = 7 . 5 / 255 .
Our goal here is to merely verify the stability of single-step training, although the use of single-step attack makes the robustness gains marginal.
We present the clean accuracy and robust accuracy against
PGD-20 attack using different values of Adversarial Weight Perturbation step size γ in Fig.4(a).
It is evident from the plots that for a fixed value of learning rate, increasing γ can delay the onset of gradient masking, thereby improving the training stability.
We also note marginal improvements in performance at higher γ , due to the enhanced generalization.
Therefore, weight-space smoothing indeed helps in improving the performance and stability of the proposed defense.
We also note from
Fig.4(b)
that for a fixed value of γ = 0 .
01 , lower learning rate leads to better stability, therefore cosine schedule also helps in improving stability.
We note that the value of gamma in relation to the learning rate is crucial.
Therefore, in the proposed approach, we use a fixed value of γ and reduce the learning rate using a cosine learning rate schedule to improve training stability as ε increases.
[Table]
and AutoAttack [8].
[Table]
Experiments and Results 6.1 State-of-the-art comparison
We compare the performance of the proposed defenses ACAT and DAJAT against the 2-step and 10-step state-of-the-art defenses NuAT2-WA [42], TRADES-AWP [57, 50] and PGD-AT [31, 38] in
Tables- 2, 3 and 4 on the CIFAR-10, CIFAR-100 [29] and ImageNette [24, 12] datasets.
Although there have been several defenses after this, we show in Table-22 that TRADES-AWP outperforms them in most settings
[Table]
and the proposed defense DAJAT consistently outperforms all methods, showing substantial gains in performance.
Further, since we integrate the proposed approach with
TRADES-AWP, we primarily compare our approach with this across all datasets.
We show in Table23 that DAJAT can be integrated with other base defenses [1, 36] as well to obtain performance gains.
We integrate model weight averaging with the TRADES-AWP defense (termed as TRADES-AWPWA) as well for a fair comparison.
We train all models for 110 epochs unless specified otherwise.
ACAT:
We compare the performance of the proposed 2-step defense ACAT with the existing state-of-the-art 2-step defense NuAT2-WA [43] in the first partition of Table-2.
While we achieve similar performance on ResNet-18, we obtain improvements in both clean and robust accuracy on
WideResNet-34-10.
We show in Section-E.4 that our proposed defense ACAT can be integrated with the Nuclear Norm training objective as well to obtain improved results.
The performance of the proposed ACAT defense is superior to PGD-AT (10-step) defense [38] as well.
When compared to the TRADES-AWP (10-step) defense, ACAT achieves substantial gains in clean accuracy and improved robust accuracy on CIFAR-100 (Table-3), and improved clean accuracy at a slight drop in robust accuracy on CIFAR-10 (Table-2), at half the computational cost.
DAJAT:
We present three variants of the proposed defense DAJAT, by using one, two and three
AutoAugment based augmentations for every image, denoted as (Base, AA), (Base, 2*AA) and (Base, 3*AA) respectively.
From Tables-2 and 3, we note that even by using only a single augmentation (Base, AA), we obtain improved clean and robust accuracy when compared to most of the baselines considered across all datasets and models.
By increasing the number of augmentations to 2 (Base, 2*AA), we observe consistent gains in robust and clean accuracy in all cases.
In this setting, the computational complexity of the proposed approach matches with that of TRADES-AWP [50] as shown in Table-2.
With the setting (Base, 3*AA), we further obtain marginal improvements in performance over (Base, 2*AA).
Overall, using the (Base, 2*AA) approach, which has comparable time complexity as the TRADES-AWP 10-step defense, we obtain large gains ranging from 3.8% to 7% on clean accuracy and ∼ 1 . 8% in robust accuracy against AutoAttack [8] across most settings.
On the Imagenette dataset we obtain 4.2% higher clean accuracy and 4.49% higher robust accuracy, showing that augmentation strategies work best when the amount of training data is less when
[Table]
compared to the complexity of the task.
observe a similar trend using smaller subsets of training data on CIFAR-10 in Fig.
Scaling
to higher attack
steps
, longer training and larger models: While the use of 2 attack steps helps in improving the training efficiency of DAJAT, we show that by using more attack steps and longer training epochs, we can indeed obtain further gains in performance.
The varying ε schedule in DAJAT allows the use of an increasing schedule in the number of steps as well, thereby limiting the overall cost associated with higher attack steps.
We present results by increasing the number of attack steps from 2 to 5 uniformly every 50 epochs in Table-4.
We obtain ∼ 3 .
5% and 6 − 9% higher clean accuracy, along with 1 − 1 .
6% and 1 .
7 − 3 .
2% gains in robust accuracy against AutoAttack on CIFAR-10 and CIFAR-100 respectively when compared to the TRADES-AWP-WA 200 epoch baseline.
This achieves better robustness-accuracy trade-off when compared to all existing defenses that use the same model architecture on the RobustBench leaderboard [9].
On the CIFARRobustBench leaderboard, we outperform all existing methods using the same model architecture, w.r.t.
both clean and robust accuracy, including the ones that use additional data, showing that data augmentations can be effectively used to overcome the large sample complexity of adversarial training.
The use of diverse augmentations in DAJAT also improves the generalization of the model to Common Corruptions by 4% and 8% on CIFAR-10-C and CIFAR-100-C datasets [21] respectively as shown in Table-4.
Further, we find that the performance gains obtained using DAJAT are higher on larger capacity models (Ref:Table-16).
Computational Efficiency: As shown in Appendix-F.6, the use of ACAT strategy in the proposed
DAJAT defense enables us to achieve similar computational complexity as TRADES-AWP defense, while obtaining gains in performance.
Using DAJAT, we achieve 10% reduction in FLOPs (training) and training time, while obtaining 3.8-5.5% higher clean accuracy and 1-1.6% higher robust accuracy.
6.2 Ablation experiments
We present ablation experiments to highlight the significance of different components of the proposed approach in Table-5 on the CIFAR-10 dataset using ResNet-18 architecture.
All experiments are run for 110 training epochs, except A7 which is run for 220 epochs.
We show the importance of the JS divergence term in the proposed loss in the ablations A1-A6 of Table-5.
Using the JS divergence term we obtain ∼ 1% higher clean accuracy across (Base, AA), (Base, 2*AA) and (Base, 3*AA) settings of the proposed defense.
For (Base, 2*AA) and (Base, 3*AA) we obtain marginal improvements in robust accuracy as well.
From A7, A9 and A10, we find that the proposed JS divergence term helps even in the case where both augmentations of an image are generated using the same pipeline.
Using two AutoAugment based transformations, we obtain 1.6% higher clean accuracy when compared to the 220 epoch 2-step defense at a comparable computational cost.
Comparing A9, A10 and A11, we note that the use of simple and complex augmentations indeed shows improvements over the case of using 2 complex or simple augmentations alone.
The importance of split-batch norm in the proposed approach can be evidently seen by comparing A12 and A14.
By using single batch norm (A12), robust accuracy drops by 8.24%.
Further, in this case if the JS term is also dropped, the robustness of the network is almost completely lost.
This shows that using a single batch norm layer for diverse augmentations makes it harder for the network to converge.
We also note that the JS divergence term indeed helps in improving the convergence of training in addition to improving performance.
From
Appendix-F.4, we note that the use of varying ε schedule in DAJAT improves the stability of training resulting in large performance gains w.r.t.
the use of fixed ε , specifically at larger model capacities.
[Table] [Table]
6.3 Combining the proposed defense with other augmentations
We explore combining the proposed defense DAJAT with other augmentations in Table-
[Table]
and the impact of individual augmentations in AutoAugment in Table-10.
We do not use the JS divergence term for Cutmix and Mixup since they involve changes in the label space.
Without using any augmentation in the training dataset
[Table]
we obtain poor clean and robust accuracy, highlighting the importance of the simple augmentations.
The proposed approach is able to obtain good performance gains using AutoAugment [10], Color Jitter and CutOut [13] augmentations, highlighting that it can work well with pixel-level and spatial augmentations.
In case of CutMix [54] and Mixup [56], since the base accuracy obtained by using the augmentation alone is itself very poor, combining them with the proposed approach does not yield competent results.
However they are considerably better than naively using the augmentation.
This shows that the proposed approach enables the use of a variety of augmentations without the need for careful selection.
The use of Cutmix and Mixup in adversarial training are challenging since they involve changes in label space.
We note that Rebuffi et al.
[37] obtain considerable gains using Cutmix along with many other improvements.
However, naively augmenting using CutMix leads to a considerably degraded performance.
By incorporating some of the tricks reproduced by Rade et al.
[35] we obtain improvements in the CutMix baseline and obtain further gains in the proposed method as well (Ref: Appendix-F.7, Table-21).
Conclusion
Contrary to prior knowledge, we show that it is indeed possible to use common augmentation strategies that modify the low-level statistics of images to improve the performance of adversarial training.
We propose a novel defense Diverse Augmentation based Joint Adversarial Training (DAJAT), that uses a combination of simple and complex augmentations with separate batch normalization layers to allow the network training to benefit from the diverse training data distribution obtained using complex augmentations, while also specializing on a distribution that is close to the test set.
The use of JS divergence term between network predictions of different augmentations enables the joint learning across various augmentations.
We improve the efficiency of the proposed defense by utilizing the proposed approach Ascending Constraint Adversarial Training (ACAT), that improves the stability and performance of TRADES 2-step adversarial training significantly by using a linearly increasing ε schedule along with a cosine learning rate schedule and weight-space smoothing.
Limitations: While we focus our work on how to use augmentations effectively in adversarial training, we do not focus on which augmentations are best suited for the same.
We believe this work can open up further possibilities towards finding better data augmentations for adversarial training.
Acknowledgments and Disclosure of Funding
This work was supported by a research grant (CRG/2021/005925) from SERB, DST, Govt.
of India.
Sravanti Addepalli is supported by a Google PhD Fellowship in Machine Learning.
Checklist
For all authors... (a) Do the main claims made in the abstract and introduction accurately reflect the paper’s contribu- tions and scope?
[Yes] (b) Did you describe the limitations of your work?
[Yes] Section- (c) Did you discuss any potential negative societal impacts of your work?
[N/A]
There are no known negative societal impacts of our work.
(d) Have you read the ethics review guidelines and ensured that your paper conforms to them?
[Yes] 2.
If you are including theoretical results... (a) Did you state the full set of assumptions of all theoretical results?
[N/A] (b) Did you include complete proofs of all theoretical results?
[N/A] 3.
If you ran experiments...
(a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?
[Yes] https://github.com/val-iisc/ DAJAT .
(b) Did you specify all the training details (e.g., data splits, hyperparameters, how they were chosen)?
[Yes] Appendix-F.2 and ReadMe file at https://github.com/val-iisc/DAJAT (c) Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?
[Yes] Table
(d) Did you include the total amount of compute and the type of resources used (e.g., type of GPUs, internal cluster, or cloud provider)?
[Yes] Details on compute: Table-19, Details on resources: Appendix-
F. 4.
If you are using existing assets (e.g., code, data, models) or curating/releasing new assets... (a) If your work uses existing assets, did you cite the creators?
[Yes] Appendix- F. (b) Did you mention the license of the assets?
[Yes] Appendix- F. (c) Did you include any new assets either in the supplemental material or as a URL?
[Yes] We share the code for the proposed approach.
(d) Did you discuss whether and how consent was obtained from people whose data you’re us- ing/curating?
[N/A] We use only publicly released and open-sourced datasets and codes.
(e) Did you discuss whether the data you are using/curating contains personally identifiable informa- tion or offensive content?
[Yes] Appendix-F. 5.
If you used crowdsourcing or conducted research with human subjects... (a) Did you include the full text of instructions given to participants and screenshots, if applicable?
[N/A] (b) Did you describe any potential participant risks, with links to Institutional Review Board (IRB) approvals, if applicable?
[N/A] (c) Did you include the estimated hourly wage paid to participants and the total amount spent on participant compensation?
[N/A]
A Details on the proposed defense DAJAT
The algorithm of the proposed approach is presented in Algorithm-1.
In every training iteration, multiple augmentations are considered for every image x i (L7).
We consider one base augmentation and T complex augmentations.
The base augmentation consists of Pad and Crop followed by Horizontal Flip, while the complex augmentations are a combination of AutoAugment [10] and the base augmentations.
The attack generation for each augmentation (L8-L13) is similar to the ACAT algorithm discussed in Section-E.2.
The DAJAT loss (L16) is a combination of the TRADES loss [57] (L17) on each augmentation, and a Jensen-Shannon (JS) divergence term between all augmentations.
The JS divergence is a combination of KL divergence terms with respect to the average probability vector as shown below.
[Equation]
where M is defined as below,
[Equation]
As shown in Table-5, the JS-divergence term improves accuracy on clean samples and training convergence by enabling the joint learning of representations across different augmentations.
The model weights are perturbed by ˜ θ , by maximizing the TRADES loss on the base augmentations alone within the constraint set M ( θ ) (L18).
This constraint set is chosen such that ||
˜ θ l || ≤ γ · ||
θ
l
|| for any layer l .
The network at θ is then updated using gradients at f θ +˜ θ to minimize the overall loss L DAJAT ( θ + ˜ θ ) (L20).
B Augmentations
While existing works hypothesize that augmentations changing the low-level statistics of images cannot effec- tively improve adversarial training [37], we show in this work that with the use of split Batch-normalization layers and JS divergence term between different augmentations, it is indeed possible to obtain significant gains using augmentations that modify the low-level statistics of images as well.
In this work, we use an existing augmentation strategy, AutoAugment to obtain an improvement in performance using the proposed training algorithm DAJAT.
AutoAugment uses Proximal Policy Optimization to find the set of policies that can yield optimal performance on a given dataset.
It consists of 25 unique sub-policies for a given dataset, where each sub-policy is a combination of two augmentations chosen from a set of pre-defined augmentations in series.
The pre-defined augmentations include the spatial transformations - shear, rotation and translation, and augmentations that cause changes in low-level statistics of images - color, posterize, solarize, brightness, contrast, sharpness, autocontrast, equalize and invert.
We visualize some of the augmentations generated using AutoAugment and Base augmentations (Pad+Crop, Horizontal Flip) in Fig.5 and Fig.6 respectively.
It can be noted that multiple augmentations generated using
AutoAugment are significantly more diverse than the augmentations generated using the base augmentations.
The use of multiple diverse augmentations leads to improved generalization on test set as discussed in Sec.4.
Further we visualize the perturbations generated using the 2-step attack with KL-divergence loss on CIFAR-10 images without augmentations, with Base augmentations and with AutoAugment on Trades-AWP [50] model trained at ε = 8 / 255 in Fig.7, Fig.8 and Fig.9 respectively.
For plotting, one image is selected at random from each of the ten classes.
Because of the increased diversity amongst the images on using AutoAugment, we observe more diversity in the perturbations as well (Fig.9) when compared to the Base augmentations (Pad+Crop, Horizontal Flip) (Fig.8) and No augmentations (Fig.7) case.
B.1 Distinction between Simple and Complex Augmentations
We term the augmentations that preserve low-level features of images as simple augmentations, and those that modify the same as complex augmentations.
To distinguish between simple and complex augmentations, we do not use the difference between two images in pixel-space, since this would incorrectly show that simple changes like horizontal-flip and crop are far apart.
Instead, we use metrics that better capture low-level features at pixel and patch levels.
This can be measured at a pixel-level using MSE between color histograms, and at a patch-level using patch-wise MSE.
To compute patch-wise MSE between two images x 1 and x 2 , for every 8 × 8 patch in x 1 we find the nearest patch in x 2 and a horizontal flip of x 2 , and compute an average across all patches in x 1 .
We report the mean and standard deviation of this value across all images in the test set.
We show the pair-wise distances between three sets of images (Unaugmented, Pad+Crop+HFlip, AutoAugment) in Table-7.
Lower value indicates that the images are more similar.
We note that Pad+Crop+HFlip augmentations have the advantage of being more similar to the distribution of unaugmented images that are expected during inference,
1: Input: Network f θ , Training Dataset D = { ( x i , y i ) } , Adversarial Threat model: ℓ ∞ bound of radius ε , number of epochs E, Maximum Learning Rate LR max , M training mini-batches of size n , number of attack steps S , Cross-entropy loss ℓ CE , Weight perturbation constraint M ( θ ) ,
Number of augmented images using autoaugment T , coefficient of KL divergence term β 2: for epoch = 1 to E do 3: ε asc = epoch · ε/E 4:
LR = 0 .
5 · LR max · (1 + cosine
(( epoch − 1) /E
· π )) 5: for iter = 1 to M do 6: for i = 1 to n (in parallel) do 7: for a ∈ { base , auto(1) , . . . , auto(T) } do 8: for steps = 1 to S do 9: δ = 0 .
001 · N (0 , 1) 10: δ = δ + ε asc · sign ( ∇ δ KL( f θ ( x i,a ) ||
f θ ( x i,a + δ ))) 11:
δ =
Clamp ( δ, − ε asc , ε asc ) 12: (cid:101) x i,a = Clamp ( x i,a + δ, 0 , 1) 13: end for 14: end for 15: end for 16:
L DAJAT ( θ ) =
T + 1 · n n (cid:88) i = (cid:8) L TR ( θ, ( x i , ˜ x i ) base , y i )
+
T (cid:88) t =
L TR ( θ, ( x i , ˜ x i ) auto , y i ) (cid:9) +n n (cid:88) i = (cid:8) JSD( f θ ( x i, base ) , f θ ( x i, auto(1) ) , . . .
, f θ ( x i, auto(T) ))
(cid:9) 17: where, L TR ( θ, ( x, ˜ x ) , y ) =
L CE ( f θ ( x ) , y ) + β · KL( f θ ( x ) ||
f θ (˜ x )) 18: ˜ θ = argmax ˆ θ ∈M ( θ ) 1 n n (cid:80) i = (cid:8) L TR ( θ + ˆ θ, ( x i , ˜ x i ) base , y i ) (cid:9) 19: [Equation] =
[Equation]
20: end for 21: end for while AutoAugment transformed images are farther away from the unaugmented images.
AutoAugment consists of several augmentations of varying complexity levels, and may contain augmentations of similar complexity as the Base augmentations (Pad+Crop+HFlip) as well.
This is reflected in the higher variance in pair-wise distances corresponding to AutoAugment.
[Table]
DAJAT allows separate function mappings for augmentations that resemble the inference-time distribution (Pad+Crop+HFlip), and those that lead to better diversity (AutoAugment).
Base augmentations have low variation, and are similar to the distribution of unaugmented images, which is important to obtain performance gains using the batch-norm layer corresponding to these base augmentations during inference.
On the other hand, the high variance of AutoAugment based transformations helps in improving the robust generalization of the overall model.
B.2 Distribution shift of Natural and Adversarial images due to Augmentations
We compare the distribution shift between (natural-augmented, natural-unaugmented) pairs and (adversarial- augmented, adversarial-unaugmented) pairs.
We consider two types of distances between image pairs: lowlevel (MSE between histograms/patches) and feature-level (FID).
In terms of low-level distances, we expect the distances between (natural-augmented, natural-unaugmented) pairs and the corresponding (adversarialaugmented, adversarial-unaugmented) pairs to be similar, since the perturbed images are only an ε away from ship ship aero frog frog
[Figure]
ship ship
[Figure]
natural images.
However, as seen in Fig.7, 8 and 9, the perturbations of Pad+Crop+HFlip look similar to the perturbations of unaugmented images, while the perturbations of AutoAugment based images look different from those of unaugmented images.
This is a result of larger pixel-level differences between the (natural-AutoAugment, natural-unaugmented) image pairs when compared to (natural-PadCrop, natural-unaugmented) image pairs, which serves as a more diverse initialization for the attack.
The difference in the absolute perturbations results in a larger distance in feature space (Fréchet Inception Distance or FID) as shown in Table-8.
[Table]
For better clarity, we summarize our findings in Table-9.
The higher feature level distance between (adversarial- AutoAugment, adversarial-unaugmented) image pairs when compared to (natural-AutoAugment, naturalunaugmented) image pairs translates to higher 12 d F ∆ F ( s, t ) in Eq.1.
Based on Conjecture-1(ii), unless this difference is accounted for, complex augmentations cannot improve the performance of adversarial training.
B.3 Justification on the choice of Simple and Complex Augmentation pipeline
In the proposed method, we use two sets of augmentations - Pad+Crop+HFlip and AutoAugment.
The second set of augmentations (complex augmentations) consists of an autoaugment based transformation followed by the base
[Table]
[Figure] [Figure]
[Figure]
augmentations (Pad+Crop+HFlip).
This has two implications - firstly, this ensures that the complexity of these augmentations is always greater than or equal to the base augmentations.
Secondly, since AutoAugment returns the unaugmented image as well, with a certain probability (0.22 for CIFAR-10 policy), the base augmentations form a subset of the complex augmentations.
This trend is indeed reflected in the distribution of pair-wise feature-level similiarities (Cosine similarity between features obtained from an Inception-V3 network) between the following pairs: (Unaugmented, Pad+Crop+HFlip (PCHf)) and (Unaugmented, AutoAugment+PCHf) as shown in Fig.10(a).
When AutoAugment alone is applied, a large fraction of images have a very high cosine similarity, while others have a more spread out distribution as shown in Fig.10(b).
When Pad+Crop+HFlip is applied in series after
AutoAugment, the distribution of these images shifts to the left, leading to an overlap in the two distributions.
Even with such a large overlap the method works well because, the role of the "complex" batch-norm layer is to allow the learning of a function that minimizes empirical risk across a wide distribution of data.
While the test distribution may be different from these augmentations, learning from diverse data is known to prevent overfitting and improve generalization.
However, since the task of adversarial training is inherently hard, and the objective of minimizing loss on a wider distribution of data makes the task harder, we observe a drop in overall accuracy.
The use of a separate batch-norm layer for "simple" augmentations allows the network to specialize on a select subset that is close to the distribution of test set images, and has a low variance.
While the diversity of simple augmentations is low, it is sufficient to learn the batch-norm statistics and affine parameters which constitute 0.05% of all parameters, while majority of the parameters are learned using both distributions, resulting in low overfitting.
B.4 Ablations
We show the impact of some of the important categories of augmentations individually in Table-10.
The robust accuracy improves when the spatial augmentations - shear, rotation and translation are not used for adversarial training.
Amongst the augmentations that modify the low-level statistics of images, change in color balance gives maximum benefit.
Further, it can be noted that although some augmentations such as change in
[Figure]
[Table] [Table]
[Table]
51.48 Contrast 82.
brightness and contrast lead to a drop in robust accuracy when used directly, the use of the same augmentations in the proposed framework results in a significant boost in accuracy.
Therefore there is no need to use carefully selected augmentations with the proposed framework.
C Split Batch-Normalization
We perform three ablation experiments - first by training with separate running statistics and common affine parameters, second by training with common running statistics and separate affine parameters, and third without using split batch-norm at all, as shown in Table-11.
Robust Accuracy is reported against the GAMA attack.
As shown in the Table-11, E2 and E3 (having either split running statistics or split affine parameters) perform similar to the proposed approach, where separate running statistics and affine parameters are used.
This shows that our method learns a different function mapping for both augmentations, and this can be realized by having different running statistics or different affine parameters or using a combination of both.
We further note that the use of a single batch-norm layer for both augmentations (E4) degrades the results significantly.
We compare the average cosine similarity of the running statistics across training iterations for both our method, and the case where we have separate running statistics and common affine parameters in Fig.11.
We note that the scale and trend of the average cosine similarity is similar in both cases.
In the case where common affine parameters are used, the gains in results w.r.t.
single batch-norm case can be attributed to the small drop in cosine similarity over training.
This indicates that small changes in these running statistics can indeed lead to a large impact in the overall results (as shown in Table-11).
We further verify this by noting the large difference in performance of the models when different batch-norm parameters are used for training, in Table-12.
Robust Accuracy is reported against the GAMA attack.
D Improvements of DAJAT in the low data regime
We compare the performance of the proposed DAJAT defense (using Base, 2*AA) with TRADES-AWP [50] 2-step baseline across different sizes of the CIFAR-10 training dataset on ResNet-18 architecture in Fig.12.
We
[Table]
consider class balanced dataset for each case.
We note that across different settings, the proposed approach achieves 5-9% gains in clean accuracy and an average gain of 1.3% in robust accuracy.
The gain in clean accuracy in the low data regime is significantly high (8.93%) highlighting the need for augmentations in improving Adversarial Training performance, specifically in real-world settings where the training data is low
E Details on ACAT E.1 Motivation: Instability of 2-step Adversarial Training
Ascending perturbation radius helps in mitigating gradient masking when lesser steps are used for attack generation.
We present results of ACAT when compared to Fixed constraint AT (TRADES-AWP with 2 attack steps) on CIFAR-10 dataset using ε = 8 / 255 with ResNet-18 and WideResNet-34-10 model architectures in Table-13.
Robust Accuracy is reported
[Figure]
[Figure]
improvements
[Figure]
[Table] [Table]
[Table] [Table]
[Table] [Table]
attack, which is not very reliable.
Hence, in some cases, best epoch may have a slightly lower accuracy when compared to the last epoch.
On ResNet-18, we observe that the difference between last and best epochs for both methods is very low.
However, on WideResNet-34-10, we observe the phenomenon of gradient masking in Fixed Constraint AT, with robust accuracy dropping by around 10% towards the end of training.
We note that the difference between last and best epochs is very low for ACAT even on WideResNet-34-10.
The main motivation of using an ascending perturbation radius is to stabilize training and prevent the onset of gradient masking.
E.2 ACAT training algorithm
The algorithm for the proposed ACAT defense is presented in Algorithm-2.
We consider an ℓ ∞ threat model of perturbation radius ε .
The perturbation bound for attack generation ε asc is linearly increased from 0 to ε during training (L3).
The learning rate follows a cosine schedule across the training epochs as shown in L4.
The attack generation (L7-L12) is done for 2 iterations and follows the TRADES [57] settings.
Initially Gaussian noise of magnitude 0 .
001 is added to every pixel.
The KL divergence loss between the clean and perturbed images is maximized using the perturbation step size ε asc .
Further, the perturbation is clipped to remain within the threat model in every iteration.
As shown in L14, the TRADES-AWP [50] loss is used for adversarial training.
The loss L TR ( θ + ˆ θ ) is maximized with respect to ˆ θ to find the perturbation ˜ θ within the constraint set M ( θ ) (L15).
Further, the model weights θ are update using gradients at f θ +˜ θ (L16).
The defense ACAT does not use any additional training hyperparameters when compared to the TRADES-AWP defense.
We vary the hyperparameter β to obtain optimal results.
We show the trend of model performance across variation in β in Section-F.2.
E.3 Analysis of the proposed ACAT defense
Conjecture-2: We hypothesize that given a Neural Network f θ ε that minimizes the TRADES loss [57] within a maximum perturbation radius of ε , and has sufficient smoothness in weight space within an ℓ 2 radius ψ around θ ε , there exist ε ′ >
ε and a model f θ ε ′
where || θ ε ′ − θ ε || ≤ ψ , such that f θ ε ′ has a lower TRADES loss within ε ′ when compared to f θ ε .
Justification: We first consider Adversarial Training within a perturbation bound ε using the TRADES-AWP loss shown below.
[Equation]
The model f θ ε which is the minimizer of the above loss, achieves an optimal trade-off between the cross-entropy loss on clean samples (clean loss, L clean ) and weighted KL divergence between clean and adversarial images [57] (adversarial loss, L adv ).
[Equation]
Since the loss attains a minima at θ ε , a direction of further reduction in both clean and adversarial losses does not exist (Eq.9).
Gradient descent on the adversarial loss at θ ε to parameter θ ′ results in a reduction in adversarial loss at the cost of a higher clean loss.
[Equation]
We assume that L clean ,θ ε increases by a rate γ CE ,θ ε and L adv ,θ ε ,ε decreases by a rate γ KL ε ,θ ε in the direction of gradient descent of the adversarial loss ( −∇L adv ,θ ε ,ε ) .
Since θ ε is a minimizer of loss,
[Equation]
Since the Cross-entropy loss is minimized at x , it attains a minima at x within the pixel neighborhood.
[Equation]
Since the model f θ is adversarially robust within ε , the loss surface is locally smooth within the open interval ( − ε, ε ) .
The adversarial loss, which measures the KL divergence of the adversarial image w.r.t.
the clean image is least at x and increases monotonically in the ε -neighborhood for adversarially robust models [3].
Therefore, adversarial loss at ε ′ =
ε + δ for a small enough δ would be marginally higher than the loss at ε .
[Equation]
Based on the local smoothness in weight space as well, the same property holds at any θ ′ in the gradient descent direction of L adv ,θ ε ,ε (satisfying Eq.11) such that || θ ′ − θ ε || ≤ ψ , as shown below:
[Equation]
[Equation]
Since the adversarial loss at θ ′ is lower than the same at θ ε , the loss surface at θ ′ has a lower local Lipschitz constant when compared to θ ε leading to the following:
[Equation]
Rearranging terms,
[Equation] [Equation]
For small enough gradient descent step size η , the above can be related to the rate of reduction in the adversarial loss as shown below:
[Equation]
[Equation]
Since the Cross-entropy loss does not depend on ε , from Eq.13 and Eq.20,
[Equation]
[Equation]
Therefore, the rate of increase in L AWP ,θ ε ,ε ′ , or α − α ′ , is less than the rate of increase in L AWP ,θ ε ,ε , or α .
For small enough α , α ′ >
α , so that the overall loss L AWP ,θ ε ,ε ′ decreases.
Based on this, for small enough η , ∃ θ ε ′ s.t.
|| θ ε ′ − θ ε || ≤ ψ and L AWP ,θ ε ′ ,ε ′ <
L AWP ,θ ε ,ε ′ .
Hence, it is possible to move to θ ε ′ which has a lower overall loss than the loss at θ ε .
■
E.4 Integrating ACAT with other efficient training methods
The proposed ACAT defense uses the KL divergence loss between clean and adversarial images, similar to the TRADES adversarial training algorithm [57].
We present results by integrating the proposed ACAT defense with losses from existing efficient adversarial training algorithms [42, 43] in Table-14.
We obtain a significant boost in performance over the respective baselines, when we use ACAT with GAT [42] and TRADES [57] losses, and
1: Input: Network f θ , Training Dataset D = { ( x i , y i ) } , Adversarial Threat model: ℓ ∞ bound of radius ε , number of epochs E, Maximum Learning Rate LR max , M training mini-batches of size n , Cross-entropy loss ℓ CE , Weight perturbation constraint M ( θ ) , coefficient of KL divergence term β 2: for epoch = 1 to E do 3: ε asc = epoch · ε/E 4:
LR = 0 .
5 · LR max · (1 + cosine
(( epoch − 1) /E
· π )) 5: for iter = 1 to M do 6: for i = 1 to n (in parallel) do 7: for steps = 1 to 2 do 8: δ = 0 .
001 · N (0 , 1) 9: δ = δ + ε asc · sign ( ∇ δ KL( f θ ( x i ) ||
f θ ( x i + δ ))) 10: δ =
Clamp ( δ, − ε asc , ε asc ) 11: (cid:101) x i =
Clamp ( x i + δ, 0 , 1) 12: end for 13: end for 14:
L TR ( θ ) = 1 n n (cid:80) i =
1 L CE ( f θ ( x i ) , y i ) + β · KL( f θ ( x i ) ||
f θ (˜ x i )) 15: ˜ θ = argmax ˆ θ ∈M ( θ )
L TR ( θ + ˆ θ ) 16: θ = θ − LR · ∇ θ ( L TR ( θ + ˜ θ )) 17: end for 18: end for gives the best overall performance on the unaugmented test set
[Table]
a marginal boost when integrated with the NuAT defense [43].
The adversarial weight perturbation step in the proposed defense results in an increase in computational time when compared to the respective baselines.
We choose the KL divergence based loss for both proposed defenses ACAT and DAJAT since it results in an optimal trade-off between performance and training time
[Table]
[Table]
5 Analysis of the effect of augmentations on ACAT
We [Figure]
the batch leads to a degradation in the performance of the model as compared to using simple augmentations like Pad + Crop + Horizontal Flip.
F Details on Experiments and Results F.1 Details on Datasets
We perform evaluations of the proposed defenses ACAT and DAJAT on the CIFAR-10, CIFAR-100 [29] and ImageNette-10 [24, 12] datasets, comprising of 10, 100 and 10 classes respectively.
The resolution of images in the CIFAR-10 and CIFAR-100 datasets is 32x32, while it is 128x128 in ImageNette dataset.
We use ResNet-18 [20] and WideResNet-34-10 [55] architectures for the CIFAR-10 and CIFAR-100 datasets and ResNetarchitecture for ImageNette.
While CIFAR-10 is the most popular dataset used for benchmarking adversarial defenses, CIFAR-100 has a larger number of classes with one-tenth the number of images in each class, making it a more challenging setting.
ImageNette dataset is used to show the performance of the proposed method on higher resolution images.
We consider an ℓ ∞ threat model with ε = 8 / 255 for the primary evaluations across all datasets.
We use TRADES-AWP [50] 2 as the base code for most of our analysis.
For analysis in Table-23 we use HAT [36] 3 and OAAT [1] 4 as the base codes.
For cutmix analysis in Table-21 we use [35] 5 as the base code.
The license for each of these codes are available on their respective github repositories.
Since the datasets used in this work are public, commonly used for research purposes and do not contain any objectionable content, we find no need to take any consent from the authors of these datasets.
F.2 Details on Training Settings
The training for the baseline methods and the proposed approach is done for 110 epochs as is common in literature [33].
We use SGD optimizer along with cosine learning rate schedule for the proposed method with a momentum of 0.9.
We fix the maximum learning rate to 0.2 and weight decay to 5e-4 for the proposed approach across all datasets and model architectures.
For the baselines, we use the training settings from the official codes released by the authors.
We performed all the experiments on two NVidia V100 GPUs, two RTX-2080 GPUs and one RTX-3090 GPU.
We use a validation split of 1000 images from the train dataset both for CIFAR-10 and
CIFAR-100 images, except for the results reported in Table-4, where we use the full dataset to compare against the state-of-the-art defenses on the RobustBench leaderboard [9].
For the proposed approaches ACAT and DAJAT (Base, 2*AA), we vary the value of β to achieve an optimal trade-off between the clean and adversarial accuracy.
As shown in Fig.13 and Fig.14(a,b), as we increase β , robust accuracy improves and clean accuracy degrades initially, with a saturating trend in robust accuracy at higher values of β .
For the ResNet-18 model and CIFAR-10 dataset, the
We further fix the value of β to the optimal setting of 9 and vary the coefficient of the JS divergence term in Fig.14(c,d).
This term leads to a boost in the clean accuracy at the cost of a slight degradation in the robust
[Table] [Table]
We consider the Base, 2*AA as the main setting of DAJAT since its computational complexity matches with that of TRADES-AWP.
However, we show the result of Base, 3*AA as well to highlight that the performance improves with a further increase in diversity.
In this case, since the weight of the Base augmentations is considerably low in the overall loss (L16 in Algorithm-1), we give a weight of 1/3 to the TRADES loss on base augmentations and 2/3 to the TRADES loss on the AutoAugment based images.
This mimics the setting of Base, 2*AA in terms of loss weighting, while introducing additional diversity due to the presence of a larger number of complex augmentations, yielding a small boost in performance.
We share the optimal set of hyperparameters across all datasets and model architectures in the ReadMe file that is submitted along with our Code in the Supplementary submission. [Figure]
(ResNet-18), there is a sudden drop in the robust accuracy due to Gradient masking on WideResNet-34-10 (c,d) after epoch 87, indicating the need for using varying ε schedule in DAJAT.
Evaluations are done using an attack perturbation bound of ε = 8 / 255 .
[Table]
[Table]
F.3 Performance on Larger Capacity Models
We find that the performance gains obtained using DAJAT are indeed higher on larger capacity models.
In Table-16, we present results on CIFAR-100 dataset, on WideResNet-34-10 and WideResNet-34-20 model architectures using 110 epochs of training.
We note that the improvements in clean accuracy increase from 6.01% to 7.37%, while the improvements in robust accuracy against AutoAttack increase from 1.71% to 2.72%.
F.4 Impact of Ascending Perturbation Radius in DAJAT
We present an ablation of DAJAT without ascending perturbation radius (DAJAT+Fixed- ε ), where attacks are constrained within a fixed perturbation bound of 8/255 during training.
Table-17 shows results on CIFAR-10 and
CIFAR-100 datasets with WideResNet-34-10 and ResNet-18 architectures.
Robust Accuracy is reported against the GAMA attack.
As seen in the first half of the table, on ResNet-18 architecture, there is no gradient masking even with DAJAT+Fixed- ε .
However, on the WideResNet-34-10 architecture, DAJAT+Fixed- ε results in a large drop in robust accuracy due to gradient masking.
Although the use of weight averaging improves results, its robust accuracy is still lower by around 5-10% when compared to DAJAT.
The phenomenon of gradient masking in DAJAT+Fixed- ε can also be observed in Fig.15, where its robust accuracy suddenly drops after epochaccompanied by an increase in clean accuracy on CIFAR-10 with WideResNet-34-10 architecture.
We note that even with respect to the best epoch accuracy on DAJAT+Fixed- ε , we obtain an improvement of 2.57% on robust accuracy using DAJAT.
F.5 Variance across reruns
We present the variation across three reruns for the proposed defenses ACAT and DAJAT (Base, 2*AA) on CIFAR-10 dataset and ResNet-18 architecture in Table-18.
Since weight averaging is known to improve the stability of the base method [43], we present results without the use of weight averaging to highlight the inherent variance of the base algorithm.
The standard deviation of robust accuracy across reruns is low (0.06-0.07) across both approaches indicating stability of the proposed method.
It can be noted that [Table]
F.6 Analysis on Compute, Flops and Performance
We present the FLOPs, number of parameters and training time on a single Nvidia RTX-3090 GPU along with our results when compared to the TRADES-AWP baseline on the CIFAR-10 dataset for ResNet18 and
WRN-34-10 models in Table-19.
Robust accuracy is reported against AutoAttack.
We discuss our observations below:
• FLOPs and number of parameters during inference are identical among the three training methods (TRADES-AWP, ACAT, DAJAT), since we use only a single batch-normalization layer (corresponding to Pad+Crop) during inference.
As expected, these values are higher for WideResNet-34-10 model architecture when compared to ResNet-18.
• Since we use split batch-norm layers in DAJAT, the number of parameters increases by 0.05% during training, while it remains the same during inference.
• We compute FLOPs during training by considering that a single backward pass requires twice the number of FLOPs when compared to a forward pass.
We also provide the number of forward and backward passes in each method for reference.
• Using ACAT, we achieve 63% reduction in FLOPs (training) and training time when compared to the TRADES-AWP baseline, while achieving 1.6-1.9% higher clean accuracy and comparable robust accuracy.
• The use of ACAT strategy in the proposed DAJAT defense enables us to achieve similar computational complexity as TRADES-AWP defense, while obtaining gains in performance.
Using DAJAT, we achieve 10% reduction in FLOPs ( training) and training time, while obtaining 3.8-5.5% higher clean accuracy and 1-1.6% higher robust accuracy.
F.7 Comparison against CutMix based augmentation
While we compare the performance of the proposed approach against various base adversarial training algorithms [50, 31, 33, 43] in the main paper, we additionally compare with a recent augmentation scheme that uses CutMix augmentations [37] to improve performance in this section.
The authors of [37] show a significant boost in performance using 400 epochs of training and large model architectures.
However, to ensure a fair comparison, we report the result of 110 epochs of training on WideResNet-34-10 architecture and CIFAR-10 dataset that has been shared by the authors with us upon request.
We report the PGD 40-step accuracy as shared by the authors.
As shown in Table-20, we obtain a significant boost in performance over the CutMix based augmentation as well as the TRADES-AWP [50] baseline using the proposed defense DAJAT.
Additionally, contrary to the claims by Rebuffi et al.
[37], we show that it is indeed possible to effectively use augmentations that modify the low-level statistics of images for obtaining improved performance in Adversarial
Training by using the proposed defense DAJAT.
As present in the github repository 6 of [37] we note that naively using cutmix doesn’t give good results as shown in Table-6, therefore as suggested we use [35] as the base code and incorporate cutmix into it.
We present the results for 200 epochs training with learning rate drop of 0.1 at 100 and 150 epochs, using the PreActResNetmodel with Swish Activation and batch size of 128 in Table-21(C1).
We observe significantly improved results as compared to Table-6 on using [35] as the base code.
We observe that the key differences in [35] as compared to [57] are:
• Use of swish activation function in the PreActResNet18 model • Weight decay not used for batch normalization layers
[Table] [Table]
To study the impact of these changes, we investigate the use ReLU instead of Swish activation (Table-21(C5)) and the use of weight decay for all the parameters of the model including the batch normalization layers (Table-21(C6)).
In both cases, we observe a significant drop with respect to C1.
Thus based on this ablation, the use of swish activation, and avoiding weight decay for batch normalization layers seems important to obtain benefits using Cutmix.
Further we incorporate linearly increasing varying epsilon schedule along with cosine learning rate schedule and get improved results in Table-21(C2).
Next we incorporated our method DAJAT with C2 and present the results in Table-21(C3,C5), where we can observe significant gains over C2, thus showing the effectiveness of DAJAT.
F.8 Comparison of DAJAT with Concurrent Works
Here we compare the proposed approach DAJAT trained for 200 epochs with recent works that appeared at ICLR 2022.
The comparison of the proposed method DAJAT with AWP [50], HAT [36], Self Ensemble Adversarial
Training (SEAT) [47] with (SEAT+cutmix) and without cutmix (SEAT), Unified distributional robustness for TRADES (UDR + TRADES) [5], temporal ensembling with TRADES (TRADES + TE) [14] on CIFAR10 and
CIFAR100 datasets for ResNet18 and WideResNet-34-10 models is shown in Table-22.
Since these are very recent works, we only present results reported in the paper, and leave the remaining entries in the table blank.
F.9 Combining the proposed approach with different adversarial training methods
We explore combining the proposed defense DAJAT with some existing methods like [50], [1] and [36] in Table-23.
We observe that combining DAJAT with all three existing works leads to significant gains both in clean as well as adversarial accuracies (AA, 8/255), especially on CIFAR-100 where the number of images per class is low.
Although OAAT [1] shows improved results over AWP [50], combining DAJAT with OAAT leads to further gains of ∼ 1 .
5% in both clean and adversarial accuracy on CIFAR10 and 1 − 1 .
5% gains in both clean and adversarial accuracy on CIFAR100.
Further, since OAAT [1] claims to achieve robustness at larger epsilon bounds, we evaluate using Auto-Attack at ε = 16 / 255 .
Using OAAT+DAJAT we observe gains over OAAT on
AutoAttack with ε = 16 / 255 as well, which further confirms the effectiveness of DAJAT.
Finally we combine
DAJAT with HAT [36] and we observe consistent gains over HAT [36] on all models and datasets.
While HAT [36] proposes to improve the robustness-accuracy trade-off, combining DAJAT with HAT further improves this trade-off and shows gains of ∼ 1% on clean accuracy and ∼ 2% on robust accuracy for CIFAR-10, and 3 − 5% on clean accuracy and ∼ 3% on robust accuracy for CIFAR-100 dataset.
[Table]
[Figure]
u s t
[Figure]
u r a c y
[Figure]
L
[Figure]
F.10 Sanity checks to verify the absence of gradient masking
We perform several sanity checks as recommended by Athalye et al.
[3] to ensure the absence of gradient masking in the proposed defenses ACAT and DAJAT.
• From Table-24 we note that Black-Box attacks are weaker than White-Box attacks, indicating that the gradients
from the
model
are reliable
• We further note from Table-24 that attacks with higher number of steps are stronger than those with lower steps.
Further, PGD multi-step attacks are stronger than FGSM white-box attacks.
• From Table-25 we note that robust accuracy against targeted and untargeted attacks saturates as the number of attack steps increase from 500 to 1000, indicating that the evaluation is robust.
• We also note from Table-25 that the drop in accuracy with 1000 random restarts is marginal.
• We note from Fig.16 that an increase in perturbation bound increases the effectiveness of PGD 7-step attacks, and is able to bring down the accuracy of the model to 0 at large bounds.
Further, the loss on FGSM samples monotonically increases in the vicinity of the data samples.
These trends indicate the absence of gradient masking.
[Figure]
[Table] [Table]
against AutoAttack is similar to the accuracy against gradient-based attack GAMA [42] indicating that gradient-free attacks are not significantly stronger than gradient based attacks.
• We show the loss surface plots of the proposed defenses ACAT and DAJAT in the vicinity of data samples in Fig.17.
We note that the loss surface of the proposed defenses is smooth similar to the TRADES-AWP defense, indicating the absence of gradient masking.
We finally compare
the robust accuracy against various attacks
in
Tables-24 and 25 with the
robust accuracy against GAMA attack
] and
AutoAttack [
8] in
Tables-2 and 3 in the main paper.
The latter evaluations are significantly stronger, indicating that the evaluation presented in the main paper is robust.