Temporal Effective Batch Normalization in Spiking Neural Networks
Anonymous Author(s
Abstract
Spiking Neural Networks (SNNs) are promising in neuromorphic hardware owingto utilizing spatio-temporal information and sparse event-driven signal processing.
However, it is challenging to train SNNs due to the non-differentiable nature of thebinary firing function.
The surrogate gradients alleviate the training problem andmake SNNs obtain comparable performance as Artificial Neural Networks (ANNs)with the same structure.
Unfortunately, batch normalization, contributing to thesuccess of ANNs, does not play a prominent role in SNNs because of the additionaltemporal dimension.
To this end, we propose an effective normalization methodcalled temporal effective batch normalization (TEBN).
By rescaling the presynapticinputs with different weights at every time-step, temporal distributions becomesmoother and uniform.
Theoretical analysis shows that TEBN can be viewed as asmoother of SNN’s optimization landscape and could help stabilize the gradientnorm.
Experimental results on both static and neuromorphic datasets show that
SNNs with TEBN outperform the state-of-the-art accuracy with fewer time-steps,and achieve better robustness to hyper-parameters than other normalizations.
Introduction
As the third generation of neural network models, Spiking Neural Networks (SNNs) are closer to theneuronal circuits of the brain and have recently received substantial attention in artificial intelligenceand neuroscience [30, 37].
SNNs process spatio-temporal information with asynchronous discreteevents, which is ultra-low-power and highly compatible with neuromorphic and FPGA devices.
However, due to the non-differentiable nature of the membrane potential at the firing time, it remainschallenging to train high-performance deep SNNs [28, 41].
There are two main methodologies to address the training problems.
One is the conversion-basedmethod which converts pre-trained Artificial Neural Networks (ANNs) to SNNs by converting ReLUactivation to spiking neurons and retaining the weights [5, 33, 40].
The converted SNNs usuallyrequire a large number of time-steps to achieve comparable performance as source ANNS [4, 15],and can not be applied to neuromorphic datasets [7].
The second is end-to-end training with backpropagation, which is promising as it only needs a few time-steps [46].
In the end-to-end training, theforward path is achieved with a non-differentiable spiking function, and the network back-propagatesthrough surrogate gradient functions [32] or temporal dependencies [32, 50].
Batch normalization (BN) contributes to the success of ANNs by flattening the loss landscape andreducing the internal covariate shift (ICS) [22, 39].
Whereas when it comes to SNNs, the existingnormalization methods rarely take full advantage of the additional temporal dimension, which restricts the performance of SNNs [47].
Furthermore, the temporal dynamics of spiking neuron is tightlyin connection with the neuronal parameters.
Therefore, when these parameters are changed, theperformance of some methods may be degraded [11].
In this paper, we propose Temporal Effective Batch Normalization (TEBN), a novel and effectivenormalization approach that regularizes the temporal distribution through weighting the presynapticinputs of the spiking neurons.
We prove that our approach could smooth the optimization landscapeof SNN and help stabilize the gradient norm.
The experiment results on CIFAE-10, CIFAR-100,and DVS-CIFAR10 datasets show that our approach achieves better classification performance androbustness to hyper-parameters than other BN methods.
Besides, the proposed method outperformsthe state-of-the-art learning methods, using fewer time-steps.
Related Works
2.1 Learning of Spiking Neural Networks
In recent years, many learning methods have been developed to train deep SNNs with excellentperformance, which can be classified into ANN to SNN conversion (ANN2SNN)
[4, 5, 7, 9, 14,15, 18, 20, 38, 40, 42] and end-to-end backpropagation methods [10, 19, 28, 28, 29, 32, 41, 46, 51].
ANN2SNN pre-trains a source ANN and then converts it to an SNN by changing the artificialneuron model to the spiking neuron [5].
The main idea is to use the firing rates [15] or averagepostsynaptic potentials [7] of spiking neurons to approximate the ReLU activations of artificialneurons.
Although some advanced conversion methods have achieved almost loss-less accuracy onlarge-scale datasets with ResNet and VGG-16 structures [4, 7, 15, 40], they overlook the rich temporaldynamic characteristics of SNNs and demand many time steps to approach the accuracy of pre-trained
ANNs.
In contrast, the backpropagation method directly trains SNNs by unfolding the network overthe time-steps and then computing the gradient on both spatial and temporal domains, which borrowsthe idea of training Recurrent Neural Networks (RNNs) with backpropagation through time [46].
Asthe gradient of spikes with respect to membrane potential is non-differentiable, the surrogate gradientis proposed by approximating the gradient with smooth functions [32, 49].
The backpropagationmethod with surrogate gradients can be applied to both static and neuromorphic datasets, and requiresfar fewer time-steps than ANN2SNN methods.
Another kind of backpropagation method is timingbased [2, 6, 23, 50], which directly computes the gradient of the timing of firing spikes to themembrane potential and does not require unfolding the network over the time-steps.
However, theyare usually limited to shallow networks that are less than 15 layers [3].
2.2 Normalization in Spiking Neural Networks
The training of well-behaved ANNs is made possible by using normalization approaches, includingbatch normalization [22], group normalization [48], and layer normalization [1].
Therefore, theresearchers try to incorporate normalization approaches in ANNs to enhance the learning of SNNs.
For example, NeuNorm [47] constructed auxiliary feature maps receiving the lateral inputs fromthe same layer to control the strength of the stimulus, which normalized the data along the channeldimension.
Recently, some methods have modified batch normalization from a temporal perspectiveto fit the training of SNNs.
Zheng et al.
[51] proposed a threshold-dependent batch normalization(tdBN) method, which extended the scope of BN to the additional temporal dimension.
tdBN is statedto be able to alleviate the vanishing or explosion of gradients.
Just as vanilla BN, the utilization ofshared parameters may neglect the negative impact brought by the unusual temporal distributions.
PSP-BN [21] used unique statistics, the second raw moment, as the denominator in normalizationand it can be inserted right after the spiking functions.
BNTT [26] regulated the firing rates byutilizing separate sets of BN parameters on different time-steps, and can be used for learning indiverse scenarios [24, 25, 44].
The complexity of BN parameters is higher compared to other BNmethods and could break the temporal coherence of information.
Inspired by these methods, weaim to develop a modified BN method with low complexity of parameters and take advantage of thetemporal distribution of presynaptic inputs in the meantime.
Preliminary3.1 Spiking Neuron Model
Unlike traditional ANNs, SNNs use binary spike trains to transmit information.
Here we consider thewidely used Leaky-Integrate-and-Fire (LIF) [13] model to emulate the dynamics of spiking neurons,which is formulated as a first-order differential equation.
[Equation]
where u i ( t ) denotes the membrane potential of the i -th neuron at time t , τ m represents the membranetime constant,
R and I i ( t ) denote the linear resistor and the input current to the i -th neuron attime t .
For numerical simulations of LIF neurons, we need to consider a discrete version of theparameters dynamics.
Similar to [46], the membrane potential u i [ t ] of the i -th neuron at time-step tis represented as:
[Equation]
Here j denotes the index of pre-synaptic neuron and o j [ t ] denotes the binary spike of neuron jat time-step t , which equals 1 if there is a spike and 0 otherwise.
The membrane potential u i [ t ]decreases with a leak factor τ that is no more than 1, and increases with the summation of inputsspikes from the pre-synaptic neurons
pre( i ) through synaptic weight w ij .
When the membranepotential u i [ t ] exceeds a specific threshold θ , the neuron will fire a spike and then the membranepotential is reset to 0.
By combining the sub-threshold dynamics (Eq. 2) and hard reset mechanism,the whole iterative LIF model can be determined by: [Equation]
[Equation]
where H denotes the Heaviside step function.
3.2 Batch Normalization
Batch Normalization (BN) has been a typical strategy for training deep neural networks.
By fixingthe distribution of inputs, BN can reduce the Internal Covariate Shift (ICS) during training, allowingstable convergence of deeper neural networks [22].
Considering an analog neuron with inputx = (cid:0) x
(1) , x (2) , · · · , x ( m ) (cid:1) , where m is a mini-batch size.
BN first normalizes each activation with:
[Equation]
(5) where the expectation µ and the variance σ 2 are computed by µ = 1 m (cid:80) mb
=1 x ( b ) and σ =1 m (cid:80) mb
=1 (cid:0) x
( b ) − µ (cid:1) 2 , respectively.
To enhance the representation capability and ensure BN canrepresent the identity transformation, the learnable parameters γ and β are introduced to scale andshift the normalized vector, and the output of BN is:
[Equation]
Methodology
4.1 Covariate Shift in the Temporal Dimension
ICS has been widely regarded as the key to the effectiveness of BN.
In SNNs, synaptic currents arefed into spiking neurons sequentially, where BN is still the key to enforcing effective SNN training.
Intuitively, the spikes triggering asynchronous currents may strengthen the internal covariate shiftin the temporal domain.
We refer to this phenomenon as Temporal Covariate Shift (TCS), whichcan be viewed as a special case of ICS.
Default BN actually updates its statistics at each time-step,approximating the statistics of total time-step inputs.
Here we build the relationship between theexpectation and variance across all time-steps (cid:0) µ total , σ 2 total (cid:1) and those of the single time-step 118 (cid:0) µ [ t ] , σ 2 [ t ] (cid:1) ( t = 1 , 2 , · · · , T ) :µ total = 1 T T (cid:88) i = µ [ i ] , (7) σ 2 total = 1 T
T (cid:88) i = σ 2 [ i ] + 1 T (1 − 1 T ) T (cid:88) i = µ 2 [ i ] − 2 T 2 (cid:88) i ̸ =
j µ [ i ] µ [ j ] .
By supposing that µ [ t ] is approximately identical for each time-step t , we get:
[Equation]
Hence, the Gaussian distribution across all time-steps can be seen as the composition of T independentdistributions.
Fig.
1 illustrates three typical BN methods used in SNN, including default BN [22],
BNTT [26], and tdBN [51].
The statistics and parameters these methods use are listed in Tab. 1.
[Table]
As shown in Tab. 1, BNTT exploits separate sets of mean, variance, and the scale and shift parametersto model the distribution of presynaptic input at each time-step.
It establishes a delicate modelof distributions while ignoring the time dependence of the input spikes.
In addition, BNTT takeslarge amounts of computation in implementation as it needs the same number of BN modules as thetime-step.
Different from it, tdBN calculates the overall expectation and variance for all T time-steps,and the scale and shift parameters are also shared for all time-steps.
The difference between tdBNand default BN lies in the implementation.
As illustrated in Fig.
1, the input statistics of tdBNconsider the statistics of all the batches and time-steps, while default BN uses the momentum update to approximate the total statistics.
The merit of using µ total , σ 2 total in tdBN is that when doingbackpropagation, there is only one set of input statistics that may contribute to the alignment oftemporal distributions.
Actually, tdBN considers the time dependence of the input spikes, but ignoresthe varying temporal characteristics at different time-steps.
4.2 Temporal Effective Batch Normalization
To model the temporal distributions in SNN training without using too many parameters, combiningthe findings of Eq.
9, we treat the distribution of presynaptic currents at each time step as a scaling ofthe overall distribution.
To this end, we propose Temporal Effective Batch Normalization (TEBN),which assigns different weights p to each time-step to distinguish their effect on the final result.
Theweights are learnable to find an optimum for every time-step to implement efficient inference.
Giventhat x l − 1 [ t ] is the input to layer l at time-step t , the spiking neuron with TEBN can be described as:
[Equation] [Equation]
) where
[Equation]
Here u l [ t ] and o l [ t ] denote the membrane potential and binary output spikes of all neurons in layer lat time-step t .
W l is the synaptic weights between layer l − 1 and layer l , and ˆ x l [ t ] represents theoutput of TEBN in layer l at time-step t .
We calculate the mean µ and variance σ 2 from samples ofall time-steps.
ϵ is a small constant, which is added to guarantee numerical stability.
Each TEBNlayer processes time-invariant BN parameters γ and β and learnable weight parameters p [ t ] .
Sincethe parameters p
[ t ]( t = 0 , 1 , ..., T ) are self-adapting to adjust the distribution of x
[ t ] , TEBN willhelp relieve the problem of TCS.
4.3 Detailed Learning Rule in SNNs
We apply TEBN to SNNs and derive the detailed learning rule.
Actually, the problem is to compute thegradients of the loss function L with respect to the weights ∂ W lij and with respect to the parameterp [ t ] , where ∂ W lij denotes the weight between the j -th neuron in layer l − 1 and the i -th neuron inlayer l .
Similar to the previous works [26, 51], we compute the gradient by unfolding the networkover the simulation time-steps, and get:
[Equation]
where u li [ t ] and o li [ t ] denote the membrane potential and output spikes of the i -th neurons in layer l attime-step t , respectively.
x li [ t ] and ˆ x li [ t ] represent the i -th input and output of TEBN in layer l at timestep t .
As the derivative of spike with respect to the membrane potential ∂ o li [ t ] ∂ u li [ t ] is non-differentiable,the surrogate gradient method [32, 46] is used to smooth the Heaviside step function.
The weight parameter p [ t ] allows the network to capture temporal dynamics when training synapticconnections, and the gradient of the loss function L to the weight parameter p l [ t ] in layer l is:
[Equation]
where µ li and ( σ li ) 2 denote the mean and variance of the i -th neuron from samples of all time-steps.γ li and β li are the i -th parameters of TEBN.4.4 Related to Learnable Input Resistance of LIF Neuron
Like Long Short-Term Memory (LSTM) [16], the LIF neuron has a similar function in controllingthe memory.
As illustrated in Eq. 1, the LIF neuron is able to remember current input informationand forget some information from the past, which is under the regulation of the relative scale ofmembrane time constant τ m and linear resistor R .
A larger τ m or a smaller R typically indicatesa more reinforced memory.
The resistor is usually regarded as a latent variable absorbed in theweights (c.f. Eq. 2).
Fixing the time constant has its problem.
First, when given the time-step numberfor inference, the LIF neuron cannot maintain a memory to enhance the internal representation.
Second, the accuracy of SNN is subjected to the chosen τ [11].
In this regard, our TEBN useslearnable hyperparameter p [ t ] to rescale the presynaptic inputs at time-step t , which can be regardedas optimizing a learnable input resistance R .
The learnable p [ t ] can share the benefit of the learnableτ proposed in [11] to improve the representation.
Different from [11], the time-varying characteristicfurther enables the network to find an optimal proportion of remembrance to input at each time-step,which endows the network with better fitting ability and robustness to hyperparameters.
Smoothing Optimization: A Theoretical Analysis
The proposed normalization methods suggest diverse disposal for different time-steps of neurons.
The mini-batch training makes each neuron i have a dimension of mini-batches.
We will show in ouranalysis that the special design of TEBN can not only flatten the loss landscape with regard to theinput signal, but also help absorb the decay of gradient norm of mini-batches in adjacent time-steps.
Theorem 1.
For the time-dependent input signal x i [ t ] with t as the current time-step and i as theneuron index, the relation between the gradient of ∇ L w.r.t.
x i [ t ] in a TEBN network ∇ x i [ t ] L ( ˆ x [ t ])and the corresponding gradient ∇ x i [ t ] ˜ L ( x [ t ]) in a non-TEBN counterpart network which has a loss˜ L is as follows:
[Equation]
where ˆ x [ t ] = TEBN ( x [ t ]) , ˆ γ
i
[ t ] is the i-th element of ˆ γ [ t ] in TEBN.
Note that the L 2 norm iscalculated in the dimension of mini-batches.
The Lipschitzness of the loss with TEBN blocks is shown to exploit a better Lipschitz constant in
Theorem 1, which contributes to the restraint of the amplification of gradient update steps.
Theorem 1implies that the TEBN block performs as traditional BN in ANNs.
TEBN actually smooths thegradient of the temporal-varying currents.
With a favored optimization landscape, SNNs can alsohave the opportunity to flatten the optimization.
Moreover, as the existence of the time-dependentˆ γ i [ t ] , the bound of the Lipschitz constant is non-static.
By setting p [ t ] s equal 1, TEBN degeneratesto traditional BN.
This may decrease the capability of controlling the temporal Lipschitz constant inpractice.
As illustrated in Sec. 4.4, the TEBN block scaling presynaptic inputs can be seen as learnableresistance in SNN.
We further check the Lipschitzness of the gradient between time-steps t − 1 and t .
Our analysis can help understand why extra scaling on the time-step is necessary.
Theorem 2.
For the time-dependent input signal x i [ t ] with t as the current time-step and i as theneuron index, denote ¯ x il − 1 [ t ] as the hidden output of TEBN without scaling presynaptic inputs byp l [ t ] .
Then, the relation between the gradient of ∇ L w.r.t.
¯ x il − 1 [ t ] and ¯ x il − 1 [ t − 1] is as follows:
[Equation]
where h max is the maximum that the surrogate gradient function can take, and k is the mini-batchsize.
Theorem 2 depicts the magnification of the gradient norm with regard to time.
When setting all p [ t ] sequal one, TEBN can provide the effects of traditional BN.
The Lipschitz constant of gradients foradjacent time is constant τ √ k
(1 + θ h max ) , which may cause the norm to be unstable while training.
The use of trainable p [ t ] , in this regard, can help alleviate this situation and stabilize the gradientnorm, which is essential for a training procedure.
To summarize, directly applying the traditional resolution of Batch Norm into SNN can benefit thetraining process: smoothing the optimization landscape.
We conclude from Theorem 1 that ourproposed normalization method has at least the same ability to preserve gradient norm.
Besides, wealso discover that the Lipschitz constant of BN depends on some neuron parameters like the leakfactor τ and the threshold θ in Theorem 2.
We believe a trainable scaling factor in the temporaldimension will mitigate the gradient norm from explosion and vanishing.
Experiments
In this section, we validate the effectiveness of our proposed TEBN for classification tasks on bothstatic and neuromorphic datasets.
We first compare our algorithm with BN methods to demonstratethe advantages of TEBN.
Further, we compare our method with other state-of-the-art approaches.
Finally, we visualize the distribution of TEBN outputs and demonstrate that the proposed method isrobust to hyper-parameters.
We follow the same data pre-processing protocol as previous work [47].
More details of the configurations are provided in the supplementary.
6.1 Comparison with other BN Methods
We first evaluate the performance of the proposed TEBN and other normalization methods.
For a faircomparison, we do not use advanced data augmentation like cutout [8].
Tab.
2 reports the test accuracyon both traditional static CIFAR-10, CIFAR-100 [27] datasets and neuromorphic DVS-CIFAR10 [17]dataset.
On the CIFAR-10 dataset, our TEBN achieves 94.57% top-1 accuracy with ResNet-19network using only 2 time-steps.
When the network structure is the same, TEBN outperforms theother BN methods, even with fewer time-steps T. We get the same conclusion on other datasets.
Forexample, on CIFAR-100, our method achieves better performance (74.37% v.s. 66.6%) and fewertime-steps (4 v.s. 50) than BNTT [26].
On DVS-CIFAR10, the accuracy of our method is 14.6%(75.1% v.s. 60.5%) and 11.9% (75.1% v.s. 63.2%) higher than NeuNorm and BNTT, which use4 times and 2 times as many simulation time-steps T, respectively. Moreover, we achieve betterperformance (64.29% v.s. 63.72%) and fewer time-steps (4 v.s. 6) than tdBN [51] on ImageNet. Allthe accuracies of other methods reported in the tables result from the literature.
[Table]
6.2 Comparison with the State-of-the-Art
We compare our method with other state-of-the-art learning methods for SNNs on CIFAR-10, CIFAR100, and DVS-CIFAR10 datasets and report the results in Tab. 3.
With our reproduction of the
CNN model, our TEBN outperforms HC ( 93.96% v.s. 92.94%, VGG-11) and TSSL-BP (92.65%v.s.
91.41%, 7-layer CNN) with fewer time-steps.
We contribute this to the better representationalcapacity of TEBN.
On CIFAR-100, our TEBN achieves an accuracy of 75.86% with 2 time-steps on
ResNet-19, which is better than results of ANN2SNN and hybrid training.
On DVS-CIFAR10, ourmethod performs better than PLIF and TET using the same architecture.
Besides, we also adopt thecutout augmentation on static datasets denoted by “*” in the table.
Details of the data augmentationare presented in the supplementary.
Cutout helps TEBN to realize better performance.
Compared withother surrogate gradient methods such as TET and Dspike, our TEBN model performs consistentlybetter.
For instance, We achieve the top-1 accuracy of 78.76% on CIFAR-100 dataset with ResNet-19(T=6), which is 4.04% higher than that of TET with the same network structure and time-steps. Moreover, our method outperforms the state-of-the-art learning methods on ImageNet dataset.
Allthe accuracies of other methods reported in the tables result from the literature.
[Table]
6.3 Distribution of TEBN Outputs
We train 9-layer CNN models to visualize the temporal distribution of normalization layers withdefault BN, BNTT, tdBN, and the proposed TEBN.
Fig.
2 illustrates the results of inputs in layer2 on CIFAR-10 with 3 time-steps.
The default BN shows an irregular shape instead of a standardnormal distribution.
On the other hand, BNTT, tdBN, and TEBN reshape the presynaptic inputs into abell-shaped distribution.
Among the three methods, the temporal distribution of TEBN appears morehomogeneous.
Unlike the static datasets, neuromorphic datasets contain rich temporal information,which means presynaptic inputs in different time-steps may have varied distributions.
Here we train
2.0 1.5 1.0 0.5 0.0 0.5 1.0 1.5 2.0 Value 0.0 0.1 0.
D e n s i t y default BN t=0t=1t= 2.0 1.5 1.0 0.5 0.0 {+0.
+} 1.0 1.5 2.0 Value 0.0 0.
D e n s i t y
BNTT t=0t=1t= 2.0 1.5 1.0 0.5 0.0 0.5 1.0 1.5 2.
[Figure]
D e n s i t y tdBN t=0t=1t=2all timesteps 2.0 1.5 1.0 0.5 0.0 0.5 1.0 1.5 2.0 Value 0.0 0.
D e n s i t y
TEBN t=0t=1t=2all timesteps
[Figure]
[Figure]
[Figure]
D e n s i t y
TEBN Layert=5t=6t=7t=8t=      3 Value 0.0 0.
D e n s i t y
TEBN Layert=5t=6t=7t=8t=
9-layer CNN model on DVS-CIFAR10 with TEBN and visualize the temporal distribution of thenormalization layers in Fig.
The last five time-steps are selected for better visual effects.
All thechosen time-steps have an almost identical distribution.
We can conclude that our TEBN can play arole in adjusting the current distribution of DVS data.
6.4 Robustness on Hyper-parameters
Previous work has revealed that improper initial value of membrane time constant τ will hamper thelearning of SNN [11].
Here we compare the performances of different BN methods with various τ .
We train 9-layer CNN models on CIFAR-10 dataset with 2 time-steps and τ values chosen from [0.1,0.25, 0.5, 0.75, 1.0].
As shown in Fig. 4(a), the models with TEBN maintain stable accuracy when τchanges, whereas others fluctuate.
The result indicates the robustness of our method to various τ .
In fact, the parameters p [ t ] are self-adapted to find the optimum when τ changes.
We conductadditional experiments with TEBN.
The time-step is set to 6, and τ varies from 0.25 to 1.0 with step0.25.
As shown in Fig. 4(b)-4(c), smaller τ makes p converge to a bigger value and vice versa.
Notethat when τ = 1 . 0 , the LIF neuron degenerates to the IF neuron, which affects the optimization of p .0.
1.0 τ 92.2 92.
A cc u r a c y ( % ) default BN BNTTtdBNTEBN [Figure] Accuracy     5 Timestep 0 .1 .
V a l u e τ =0.25 τ =0.5 τ =0.75 τ =1.
(b) Layer     5 Timestep 0 .
V a l u e τ =0.25 τ =0.5 τ =0.75 τ =1.
[Figure]
Conclusion
An effective and robust normalization method TEBN is proposed for SNN in this paper.
The mainidea is utilizing time-specific learnable weights to rescale the presynaptic inputs, which serves tonormalize the temporal information to smooth and conform temporal distribution.
Optimizing thelearnable parameters p [ t ] can be regarded as adjusting the input resistance, which helps to enhancethe fitting ability and robustness to specific hyper-parameters of spiking neurons.
TEBN promotes thepotential advantages of backpropagation methods for future practical applications of SNNs.
In futureresearches, we aim to dive deeper into the temporal distribution of SNNs with BN and investigatemore robust SNNs.
Besides, recent works have shown that short-term plasticity (STP) [12, 36, 43]can be incorporated into ANNs to enhance efficiency and computational power [31, 35].
As STPperforms a function of temporal filtering similar to TEBN, how to use the biologically-realisticfilter-STP in SNNs is the future direction.
Checklist
For all authors...
(a) Do the main claims made in the abstract and introduction accurately reflect the paper’s
contributions and scope?
[Yes]
(b) Did you describe the limitations of your work?
[Yes]
(c) Did you discuss any potential negative societal impacts of your work?
[Yes]
(d) Have you read the ethics review guidelines and ensured that your paper conforms tothem?
[Yes]2.
If you are including theoretical results...
(a) Did you state the full set of assumptions of all theoretical results?
[Yes]
(b) Did you include complete proofs of all theoretical results?
[Yes] The proof is availablein the supplementary.3.
If you ran experiments...
(a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?
[Yes] Our code will
be available in the supplementary.
(b) Did you specify all the training details (e.g., data splits, hyperparameters, how theywere chosen)?
[Yes] All implementations are described in the experiments section andsupplementary.(c)
Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?
[No] Fixed random seeds are used.(d)
Did you include the total amount of compute and the type of resources used (e.g., typeof GPUs, internal cluster, or cloud provider)?
[Yes]4.
If you are using existing assets (e.g., code, data, models) or curating/releasing new assets...
(a)
If your work uses existing assets, did you cite the creators?
[Yes] We use
CIFAR10/100[27], and CIFAR10-DVS [17].
(b) Did you mention the license of the assets?
[No] We adopt public datasets.
(c) Did you include any new assets either in the supplemental material or as a URL?
[Yes]
(d) Did you discuss whether and how consent was obtained from people whose data you’re
using/curating?
[No]
(e) Did you discuss whether the data you are using/curating contains personally identifiable
information or offensive content?
[No]
If you used crowdsourcing or conducted research with human subjects...
(a) Did you include the full text of instructions given to participants and screenshots, ifapplicable?
[N/A]
(b) Did you describe any potential participant risks, with links to Institutional Review
Board (IRB) approvals, if applicable?
[N/A]
(c) Did you include the estimated hourly wage paid to participants and the total amount
spent on participant compensation?
[N/A]