A Training Scheme for the Uncertain Neuromorphic Computing Chips
Authors: Qingtian Zhang
Bin Gao
Huaqiang Wu
Venue:  (2020)
Keywords: deep learning
neuromorphic computing
uncertainty
training

Abstract: Uncertainty is a very important feature of the intelligence and helps the brain become a flexible, creative and powerful intelligent system. The crossbar-based neuromorphic computing chips, in which the computing is mainly performed by analog circuits, have the uncertainty and can be used to imitate the brain. However, most of the current deep neural networks have not taken the uncertainty of the neuromorphic computing chip into consideration. Therefore, their performances on the neuromorphic computing chips are not as good as on the original platforms (CPUs/GPUs). In this work, we proposed the uncertainty adaptation training scheme (UATS) that tells the uncertainty to the neural network in the training process. The experimental results show that the neural networks can achieve comparable inference performances on the uncertain neuromorphic computing chip compared to the results on the original platforms, and much better than the performances without this training scheme.

Under review as a conference paper at ICLR 2020
A TRAINING SCHEME FOR THE UNCERTAIN NEURO- MORPHIC COMPUTING CHIP CONFERENCE SUBMISSIONS
Anonymous authors Paper under double-bling review
ABSTRACT
Uncertainty is very important feature of the intelligence and helps the brain become a flexible, creative and powerful intelligent system. The crossbar-bases based neuromorphic computing chips, in which the computing is mainly performed by analog circuits, have the uncertainty and can be used to imitate the brain. Howev- most of the current deep neural networks have not taken the uncertainty of the neuromorphic computing chip into consideration. Therefore, their performances the neuromorphic computing chips not good as the original platform- s (CPUs/GPUs). In this work, we proposed the uncertainty adaptation training scheme (UATS) that tells the uncertainty to the neural network in the training process. The experimental results show that the neural networks can achieve com- parable inference performances on the uncertain neuromorphic computing chip compared to the results on the original platforms, and much better than the perfor- mances without this training scheme.
INTRODUCTION
Uncertainty reasoning the essence of human thinking activities and key aspect of the intelligence. There are two kind of uncertainties in intelligent systems. One is the fuzziness, the other is the stochasticity. The fuzziness helps the brain deal with the real world efficiently by ignoring the enormous redundant information. When we try to distinguish a cat or dog, we do not need to know the expressions and the number of the legs. Although such information can be easily captured by our visual system with a glance, it will be ignored for efficiency. The stochasticity endows the brain the creativity and enables us not always failed in an unfamiliar field. Our decisions may change when we do not sure. These characteristics are not available in most existing artificial intelligence (AI) systems, such as a classifier based on a deep neural network (DNN). The 32-bit or 64-bit floating numbers used to describe the weights and activations. While some researchers found that the 8- bit integer is enough for many applications Banner et al.) (2018); Wu et al. (2018). Moreover, after the matter how many times performs, although the
training procedure, the results will be the margin is very small and the answer is wrong. There are some methods to address these issues, such as the network quantization and the Bayesian network. In addition, the neuromorphic computing chip has provide a hardware approach to supplement the missing uncertainty in DNN.
In recent years, the emerging nanotechnology device and crossbar structure based neuromorphic computing chips have developed a lot Fuller et al. (2019); [Boybat et al. (2018); Yao et al. (2017). The Ohms law and Kirchhoffs law make the crossbar structure very efficient when doing the vector- matrix multiplication (VMM), and the emerging nanoscale nonvolatile memory (NVM) device at each cross point provides additional storage capability (Figure [ The crossbar holds the devices conductances as memory in peacetime, and performs the computing function when applied voltages. The so-called computing in memory (CIM) architecture can relieve the memory bottleneck, which is the most serious problem in the von Neumann architecture, and make the neuromorphic comput- ing chips more energy and area efficiency. Therefore, the neuromorphic computing has become a promising approach to realize the AI applications, which is full of VMMs and great memory quirement. Besides the energy and area efficiency, the uncertainty is also an important and intrinsic feature of the neuromorphic computing chips and is not well utilized.

---

Under review as a conference paper at ICLR 2020
Synapses
G
W
2
X1
V1
V2
X2
J/2
V/3
1
Vn
Vm
Xpp Pre-
Post-
1/
1/ 00
neurons
neurons
P=1
1
i
x
y
Figure 1: The crossbar structure. V the applied voltage that correspond the input x, G is the conductance of devices that correspond to the weight W, is the output current, which can indicates the output y according the Ohms law and Kirchhoffs law.
The uncertainty in the neuromorphic computing chips comes from two aspects. The fuzziness is mainly caused by the analog to digital converters (ADCs) and the stochasticity is mainly induced by the NVM devices. According the Kirchhoffs law, the VMM result is indicated the sum- marization of the currents, which an analog output. is necessary to use the ADC to convert the analog currents digital voltages for data transferring. The function of ADC is similar as the activation quantization in the network. The stochasticity of the NVM device is due to the intrinsic physical mechanism Zhao al. (2017); [in et al. (2018). The random movement of the particles in the device makes the conductance varied. The output current will be different even applying the same voltage. The stochasticity of the device is usually simulated as non-ideal factor that makes the network perform worse Prezioso et al. (2015); Ambrogio et al. (2018); Tang et al. (2017). In this worse/rrezioso
work, we proposed a training scheme that utilizes the stochasticity to improve the performance of the neuromorphic computing chips.
METHODOLOGY
2.1 MODELING THE DEVICE STOCHASTICITY
There are several varieties of NVM devices including phase change memories et al. 2012),, fila- mentary migrating oxide devices Wong & Salahuddin (2013). ferroelectric tunnel junction synapses Chanthbouala et al. (2012), and so on. The stochasticity of each types of devices is different due the different intrinsic physical mechanisms. Without loss of generality, used the Gaussian distribution to model the device stochasticity. Although the Gaussian distribution may not fit the stochasticity of each types of devices well, has the basic characteristics, that is, a stable state and the farther away from the stable state, the probability is lower. The mean of the Gaussian distribution the conductance value of the stable state. The variance the Gaussian distribution usually cor- responded to the mean according to experimental results Zhao et al.) (2017). It is also hard to use singular model the relations between the mean and the variance various devices. For simplify and without loss of generality, we assumed that the standard deviation of the distribution is linearly and positively correlated to the mean. Furthermore, the real conductance device is a positive value. Therefore, the conductances sampled from the distribution which are less than the given value Gmin will be cut off to G Gmin where Gmin denotes the minimum conductance that all devices could reach. The model of the devices stochasticity is follow:
2

---

Under review as a conference paper at ICLR 2020
G = max (Gmin G'), G' ~ N (Go, aGb);
where G. denotes the stochastic conductance, G' denotes the value sampled from the Gaussian distribution N (1,, o²) with the a mean of and variance of o², Go denotes the conductance of the device when is in the stable state, and a denotes the level of the devices stochasticity.
2.2 MODELING THE DEVICE FUZZINESS
The device fuzziness is by- -y-oruuuct of the writing process. Writing the conductance of each device in the crossbar is an essential step when using neuromorphic computing chip to realize an Al appli- cation. Before writing, we need to determine the target conductance of each device according to the weights of the neural network. That is what the mapping process do. Besides scaling the weights into the working range of devices conductance [Glow Ghigh]. we used the difference of two devices conductances Goss Gueg to express one weight w, which can be positive or negative. In order to achieve higher energy efficiency, it is better to use lower conductances to express the same weight. Moreover, in order to make full use of the entire conductance working range, the mapping algorithm follow:
(ww] + w) (Ghigh Glow) + Glow
G pos
(2)
2mar |w|
(ww)= w) (Ghigh Glow)
Gneg
+ Giow
(3)
2maa |w|
where |w] denotes the absolute value of singular w, mar |w] denotes the maximum of all the |w], Goos and Gneg are the target conductances that we want to write. However, the conductance cannot be written accurately due to the stochasticity of the device and the fuzziness of the circuit. There is a variation when manipulate the conductance of the device and the measurement of the conductance is not accurate. The conductance value is obtained by dividing the read current by the applied voltage, which is obviously affected by the stochasticity of the device and the precision of the ADC. Therefore, we need model to describe the fuzziness. Without loss of the generality, we also used the Gaussian distribution, which is as follow:
G max (Grains G¹), G' N (Gtarget, B),
(4)
where Gy denotes fuzzy target conductance, G" denotes the value sampled from the Gaussian distri- bution N (u, with the a mean of μl and a variance of o², Grarget denotes the target conductance determined in the mapping process, and | denotes the level of devices fuzziness, which is corre- spond to the level of the devices stochasticity, the precision of the ADC, and the writing strategy. For the sake of simplicity, assumed /3 constant in this work.
2.3 THE UNCERTAINTY ADAPTATION TRAINING SCHEME
If we program a well-trained DNN into a neuromorphic computing chip directly, the uncertainty will make the performance of the DNN worse, such as decrease the classification accuracy (Tang et al. (2017). Fig. 2). However, the decrease of accuracy can be alleviated by using the proposed uncertainty adaptation training scheme (UATS), and in some cases the accuracy will improved.
The core idea of UATS is to tell the uncertainty to the neural networks during training process and guide them to learn how to deal with this situation. The stochasticity model introduced in every feed forward (FF) process. When a weight w participates in the calculation of the FF process, we use a sample of random variable W, to do the calculation instead of w. W, defined as:
MaX |wl
16. =
(Gps Gns)
(5)
Ghigh Glow
3

---

Under review as a conference paper at ICLR 2020
Both Gus and Gri are obtained by the stochasticity model I and the conductances of the stable states Gpo and Go are calculated by and (3) according to w, respectively. Actually, the wg can be approximated as (6 if G' is significantly larger than Gmin-
N (w, aw +c)
(6)
where c = 2n GLow-maz maz Ghigh
Giow
The fuzziness model is introduced during the training process. After every h epochs of training, every weight are replaced by sample of random variable wy, which is defined as:
male [wol
w/
(Gp G..)
Ghigh
Glow
Both Gpf and Gnf obtained by the fuzziness model (.) and the target conductances G ptarget and Gntarget are calculated by ( and 33 according to w, respectively. Actually, the wy can be approximated as 88 if G" is significantly larger than Gmin-
max [
w ~
w.
Ghigh Gtow
(8)
Besides making the network train in uncertain way, we also tried to teach a better way to eval- uate the networks performance when there is uncertainty, that is, how to calculate the loss function. The loss function is not calculated by the output of one FF process, but the average output of FF processes with the same input batch.
3
EXPERIMENTS
We evaluated the ideas of UATS on multiple models and datasets.
3.1 EXPERIMENT RESULTS ON MNIST
We first investigated the effect of the uncertainty without UATS on MNIST dataset LeCun et al.) (1998). Two multilayer perceptron (MLP) models (28 x 28-100-10 and 28 28 18-300-10) and convolutional neural network (CNN) models (LeNet-5) LeCun et al. (9988) are used. There are 60, 000 images in the training set of the MNIST dataset. We randomly selected 50, 000 images for training, and the other 10, 000 images for validation. The 10, 000 images in the test set were used to calculate the test error. Gmain 1μ5, Grow 5μS, Ghigh 50pS were used in the experiments. The models were trained in a normal way and then tested with different level of the uncertainty. The fuzziness model (8) was first used generate the weights that actually written in the chip, and then the stochasticity model was used to simulate the read variation. We ran 20 trials for every model with every uncertainty level. The average test error and the standard deviation were reported.
As shown in Figure 2 without using the UATS, the uncertainty makes the test errors of both MLP and CNN models higher. The higher level of the uncertainty, the higher the test error. The CNN model (LeNet-5) has the best performance without the uncertainty. but it is also the most affected by the uncertainty (t-test, p < 0.01). It is because the average width of LeNet-5 is smaller than two MLP models, as the 'mlp2' model is more robust to the uncertainty than the 'mlp1'.
Then we validated the power of UATS. We used UATS to tune the weight of the pre-trained model and also retrained the models from the initial. k=5.n=5 were used in the fine-tuning experiment. The number of epochs is 25. & = 10, n = 5 were used in the retraining experiment and the number of epochs is 100.
As Beeure3showe UATS can significantly improve the accuracies with the same level of uncertainty in both retraining and fine-tuning experiments. Most of the retraining results is better than the fine- tuning us UATS. When the uncertainty level is small (a = 0.1, B = 0.1), the UATS achieved a comparable results the ideal case.
4

---

Under review as a conference paper at ICLR 2020
30
No uncertainty
(0.1, 0.1)
(0.3, 0.1) (0.5, 0.3)
(0.5, 0.1)
25
(0.5, 0.5)
20
Test (%)
15
10
T
5
0 mlp1
mlp2
LeNet-5
models
Figure 2: The test errors of different models on MNIST with varies level of uncertainty. The 'mlp1' indicates the smaller MLP model, which has 100 hidden units. The 'mlp2' model indicates the bigger MLP model, which has 300 hidden units. The (a, B) indicates the level of uncertainty in the equation and respectively
30
No uncertainty (0.3, 0.1) (0.5, 0.3)
(0.1, 0.1)
(0.5, 0.1)
25
(0.5, 0.5)
20
Test Test error (%)
15
fine-tune
10
fine-tune
retrain
retrain
5
0
mlp1
LeNet-5
models
Figure 3: The test errors of different models on MNIST with varies level of uncertainty using UATS. The 'mlp1' indicates the MLP model has 100 hidden units. The (a. 3) indicates the level of uncer- tainty in the equation I1 and 4 respectively. The results located to the left of the model results without UATS were obtained by retraining and the right were obtained by fine-tuning.

---

Under review as a conference paper at ICLR 2020
10
Ideal case
UATS
9
Test error rate (%)
8
6
1
3
8
10 15
20
Figure 4: The test error rates of ResNet-44 on CIFAR-10 using UATS with the uncertainty level of 0.1 and / The ideal case indicates the error of ResNet-44 model without uncertainty. The n indicates how many FF processes are summarized to calculate the loss function.
3.2 EXPERIMENT RESULTS ON CIFAR-10
We also validated the power of UATS on CIFAR 10 dataset Krizhevsky & Hinton (2009) with a more complicated DNN model ResNet-44 He et al. (2066). All the training setting
the previous work He et al. (2016) except we used the UATS from the beginning. a = 0.1, 1, f = 0.1, k 10 were used in these experiments. The results shows that UATS can achieve lower error rate than the ideal cases with proper typer-parameete the neural network has more layers. It can be seen as a regularization methods that make the training of DNN easier.
(Figure 4 The UATS performs better when
4 DISCUSSION
The uncertainty is very important in the intelligent system. The Bayesian network a very useful method to build uncertain neural network. However, usually requires that the distribution of each weight is controllable. This is hard to be realized by the neuromorphic computing chip due to the distribution is determined by the devices. Although there may be methods to manipulate the conductance distribution of the device, it is not as convenient as UATS, which has no additional circuit required.
We have tried a series of distributions to model the device stochasticity besides the Gaussian distri- bution, such the Laplacian distribution, the uniform distribution, and the asymmetrical distribu- tions, such as the lognormal distribution, the asymmetric Laplacian distribution, and the Bernoulli distribution for devices that have two stable states the random telegraph noise (RTN). Although the modeled behavior of the device from different distributions is significantly different, the perfor- mance of network using each type of distribution with the same mean and variance similar. because the VMM transform the individual distribution of each device to summarization of large number random parameters.p
The computation intension of UATS may be little strong due to the requirement of large number of random numbers. There are some methods to reduce the requirement of random numbers. Such samples the weight for every input every batch instead of the every VMM and using the uncertainty model of VMM results instead the weights. The simulation speed can accelerated and achieve similar results.

---

Under review as a conference paper at ICLR 2020
REFERENCES
Stefano Ambrogio, Pritish Narayanan, Hsinyu Tsai, Robert M Shelby, Irem Boybat, Carmelo Nol- fo, Severin Sidler, Massimo Giordano, Martina Bodini, Nathan CP Farinha, et al. Equivalent- accuracy accelerated neural-network training using analogue memory. Nature, 558(7708):60,, 2018.
Ron Banner, Itay Hubara, Elad Hoffer, and Daniel Soudry. Scalable methods for 8-bit training of neural networks. In Advances in Neural Information Processing Systems. pp. 5145-5153, 2018.
Irem Boybat, Manuel Le Gallo, SR Nandakumar, Timoleon Moraitis, Thomas Parnell, Tomas Tuma, Bipin Rajendran, Yusuf Leblebici, Abu Sebastian, and Evangelos Eleftheriou. Neuromorphic computing with multi-memristive synapses. Nature communications, 91):2511, 2018.
André Chanthbouala, Vincent Garcia, Ryan O Cherifi, Karim Bouzehouane, Stéphane Fusil, Xavier Moya, Stéphane Xavier, Hiroyuki Yamada, Cyrile Deranlot, Neil D Mathur, et al. A ferroclectric memristor. Nature materials, 11(10):860, 2012.
Elliot J Fuller, Scott T Keene, Armantas Melianas. Zhongrui Wang, Sapan Agarwal, Yiyang Li, Yaakov Tuchman, Conrad D James, Matthew J Marinella, J Joshua Yang, et al. Parallel program- ming of an ionic floating-gate memory array for scalable neuromorphic computing. Science, 364 (6440):570-577) 2019.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE conference computer vision and pattern recognition, pp- 770-778, 2016.
Alex Krizhevsky and Geoffrey Hinton. Learning multiple layers of features from tiny images. Tech- nical report, Citeseer, 2009.
Yann LeCun, Léon Bottou, Yoshua Bengio, Patrick Haffner, et al. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(1 (((11))227--2324 1998.
Yudeng Lin, Huaqiang Wu, Bin Gao, Peng Yao, Wei Wu, Qingtian Zhang, Xiang Zhang, Xinyi Li, Fuhai Li, Jiwu Lu, et al. Demonstration generative adversarial network by intrinsic random noises of analog rram devices. In 2018 IEEE International Electron Devices Meeting (IEDM), pp. 3-4. IEEE, 2018
Mirko Prezioso, Farnood Merrikh- Bayat, BD Hoskins, Gina C Adam, Konstantin Likharev, and Dmitri B Strukov. Training and operation of an integrated neuromorphic network based on metal- oxide memristors. Nature, (21(7550))61, 2015.
Manan Suri, Olivier Bichler, Damien Querlioz. Boubacar Traoré, Olga Cueto, Luca Perniola, Veronique Sousa, Dominique Vuillaume, Christian Gamrat, and Barbara DeSalvo. Physical as- pects of low power synapses based on phase change memory devices. Journal of Applied Physics, 112(5):054904, 2012.
Tianqi Tang, Lixue Xia, Boxun Li, Yu Wang, and Huazhong Yang. Binary convolutional neural network rram. In 2017 22nd Asia and South Pacific Design Automation Conference (ASP- DAC), pp. 782-787. IEEE, 2017.
H-S Philip Wong and Sayeef Salahuddin. Memory leads the way to better computing. Nature nanotechnology. 10(3):191, 2015.
Shuang Wu, Guoqi Li, Feng Chen, and Luping Shi. Training and inference with integers in deep neural networks. arXiv preprint arXiv: 04680, 2018.
Peng Yao, Huaqiang Wu, Bin Gao, Sukru Bure Eryilmaz, Xueyao Huang, Wengiang Zhang, Qing- tian Zhang, Ning Deng, Luping Shi, H-S Philip Wong, et al. Face classification using electronic synapses. Nature communications, 8:15199, 2017.
Meiran Zhao, Huaqiang Wu, Bin Gao, Qingtian Zhang, Wei Wu, Shan Wang, Yue Xi, Dong Wu, Ning Deng, Shimeng Yu, et al. Investigation of statistical retention of filamentary analog rram for neuromophic computing. In 2017 IEEE International Electron Devices Meeting (IEDM), pp. 39-4. IEEE, 2017.
7


Reviews:
[{"review_id": "rJlZhT3p9B", "reviewer": "AnonReviewer1", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "The paper is hard to read and there are syntactic errors as well as  issues with the grammar. The paper is not at all well written and the contributions very questionable. The paper lacks a conclusion where the main contribution are mentioned and backup. Figures and illustrations are not the best.  From my point of view, this paper is a clear rejection. \n\nI would encourage the authors to be explicit about their contribution and the intellectual products of this work. In addition, I would encourage them the identify comparable methods if any and explicitly enumerate the advantages of their approach against prior work/methods. ", "extra_scores": {"experience_assessment": "I have read many papers in this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory.", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper at least twice and used my best judgement in assessing the paper."}, "extra_text": {}}, {"review_id": "S1lkFcwCFB", "reviewer": "AnonReviewer2", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "The authors propose an \"uncertainty adaptation training scheme\" (UATS) that describes the uncertainty of the neural network in the training process. The authors present experimental results on MNIST and CIFAR-10 demonstrating the utility of their approach. \n\nOverall the quality of the presentation and the exposition in the paper is poor. I am also not convinced about the novelty and importance of this work.  Calibrating neural network uncertainty has been explored quite thoroughly in the bayesian neural nets community - I do not see comparisons with existing work on this subject or justification/explanation of why this work is better than other prior work on this topic. ", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_thoroughness_in_paper_reading": "I made a quick assessment of this paper.", "review_assessment:_checking_correctness_of_experiments": "I did not assess the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I assessed the sensibility of the derivations and theory."}, "extra_text": {}}, {"review_id": "Bylo-7Sy9S", "reviewer": "AnonReviewer3", "summary": "", "questions": "", "limitations": "", "rating": 6, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper proposes a way of training neural nets on analog-circuit based chips, which are cursed with uncertainties. Such uncertainties are deeply rooted in the way neural nets are implemented on such chips. Take [c = a x b] as an example. In order to perform this operation, one can set the electric potential to a and the conductance to b and c will be the output current. The problem here is that we cannot set the conductance precisely, which often encodes the weights of a neural net. This implies we cannot precisely program a neural net into these chips. This paper proposes to train a neural net with the presence of such noise, by treating weight as a random variable during training. The experimental results based on simulation suggest this is a much better strategy than programming a neural net into chips imprecisely. \n\nOverall, this paper touches upon an important research problem towards running neural nets on neuromorphic computing chips, which is how to deal with the underlying uncertainties. The proposed algorithm is reasonable and the experimental results look encouraging. However, I would like to ask a few clarification questions. Given authors’ response, I will be willing to adjust my score. \n\n(1) For the baseline, have you tried randomly jittering the network weights after every training iteration in a way that is “blind” to the source of the uncertainties (i.e. conductance)? I would like to understand in what degree modeling the noise helps. If this works out, it implies, (1) we do not have to pay much cost in sampling; (2) there is a simpler way to train neural nets that behave robust when deploying onto neuromorphic computing chips despite the uncertainties. \n\n(2) Is there any intuition behind replacing every weight after every k epochs with new samples (Sec. 2.3)?\n\n(3) The paper does not mention the overhead of estimating the loss with n feed-forward passes dramatically slows the training process. I assume it will slow down training by n times? \n\n(4) There is a comparison between retraining and fine-tuning. Despite being less accurate, is fine-tuning faster to train in terms of the actual training time?\n\n(5) Here I quote the paper “The UATS performs better when the neural network has more layers” (Sec. 3.2). I cannot find an empirical comparison that supports this claim. \n", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper thoroughly.", "review_assessment:_checking_correctness_of_experiments": "I carefully checked the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "I carefully checked the derivations and theory."}, "extra_text": {}}]

Author rebuttal:

Meta-review: The paper is proposing uncertainty of the NN’s in the training process on analog-circuits based chips. As one reviewer emphasized, the paper addresses important and unique research problem to run NN on chips. Unfortunately, a few issues are raised by reviewers including presentation, novelly and experiments. This might be partially be mitigated by 1) writing motivation/intro in most lay person possible way 2) give easy contrast to normal NN (on computers) to emphasize the unique and interesting challenges in this setting. We encourage authors to take a few cycles of edition, and hope this paper to see the light soon.

Decision: Reject