<figure><img src="image_1.png" /></figure>

HAL
open science

# Using Shallow Neural Network Fitting Technique to Improve Calibration Accuracy of Modeless Robots

Ying Bai, Dali Wang

► To cite this version:

Ying Bai, Dali Wang. Using Shallow Neural Network Fitting Technique to Improve Calibration Accuracy of Modeless Robots. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.623-631, 10.1007/978-3-030-19823-7_52 hal-02331343

HAL Id: hal-02331343

https://inria.hal.science/hal-02331343

Submitted on 24 Oct 2019

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Using Shallow Neural Network Fitting Technique to Improve Calibration Accuracy of Modeless Robots

Ying Bai¹ and Dali Wang²

¹ Johnson C. Smith University, Charlotte NC 28216, USA

² Christopher Newport University, Newport News, VA 23606
ybai@jcsu.edu, dwang@cnu.edu

**Abstract.** This paper describes a technique for the position error estimations and compensations of the modeless robots and manipulators calibration process based on a shallow neural network fitting function method. Unlike traditional model-based robots calibrations, the modeless robots calibrations do not need to perform any modeling and identification processes. Only two processes, measurements and compensations, are necessary for this kind of robots calibrations. By using the shallow neural network fitting technique, the accuracy of the position error compensation can be greatly improved, which is confirmed by the simulation results given in this paper. Also the comparisons among the popular traditional interpolation methods, such as bilinear and fuzzy interpolations, and this shallow neural network technique, are made via simulation studies. The simulation results show that more accurate compensation result can be achieved using the shallow neural network fitting technique compared with the bilinear and fuzzy interpolation methods.

**Keywords:** Neural Networks, Modeless Robots, Robots Calibrations.

## 1 Introduction

The prerequisite requirement of the robotic modeless calibration is the successful self-calibration of the camera [1, 2] or other measurement device, such as laser tracking system [3]. Both internal and external parameters of the camera need to be calibrated accurately [4, 5]. Then the modeless robot calibration is divided into two steps [6].

The first step is to measure the position errors for all grid points on a standard calibration board, which is installed on the robot's workspace. A calibrated camera is used to find 4 neighboring position errors. This process can be considered as a measurement process, which is shown in Fig 1.

At each grid point, a calibrated camera is used to check the position errors of the end-effector of the robot. In Fig 1, the desired position of the grid point 0 is $(x_0, y_0)$, and the actual position of the robot end-effector is $(x'_0, y'_0)$. The position errors for this grid point are $e_x = x - x'_0$ and $e_y = y - y'_0$. The robot will be moved to all these grid points on the standard calibration board, and all position errors
<figure><img src="image_3.png" /><figcaption>Fig. 1. Setup of the Modeless Calibration.</figcaption></figure>

on these grid points will be measured and stored in the memory for future usage.

In the second step, the robot's end-effector is moved to a target position that is located in the range of the workspace. The target position error could be found by an interpolation technique using the stored 4-neighboring grid position errors around the target position, which were obtained from the first step. Finally, the target position could be compensated with the interpolation results to obtain more accurate positions.

J. Triantafilis and D. Suzana et al reported approaches of using fuzzy interpolation methods to estimate the soil layer and geographical distributions for GIS database [7, 8]. F. Song et al described a fuzzy logic methodology for 4-dimensional (4D) systems with optimal global performance using enhanced cell state space [9]. The most popular interpolation techniques applied in the position compensations of the modeless robotic calibration include the bilinear interpolation and fuzzy interpolation methods; both methods can achieve satisfactory interpolation results for general calibration process [2, 10]. The bilinear interpolation technique assumes that the error of the target position is located on the surface that is constructed by the position errors of 4-neighboring grid points around the target position [9]. The fuzzy interpolation method assumes that the workspace can be divided into a group of smaller cells, and the target positions can be obtained by interpolating position errors on 4 neighboring grid points in cells via fuzzy inference system [10]. Consequently, the target point's errors are estimated according to the equations of the error surface or fuzzy inference techniques. Since the actual position errors are randomly distributed, and it is impossible to pinpoint a position on the error surface at any given moment, the traditional interpolation technique is unable to provide an accurate estimation of the position errors. Fuzzy error interpolation technique utilizes the fuzzy inference system to estimate the position errors, which is consistent with the random distributed nature of position errors. The position errors can be considered as a fuzzy set at any given moment of the time. The fuzzification process takes into account of a range of error rather only a crisp error value. Therefore, the fuzzy error interpolation technique has the fundamentals to improve error estimation results.

However, more and more robots calibration techniques developed by using artificial neural network (ANN) are reported in recent years [11-18].
This study describes a technique for the position error estimations and com-
pensations of the modeless robots and manipulators calibration process based on
a shallow neural network (SNN) fitting function method. A feedforward neural
network or called shallow neural network fitting technique is utilized to estimate
the position errors based on errors on the 4 neighboring grind points. With this
method, the calibration accuracy can be significantly improved and the calibra-
tion process can also be greatly simplified. A comparison among three different
error interpolation methods, bilinear, fuzzy interpolation and SNN, are per-
formed, and the simulation results indicate that the SNN method outperforms the
other methods.

This paper is organized in 4 sections. After this introduction section, the prin-
ciple of the fuzzy interpolation technique is provided in sections 2. A simulation
is given in section 3 to illustrate the effectiveness of the SNN technique. Section
4 presents the conclusion.

## 2. Fuzzy Error Interpolation Method

2.1 Overview of the Fuzzy Interpolation System

Fig 2 shows the definition of the fuzzy error interpolation inference system.

Each square that is defined by 4 grid points is called a cell; and each cell is divid-
ed into 4 equal smaller cells, which are NW, NE, SW and SE, respectively (Fig 2a).
The position error at each grid point is defined as P₁, P₂, P₃ and P₄.

For the fuzzy inference system, we apply the fuzzy error interpolation method in

<figure><img src="image_4.png" /><figcaption>Fig. 2. Definition of the Fuzzy Error Interpolation System</figcaption></figure>

two dimensions separately, so the inputs to the fuzzy inference system are eₓ and eᵧ
and the outputs are eeₓ and eeᵧ (Fig 2b). The control rules are shown in Fig 2c, and
will be discussed following the discussion of membership functions.

2.2 Membership Functions

In this study, the distance between two neighboring grid points on the standard cali-
bration board is 20 mm in both x and y directions, which is a standard value for a mid-
size calibration workspace. The calibration board includes a total of 20 by 20 cells,
which is equivalent to a 400 by 400 mm space.
<figure><img src="image_5.png" /><figcaption>Fig. 3. Input and output membership functions.</figcaption></figure>

The input membership functions for both x and y directions and the predefined output membership functions are shown in Fig 3. The predefined output membership functions are used as a default one, and the final output membership function will be obtained by shifting the default one by the actual error values on the grid points.

The gaussian-bell waveforms are selected as the shape of the membership func-
tions for both inputs (Fig 3a) in x and y directions. The ranges of inputs are between –
10 mm and 10 mm (20 mm intervals). H. Zhuang and X. Wu reported a histogram
method to estimate the optimal membership function distribution [19]. However in
our case, a gaussian-bell shape is selected due to the fact that most errors in real world
match this distribution. We use W and E to represent the location of inputs in x direc-
tion, N and S to represent the location of inputs in y direction.

Fig 3b shows an example of the output membership functions, which are related to the simulated random errors at neighboring grid points. Each P xi and P yi correspond to the position error at the ith grid point in x and y directions, respectively. During the design stage, all output membership functions are initialized to a gaussian waveform with a mean of 0 and a range between –0.5 and 0.5 mm, which is a typical error range for this workspace in robotic calibration (Fig 3c). These output membership functions will be determined based on the errors of the neighboring grid points around the target in the workspace as mentioned above. For example, during the compensation process if the input position in the x direction is in the NW area of a cell, the associated output membership function should be modified based on the position error in the NW grid point P1. This modification is equivalent to shifting the P x1 Gaussian waveform (Fig 3b) and allowing the center of that waveform to be located at x0 = the position error value of the P1 in the x direction. A similar modification should be performed for the position error in the y direction. It can be seen from Fig 3b that for the position com- pensation process, the performance loss would be significant if the default member- ship function is utilized, which is shown in Fig 3c.

2.3 Control Rules

The control rules shown in Fig 2c can be interpreted as follows after the output
membership functions are determined:

* If $e_x$ is W and $e_y$ is N, $ee_x$ is $P_{x1}$ and $ee_y$ is $P_{y1}$ (NW).

* If $e_x$ is W and $e_y$ is S, $ee_x$ is $P_{x3}$ and $ee_y$ is $P_{y3}$ (SW).

* If $e_x$ is E and $e_y$ is N, $ee_x$ is $P_{x2}$ and $ee_y$ is $P_{y2}$ (NE).

* If $e_x$ is E and $e_y$ is S, $ee_x$ is $P_{x4}$ and $ee_y$ is $P_{y4}$ (SE). (1)

Each $P_i$ should be considered as a combination of two error components, $P_{xi}$ and $P_{yi}$, which are corresponding to errors in both x and y directions. The error on NW grid point should take more weight if the target position (input) is located inside the NW area on a cell. Similar conclusion can be derived for errors on SW, NE and SE grid points.

## 2.4 Fuzzy Inference System

The fuzzy inference system implemented in this study is an on-line one. This means that output of the fuzzy system is not obtained from the pre-defined lookup table, but from a real time fuzzy inference calculation that utilizes the pre-defined input membership functions and the real time position errors. The input error variances can be expressed as a label set L(E), where E is a linguistic input variable:

$$L(E) = \{\text{NW, NE, SW, SE}\} \qquad (2)$$

Assume that $u_i$ is the membership function, $U_i$ the universe of discourse and $m$ the number of contributions, the traditional output of the fuzzy inference system can be represented as:

$$u = \frac{\sum_{i=1}^{m} (u_i \times U_i)}{\sum_{i=1}^{m} u_i} \qquad (3)$$

where $u$ is the current crisp output of the fuzzy inference system. Equation (3) is obtained by using the Center-Of-Gravity method (COG). In this study, both $u_i$ and $U_i$ in the output membership functions are randomly distributed variables and the actual values of these variables depend upon the position errors of four neighboring grid points around the target position. These relationships can be expressed as:

$$u_i = F_i(P_1, P_2, P_3, P_4) \qquad (4)$$

$$U_i = Q_i(P_1, P_2, P_3, P_4) \qquad (5)$$

where $F_i$ and $Q_i$ are randomly distributed functions. Substituting (4) and (5) into (3), we obtain:
$$u = \frac{\sum_{i=1}^{m} F_i(P_1, P_2, P_3, P_4) \times Q_i(P_1, P_2, P_3, P_4)}{\sum_{i=1}^{m} F_i(P_1, P_2, P_3, P_4)} \qquad (6)$$

In (6), both $F_i$ and $Q_i$ will not be determined until the fuzzy error interpolation technique is applied in an actual compensation process, which means that this fuzzy inference system is an on-line process.

### 3. Simulation Results

Extensive simulation study has been performed to illustrate the effectiveness of the proposed SNN technique in comparison to bilinear and fuzzy interpolation methods. The uniform distributed random error is used for the simulation study due to its popularity. We estimate the valid workspace of the robot to be 400 x 400 mm. We choose the size of each cell to be 20 x 20 mm after taking into consideration the repeatability of the robot. Consequently, the workspace consists of 20 cells in each direction. In our simulation, we simulate actual position based on in this format:

$$P_a = (x_i, y_i) + A * rand(x, y) \qquad (7)$$

where $(x_i, y_i)$ is the nominal position, and $A$ is the amplitude of the uniformly distributed noise in the interval (-0.5, 0.5) for the random component.

We implemented MATLAB® Neural Network Toolbox® to perform these simulation studies. Fig 4 shows the training, validation and testing process of this fitting SNN. The Levenberg-Marquardt algorithm is used for this training.

After the first epoch training process, the mean square error (MSE) is reduced below 0.01, and the best validation result is in the first epoch (0.0096). The testing result is also good with all errors being about 0.01. Fig. 5 shows a comparisons in mean error, maximum error and STD values among bilinear, fuzzy interpolation and SNN technique in the histograms.

<figure><img src="image_6.png" /><figcaption>Fig. 4. Performance of the used SNN (training, validation and testing).</figcaption></figure>
It can be seen that both mean errors and maximum errors of SNN are much smaller than those of fuzzy interpolation and bilinear methods. For the uniform distributed error, the mean error of the SNN method is approximately 60% to 70% smaller compared with those of bilinear and fuzzy interpolation methods. The maximum errors of the SNN technique is about 40% to 50% smaller than those of bilinear and fuzzy interpolation techniques.

The simulated results show the effectiveness of the SNN fitting method in reducing the position errors in the modeless robot compensation process.

<figure><img src="image_7.png" /><figcaption>Fig. 5. Comparison among bilinear, fuzzy interpolation and SNN.</figcaption></figure>

## 4. Conclusion and Summary

A shallow neural network fitting method is presented in this paper. The compensated position errors in a modeless robot calibration can be greatly reduced by the proposed technique. Simulation results demonstrate the effectiveness of the proposed shallow neural network (SNN) fitting method. One typical error model, uniform distributed error, is utilized for comparison and simulation study purpose. This SNN technique is ideal for the modeless robot position compensation, especially the high accuracy (<10 µm) robot calibration process.

## References

1. B. W. Mooring, Z. S. Roth and M. R. Driels, *Fundamentals of Manipulator Calibration*, John Wiley & Sons, Inc. 1991.

2. M. A. Penna, “Camera Calibration: A Quick and Easy Way to Determine the Scale Factor”, *IEEE Trans. Pattern Anal. Machine Intell.* 13, 1991, pp. 1240-1245.

3. Ying Bai, *Design and Implementation of a Control System for a Laser Tracking Measurement System*, Ph.D. Dissertation, Florida Atlantic University, May, 2000.

4. J. Weng et al, “Camera Calibration with Distortion Models and Accuracy Evaluation”, *IEEE Trans, Pattern Anal. Machine Intell.* 14, 1992, pp. 965-980.

5. F. Du and M. Brady, “Self Calibration of the Intrinsic Parameters of Cameras for Active Vision Systems”, In *Proceedings of IEEE Conference on Computer Vision and Pattern Recognition*, New York, NY June, 1993, pp. 477-482.
6. Hanqi Zhuang and Z. S. Roth, *Camera-Aided Robot Calibration*, CRC Press, Inc. 1996.

7. J. Triantafilis, W. T. Ward, I.O.A Odeh and A.B. McBratney, "Creation and Interpolation of Continuous Soil Layer Classes in the Lower Namoi Valley", *Soil Science Society of America Journal*, Mar/Apr 2001, Vol. 65, Issue 2, pp. 403-414.

8. D. Suzana, J.D. Marceau and M. Claude, "Space, time, and dynamics modeling in historical GIS databases: A Fuzzy Logic Approach", *Environment & Planning B: Planning & Design*, Jul 2001, Vol. 28 Issue 4, pp. 545-563.

9. F. Song, S. M. Smith, and C. G. Rizk, "A Fuzzy Logic Controller Design Methodology for 4D System with Optimal Global Performance Using Enhanced Cell State Space Based Best Estimate Directed Search Method", *IEEE Int. Conf. On Systems, Man and Cybernetics*, 1999.

10. Y. Bai, "On the Comparison of Model-Based and Modeless Robotic Calibration Based on a Fuzzy Interpolation Method", *International Journal of Advanced Manufacturing Technology*, Springer, Vol.31, No.11-12, February 2007, pp.1243-1250.

11. W. L. Xu, K. H. Wurst, T. Watanabe and S. Q. Yang, "Calibrating a modular robotic joint using neural network approach," *Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94)*, Orlando, FL, USA, 1994, pp. 2720a-2725.

12. H. Wu, W. Tizzano, T. T. Andersen, N. A. Andersen, O. Ravn, Hand-Eye Calibration and Inverse Kinematics of Robot Arm Using Neural Network, *Robot Intelligence Technology and Applications* 2, 2014, pp. 581-591.

13. GordonWells, ChristopheVenaille and CarneTorras, "Vision-based robot positioning using neural networks", *Image and Vision Computing*, Vol 14, Issue 10, December 1996, pp. 715-732.

14. H. N. Nguyen, J. Zhou and H. J. Kang, "A calibration method for enhancing robot accuracy through integration of an extended Kalman filter algorithm and an artificial neural network", *Neurocomputing*, Vol 151, Part 3, 3 March 2015, pp. 996-1005.

15. W. Xu, L. Dongsheng and W. Mingming, "Complete calibration of industrial robot with limited parameters and neural network", *2016 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS)*, Dec. 17-20, 2016, Tokyo, Japan, pp. 103-108.

16. R. Zouaoui and H. Mekki, "2D visual servoing of wheeled mobile robot by neural networks," *2013 International Conference on Individual and Collective Behaviors in Robotics (ICBR)*, Sousse, Tunisia, 2013, pp. 130-133.

17. P. Y. Tao and G. Yang, "Calibration of industry robots with consideration of loading effects using Product-Of-Exponential (POE) and Gaussian Process (GP)", *2016 IEEE International Conference on Robotics and Automation (ICRA)*, May 26-30, 2016, Seattle, WA, USA, pp. 4380-4385.

18. R. C. Luo, H. Wang and M. Kuo, "Low cost solution for calibration in absolute accuracy of an industrial robot for iCPS applications," *2018 IEEE Industrial Cyber-Physical Systems (ICPS)*, St. Petersburg, Russia, May 15-18, 2018, pp. 428-433.

19. H. Zhuang and Xiaomin Wu, "Membership Function Modification of Fuzzy Logic Controllers with Histogram Equalization", *IEEE Trans. On System, Man, and Cybernetics – Part B: Cybernetics*, Vol. 31, No. 1, Feb. 2001.

20. S. V. Kartalopoulos, *Understanding Neural Networks and Fuzzy Logic*, IEEE Press, 1996.

21. N. Gulley and J. S. Roger. Jang, *Fuzzy Logic Toolbox User Guide*, The MathWorks, Inc. 1995.