# Strategies for Dealing with Problems in Robotised Unscrewing Operations

Jun Huang, Duc Truong Pham, Ruiya Li, Kaiwen Jiang, Dalong Lyu, Chunqian Ji

► To cite this version:

Jun Huang, Duc Truong Pham, Ruiya Li, Kaiwen Jiang, Dalong Lyu, et al. Strategies for Dealing with Problems in Robotised Unscrewing Operations. 9th International Precision Assembly Seminar (IPAS), Dec 2020, Held virtually, Unknown Region. pp.93-107, 10.1007/978-3-030-72632-4_7. hal-03520389

HAL Id: hal-03520389

https://inria.hal.science/hal-03520389

Submitted on 11 Jan 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Strategies for Dealing with Problems in Robotised Unscrewing Operations

Jun Huang [0000-0001-9096-6236], Duc Truong Pham [0000-0003-3148-2404], Ruiya Li [0000-0002-4134-7604], Kaiwen Jiang [0000-0002-9644-0902], Dalong Lyu and Chunqian Ji [0000-0002-1471-8406]

Department of Mechanical Engineering, School of Engineering, University of Birmingham,
Birmingham B15 2TT, UK

j.huang.1@bham.ac.uk (J. Huang); d.t.pham@bham.ac.uk (D.T. Pham); rx1721@student.bham.ac.uk (R. Li);
xj797@student.bham.ac.uk (K. Jiang); dx1887@student.bham.ac.uk (D. Lyu); C.Ji@bham.ac.uk (C. Ji)

**Abstract.** Disassembly is the first step in a remanufacturing process chain with unscrewing being usually the most frequent task. In previously reported research in the authors' laboratory, a new method has been developed for using robots to unfasten screws. Uncertainties and variability in the physical condition of screws induced by dirt, rust, or mechanical damage pose difficulties for such robotised unscrewing systems. There are three common failure modes: screwdriver missing screw head, screwdriver slipping on screw head and screw too tight to remove. This paper presents strategies to handle these failure modes, making the developed robotised method more robust and reliable. The strategies include conducting a second search and second unfastening trial as well as involving collaboration with a human operator. Tests were carried out to validate the proposed strategies. The results show that the strategies could deal with the failure modes, enabling 100% successful operation.

**Keywords:** Remanufacturing, Robotic Disassembly, Automated Unscrewing.

## 1 Introduction

Remanufacturing is an increasingly significant part of a circular economy, delivering economic, environmental and social benefits [1,2]. In remanufacturing, disassembly of end-of-life (EoL) products is a critical first step [3]. Disassembly is labour intensive and skill intensive and disassembly costs usually represent a substantial proportion of the cost of the remanufactured product. Robotic technology has been proposed for disassembly [4,5], with a range of approaches having been explored for robotic disassembly applications [6-8]. For example, robot-assisted disassembly was used for dismantling electronic products as early as 1994 [9]. Robots have many advantages including high accuracy, speed and repeatability and the ability to handle repetitive and tedious disassembly operations such as unscrewing [10]. Screws are very common mechanical fasteners as they can be dismantled non-destructively for future maintenance, repair, remanufacturing and recycling [11]. However, unscrewing is difficult to be automated.
This is due to uncertainties and variability in the location and the physical condition of
screws in EoL products caused by corrosion, contaminants (grease and dirt), defor-
mation and other forms of mechanical damage [12].

A robotic system was prototyped for automated screw removal from e-waste prod-
ucts such as laptops [13]. Computer vision and force sensing were employed to locate
screws automatically. An accelerometer mounted on a screwdriver was used to detect
when a screw had been completely detached from a mating threaded hole. A screw
removal success rate of 96.5% was achieved, which was affected by the lighting con-
ditions of the computer vision system. A robotic workstation fitted with Kinect cameras
was developed for autonomous disassembly of electric vehicle motors [14]. A detection
algorithm was proposed to locate the position and determine the type of the screws to
be removed by the robot. A hybrid workstation with a collaborative robot was presented
for performing unscrewing in EoL electric vehicles (EV) batteries which contained sub-
stances hazardous to human health [15,16]. A bit holder was designed to allow the robot
to change different socket wrench bits. An electric screwdriver and a camera-based
location detection system were also proposed for automatic unscrewing tasks [17]. A
spiral search strategy was designed for a robot to locate and engage a screw head, en-
suring that no position was scanned twice [18]. In addition, a robotised screwing and
unscrewing technique was developed for dismantling electronic devices [19]. A robot
was released by Apple in 2016 for removing screws on EoL iPhones to disassemble
them for remanufacturing and recycling to reduce e-waste [20].

The above research has mainly focused on methods and devices for automated un-
screwing. Few studies have considered the uncertain physical conditions of screws in
EoL products. Four common conditions have been identified in automated unscrewing
operations [21]. They include three failure modes: (1) screwdriver missing screw head,
(2) screwdriver slipping on screw head and (3) screw too tight to remove. In previously
reported research in the authors' laboratory, a new method was developed for using a
collaborative robot to unfasten screws [22]. This paper presents strategies for handling
the above failure modes in robotised unscrewing operations, making the developed
method more robust and reliable.

The remainder of this paper is organised as follows. Section 2 briefly introduces a human-robot collaborative disassembly cell built in the authors' laboratory and the automated unscrewing method implemented in that cell. Section 3 describes the proposed failure handling strategies. Section 4 reports on tests carried out to validate the proposed strategies. Section 5 concludes the paper and provides suggestions for future work.

2 Automated Unscrewing Method

2.1 A Human-Robot Collaborative Disassembly Cell

Fig. 1 shows a human-robot collaborative disassembly cell for unfastening screws built in the authors’ laboratory. The cell mainly composes a collaborative robot (KUKA LBR iiwa 14 R800), an electrical nutrunner (torque spindle, Georges Renault SAS MC51-10) and a geared offset attachment (LUBBERING basic line 4-22-15). The nutrunner was installed on the flange of robot. A spindle controller (Georges Renault SAS, 8216-
CVIC H-4) was used to control and programme the nutrunner. The geared offset attachment mounted on the nutrunner could unfasten Hexagonal head bolts with flanges, as shown in Fig. 1. When connected, the robot could trigger and stop the nutrunner.

The robot has active compliance control using a Cartesian impedance controller. This facilitates human-robot collaboration for complex disassembly operations in the cell. A human operator can work alongside the robot directly without safety guarding, providing the cell with higher flexibility and adaptability and thus a better ability to handle disassembly uncertainties.

<figure><img src="image_2.png" /><figcaption>Fig. 1. A robotic cell for automated unscrewing.</figcaption></figure>

## 2.2 Automated Unscrewing Process

Fig. 2 shows the developed automated unscrewing process, which involves four stages: approach, search and engage, unfasten, and assess and leave. The control strategies of torque, position and active compliance are adopted during the process. The corresponding control method of each stage is briefly introduced below. More details about the automated unscrewing method could be found in [22].

1. Approach. The robot with a nutrunner moves to an estimated position above screw head. The nutrunner rotates in the fastening direction at a low speed to ensure that any loose screw will be tightened up before unfastening, making the following stage easier to control. Then, the robot turns on its compliant mode. The compliant behaviour of the robot is achieved by impedance control, which is modelled on a virtual
spring-damper system with configurable stiffness and damping [23]. Thanks to com-
pliance, the robot can avoid hard collisions with humans operating in its workspace.

<figure><img src="image_3.png" /><figcaption>Fig. 2. Automated unscrewing process.</figcaption></figure>

2). Search and engage. Due to factors such as the uncertain mechanical condition of screws and the limited accuracy of robot motion, there is a position error between the hexagonal hole in the geared offset attachment and the hexagonal screw head. A spiral motion is designed for the robot to search for and engage the screw head. The equations of the spiral path employed are [22]:

$$
\begin{equation}
\begin{cases}
x = \frac{f_s}{\pi} \sqrt{\frac{2\pi n_s}{5}} t \cos\left(\sqrt{\frac{2\pi n_s}{5}} t\right) \\
y = \frac{f_s}{\pi} \sqrt{\frac{2\pi n_s}{5}} t \sin\left(\sqrt{\frac{2\pi n_s}{5}} t\right)
\end{cases}
\tag{1}
\end{equation}
$$

where x and y are the coordinates along the X and Y axes, respectively. f_s is the size
of the hexagonal screw head chamfer. n_s is the rotating speed of the tool and t is search
time.
3). Unfasten. Once the tool and screw head have engaged, the robot stops its search motion and the nutrunner rotates in the unfastening direction. Under the compliant mode, the robot can follow the movement of the screw during run-out.

4). Assess and leave. When the screw has been separated from the screw hole, the screw oscillates slightly along its axis due to the chamfer at the end of the screw threads and continuous rotation of the tool. The position information of the robot along the direction of the screw axis is employed to determine when the screw is completely out. Finally, the separated screw is moved away.

# 3 Mitigating Strategies for Failure Modes

## 3.1 Strategies for Dealing with Failure Modes

Three common failure modes are identified in automated unscrewing operations, which are: (1) screwdriver missing screw head, (2) screwdriver slipping on screw head and (3) screw too tight to remove [21]. Fig. 3 illustrates the flow chart of the proposed strategies to deal with these problems.

<figure><img src="image_4.png" /><figcaption>Fig. 3. The flow chart of the proposed strategies.</figcaption></figure>

If the position error were without the spiral search range, the tool would miss the screw head in its search motion (failure mode 1). Conducting a second spiral search along a path with a larger range and higher density is proposed as a strategy to handle this problem, as shown in Fig. 3. If the second search succeeds, subsequent unscrewing steps will proceed. Otherwise, human-robot collaboration will be implemented to cope
with this screw in the human-robot collaborative disassembly cell. The robot will leave its search position and call a human operator to come to dismantle the screw.

Due to rust, corrosion or mechanical damage to a screw, the tool may slip on the screw head (failure mode 2). It is difficult for the robot to disassemble screws in such a situation. Once the situation is detected by the robot, the operator will again be called to handle it. If a screw is too tightly fixed, the tool is unable to disassemble it because the required loosening torque exceeds the maximum capability of the tool (failure mode 3). Although the screw has not been successfully removed in the unfastening operation, the impact force exerted by the tool might have loosened it. A second unfastening attempt is made to apply another impact force to try and release the screw. If this fails again, the robot will leave the current position and call the operator.

## 3.2 Detection Methods for Failure Modes

Before adopting the above strategies, it is critical for the robot to detect these failure modes during automated unscrewing. Information regarding the position and torque of the robot is employed for this detection. Fig. 4 shows how information on the position of the robot tool is used to determine a search failure. Once the tool fits in the screw head, its position along the Z axis will increase from $P_{z0}$ to $P_{z1}$. The following equation is used to determine if engagement has occurred:

$$P_{z1} - P_{z0} > \Delta P \qquad (2)$$

where $P_{z0}$ and $P_{z1}$ are the initial and end positions of the tool during search along the Z axis, respectively. $\Delta P$ is a set threshold value for position change and is related to the size of the screw head. In the second search motion, the same way could be employed to determine whether the tool fits in the screw head or not, as shown in Fig. 4.

<figure><img src="image_5.png" /><figcaption>Fig. 4. Detection of failure mode 1.</figcaption></figure>

Robot's torque information is employed to detect failure modes 2 and 3, as shown in Fig. 5. A target torque value ($T_{t0}$) is set to stop the search, once the tool engages the screw head during a searching process. As shown in Equation (4), the applied torque
on the tool ($T_e$) will increase once the tool engages the screw head due to its slow rotation in fastening direction. However, if the tool slips on screw head, torque on the tool could not increase to the target value.

$$T_e > T_{t0} \qquad (3)$$

If the screw is too tight to be removed, the applied torque on robot tool ($T_u$) will increase and exceed the maximum safe torque value ($T_{t1}$), as expressed in Equation (4). Therefore, the torque on robot tool during unfastening process could be used to detect the failure mode 3.

$$T_u > T_{t1} \qquad (4)$$

<figure><img src="image_6.png" /><figcaption>Fig. 5. Detections of failure modes 2 and 3.</figcaption></figure>

## 4 Experimental Tests and Results

The robot cell in Fig. 1 was implemented for experimental tests to validate the above strategies. Hexagon headed screws (M6 x 16 mm) with flange were installed on a metal plate. Table 1 lists the set speed and torque values of the nutrunner in stages 2 and 3. A flashing LED strobe light connected to robot controller was adopted to inform a human operator to handle the screws when the robot was unable to do that.
<table><caption>**Table 1.** Parameters of the nutrunner.</caption><thead><tr><th colspan="2">Search and engage</th><th colspan="2">Unfasten</th></tr></thead><tbody><tr><td>Rotating speed of the tool</td><td>25 r/min</td><td>Rotating speed of the tool</td><td>100 r/min</td></tr><tr><td>Target fastening torque</td><td>14 Nm</td><td>Maximum unfastening torque</td><td>25 Nm</td></tr></tbody></table>

## 4.1 Tests and Results for Dealing with Failure Mode 1

The proposed strategy of second search worked and successfully engaged the screw head after the first search failed. Fig. 6 presents selected image frames captured from the testing process. Fig. 6(a) shows the robot with the nutrunner approaching an estimated position of the screw head. The failure of the first search can be seen in Fig. 6(b). Fig 6 (c) shows that the tool capturing and engaging the screw head within the second spiral search. The unfastening of the screw is shown in Fig. (d). Once the unfastening stage finished, the screw was taken away by the robot, as shown in Fig. (e).

<figure><img src="image_7.png" /><figcaption>**Fig. 6.** Strategy of conducting a second search: (a) approach, (b) the first search fails, (c) the second search succeeds, (d) unfasten, and (e) assess and leave.</figcaption></figure>

Fig. 7 shows the torque and position information measured by the robot during the unscrewing process. Four stages are illustrated clearly. The torque value of -2.5 Nm was set as a threshold value to stop the search once the tool engaged the screw head. Position information was used to determine whether the first search was successful and when the screw was completely out during unfastening.
<figure><img src="image_8.png" /><figcaption>Fig. 7. Torque and position information recorded by the robot.</figcaption></figure>

The strategy for dealing with the failure of both searches was tested. Fig. 8 illustrates the selected image frames captured from the unscrewing process. After the tool approached the screw head (Fig. 8(a)), both the first and second searches failed, as shown in Fig. 8(b) and 8(c), respectively. Then, the robot left its current position and turned on the strobe light to inform an operator (Fig. 8 (d)). Fig. 8 (e) shows the operator unfastening the screw with a spanner. Fig. 9 shows the measured torque and position information by the robot during the unscrewing process. The maximum torque of the robot did not reach the threshold value of -2.5 or 2.5 Nm, which was used to stop the search once the tool engaged with the screw head.

<figure><img src="image_9.png" /><figcaption>Fig. 8. Strategy for dealing with the failure of both searches, (a) approach, (b) the first search fails, (c) the second search fails, (d) leave and inform an operator, and (e) handle the screw by the operator.</figcaption></figure>
<figure><img src="image_10.png" /><figcaption>Fig. 9. Torque and position information recorded by the robot.</figcaption></figure>

## 4.2 Tests and Results for Dealing with Failure Mode 2

Fig. 10 shows selected image frames captured from the testing of the strategy proposed for handling the failure mode associated with the tool slipping on the screw head. Fig. 10(c) shows the tool slipped on the head of screw after the nutrunner approached the screw (Fig. 10(a)) and fitted in the screw head (Fig. 10(b)). Once slipping was detected, the robot left its current position and called the operator using the strobe light (Fig. 10(d)) to handle the screw with a special tool (Fig. 10(e)). Fig. 11 depicts the recorded position and torque information by the robot. During slipping, the tool stayed nearly in a fixed position with small fluctuations.

<figure><img src="image_11.png" /><figcaption>Fig. 10. Strategy for dealing with slipping, (a) approach, (b) search and fit in, (c) slip, (d) leave and inform an operator, and (e) handle the screw by the operator.</figcaption></figure>
<figure><img src="image_12.png" /><figcaption>Fig. 11. Torque and position information recorded by the robot.</figcaption></figure>

## 4.3 Tests and Results for Dealing with Failure Mode 3

Fig. 12 shows image frames captured in the test of the strategy to handle a screw that is too tight to remove. Fig. 12(a) depicts the tool approaching the screw head. Then, the tool searched for and engaged with the screw head, as shown in Fig. 12(b). However, the tool was unable to unfasten the screw because it was too tight (Fig. 12(c)). The tool left its current position and turned on the strobe light (Fig. 12(d)). Finally, an operator came to disassemble the screw with a hammer and a spanner (Fig. 12(e)). Fig. 13 shows the recorded torque and position of the robot. Before the robot left, the position of the tool almost did not change after engaging with the screw head.

<figure><img src="image_13.png" /><figcaption>Fig. 12. Strategy for dealing with a screw that is too tight to remove, (a) approach, (b) search and engage, (c) the screw too tight to remove, (d) leave and inform an operator, and (e) handle the screw by the operator.</figcaption></figure>
<figure><img src="image_14.png" /><figcaption>Fig. 13. Torque and position information recorded by the robot.</figcaption></figure>

The proposed strategy involving a second unfastening attempt was tested. Fig. 14 illustrates the selected image frames captured during the test. After approaching the screw (Fig. 14(a)), the robot searched for and engaged with the screw head (Fig. 14(b)). Fig. 14(c) shows the first unfastening failed because the screw was too tight. The second unfastening trial succeeded as shown in Fig. 14(d). After the screw was separated from the screw hole, the robot moved the screw away (Fig. 14(e)). The large torque fluctuations during the two unfastening trials are clearly captured, as shown in Fig. 15.

<figure><img src="image_15.png" /><figcaption>Fig. 14. Strategy of conducting a second unfastening attempt, (a) approach, (b) search and engage, (c) the first attempt fails, (d) the second attempt succeeds, and (e) assess and leave.</figcaption></figure>
<figure><img src="image_16.png" /><figcaption>Fig. 15. Torque and position information recorded by the robot.</figcaption></figure>

**5 Conclusion**

Unscrewing is one of the most common disassembly operations. Automating unscrew-
ing can release people from tedious and repetitive work. Unlike the case of screwing in
assembling a new product, unscrewing is difficult to automate due to the poor physical
conditions of screws in EoL products. This paper has presented strategies for handling
the three main failure modes in automated unscrewing operations, namely, screwdriver
missing screw head, screwdriver slipping on screw head and screw too tight to remove.
The strategies involve conducting a second search and second unfastening trial or col-
laborating with a human operator. The paper has briefly introduced a robotic unscrew-
ing method implemented in a human-robot collaborative disassembly cell. The un-
screwing process has four stages: approach, search and engage, unfasten, and assess
and leave. Experiments have been conducted to test and validate the proposed strate-
gies. The results obtained have demonstrated the feasibility of the strategies which can
be adopted to enhance the robustness and reliability of the robotised unscrewing method
developed.

In the future, the proposed strategies will be integrated and further tests will be con-
ducted to improve the robustness and efficiency of the robotised unscrewing method.
The unscrewing system will also be adapted to make it suitable for different types of
screws and bolts.

**Acknowledgments**

This research was supported by the Engineering and Physical Sciences Research Coun-
cil (EPSRC) (Grant. No. EP/N018524/1).
# Appendix

The automated unscrewing method presented in Section 2 was implemented in a turbocharger disassembly demonstration which can be viewed on YouTube at https://www.youtube.com/watch?v=kOwGe_LbLzs.

# References

1. Kerin, M. & Pham, D. T.: A review of emerging industry 4.0 technologies in remanufacturing. Journal of Cleaner Production, 117805 (2019).

2. Stahel, W. R.: The circular economy. Nature News 531(7595), 435 (2016).

3. Vongbunyong, S. & Chen, W. H.: in Disassembly Automation. pp. 25-54. Springer, (2015).

4. AUTOREMAN project, http://autoreman.altervista.org/index.html, last accessed 03/10/2019.

5. Huang, J., Pham, D. T., Wang, Y., Ji, C., Xu, W. & Liu, Q.: A strategy for human-robot collaboration in taking products apart for remanufacture. FME Transactions 47, 731-738 (2019).

6. Li, J., Barwood, M. & Rahimifard, S.: Robotic disassembly for increased recovery of strategically important materials from electrical vehicles. Robotics and Computer-Integrated Manufacturing 50, 203-212 (2018).

7. Palmieri, G., Marconi, M., Corinaldi, D., Germani, M. & Callegari, M.: Automated disassembly of electronic components: feasibility and technical implementation. In: ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. American Society of Mechanical Engineers, (2018).

8. Kristensen, C. B., Sørensen, F. A., Nielsen, H. B. D. B., Andersen, M. S., Bendtsen, S. P. & Bøgh, S.: Towards a robot simulation framework for E-waste disassembly using reinforcement learning. In: 29th International Conference on Flexible Automation and Intelligent Manufacturing. (2019).

9. Weigl, A.: Requirements for robot assisted disassembly of not appropriately designed electronic products: lessons from first studies. In: Proceedings of 1994 IEEE International Symposium on Electronics and The Environment. 337-342 (1994).

10. Huang, J., Pham, D. T., Li, R., Jiang, K., Qu, M., Wang, Y., Su, S. & Ji, C.: A screw unfastening method for robotic disassembly. In: the International Conference on Sustainable Smart Manufacturing (S2M 2019). (2019).

11. Jia, Z., Bhatia, A., Aronson, R. M., Bourne, D. & Mason, M. T.: A survey of automated threaded fastening. IEEE Transactions on Automation Science and Engineering 16(1), 298-310 (2019).

12. Gao, Y., Feng, Y., Wang, Q., Zheng, H. & Tan, J.: A multi-objective decision making approach for dealing with uncertainty in EOL product recovery. Journal of Cleaner Production 204, 712-725 (2018).

13. DiFilippo, N. M. & Jouaneh, M. K.: A system combining force and vision sensing for automated screw removal on laptops. IEEE Transactions on Automation Science and Engineering 15(2), 887-895 (2018).

14. Bdiwi, M., Rashid, A. & Putz, M.: Autonomous disassembly of electric vehicle motors based on robot cognition. In: 2016 IEEE International Conference on Robotics and Automation (ICRA). 2500-2505 (2016).
15. Chen, W. H., Wegener, K. & Dietrich, F.: A robot assistant for unscrewing in hybrid human-robot disassembly. In: 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014). 536-541 (2014).

16. Gerbers, R., Wegener, K., Dietrich, F. & Dröder, K.: in Recycling of Lithium-Ion Batteries. pp. 99-126. Springer, (2018).

17. Wegener, K., Chen, W. H., Dietrich, F., Dröder, K. & Kara, S.: Robot assisted disassembly for the recycling of electric vehicle batteries. Procedia CIRP 29, 716-721 (2015).

18. Gerbers, R., Mücke, M., Dietrich, F. & Dröder, K.: Simplifying robot tools by taking advantage of sensor integration in human collaboration robots. Procedia CIRP 44, 287-292 (2016).

19. Mironov, D., Altamirano, M., Zabihifar, H., Liviniuk, A., Liviniuk, V. & Tsetserukou, D.: Haptics of screwing and unscrewing for its application in smart factories for disassembly. Haptics: Science, Technology, and Applications 10894, 428-439 (2018).

20. How and why Apple's robot Liam disassembles iPhones, https://www.zdnet.com/article/how-and-why-apples-robot-liam-disassembles-iphones/, last accessed 2019.

21. Apley, D. W., Seliger, G., Voit, L. & Shi, J.: Diagnostics in disassembly unscrewing operations. International journal of flexible manufacturing systems 10(2), 111-128 (1998).

22. Li, R., Pham, D. T., Huang, J., Tan, Y., Qu, M., Wang, Y., Kerin, M., Jiang, K., Su, S., Ji, C., Liu, Q., & Zhou, Z.: Unfastening of hexagonal headed screws by a collaborative robot. IEEE Transactions on Automation Science and Engineering, 1-14 (2020).

23. KUKA Sunrise.OS 1.11, http://www.oir.caltech.edu/twiki_oir/pub/Palomar/ZTF/KUKARoboticArmMaterial/KUKA_SunriseOS_111_SI_en.pdf, last accessed 03/10/2019.