METHOD AND APPARATUS FOR OUTLINING THE ENVIRONMENT OF A MULTIARTICULAR DUTY MACHINE BY MEANS OF A LASER POINTER

Abstract: A method and apparatus for outlining the manipulation environment of a duty machine in order to automatically determine the working cycles. The method includes a laser pointer (2) which measures the direction and distance of the laser beam with respect to the object. By means of the pointer there is registered a set of points (1), which can be formed of separate points or of continuous lines and which gives a rough illustration of the entire manipulation space, i.e. its free space and the objects located therein. The set of points is completed to form a model of the manipulation environment both by means of geometric plane figures (primitive volumes) (3) sent from the user's keyboard, and by means of mathematical algorithms, in order to match the spatial planes and curves with the given set of points. The automatically determined trajectories are corrected during the working performance according to the feedback information received from the object under operations.

Description: METHOD AND APPARATUS FOR OUTLINING THE ENVIRONMENT OF A MULTIARTICULAR DUTY MACHINE BY MEANS OF A LASER POINTER The present invention relates to a method and apparatus for outlining the manipulation environment of a multiarticular duty machine, such as a hoist and transmitter, an excavator, a forest harvester or a rock drill, by means of a laser pointer in order to determine the trajectories automatically and to control the machine. The invention can also be applied for teaching an industrial robot its working cycle. At present a multiarticular duty machine, for instance a hydraulic jack, an excavator or a drilling arm assembly are controlled articulation by articulation so that the user, while controlling the various articulations, simultaneously also controls the movements of the arm head. While the total number of controlled articulations can rise up to seven, the arm control may become troublesome. The most developed manipulator arrangements have utilized a computer system for coordinating the movements so that the user may directly control the arm head by the control stick, and the computer calculates the control of each separate articulation and guides the arm control so that the arm head moves along a straight path to the direction ordered by the user. The user can also program the automatic cycles of the computer by means of the control stick and the keyboard. The said control method is generally known in the prior art, but the applications for controlling arm machines have been limited. The purpose of the invented method is to release the user almost totally from controlling the arm and from teaching the automatic movements by handling the arm, so that he has his hands free for task description and for general control OMPI of operations. Before a certain work performance, the user registers the manipulation environment by means of a suitable device (laser pointer) into the control unit, and on the grounds of this simple registration the control unit determines the working cycles in order to perform the task. Thus the remaining duties of the user, are to supervise the work performance and to correct trajectories if necessary. The invented method brings forth a completely new way of controlling duty machines provided with arms. The method is characterized by the novel features enlisted in the patent claims. Another object of the invention is an apparatus for realizing the method. The system components include a laser spot pointer and a menu-type user keyboard, by means of which equipment the manipulation environment is registered. The system components as such do not form the object of the invention, because their operation is generally known in the prior art. The main inventional idea is the new way of combining old principles. The apparatus developed for applying the new method is characterized by the novel features enlisted in the patent claims. The method of the present invention can also be applied in the teaching of industrial robots and manipulators, which is known to be a difficult and time-consuming operation. Robots of the first generation are taught so that the robot is once carried through the whole cycle, whereafter this cycle is stored in the memory so that it can later be repeated from the memory. The second generation robots are taught in the control language. This method of teaching is troublesome, too, because the user must define the cycle and the manipulated objects in an ordinary computer language. The method and apparatus of the present invention, combined to the teaching language, renders a "BϋREAI OMPI - 1PO teaching method which in many partical applications is suited for industrial robots much better than the currently used methods. The present invention aims at developing a simple method and system for registering the environment of multiarticular duty machines provided with arm assemblies - such as hoist and transmitter equipment, excavators, forest harvesters and rock drills in order to define the working cycles automatically. Thus the principal purpose of the invention is to improve the degree of automatization in such duty machines that are provided with arms and are operated in difficult environmental circumstances. The invented method and system of registration can also be applied in teaching industrial robots, in which case the invented method and system can be used to speed up the teaching process. The main principle of the invention is that the user analyzes and outlines the manipulation environment, whereafter he, as a result of this analyse, produces a point model of the manipulation environment. This point model approximates the working space in a very rough fashion. Each point of the point model represents a certain feature point in the real space. This point model is completed in two ways: by feeding in geometric plane figures, so called primitive volumes, from the menu-type user terminal, and by completing a certain partial area in the point model by mathematical algorithms, so that a convex mask for example is calculated for a given set of points. As a result of this completion process, the model describing the manipulation space is recorded in the computer memory in a form which is sufficiently accurate for the determination of the trajectories. On the basis of the produced model it is possible to define the working cycles and to calculate the trajectories for performing the cycles. While defining the cycles, the user may complete the model by pointing out for instance the points of grip of shiftable objects, as well as their terminal station. The present invention also relates to an apparatus for applying the method. The system includes the following components: a laser pointer, a menu-type user keyboard, a calculation unit and an arm control unit. By means of the laser pointer the user points out such objects in the real environment as are represented in the point model. The menu-type keyboard is used for completing the model by giving the geometric plane figures. The calculation unit carries out all mathematical calculations required for producing the final model and for determining the trajectories. The arm control unit performs the control operations according to the predetermined path. The basic component is the laser spot pointer, which points out the objects in the manipulation environment. The laser pointer measures the direction of the laser beam by means of two position sensors; it also measures the distance on the basis of the light pulse received from the objects in the manipulation environment - without employing a reflective prism. Another important component is the intelligent menu-type keyboard of the user. In the following the invention is described in the light of detailed examples and with reference to the appended drawings, where Figure 1 illustrates the environment registration system; Figure 2 illustrates a preferred embodiment of the laser pointer; Figure 3 illustrates a preferred embodiment of the intelligent menu-type keyboard of the user; -gUREAt OMPI Figure 4 is a schematical diagram of an application of the method; Figure 5 illustrates how the positions of the, points pointed out by the laser pointer are calculated in the base coordinates of the arm assembly; Figure 6 illustrates two exemplary cases for determining the trajectories. The basic transaction in the invented method is first to create a point model which describes the manipulation environment of a multiarticular duty machine in a sufficiently accurate way. Figure 1 shows the set of points 1 located in the base coordinates of the arm, the said set of points representing the point model. According to the method of the invention, the point model is completed either by means of geometric primitive volumes given by the user - such primitive volumes are basic figures drawn on a plane, such as a circle, a rectangle and a straight line - and/or by means of mathematical algorithms. Figure 1 also shows a completed version of the earlier point model. The object (A) is now completed as a cylinder on the basis of its diameter and the form given by user. This description may represent for instance a log. The obstacle (B) is completed according to a mathematical algorithm. The algorithm can be for example a generally known algorithm descending into the given set of points in the convex mask. The terminal station (C) is completed with a straight line which defines the position of the position of the shiftable object in the terminal station. The .completed model contains an adequate amount of information for determining the arm trajectories. In addition to this, the user may complete the model in order to calculate the trajectories by determining point of grip in the shiftable object as well as by defining how the obstacle should be avoided. The following specification gives a detailed description of one preferred embodiment of the system of the invention. It is to be noted that the practical applications of the present invention can be largely modified within the scope of the patent claims. The basic component of the invented teaching method is the laser rangefinder, which is illustrated in Figure 2. The rangefinder serves as a pointer which can be directed to- wards a desired point in the manipulation space of the arm assembly by means of two ball pivots (2, Q f<j and β ^)- The focusing is carried out by means of the viewfinder (2, C). After focusing the device to a desired object, the user records the coordinates of the object by pressing the press key (2, B) so that the position readings of the rangefinder ( ^l andOf^) and the distance information are stored in the memory. The rangefinder is constructed so that it measures the transit time of the light pulse transmitted by the pulsated semiconductor laser from the transmitter (2, E) towards the object (2, G) and back to the receiver (2, E). A sufficient accuracy and resolution is achieved by averaging the measuring results. Because the pulse frequency may be high (10 kHz), a distance reading is received (after averaging) at each 10 ms, which is a sufficient measuring rate. The radiation power of the semiconductor laser is collimated in the transmitter lenses so that the beam width is a small as possible (= 1 cm^ on the surface of the object at the distance of 10 ). Another essential component of the invention is the menu-type keyboard, which the user can employ for sending geometric primitive volumes to the calculation unit and for giving information of the object that the laser is pointing. Figure 3 shows an example of the menu-keyboards. Figure 4 is a schematical diagram of the system of the BUREAt OMPI invention. The user (4, A) of the arm machine (4, B) directs the laser pointer (4, C) towards the object (4, H) situated in the manipulation environment and sends a command message (4, C) from the terminal device (4, E) to the calculation unit (4, D), whereafter he presses the press key of the laser pointer which sends a reading command (4 a) to the sensor unit (4, F). After receiving the reading command, the sensor unit reads the laser pointer position information (4, d and f) on the position sensor, and the distance information (4 g) on the rangefinder. The sensor unit records the information in its memory until the calculation unit inquires them. The arm control unit (4, G) sends the arm position information (h) regularly to the calculation unit, and inquires, when necessary, the determined trajectory (i) in order to calculate respective control advice for each articulation and in order to realize a guided path (j) according to the given trajectory. Figure 5 shows an example of how the coordinates of the object pointed out by means of the laser are calculated in the arm coordinate system. To give an example, let the arm and the laser device be located on the same level. The laser rangefinder is situated in the arm coordinates E2 at the point (xj-., v τ ? vector R-. ). The projection of the distance vector, measured by the rangefinder, on the plane E2' is D*, which can be calculated in normal fashion on the basis of distance information and the readings of the position sensor ( O C1» _( l ) , which define the position of the rangefinder. The location in the arm coordinate system of the object P pointed out by the laser is defined by the vector D, i.e. D = D + R^ . If the arm and laser rangefinder are not situated on the same level, the location of a point in the laser coordinate system can be calculated according to the same principle in the arm coordinate system. Thus, according to the principle explained above, the location of each point pointed out by the laser can be determined in the Cartesian coordinates E' placed at the base of the arm. Each point in E-- 5 can be described in the arm articulation coordinate system N n by following the generally known principles of robotics (n refers to the number of free instances, i.e. the number of articulations). Thus each point pointed out by the laser can be presented in the articulation coordinate N n of the arm. The following description shows, in the light of two examples, how the trajectories for the cycles are produced after outlining the working space. The starting point is a completed point model of the manipulation environment. Figure 6 shows two simplified diagrams, the first about transmitting objects and the second about drilling rock. The trajectories are determined so that the user points out the starting point (6, A) of the path - this can be for instance the point of grip of the shiftable object - and the terminal point (6, B). Thereafter the system can automatically produce a necessary amount of intermediate points (6, C-j, C2) in order to determine the trajectory in more detail; these intermediate points are calculated on the basis of the completed point model so that the trajectory does not collide with the obstacles situated in the manipulation environment. From his terminal device, the user gives the speed and acceleration information for the separate parts of the path. By combining the path points with a straight line, he gets the final trajectory which the arm head should follow in order to realize the planned cycle. When the straight-line trajectory in the articular base coordinate system is known, the set points between each two articulations can be determined as a function of the trajectory according to generally known principles. The above specification, illustrations and examples describing the invention are meant only to throw light onto the operation of the method and apparatus of the invention. A wide range of variation in the practical applications of the invention is possible without deviating from the appended patent claims.

Claims: AMENDED CLAIMS [received by the International Bureau on 12 November 1984 (12.11.84); original claims 1 to 8 replaced by amended claims 1 to 8] 1. A method for outlining -the manipulation environment of a duty machine by means of a laser pointer in order to automatically define the working cycles, c h a r a c e- t e r i z e d in that the laser pointer (2), which measures the direction of the laser beam and its distance from the object, is employed to point out a set of points (1) in the manipulation environment, which set of points may consist of separate points or continuous lines and which gives a rough description of the working space as a whole, of its free space and the objects located therein, and that the set of points is completed in order to form a model of the working environment both by means of geometric plane figures primitive volumes (3) sent from the user's keyboard and by mathematical algorithms in order to match the spatial planes and curves with the given set of points. 2. The method of Claim 1, c h a r a c t e r i z e d in that the user employs the laser pointer for spotting such points in the working space that are needed for calculating the trajectories, the said points being for instance the point of grip of the object, the direction in which an obstacle should be avoided and other similar points. 3. The method of Claim 1 or 2, c h a r a c t e r i z e d in that the user corrects the calculated trajectory by feeding in new points of path with the laser pointer. 4. The method of Claims 1-3, c h a r a c t e r i z e d in that the user teaches the working ' cycle by guiding the machine head by means of the laser. 5. The method of Claims 1-4, c h a r a c t e r i z e d in that the user calibrates the laser pointer with respect OMP to the machine by pointing out the predetermined calibration points of the said machine by means of the laser pointer, and that the position of the laser pointer with respect to the machine is defined by means of a specific calibration algorithm. 6. The method of Claims 1-5, c h a r a c t e r i z e d in that the calculated trajectory is corrected during the performance according to the feedback information received from a separate sensor. 7. An apparatus for applying the method of Claim 1 for describing the environment of a duty machine provided with arms in order to automatically calculate the trajectories, the said system comprising a laser spot pointer (2), an intelligent menu-type keyboard (4) of the user, a sensor unit (4, F) for processing the information received from the laser pointer and a calculation unit (4, D) for forming the models of the manipulation environment and for calculating the trajectories, c h a r a c t e r i z e d in that the system contains a laser pointer, the essential feature thereof being the fact that its operation is based on measuring the transit time of a light pulse, and that the position coordinates of the object are calculated on the basis of the direction angles (2, 0£-| ,^2) and tne distance of the laser beam (2, F), and that the distance is measured without a reflecting prism so that the user focuses the pointer either in a direct mechanical fashion by directing the transmitter manually to the object, or electrically by means of control stick or OMPI b IPO equivalent, which directs either the transmitter itself or the transmitter beam by means of rotating mirrors, and the focusing is carried out either by means of an optical viewfinder (2, C) or by means of a visible beam of light focused on the same axis with the transmitter (2, F), and that the laser pointer includes a press key (2, B) or equivalent, which is used for giving the reading command to the sensor process (4, F) or equivalent, which sensor reads both the distance information and the information about the direction angles and records them in its memory, that the menu-keyboard (3) forms a physical entity which belongs to the system and comprises the press keys which are particularly planned for controlling the machine, for feeding in the geometric forms, for controlling the geometric calculations and for pointing out the feature points in the manipulation space, and which keyboard is realized so that it contains intelligent electronics for reading the press keys and a calculation unit which is realized as a computer (microcomputer) connected to a sensor process (3, F) or equivalent which feeds the position coordinates measured by the pointer further into the calculation unit (4, D) or which directly reads the direction angles of the pointer beam and the measured distance, and which calculation unit is connected to a menu-keyboard for feeding in the control commands, which menu-keyboard controls' the machine either directly or via a separate control unit. - REA; OMPI 8. The apparatus of Claims 7, c h a r a c t e r i z e d in that the menu-keyboard contains press keys, by means of which the user programs the pointer to automatically investigate the manipulation environment or part of it.

Inventors: HALME AARNE, MANNINEN MARKKU, HALME, AARNE, MANNINEN, MARKKU
Applicants: VALTION TEKNILLINEN, VALTION TEKNILLINEN TUTKIMUSKESKUS
Application year: 1984
Main classification: B25J19
IPC codes: B25J9, B25J19, G01S17