IMPACT POSITION MARKER FOR ORDINARY OR SIMULATED SHOOTING

Abstract: An impact position marker for ordinary or simulated shooting from a fire-arm (1) towards a moving target comprises a sensor part (2) with an evaluation unit for the actual position of the target in relation to the fire-arm and a firing detector. The evaluation unit comprises an image taking device (10) with its optical axis directed in parallel with the sighting line of the fire-arm (1), a unit (11) which measures the rotation of the sighting line of the image taking device in at least two planes at an angle to each other and comprises one and the same line coinciding or parallel with the sighting line of the fire-arm. The output signals from the image taking device (10), the rotation-measuring unit (11) and the firing detector (12) are inputted to an evaluation unit (13) which calculates the distance to the target and the position of the point of impact in relation to the target at the calculated impact moment. The result of the measuring is presented on a presentation unit (4) and/or controls an acoustic feed-back signal which assists the shooter during aiming and firing.

Description: IMPACT POSTTTON MARKER FOR ORDINARY OR SIMULATED SHOOTING The present invention relates to a impact position marker of the type which is given in the preamble of claim 1. More particularly, the invention relates to a device for inputting, calculating and presenting the result of target shooting against moving targets with shotguns or similar weapons. Impact position marker is intended for ordinary or simulated shooting from a fire-arm against a moving target and comprises a sensor part with an estimating unit for the actual position of the target in relation to the fire-arm, and a firing detector. TECHNICAL FIELD During shotgun shooting against clay pigeons, e.g. skeet and trap shooting, a hit is indicated by the clay pigeon being seen to break up. Even if it is possible to some extent to judge the quality ofthe hit from how powerfully the clay pigeon is fragmented, it is difficult with bad hits and with misses to get an exact idea ofthe impact position, i.e. the angular distance between the target and the charge of shot and whether the shot passed over, under, to the left or to the right of the target. The possibilities of training for shotgun shooting are limited by the availability of shooting ranges which for environmental reasons are placed away from settlements. Other restrictions also sometimes limit the possibilities for training, for example, regulations about permitted shooting times. These said conditions mean that there is a need for, on the one hand, an aid which shows the position of impact during (conventional) shotgun shooting, on the other hand, a system for training in shotgun shooting under simulated conditions, i.e. without live ammunition needing to be discharged. DESCRIPTION OF RELATED TECHNOLOGIES A number of systems for simulating shooting have been suggested in order to improve the possibilities of practising shooting with small arms, one of which is described in US Patent 5,194,006. This system permits shooting training in a simulator with small arms where an image ofthe target is projected onto a projection screen and the shooter fires towards the projected target with a gun simulator. The system calculates the impact position with reference taken to the angular speed of the target and a Active distance. The system cannot be used for practice shooting against real targets. A number of known systems, amongst which is the one described in US Patent 3,798,795, are known for estimating the results of shooting when shooting against true moving targets with ballistic projectiles. A necessary part of systems of this type is a distance measuring function. In this system a (TV) camera image is used for inputting the vertical and horizontal position ofthe target while the distance is determined with the help of measuring the delay time interval for a radio signal which is echoed by a transponder on the target. This method for measuring the distance is not suitable for clay pigeon shooting. In the same way as with the evaluation afterwards of a shot which has been discharged, a fire control system which, before the shot is fired, must determine a suitable direction of aim. must determine the distance to the target. In US Patent 4,922,801 a fire control system for a weapon with a barrel directed by a shooter is described which assists the shooter during aiming by calculating the position for a "future'' target. The position for the future target is calculated with reference to the angular speed ofthe target and the distance, and the delay time interval for the projectile, and is presented in the form of an aiming point which the shooter shall aim towards in order to hit. The distance to the target is calculated from the apparent size of the target on a TV image. The object of this system is fire control, not the evaluation of the result of shooting. The English company Powercom (UK) Ltd sells a system called Lasersport Clay Pigeon Shooting System, which can be used for simulated shooting against speci¬ ally manufactured clay pigeons. In order to detect hits, respectively misses, an infrared light beam with a dimension which corresponds to the width of a charge of shot is sent from the gun simulator. The light reflected from the target is used in order to decide if the "shot" was a hit or a miss. The system does not take account of aiming off - hit detecting takes place as if the speed ofthe shot was equal to the speed of light. This means that the system does not correctly simulate the conditions in clay pigeon shooting with shotguns, whereby it is not a usable training aid for clay pigeon shooting, which requires aiming off. OBJECTS OF THE INVENTION An object of the invention is during shotgun shooting and similar shooting against moving targets, above all clay pigeon shooting, to produce an impact position marker which calculates and presents the position of impact for discharged shots in relation to the direction ofthe target, so that the shooter can get an idea of the size and direction ofthe mis-aiming. Another object of the marker according to the invention is to permit shoot training through the simulation of shotgun shooting against moving targets. The simulated shooting takes place under conditions which are identical with live shooting with shotguns, the only difference being that the weapon is not discharged. This means that the shooting can take place against clay pigeons which are thrown in the ordinary way and with the shooter's own weapon. Yet another object ofthe marker according to the invention is to permit simulated shooting against a projector screen where moving targets are presented with the help of an image projector. Yet another object ofthe invention is to produce a marker which on the one hand can be used for shooting against fictive targets but which also, without modification, can be used when shooting against real clay pigeons. The marker shall consequently be able to be used during shooting with live ammunition but also during shooting training in the form of simulated practice shooting for shotgun shooting or similar shooting. Yet another object ofthe invention is to help the shooter correct an incorrect direction of aim through an acoustic signal. Yet another object is to make it easier for the shooter during shooting, when the gun muzzle is successively moved nearer to a correct aiming point, to be acoustically or optically helped to fire at the right point of time. A solution to the most ofthe above mentioned objects is given by the characterizing clause of claim 1. Further developments and further characteristics ofthe marker according to the invention are given in the dependent claims. The impact position marker for ordinary or simulated shooting from a fire-arm against a real, moving target comprises a image recording device, e.g. a video camera, for determining the direction and distance ofthe target in relation to the fire¬ arm and its direction of aim. The image recording device has its optical axis directed parallelly to the line of aim of the fire-arm. A rotation measuring unit. i.e. a gyroscope, measures the rotation of the line of aim of the image recording device in at least two planes at an angle to each other and comprising one and the same line corresponding or parallel to the line of aim of the fire-arm. The output signals from the image recording device and the rotation measuring unit are inputted to an evaluation unit which calculates the distance and direction to the target and the aiming point which, with reference to the necessary compensation for aiming off, would give a hit. The result of the measuring is presented on a presentation " unit. The system can be used essentially in three different ways: - against real, moving targets which are shot at with live ammunition; - against real, moving targets in connection with simulated shooting, i.e. practising of aiming and firing without the use of live ammunition; - during simulated shooting against a projection screen where moving targets are presented with the help of an image projector. ADVANTAGES OF THE INVENTION During live shooting the position of impact marker is an aid for finding the right aiming point and understanding which mistakes have been made during aiming and discharging. Used as a simulator the position of impact marker is a training tool which permits effective and intensive shooting training at a low cost on ordinary shooting ranges and also in places where training shooting otherwise could not be performed. When used in connection with live shooting the value of the training is increased through the shooter receiving better information on which mistakes have been made during shooting, e.g. mistakes in aiming off. During use ofthe system for simulated training shooting it is possible to run training in places and at times which otherwise would not be possible. Compared with conventional clay pigeon shooting without aids, simulated shooting against real clay pigeons and also simulated shooting against targets on a projection screen can give a greater training effect through, on the one hand, the acoustic signal which indicates incorrect, respectively correct, aiming ofthe muzzle during firing, on the other hand, the indication of the impact position even for missed shots. Finally, simulator training can be run at a low cost through the cost of consumable material being considerably reduced. The system is in the first instance intended for clay pigeon shooting, e.g. skeet and trap shooting. The system can be used in shooting and simulated shooting against clay pigeons of ordinary design without any special surface coating. During simu¬ lated shooting, clay pigeons of a more solid material than ordinary can be used to make re-use possible. In simulator training against a projection screen no extra equipment apart from the projection equipment itself is required. The requirement on the projection equipment is that the target is presented with sufficient contrast and shaφness so that its posi¬ tion and, to the extent that the size of the target in the picture is used for determining the distance, size shall be able to be determined by the image recording device ofthe impact position marker, and, if there is a risk of interference between the image presentation frequency of the projector and the image frequency ofthe camera, synchronization between the projector and the camera. During training in connection with use of real clay pigeons the system can be used both in daylight and in lower surrounding lighting conditions. In the latter case, when, on the first hand, the use ofthe system as a simulator is required, the target can be actively illuminated. In order to minimize the sensitivity to interference, in this case it is appropriate to use targets with a retroreflective surface coating. During simulation of shotgun shooting against a movable target on the ground, clay pigeons can be replaced by a corresponding target surface of suitable size and surface coating which is placed in the centre of the target. SHORT DESCRIPTION OF THE FIGURES The invention is described below in more detail in the form of examples with the guidance ofthe accompanying figures, where Fig 1 shows a block diagram of an embodiment ofthe complete device according to the invention, Fig 2 shows a detailed block diagram of an embodiment of the invention, Fig 3 shows a block diagram of an embodiment for calculating the position of impact. DETAILED DESCRIPTION OF THE FIGURES Referring to Figs 1 and 2. the impact marking device according to the invention comprises a measuring system for analyzing the position of impact on a target 8 in a target region 15 in front of a weapon 1, and means for presenting the point of impact for the shot. The mechanical design comprises a sensor part 2 which is mounted on the weapon 1, and an evaluation unit 13. which is connected to but can be physically separated from the sensor part 2. In order to communicate the result ofthe impact position calculation there is an impact position indicator 4 of which the physical placing in relation to the weapon can vary depending on which design is chosen. A more detailed description ofthe sensor part 2 and the impact position indicator 4 will be given below. The need of a separate sensor part 2 and evaluation unit 13 is determined above all by the requirement for the smallest possible weight of the part which is applied to the weapon 1, i.e. sensor part 2. The weight ofthe evaluation unit 13 is. however, not so large, so that this part, if so desired, can be carried by the user and worn, for example, on a belt. A number of alternatives can be conceived for the design o the impact position indicator 4: * graphic/numerical presentation on an indicator built in the evaluation unit; * acoustic indicating which informs about the position of impact by means of synthetic speech; * head-up-display, which generates a picture which can be overlayed on the visual impression obtained during aiming. Combinations of these embodiments are also conceivable and suitable for simultane¬ ously using both sight and hearing. In order to increase the degree of the feeling of reality during simulated shooting, the system can include means for generating sound effects, e.g. a bang during firing, and means for simulating recoil. The firing bang can be simulated with the help of a sound generator which produces a noise during firing. Recoil can be simulated with the help of a device (not shown) which makes the weapon or the part of the butt which is in contact with the shoulder move backwards just like during the discharge of a live shot. An acoustic feedback signal, which during aiming indicates if the weapon is aimed towards the correct aiming point in order to give a hit, and which also can comprise information on distance and direction between the actual aiming point and the correct aiming point, is called below "the hit signal". The part ofthe hit signal which contains information on the size and direction ofthe angular distance between the correct aiming direction (in order to hit) and the actual aiming direction is called below "the aiming signal", while the part of the hit signal which concerns a suitable firing time point is called "the firing signal". The aiming signal is suitably stereo¬ phonic and modulated so that by means of the sound it is possible to determine the relative distance between the aiming point which will give a hit and the actual aiming direction. Stereophonic sound requires two sound sources whereby it is suitable to use headphones, as is shown schematically by 6. The firing signal is an intermittent signal which sounds immediately before the correct aiming point has been reached. Through adapting the interval between the firing signal and the suitable time, so that it corresponds to the reaction time of the shooter, the shooter receives help in choosing the appropriate forward aiming off through, during successively increasing aiming off, firing when he hears the firing signal. A head-up display for presentation ofthe impact position can be designed like a telescopic sight with a magnification of one, wherein graphic information can be overlaid on the visual impression. When the system is used for shooting against real clay pigeons indoors and otherwise in low surrounding light, there can be a need for active illumination 7 of the target region in order to give the target a sufficiently large contrast against the background. This illumination 7 can either be placed on the weapon or on the sensor part, as is illustrated in Fig 1, or in a fixed position at one side ofthe shooter. Target material The calculation of the position of impact is based on the target being imaged by the camera with a sufficiently high contrast against the background for its position and. by means ofthe distance measuring according to method 1 below, its size to be able to be determined. This is true to the same extent for real clay pigeons as for filmed or synthetically generated ones which are shown on a projection screen.The targets 8 in the first instance are clay pigeons according to UIT ' s general and special rules, which, amongst others, are applied during international competitions. The diameter of the clay pigeons is 110 cm and the height 25-26 mm. Various colours are permit¬ ted, whereof one is orange-red and somewhat fluorescent. When reproducing in the blue part of the spectrum a clay pigeon against a clear or cloudy sky, this colour normally gives sufficient contrast for calculating the position of impact. Normally designed clay pigeons with such a colour, can thus be used when the system is used in connection with live shooting. Nothing prevents the same type of target being used during simulated shooting. In order to reduce the cost ofthe consumption of clay pigeons in this type of use (if not before, clay pigeons often break during landing), clay pigeons manufactured in a more impact resistant material but otherwise with the same characteristics as normal clay pigeons, can be used in order to permit re-use. Power supply During outdoor use, power supply can suitably be via batteries (not shown), whereby the system is totally self-sufficient and can be carried without the encumbrance of power supply cables. Fig 2 As can be seen from Fig 2. according to the embodiment shown, the calculation of the position of impact is based upon the collection of data from in general three means in the sensor part 2: * a camera 10 which continuously generates images of the target area in front of the weapon, * a preferably twin-axis gyroscope 1 1 which registers the movement ofthe weapon. and * a firing detector 12 for registering the firing. The treatment ofthe received data and the calculation of the position of impact preferably take place in the evaluation unit 13. Camera 10 Camera 10 is placed in the sensor part 2 so that the optical centre axis 14 of the camera is parallel with the direction ofthe muzzle of the weapon. The camera has the function of continuously generating images of a target region 15. Information from the camera is electrically transferred to the evaluation unit 13. The focal distance ofthe camera is dimensioned so that the field of view has such a size 9 that all hits during normal shooting in skeet and trap shooting can be detected. The maximal aiming off, which can be up to 5 degrees in this case, is a determining dimension for the field of view. The corresponding size ofthe field of view in this case is then 2 x 5 degrees = 10 degrees. In order to be able to determine the position of impact during misses in combination with maximal aiming off. the field of view is suitably made larger, e.g. 15 degrees. The spectral sensitivity ofthe camera is such that a target 8 is reproduced with the highest possible contrast against the background. The image frequency and line resolution are chosen according to the requirements set by the image-processing function, which is described in more detail below. In order to compensate for varying environment light, the system comprises functions for automatic exposure control. As well as automatically varying the exposure time and possibly the aperture, in especially bright light in the environment a manual or automatically applied grey-filter can be used to reduce the requirement for varying the exposure time. Gyroscope 1 1 The gyroscope 1 1 continuously measures the angular speed preferably in two perpendicularly orientated planes corresponding to the vertical and horizontal directions. A suitable design for this, with regard to the requirement of low weight, is the tuning fork gyroscope. Firing detector 12 The firing detector 12 has the task of detecting when the trigger 5 ofthe weapon is activated. A possible design is in the form of a microphone which picks up vibrations from the movement of the cock and the firing pin. Signal transfering To the extent that the sensor part 2 is physically separated from the other units, transfering of signals to these units takes place via cable 16 or via telemetry to the evaluation unit 13. Evaluation unit 1 The evaluation unit 13 receives and analyzes the signal from camera 10, the firing detector 12 and the gyroscope 11. Its first task is to detect the target and calculate its direction and distance. Two suitable embodiments of image processing for detecting the target object in the image (object extraction) are described below. The first, called "thresholding" below, is based on the analysis of colour respectively intensity ofthe elements comprised in the image. A suitable colour for clay pigeons is a fluorescent red colour. With a suitably chosen colour-sensitivity ofthe camera. this colour gives a strong contrast against the sky, which most often is blue or white. This colour is also the one which is judged to be the most suitable for use together with this system. A monochromic camera sensible to blue light can be used. In that case a red clay pigeon is seen against the sky as a dark object. The target is thereby found by looking for image elements with a light level under a predetermined threshold value. If another monochromatic colour is used, the evaluation unit 13 can instead localize the target in the image by looking for image elements with a light level above a predetermined light level. In comparison with the use of a colour camera, the use of a monochromatic camera gives a lower manufacturing cost but during reproduction ofthe target in strong sunlight from the side, it can, despite the spectral filtering, happen that part ofthe target is outlined with an intensity which is higher (or alternatively lower) than the threshold value. In this case the image would not correspond to the true shape of the target. A colour camera with at least two different spectral regions, suitably one in the red and one in the blue region, gives considerably larger possibilities for correctly determining the shape of the target during illumination from the side ofthe target through the possibility of combining the pictures ofthe target in the different colours. In the red part of the spectrum the target appears lighter than (the blue or white) background, whereby the thresholding in this case is performed so that a search takes place for image elements or pixels which have a higher intensity than a certain threshold value, in order to find image elements which show the target. In the blue part ofthe spectrum, however, the search takes place for image elements which have a lower intensity than another certain threshold value. The complete image ofthe target is in this case achieved from the number of image elements which are comprised either in the blue or the red reproduction of the target or both. In order to minimize the search space during object extraction and thereby the calculation requirements, the movement of the muzzle, the earlier position ofthe object, and the predicted next position are used, as will be made clearer below. If the target stands out against an evenly lit background without sharp edges and contrasts, e.g. a cloud-free sky. the above described image processing technics are sufficient for localizing and determining the size of a target object with a high reliability. If instead the background is patterned and has shaφ contrasts, for example when reproducing trees or bushes which stand out against the sky, the said method alone normally does not give sufficiently large sensitivity to interference. A second image-processing method which will here be described for the image analysis according to the invention is a complement to the one described above and uses the temporal dependence between successive images. During panning ofthe camera, both the background and the target will move in the image. By subtraction of successive images ofthe target area, the background can be eliminated and the moving target appear as the only object in the image. The subtraction is performed so that a pixel which corresponds to a certain point in the background in one image, is subtracted from a pixel in the next image which represents the same point. The movement ofthe background which occurs through the panning ofthe camera is compensated for through the image before subtracting being moved so that the backgrounds in the two images are levelled out. In this way the information on the muzzle, and (thereby the camera's) movement, which is received from the gyro signal, is used for determining the size and direction of said displacement. The result from the image subtraction is images where stationary objects are suppressed and the moving target object appears. After this operation, image analysis according to the above, i.e. thresholding, takes place in order to detect the target object. Compared with only using image information in order, with the help of pattern recognition, to determine by subtraction the displacement, the use ofthe gyro signal has a considerably lower requirement for processing capacity, which is an advantage of the method according to the invention. CALCULATIONS Aiming off One ofthe difficulties of shotgun shooting against moving targets is to bring about a suitable aiming off, i.e. to fire in the direction where the target will be at the time when the charge of shot has come to the path ofthe target. The size ofthe aiming off is determined by the travelling time of the charge of shot and the apparent angular speed of the target according to the following equation: V f = x S r where V f = aiming off angle (rad) t b = path time (travelling time of the charge of shot (sec)) S m = target speed (rad/sec) The necessary aiming off is achieved by the shot being discharged at a suitable angle in front ofthe target 8. The technique which experienced shooters often use in order to get the biggest possible precision in aiming off is called shooting with overtaking swing, which means that the shooter lets the line of aim ofthe weapon follow the path of the target with an angular speed which is greater than the speed of the target. The effective aiming off is then found through the sum of 1) the aiming off, which the shooter experiences when he fires, and 2) the delay between the conscious deci¬ sion of the shooter to pull on the trigger and the firing instance, i.e. the time when the charge of shot leaves the muzzle. Shooting techniques and thereby the swing can. however, vary, whereby the calculation ofthe position of impact must take place in a way which is independent ofthe shooting technique. Calculation of the position of impact The calculation ofthe position of impact is based in the evaluation unit on informa¬ tion about the direction ofthe gun barrel during firing, i.e. the direction of the shot, and extrapolation ofthe movement ofthe target after firing up to the calculated impact time. If the target is to be a hit, the direction ofthe target must cross the direction ofthe shot at the impact time. The movement ofthe target The position of the target at the calculated impact time is calculated through extrapolation of its movement in both of two peφendicular planes after firing. During flight the target follows a path which is a function ofthe starting speed, the starting direction, the acceleration ofthe earth and aerodynamic forces which depend amongst other on the path angle ofthe clay pigeon. The extrapolation of the movement ofthe target takes place under the simplified assumption that the path ofthe target describes a great circle around the shooter and that the angular speed is constant during the path time. Calculation errors which can occur in this case are insignificant. The accelerations which are the actual case, the acceleration ofthe earth and the braking because of air resistance, and the geometric error by the assumption of a target path being in the shape of a great circle, have no practical significance because of the relatively short path time. The following equation describes how the position of the target is extrapolated after firing for each ofthe two peφendicular coordinate axes. Direction Targe u mpact t i me = Direction Ta rget.r.πng + m x Path time where Direction T arget .im act t i me = me direction of the target at the calculated impact time, Direction Tar e u r i n = tne direction of the target at firing, V m = the absolute angular speed of the target, Path time = the flight time for the charge of shot from firing to the calculated impact time. In addition to the direction of the target, the absolute angular speed of the target must be known. This is calculated as the sum of the angular speed of the target in relation to the aiming direction, i.e. the direction of the camera, and the angular speed ofthe barrel. In order to be able to calculate the latter, means of the gyroscopic type are included in the impact position marker. A further requirement for the impact position calculation is a value for the path time for the ammunition, which for a certain type of weapon and ammunition simply can be determined by the distance. The distance is calculated by the evaluation unit, wherein two different calculating methods can be used. Calculation method 1 : The method for calculating the distance is. according to this method, based on the fact that the target, of which the abso¬ lute size is known, is imaged with a camera, wherein the size ofthe target in the picture plane ofthe camera together with information on the optics ofthe camera are used in order to determine the distance. Calculation method 2: If information on the spacial coordinates ofthe target range and the place ofthe shooter during the actual shot have been stored in advance so that they are available to the evalua- tion unit, the distance can be calculated as a function of this information as well as the angular speed of the target seen from the shooting position. The impact position indicator 4 and the impact signal generator 6 can either be indi¬ vidual physical units or can be-included in the evaluation unit. After a shot has been discharged the position of impact, i.e. the spacial angular distance in the vertical and horizontal planes between the target and the point where the shot passes through the plane ofthe path ofthe target, is calculated and presented. In addition to the position of impact, other measured values can also be presented, for example the direction of the shot and the movement of the aiming point relative to the target before firing. All relevant factors are taken into account during calculation ofthe position of impact, including delays in the weapon, the distance to the target, the flight time for the charge of shot to the target (path time), and the movement ofthe target during the path time. The resulting position of impact is continually evaluated by the evaluation unit 13 during aiming. The result of this continuous evaluation can be used in order to control an output means, below called a "hit signal generator", which assists the shooter in choosing the aiming direction and suitable firing time. Information from the hit signal generator can be an acoustic signal which is modulated in such a way that the user can by listening decide if the shot with the chosen aiming direction will be a hit or a miss and, with a predicted miss, also determine how the aiming direction should be corrected. In outdoor clay pigeon shooting ranges, because of the current regulations in certain branches, there are predetermined throwing paths for the clay pigeon in relation to the shooter at different stations. This means that the throwing paths can be pre¬ programmed and stored in the evaluation unit 13. In this case, all the shooter has to do is to state at which station on the range the shooter is, for example by pressing on one or several press buttons (not shown), whereafter the evaluation unit 13 performs the calculations with the help ofthe programmed-in target path. The hit signal generator 6 is controlled with a signal which varies in accordance with the result of the calculated position of impact. In addition to the simple modulation principle that the signal sounds if, with the actual aiming of the barrel, there will be hit (i.e. with a certain degree of certainty will break up the pigeon) and otherwise is not heard, other more advanced modulation principles can be used which makes it possible to determine the degree of correct aiming towards the right aiming point and even the direction ofthe error. Aiming which would lead to the shot passing to the left of the target thereby sounds in a certain way which can be differentiated from other aiming mistakes. In order to maximize the use ofthe ability ofthe sense of hearing to determine direction, the hit signal can be generated as a stereophonic sound, whereby modulation ofthe strength ofthe sound, phase difference between left and right channels and the frequency content can be used in order to indicate whether the shooter is aiming too low, too high, to the left, or to the right ofthe target, as well as the size of the misaiming. The acoustic signal can thus help the shooter to choose the correct aiming direction for a certain shot, but has also the object of giving an improved training effect through the shooter being able to couple together a certain visual impression ofthe target and its position and movement during aiming with an acoustic "feed-back " signal which indicates that this is the right aiming direction. A first embodiment for determining distance (with image processing') Determination of distance based on the size ofthe target: The distance is calculated on the basis ofthe camera image of the target. As the true size ofthe target is known, the distance ofthe target can be calculated as a function ofthe size ofthe target on the image surface and the focal length ofthe camera according to the following equation: D = (di target / dia ιmage ) f D = distance to the target dia target = the true -diameter of the target dia i mage = the diameter of the target in the image f = the focal length ofthe camera The determination of the diameter ofthe target in the image is performed along the longest axis, which for an ordinary clay pigeon is 1 10 mm. In this way the influence ofthe orientation ofthe target, which can vary, is eliminated. The distance measuring function according to this alternative puts a requirement on the resolution of the image, which consequently is chosen such that the accuracy requirement for measuring the distance is fulfilled. The distance measuring function is activated as soon as a target object is identified and is performed on all the images up to the firing. Out of this series of measured values which are then normally collected, the average value is calculated from a suitable number ofthe last values before firing. In this way the influence of spread in the measured values caused by variation as a consequence ofthe quantizing ofthe pixels, the out-of-focus caused by movement, etc., is reduced. The following will be stated about the methods which can be used for calculating the size of the target and thereby its distance: The pixels in the image are searched in several passes in different directons until a threshold is passed. The searching can be performed with several threshold values in order to increase the measuring accuracy. The greatest distance between the passages through the threshold gives a measure ofthe size. The measuring of the size can be performed by determination ofthe second derivative ' s zero transition which describes the edge ofthe object. The search then takes place for the largest distance between the zero transitions. The position of the zero transition is determined by linear inteφolation in order to increase the accuracy in the measuring. The operation is performed on an image with pixels of which the intensity is given with a resolution which gives a grey scale. The edge of the clay pigeon is defined by the inflection point in the gray scale which is the point where the second derivative is equal to 0. This zero transition does not have to lie on a pixel but its spacial position is given by surrounding intensity values. The distance between the zero transitions at the respective edges of the clay pigeon is a measure ofthe projected size ofthe clay pigeon. The inflection point can be subpixel- inteφolated as follows: if the second derivative for pixel No. is equal to 10 and for pixel No. i +1 is equal to minus 15, the position for the zero transition is defined as / + 10 / (10 - (-15)) = / + 0.4 . This type of inteφolation increases the accuracy in the calculation ofthe projected size and thereby the accuracy in the calculation ofthe distance. In determination ofthe direction ofthe shot, the distance information from several consecutive images is integrated and fitted to a likely throwing path. If the target moves in the field of view in the camera during exposing of an image, an unshaφness is caused by the movement which is proportional to the speed of movement and the exposure time. The unshaφness caused by movement causes the image to be reproduced more or less out of focus in the direction of movement. The method for calculating the size ofthe target includes a minimizing of the unshaφness caused by movement based upon a calculation thereof, which is based on the speed ofthe target in the field of view calculated from the movement of the target from image to image as well as the exposure time. In addition to said method for determining the size of the target, an alternative method can be used, based upon so-called correlation against a reference, whereby the target in the image is compared with a number of reference objects. Correlation over a certain level gives the size of the object. A second embodiment of determining distance Chased upon the path of the target If the spacial coordinates of the path ofthe target relative to the shooting position are known as well as the linear starting speed ofthe target, the distance can be unambig¬ uously calculated as a function using only the angular speed and direction of the target. The angular speed of the target can be calculated as the sum ofthe rotational speed ofthe barrel (which is received from the gyro signal) and the angular speed which corresponds to the movement ofthe target in the camera image. This method for measuring distance can be used for e.g. skeet shooting, where the path ofthe target is determined in advance. Before the shot is fired the actual parameters for the path of the target are given, for example by inputting the reference of the shooting station from which shooting shall take place. The reference of the shooting station can be automatically translated by the evaluation unit into the two paths of the target which can be actual for a certain shooting station and which correspond to the throw from either of the two clay pigeon throwers. Which of these two paths for the target which is actual for a certain shot is evident from the rotational direction of the barrel and therefore does not need to be indicated by any separate inputting. The analysis ofthe image information is reduced in this case to determination ofthe position and speed ofthe target object; the size ofthe target does not need to be evaluated as this is not needed for the calculation of the distance. The measuring of distance based upon earlier inputted information on the path of the target, gives a lower demand on the image quality and a simpler image-processing. Impact position calculating During firing the information on the direction and distance ofthe target stored before the firing are used for extrapolating the continued movement of the target up to the point in time when the charge of shot would have reached or, in the case of a miss, passed the target. This extrapolated direction is compared to the direction of the shot, i.e. the direction ofthe barrel at the moment of firing. In order to be able to extra¬ polate the absolute movement ofthe target, the information from the gyroscope signal on the rotational speed ofthe barrel (and the camera) is used in order to create a fixed reference direction. For a hit, the direction of the target at the impact time- point (within a certain error margin) must correspond to the direction of the barrel at the moment of firing. The difference between these two directions is caused by mis- aiming, the size and direction of which is indicated by the impact position indicator after calculating by the evaluation unit. Flow diagram in Fig 3 Fig 3 is a flow diagram for the function ofthe evaluation unit, when the first embodiment ofthe determination ofthe distance is performed. The input signals are a continuous series of camera images from camera 10 and a signal from the gyroscope 11, which gives the state ofthe movement of the barrel concerning rotation in the vertical and horizontal directions. The output signal is the impact position and an acoustic hit signal. Elimination ofthe background takes place in block 17, wherein the image is compared to a previous image stored in an image memory 17a. Its output signal is a filtered video image which in block 18 is analyzed for extraction of a possible target object. In addition to the video image from block 17 the measured values for the movement of the barrel from the gyroscope 1 1 are used as well as a predicted next position 19 as input signals to 18. After processing in the next block 20. which performs the size measuring, and in block 21. which performs the above described distance calculation, the calculated distance forms an input signal to a block 22, where the impact position calculation takes place. The input signal to 20 from the block 18 is a segment of the complete camera image which shows the extracted object and its immediate surroundings. The processing in block 22 is a prediction ofthe position ofthe target object at the calculated time of impact. The signals which are used in this case are, in addition to the distance which is received from block 21, a signal 24 which states whether the trigger has been activated, and the position and speed ofthe target object, which latter two are received from a block 23 which performs a speed calculation with the guidance of a position output signal from block 18 and the signal from the gyroscope 1 1 concerning the movement of the barrel of the weapon. The output signal from block 22 is used for controlling the impact position indicator 4 and the hit signal generator 6. Calibration of the position of impact calculation In order for the calculation ofthe position of impact to give a result which corresponds to the true position of impact, the aiming line ofthe system, i.e. the direction which is presumed to be the direction of the shot, must correspond to the true direction ofthe shot. During shooting with live ammunication this corre¬ spondence can be performed so that, after mounting of the camera on the weapon, a special calibration shooting is performed, whereby one lets the camera take a pic¬ ture of the charge of shot which in an early part of the shot lies in the shot container which at the same time forms the wadding. The exposure of the camera is controlled by the firing in such a way that an image of the discharged shot container is obtained before its direction has deviated from that of the charge of shot because ofthe air resistance. The direction of shot can then be deduced from the position ofthe dis¬ charge shot container in the image. During determination ofthe direction of shot vertically, a compensation is made for the parallax which occurs because of the central axis of the camera not correspond¬ ing to that of the barrel. Calibration can, as mentioned, take place during a special firing which precedes the normal use, but can also be a part of the normal function¬ ing at each shot. The advantage ofthe latter solution is that small displacements of the camera position can be tolerated during the shooting without deteriorated pre¬ cision ofthe impact position calculation. In this way the requirements for mecha¬ nical stability in the fastening of the camera part to the barrel are reduced, which is an advantage. Position of impact indicator 4 The position of impact indicator 4 shall give the result ofthe last fired shot to the shooter. Besides the position of impact, i.e. the size and direction ofthe mis-aiming, the indicator can also inform about the measured shooting distance as well as on how the target following has taken place, e.g. the relative speed between the line of sight and the target. The impact position indicator 4 can be either a separate physical unit or be joined together with the evaluation unit 13. A number of alternatives can be conceived for the design ofthe indicator: * graphic/numerical presentation on an indicator e.g. ofthe LCD type built together with the evaluation unit 13: * acoustic indication which gives the position of impact by means of synthetic speech; * an indicator which is placed so that during aiming the shooter sees the image from the indicator superimposed on the target area. The indicator shows the position of impact so that the shooter sees the direction of the charge of shot at the impact moment in relation to the true target. In the latter case the image is reflected from an indi- cator via a half- transparent mirror in a sighting means placed in the line of sight of the eye of the shooter (not shown but an arrangement which is wellknown to the person skilled in the art of head-up dis¬ playing). The image on the indicator, which at the hit moment. alternatively when passing the target, shows the position of the charge of shot, overlayed on the visual impression from the target region and gives the shooter a visual impression similar to that which is received during the use of tracer ammunication. In addition to the result ofthe shot being presented in the form of a measurement of the size of the mis-aiming, the position of impact indicator can calculate the likely- hood that the shot was a hit or a miss, in which case the design is suitably so that the parameters which control this calculation, above all the bore ofthe barrel of the weapon, can be varied by the user in order to correctly reflect the actual conditions. Hit signal generator The analysis of the images received from the camera takes place continuously. Amongst the results which are received from each such analysis is a measured value of the position of impact which would have been achieved if the firing had taken place at a certain given point of time in relation to when the image was exposed. By extrapolation ofthe position of the target, the calculation is made to be valid for the position of impact for a shot which is fired a certain time increment in the future. If the time interval is chosen so that it exactly compensates for the reaction time of the shooter, the shot will be certain to hit if the shooter follows the target so that the direction of the shot crosses the path ofthe target at the calculated impact time and fires just when he hears the hit signal. Evaluation unit Position of impact indicator Firing detector Rotation-measuring unit Camera Evaluation unit Position of impact indicator Camera Elimination ofthe background Picαire memory previous picture Rotation-measuring unit Speed measuring Extraction of the object Size measuring Distance calculating Firing detector Position of impact calculating Position of impact indicator Hit signal generator

Claims: Claims 1. Impact position marker for ordinary or simulated shooting from a fire-arm ( 1 ) towards a moving target, comprising a sensor part (2) with an estimating unit for the actual position ofthe target in relation to the fire-arm and a firing detector, characterized in that the estimating unit comprises an image taking device (10) with its optical axis directed parallel to the line of sight ofthe fire-arm (1 ), and that a unit ( 1 1 ) is arranged which measures the rotation of the line of sight of the image taking device in at least two planes at an angle to each other and comprising one and the same line coincident or parallel with the line of sight of the fire-arm. and that the output signals from the image taking device (10) and the rotation-measuring unit ( 1 1 ) and the firing detector (12) are fed to an evaluation unit ( 13), which at least calculates the distance to and the deviation from the line of sight from the correct line of sight for hitting the target, and a hit result unit ( 14) for giving an indication ofthe hit result. 2. Image position marker according to Claim 1, characterized in that the image of the target is arranged to be extracted out ofthe image taken with the image taking device ( 10). 3. Impact position marker according to Claim 2, characterized in that the image taking device (10) is monochromatic and colour-adjusted in order to give a large contrast between the target and the sky, and that the evaluation unit (13) localizes the target in the image by looking for image elements with a light level under or above a predetermined light level, dependent on the colour adjustment. 4. Impact position marker according to Claim 2, characterized in that the image taking device ( 10) is colour-adjusted for only a small number, e.g. two. of discrete colours, and that the evaluation unit (13) determines the position and size ofthe target in the image for at least one ofthe colours by looking for image elements with a light level under a predetermined first light level for that colour and for at least one other of the colours by looking for image elements with a light level above a second predetermined light level for that colour, and generates the complete representation of the target by a combination ofthe searches in the different colours. 5. Impact position marker according to Claim 2. characterized in that the evalua¬ tion unit (13) calculates the displacement ofthe background between different images with the guidance of signals from the rotation-measuring unit ( 1 1 ) and discriminates away the background by subtraction of the images with reference taken to eventual image displacement caused by panning ofthe image recording device between each pair of pictures taken. 6. Impact position marker according to any of the previous claims, characterized in that the evaluation unit (13) determines the distance to the target with the guidance of the true size ofthe target, the size ofthe target in the image and the focal length of the image taking device. 7. Impact position marker according to any ofthe previous claims, characterized in that the evaluation unit (13) determines the distance to the target by searching the image of the target, image element by image element, and comparing the object in the image with one or more previously stored reference objects, whereby correlation over a certain threshold gives the position and size of the target. 8. Impact position marker according to any ofthe previous claims, characterized in that the evaluation unit (13) determines the distance to the target with the guidance of previously stored information on the spatial coordinates of the shooting range and the position ofthe shooter at the time of the actual shot, and calculates the distance to the target as a function of this information and the angular speed of the target seen from the firing position. 9. Impact position marker according to any of the previous claims, characterized in that the evaluation unit (13) calculates the absolute angular speed of the target as the sum ofthe rotational speed of the weapon barrel received from the rotation- measuring unit (11) and the angular speed ofthe target which corresponds to the movement ofthe target in the image from the image taking device. 10. Impact position marker according to any of the previous claims, characterized in that the evaluation unit calculates the aiming off on the basis of information on the distance to the target and ofthe absolute angular speed ofthe target. 1 1. Impact position marker according to any of the previous claims, characterized by means for generating effects to simulate a realistic shooting experience in the case of simulated shooting, for example sound effects, such as the bang during firing activated by a trigger (5) on the weapon (1) and/or simulating the recoil by a mechanical device which simulates the movement of a weapon during firing. 12. Impact position marker according to any of the previous claims, characterized by an acoustic means (6) for producing an acoustic feed-back signal, which during aiming indicates whether or not the weapon is aimed towards a correct aiming point in order to give a hit. 13. Impact position marker according to Claim 12, characterized in that the sound from the acoustic means (6) at mis-aiming is modulated so that the shooter hears in which direction (vertically and horizontally) the direction of aiming is to be corrected in order to hit the target. 14. Impact position marker according to Claim 13, characterized in that the acoustic means is arranged to give a mono- or stereophonic signal so modulated that the character ofthe sound shows the relative distance between the aiming point which would give a hit, and the actual direction of aiming. 15. Impact position marker according to any of Claims 12 - 14, characterized in hat the acoustic means (6) comprises two sound sources, e.g. headphones, in order to give a stereophonic sound controlled by the evaluation unit ( 13). 16. Impact position marker according to any ofthe previous claims, characterized in that the hit result unit (4) comprises a head-up display combined with an aiming means on the weapon, which head-up display generates an image which is overlaid on the visual impression which is received during aiming. 17. Impact position marker according to any of Claims 1 - 15. characterized in that the hit result unit (4) comprises a graphic/numerical presentation on an indicator built together with the evaluation unit ( 13). 18. Impact position marker according to any of Claims 1 - 15, characterized in that the hit result unit (4) comprises an acoustic indicator which indicates the impact position by means of synthetic speech. 19. Impact position marker according to any ofthe previous claims, characterized in that the impact position indicator (4) evaluates the impact position continuously while the shooter is aiming the weapon (1) towards the target (8) and controls output means which informs the shooter of a suitable opportunity to fire. 20. Impact position marker according to Claim 19, characterized in that the output means give an acoustic signal which sounds just before the suitable firing time, whereby the time interval between the acoustic signal and the suitable firing time is adapted to correspond to the delay dependent on the reaction time of the shooter. 21. Impact position marker according to any of the previous claims, characterized in that a firing detector is arranged so that the sound from the cock and the movement of the firing pin are detected by a microphone the signal of which after suitable processing forms an indication of firing and is sent to the evaluation unit.

Inventors: AAHLEN HANS, ANDERSSON TOMMY, AAHLEN, HANS, ANDERSSON, TOMMY
Applicants: AAHLEN HANS, ANDERSSON TOMMY, TOMMY ANDERSSON DATA AB, AAHLEN, HANS, ANDERSSON, TOMMY
Application year: 1996
Main classification: F41G3
IPC codes: F41G3