Source: https://patents.google.com/patent/RU2473301C2/en
Timestamp: 2020-01-27 01:05:02
Document Index: 348812552

Matched Legal Cases: ['art 11', 'art 100', 'art 24', 'art\n12', 'art\n16', 'art\n18', 'art\n19', 'art\n20', 'art\n21', 'art\n22', 'art\n23', 'art\n24', 'art\n25', 'art\n34', 'art\n101', 'art\n102', 'art\n103', 'art\n108', 'art\n115']

RU2473301C2 - Method of perception measurement - Google Patents
Method of perception measurement Download PDF
RU2473301C2
RU2473301C2 RU2010100817/14A RU2010100817A RU2473301C2 RU 2473301 C2 RU2473301 C2 RU 2473301C2 RU 2010100817/14 A RU2010100817/14 A RU 2010100817/14A RU 2010100817 A RU2010100817 A RU 2010100817A RU 2473301 C2 RU2473301 C2 RU 2473301C2
RU2010100817/14A
RU2010100817A (en
Эрнст ПФЛЕГЕР
Кристоф ПФЛЕГЕР
2007-06-12 Priority to AT0091107A priority Critical patent/AT505338B1/en
2007-06-12 Priority to ATA911/2007 priority
2008-06-12 Application filed by Эрнст ПФЛЕГЕР, Кристоф ПФЛЕГЕР filed Critical Эрнст ПФЛЕГЕР
2008-06-12 Priority to PCT/AT2008/000210 priority patent/WO2008151346A1/en
2011-07-20 Publication of RU2010100817A publication Critical patent/RU2010100817A/en
2013-01-27 Publication of RU2473301C2 publication Critical patent/RU2473301C2/en
230000000007 visual effect Effects 0 abstract 15
230000003935 attention Effects 0 abstract 11
FIELD: medicine.SUBSTANCE: invention relates to method of perception measurement, in particular measurement of visual attention. Measured is individual visual attention, in accordance to which processed are, in particular, determined with application of system, determining glance direction, at least, first, referred to the first picture of image in the field of tested person's vision visual coordinates of the first centre of visual attention and, at least, second, referred to the second picture of image in the tested person's field of vision, visual coordinates of the second centre of visual attention. The second picture of image in the field of vision was recorded after the first picture of image in the field of the tested person's vision. Video image, recorded for determination of visual coordinates of visual attention centres by means of system for glance direction determination, is sent to the field of the tested person's vision. Centres of attention, related to, at least, first fixation or, at least, first succade, are presented in video image in the field of the tested person's vision. Second visual coordinates of the second centre of visual attention are checked by first visual coordinates of the first centre of visual attention in comparison device for correspondence to, at least, one first set criterion of glance fixation, and that first and second centres of visual attention in case of correspondence to the first criterion of glance fixation are referred to the first fixation, which deals with ordered perception, and is registered as such. And first and second centres of visual attention, if they do not correspond to the first criterion of glance fixation, are referred to the first succade of non-ordered perception, and registered as such.EFFECT: group of inventions makes it possible to measure visual attention, directed at definite sections of the surrounding world, accurately.36 dwg, 2 ex
The invention relates to a method for measuring perception, in particular measuring visual attention, according to the restrictive part of paragraph 1 of the claims.
The so-called systems of determining the direction of view are known, which allow you to determine which part or place of the field of view is directed to the observer's gaze. In this case, similar systems for determining the direction of gaze determine the so-called visual coordinates, that is, the coordinates within the field of view of the observer, to which the gaze of this observer is directed. A particularly outstanding and accurate method for determining visual coordinates is known, for example, from EP 1,300,018 B1.
Therefore, the basis of the invention is the task to propose a method of measuring perception, in particular, measuring the visual attention of the variety described above, which would allow as accurately as possible to measure visual attention directed at certain areas of the world.
According to the invention, the task is solved due to the features listed in paragraph 1 of the claims.
This allows scientifically sound and at a solid level to measure the subjects' perceptions of the surrounding world or its attention directed to certain parts of this surrounding world. So, for example, in a given environment, its parts can be precisely defined, perceived by the test subject reliably and consciously, as well as parts to which he only randomly and only casually turned his gaze. This allows you to evaluate or measure the quality of the environment, for example, the working environment, mainly in important safety or hazardous areas, for example, the carriageway of the street, especially turns, construction sites and / or sections of the road passing through settlements, control panels, central control rooms, control panels for a machine or machine, up to the organization of a workplace in the cabs of vehicles of ground and air traffic, and / or advertising environment, to For example, a graphic and / or text indicator or the so-called short advertising plot. Thanks to this, it is possible to evaluate or measure, first of all, the parts of the environment or the world that pose a serious danger to life and health, in terms of their degree of perception, and make changes to them in terms of improving the perception of important information. For example, the direction of the passage of the street can be optimized already at the design stage in terms of reducing the likelihood of traffic accidents, important traffic signs, for example, mandatory stop signs, can be purposefully and scientifically justified in places where they should be watched very closely attention to road users. The working environment can be purposefully formed in such a way that important, including from a security point of view, controls, indicators and controls require a focused perception from the user, while advertising media can be consistent with the requirements of their targeted perception by the observer.
In the dependent claims, which, like paragraph 1, are simultaneously part of the description, other preferred embodiments of the invention are described.
The invention is more fully disclosed hereinafter with reference to the accompanying drawings, in which, by way of example only, preferred embodiments of the invention are presented. Moreover, in the figures of the drawings are presented:
FIG. 2 - a human eye in a section;
FIG. 6 is a schematic representation of a user's gaze behavior during fixation;
FIG. 7 is a schematic representation of the behavior of the user's gaze during the sequence of its first fixation, saccade and second fixation;
FIG. 8 is a preferred embodiment of a mode of outputting a first relative distance;
FIG. 9 is a preferred embodiment of a video image output mode in a subject’s field of view with first and second circles;
FIG. 10 is a second preferred embodiment of a video image output mode in a subject’s field of view with a third circle;
FIG. 11 is a third preferred embodiment of a video image output mode in a subject’s field of view with a fourth circle;
FIG. 12 is a preferred user interface of a preferred embodiment of the invention in computer representation;
FIG. 13 is a first preferred embodiment of a frequency dispensing mode of certain gaze fixations depending on the angle of fixation;
FIG. 14 is a first preferred embodiment of a frequency output mode for certain saccades depending on the angle of the saccade;
FIG. 15 is a first preferred embodiment of the mode of outputting the frequency of gaze fixations depending on the variable criterion of fixations in the form of a family of curves with a constant first duration;
FIG. 16 is a fourth preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 17 is a fifth preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 18 is a sixth preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 19 is a seventh preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 20 - the eighth preferred version of the issuance of video in the field of view of the subject;
FIG. 21 is a schematic representation fixed on the head of the test part of the system to determine the direction of his gaze;
FIG. 22 is a schematic illustration of the eye movements of the subject;
FIG. 23 is a schematic representation of an image frame in a subject’s field of view;
FIG. 24 - the ninth preferred mode of issuing a video image in the field of view of the subject;
FIG. 25 - the tenth preferred mode of issuing a video image in the field of view of the subject;
FIG. 26 is an eleventh preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 27 is a twelfth preferred embodiment of a video image output mode in a subject’s field of view;
FIG. 28 is a preferred mask for issuing data of the first type;
FIG. 29 is a preferred mask for issuing data of the second type;
FIG. 30 is a first preferred embodiment of a mode for issuing a frequency of certain gaze fixations depending on the duration of fixation;
FIG. 31 is a first preferred embodiment of a frequency generating mode for certain saccades depending on the duration of the saccade;
FIG. 32 is a first preferred embodiment of a mode for outputting the frequency of certain blinks depending on the duration of blinking;
FIG. 33 and FIG. 34 is a first example of a preferred data mask of a preferred analysis tool;
FIG. 35 and FIG. 36 is a second example of a preferred data mask of a preferred analysis tool.
In FIG. 1, 3, 4 and 5 are flowcharts of preferred variants of a method for measuring perception, in particular measuring visual attention, and at least the first ones related to the first frame of the image in the field of view are processed - in particular, determined using the system of determining the direction of view of the subject, the visual coordinates of the first center of 37 visual attention and at least the second, referred to the second frame of the image in the field of view, the visual coordinates of the second center of 38 visual attention, m, the second frame of the image in the field of view was recorded after the first frame of the image in the field of view of the subject, and the second visual coordinates of the second center 38 of visual attention are checked by the first visual coordinates of the first center 37 of visual attention in the comparison device for compliance with at least one first the criterion 25 for fixing the gaze of the subject, and the first and second centers 37, 38 of visual attention when the first criterion 25 for fixing the gaze of the subject is referred to the first fixation 48, which has attitude to ordered perception, and register as such, and that the first and second centers of visual attention 37, 38, if the first criterion 25 of fixing the gaze does not meet, are referred to the first saccade of disordered perception and recorded as such.
This allows scientifically sound and at a solid level to measure the subjects' perception of the world around them or their attention directed to certain parts of this environment. So, for example, in a given environment, its parts can be precisely determined, perceived by the test subject reliably and consciously, as well as parts to which he only randomly and only casually turned his gaze. This allows you to evaluate or measure the quality of the environment, for example, the working environment, mainly in important from the point of view of safety or hazardous areas, for example the carriageway of the street, especially turns, construction sites and / or sections of the road passing through settlements, on-screen control panel, central control rooms, machine or machine control panel, up to the organization of a workplace in the cabs of vehicles of ground and air traffic, and / or advertising environment, to Reamer, graphics and / or text display, or so-called short advertising scene. Thanks to this, it is possible to evaluate or measure, first of all, the parts of the environment or the surrounding world that pose a serious danger to life and health, in terms of their degree of perception, and make changes to them in terms of improving the perception of important information. For example, the direction of the passage of the street can be optimized already at the design stage in terms of reducing the likelihood of traffic accidents, important traffic signs, for example, mandatory stop signs, can be purposefully and scientifically justified in places where they should be watched very closely attention to road users. The working environment can be purposefully formed in such a way that important, including from a security point of view, controls, indicators and controls require a focused perception from the user, while advertising media can be consistent with the requirements of their targeted perception by the observer.
The concepts chosen for substantive implementation relating to the first, second, third, etc. visual coordinates, centers of visual attention, fixations of the gaze, saccades, circles, fixation angles and / or saccades and the like should preferably not be taken in any way as a restrictive reduction of the process of implementation of the method to only two of these signs or to only one single implementation or implementation method, but only perceived as a description of one single process of implementation of the often-repeated method asked.
The methods according to the invention process the data obtained using the so-called system to determine the direction of the gaze of the subject. A similar system for determining the direction of a person’s gaze is presented, for example, in FIG. 21. A particularly preferred system for determining the direction of a person’s gaze is described, for example, in EP 1 300 108 A1. The principle of operation of such a system for determining the direction of the gaze of the subject, a brief description of which is given below, is based on the use of a method for recording, evaluating and analyzing the sequences of movements of the eyes of the subject using the system to determine the direction of gaze, and the image in the field of view of the subject registers forward and fixedly fixed on the subject’s head 80, the first camera 76, which records a video image in the field of view, while the movement of the pupils the second camera 77, similarly motionlessly fixed on his head 80, which registers a video image of the subject’s eye movements, and a video image of the subject’s eyes and image 9 in his field of vision are recorded on a video system with time synchronization, and for each individual frame of the video image of eye movements subject, therefore, for each frame of the image 78 in the field of view, the coordinates xa, ya of the pupil are determined, the correlation function K between the coordinates xa, ya of the pupil in the video image of motion r az test and coordinates xb, yb B corresponding to the center of visual attention, i.e. the points at which the subject fixes his gaze are determined on the image 79 in the field of view of the video recording 9 of this field of view, and after determining the correlation function K for each individual frame according to the xa, ya coordinates of the pupil, the xb, yb coordinates of the corresponding center B are extrapolated to the pupil’s video image visual attention on the video image in the subject’s field of view, moreover, to determine the coordinates xa, ya of the pupils for each frame of the video image of the subject’s eye movement using the image recognition program In this case, the pupil contrast values are automatically recorded relative to the surrounding image field, all points of a single frame are searched for, the brightness of which is less than the set, the dark plane whose brightness corresponds to the pupil brightness is completely taken into account and delimited, and the center of the dark plane corresponding to the center of the pupil is determined with coordinates xa, ya. Preferably, it can be provided that an arbitrary number of points along the edge of the pupil are selected, which, due to their contrast with respect to the surrounding image field, can be particularly well and reliably identified, and that these points are located as part of the ellipse, and the middle or center is calculated ellipse, the circumference of which is the specified number of points. All this allows us to achieve particularly high accuracy, far superior to the systems known from the prior art for determining the direction of the gaze of the subject. This eliminates the effect of interference caused, for example, by reflections in the subject’s eye on the measurement results. In FIG. 22 is a schematic example for a visual field of 78 eyes of a video image of a subject’s eye movement with xa, ya coordinates of the pupil. In FIG. 23 is a schematic example of a frame of image 79 in the subject’s field of view with xb, yb coordinates of the first center of visual attention 37. The task of systems for determining the direction of the examinee's gaze is to determine as accurately as possible the point at which the examinee's gaze is directed, i.e. on which his interest or attention is concentrated.
In this case, on the one hand, the image in the field of view is recorded by the first video camera 76, directed forward and fixedly mounted on the subject’s head 80. In addition, the movements of the pupil’s pupil are recorded by the second video camera 77, which is also fixedly fixed on his head 80. Fixedly fixed in this case means that both video cameras 76 and 77 are thus connected to the head 80 of the subject, that they move with it or repeat all his movements, and, however, the freedom of movement of the subject’s head and eyes is in no way limited. According to the results of the assessment of both the obtained videos, it is possible to determine with great accuracy what point the subject's gaze is directed at at a given time. This allows us to draw conclusions about the direction of the gaze, its fixation and lack of attention.
Such systems for determining the direction of the examinee’s gaze are used preferably in the field of safety, in particular when studying the causes of work-related injuries, but also in the field of advertising, sports, or other studies in the field of human physiology.
In general, the study of examination processes makes it possible to make a significant contribution to the study of the physiological causes of occupational injuries. For example, in the course of extensive studies of the line of sight, new data can be obtained that are important for elucidating the causes and reconstruction of occupational injuries from the point of view of the limits of capabilities of the human body.
So, for example, especially dangerous sections on streets and roads with high traffic density can be studied using systems for determining the direction of sight. During such an examination, a test subject with a system fixed on his head to determine the direction of his gaze passes a dangerous section of the road, and the entire process of visual recognition is recorded. The set of views analyzed in this case is hereinafter referred to as the sequence of views. According to the results of the analysis of the behavior of the examinee’s gaze, it is possible to understand which traffic signs or signal boards due to their unsuccessful location receive insufficient attention, or where in the area of the intersection there are especially inconspicuous places or places that traffic participants pay little attention to. In the field of occupational safety, for example, at construction sites, it is possible to investigate which sources of danger the subject pays attention too late and what precautions would be appropriate to take. Another important area of using systems to determine the direction of view is the analysis of the effectiveness of the impact of advertising posters or commercials. In this regard, one can also very accurately determine on which messages, texts, logos, etc. the subject has fixed his gaze for how long and in what sequence.
In FIG. 21 is a part of a system for determining a subject's gaze direction for implementing a preferred method for determining centers of visual attention or visual coordinates. The image in the subject’s field of vision is recorded by the first video camera 76, directed forward and fixed on his head 80. This first video camera 76 provides an approximate image of the direction of the person’s gaze, determined only by the position of his head 80. The first camera 76 can be performed, for example, as color video camera with charge coupling, which registers the predominant part of the subject's field of vision.
Preferably, the first video camera 76 and / or the second video camera 77 can additionally be programmed, which will allow them to better meet a wide variety of outdoor conditions. Due to this, even with direct shooting of the pupil, there will be a complete absence of distortion of its image, or with the immediate proximity of the camera to the eye 33, a larger image of the pupil will be provided with a comparative compactness of the entire device. Other known methods, both because of their size and because of the less favorable location of the center of the pupil, are the cause of significant blurring of the image. And this means not only an increase in the weight of the system to determine the direction of the gaze of the subject, but also imposes general restrictions on the entire process of visual recognition of objects of the surrounding world to the subjects, which can be eliminated by the method according to the invention. Therefore, a system for recognizing the direction of gaze without any restrictions can also be used by subjects in a wide variety of clothes, wearing personal protective equipment, such as a protective helmet. Thanks to this, a wide variety of video cameras 76, 77 with different lenses can be easily and simply used depending on the requirements for the study.
The preferably high-quality video cameras used in the preferred system are preferably equipped with a control device that allows automatic compensation of white balance, color balance and lighting. These parameters can preferably also be manually adjusted. This control device allows you to optimally match the quality of the image with the test conditions. Indeed, in this way a very high quality image is provided for its subsequent analysis. In addition, preferably there is still the possibility of digitally zooming in a fragment of the resulting image. Other parameter adjustments, as a rule, very conditionally affect the quality of the resulting image.
The movement of the pupil’s pupil is recorded by the second video camera 77, also fixedly fixed on his head 80 and directed to one of both eyes 33 of this person. The second video camera 77 can be implemented, for example, as a black-and-white video camera with charge coupling and to record the movements of the right eye of the subject. The registration of the position of the pupil by the second video camera 77 is carried out directly using the system drawings shown in the figures to determine the direction of the gaze of the subject, the second camera 77 being directed directly to the eye of the subject 33. But to register the position of the pupil, optical deflecting systems such as mirrors or fiberglass cables, deflecting the image from the eye 33 to the second video camera 77, can be successfully used.
Both cameras 76, 77 are fixed, for example, on a helmet or glasses or other similar, preferably simply put on and removable mounting device, which is fixedly mounted on the head 80 of the subject. Fixedly fixed, as mentioned above, means that the mounting device and both cameras 76, 77 follow all the movements of the head 80, and however, the freedom of movement of the head 80 and eyes of the subject is not limited in any way. The installation of video cameras 76, 77 on glasses as an easily and simply put on and removable mounting device with the possibility of direct registration on a portable video recording device allows you to ensure the maximum possible mobility of the subject and a much greater variety of studies - compared to traditional systems.
Of course, it is also possible to provide several second video cameras 77, for example, to record the movements of both pupils of the subject. In addition, you can also use the first few cameras 76 to record the image of the entire field of view of the subject in full, if the focal length of the first first camera 76 is not enough. All this allows you to record individual sequences of eye movements of the subject, as well as to evaluate and analyze them, as described below. Moreover, by the sequence of eye movements is meant the totality of eye movements recorded and analyzed in each particular case.
Both video cameras 76, 77 make it possible to obtain two video signals, hereinafter referred to as a video image of eye movement and a video image in the field of view of the subject and shown schematically in FIG. 22 or 23, which are recorded on the video system. By video system here is meant any devices suitable for recording video data. Can be used analog filming techniques, as well as video tapes or digital storage media such as DVDs or the like. Storing individual images in computer memory is also their recording in the sense of the present invention. A wide variety of analog or digital video formats can be used, for example, DV, AVI or MPEG2. When using a charge-coupled camcorder, both video sequences are preferably recorded on a digital video system, for example, two video recorders with mini DV discs.
In one of the preferred embodiments of the invention, the connection between the cameras 76, 77 and the video system can be performed using a wired or radio line. The latter allows cableless transmission of video signals to a recording video system. Due to this, almost complete freedom of movement of the test subject as a pedestrian, cyclist in the open air or on scaffolding or construction sites is preferably ensured.
It is very important that both video signals are synchronized in time, i.e. so that for each individual frame of the video image of the eye movement of the subject, a corresponding separate frame of video image 9 is determined in its field of view, and vice versa. For such synchronization, a periodic signal generator and a time code can be used. The video recording process is preferably synchronized by a tone pulse, which is also recorded on the corresponding audio tracks. This method allows you to simultaneously synchronize other external devices, such as a UDS data logger, GPS systems, etc., so that other technical and medical parameters can be matched, for example, the current geographical location, heart rate or pulse rate of the subject, electrical skin resistance, respiratory rate, etc. directly with his visual behavior. Time synchronization is very important for the subsequent processing or analysis of both video signals according to the invention.
In a preferred embodiment of the method, the exact coordinates (xa, ya) of the center of the pupil of the test subject are determined from the video of the movement of his eyes using an image recognition program. In this case, the coordinates of the pupil (xa, ya) are determined for each individual frame of the video image of the eye movement of the subject. The coordinates of the pupil (xa, ya) in a separate frame of the video image of the subject’s eye movements are generally shown in FIG. 22. The determination of the coordinates of the pupil (xa, ya) is preferably carried out automatically using the pattern recognition program. For this purpose, for each individual frame of the video image of the subject’s eye movements, the contrast between the pupil itself and its environment is recorded and all points of this frame are found whose brightness is less than the set level. At these points, the dark plane is completely set and delimited, after which the center of this dark plane is determined. Since the dark plane corresponds to the pupil of the subject, the center of the dark plane represents the center of the pupil of his eye. Preferably, the pattern recognition program offers tuning options for different contrast and brightness levels, which allows for a high degree of accuracy for each individual frame of the video image. As mentioned above, it can be additionally provided that an arbitrary number of points along the edge of the pupil be selected, which, due to their contrast with respect to the surrounding image field, can be particularly well and reliably identified, and these points would be located as part of the ellipse, after which calculates the middle or center of the ellipse, the circumference of which is the specified number of points. Thus, for each individual frame of the video image, the best contrast can be provided in the form of a limit value according to gray level under various lighting conditions, which together allows for accurate determination of the pupil coordinates (xa, ya). The gray level limit value is a value that, for example, in digital format is between 1 and 256 and determines the percentage of black or white at the image point. The maximum attainable value corresponds to completely black, and the minimum attainable value corresponds to completely white. Since the pupil during video recording probably can never reach the level of completely black, it is necessary to determine the level, which, at least for this frame, corresponds to the really existing gray color of the pupil. The threshold level excludes all image points whose brightness is higher than the set gray level, and the center of the dark plane is determined by all the darker parts of the image. Three parameters allow you to optimize the determination of the threshold level. Since the lighting conditions are often very different when conducting tests within a video sequence, such a determination of the threshold level is preferably also possible for each individual frame individually. All settings in accordance with the highest requirements for each frame of the video sequence can be saved to a file. The method according to the invention allows to achieve particularly high accuracy when comparing the coordinates of the pupil of the subject (xa, ya) with his field of vision. It is possible to visualize each level of accuracy.
In order to achieve a particularly high degree of accuracy of the determined pupil coordinates and, at the same time, a particularly high accuracy in determining the direction of the test eye, in a particularly preferred embodiment of the method according to the invention, it is provided that optical defects are additionally corrected, in particular, distortion caused by the lens, perspective correction , correction of the field of view and / or correction of the so-called image distortion, such as, for example, spherical aberration, chromatic aberration, light scattering defect symmetry (coma), astigmatism of oblique beams (or astigmatism) of curvature of the image field curvature of the image field, optical distortion and / or monochromatic image defects.
In front of the camera for more accurate localization of the center of the pupil, an infrared filter can additionally be provided. Its purpose is to enhance the contrast of the video image of the subject's eye movements. The infrared filter preferably has two functions: firstly, the eye 33 is illuminated by infrared light emitting diodes (IR-LEDs), which even in complete darkness provide good image contrast from the camera for recording eye movement for subsequent processing. The task of the filter is to pass the light emitted by the IR spectrum LEDs onto the camera matrix, while all other areas of the spectrum are accordingly eliminated by the filter transmission curve. Secondly, the reflections caused by sunlight on the pupil, which adversely affect the accuracy of determining the center of the pupil, are present mainly in the blue region of the spectrum. So in this regard, the filter’s task is to reduce the reflections on the pupil caused by sunlight.
In another preferred embodiment of the method, after automatically determining the coordinates of the pupil (xa, ya), manual control is additionally performed. The operator can, with incorrect automatic determination, as often happens when sudden reflections of light occur on the surface of the eyes, etc., manually change the image processing parameters. In addition, it is still possible to directly correct the coordinates of the pupil (xa, ya).
In total, for each individual frame of the video image of the subject's eye movements, the pupil coordinates (xa, ya) are obtained, for example, in the form of a pair of Cartesian coordinates. Of course, other coordinate systems can be used, for example, polar coordinates, etc. Since both video cameras 76, 77 are fixed on the subject’s head 80, then for each specific position of the pupil or the center of the pupil in the video image of the eye movement, there is always a precisely defined center of visual attention to video image 9 in the field of view. Thus, from the video image of the subject’s eye movement and the video image 9 in the field of view, it is possible to accurately calculate at what point the subject’s gaze is directed. In order to compare the coordinates of the pupil (xa, ya) with the coordinates (xb, yb) of the corresponding center of visual attention B, i.e. the point at which the subject’s gaze is fixed, the correlation function K between these two pairs of coordinates (xa, ya) and (xb, yb) must first be determined on the video image of his field of vision. The correlation between the coordinates of the pupil (xa, ya) and the center of visual attention B in the video image in the field of view of the subject is established during a series of experiments (calibration). In this case, the subject alternately fixes his gaze at certain predetermined control points P. The correlation function K between the coordinates of the pupil (xa, ya) and the coordinates (xb, yb) in the video image in the subject’s field of vision is determined from the measured data.
In a preferred embodiment of the method, the correlation function K between the coordinates of the pupil (xa, ya) on the video image of the subject’s eyes and the coordinates (xb, yb) of the corresponding center of visual attention B on the video image 9 of his field of vision is preferably determined automatically. To do this, first record one or more sequences of samples of the subject’s views on one or more specified control points P. Under the sequence of samples of the subject’s views, it is necessary to understand the sequence of views that is recorded exclusively for calibration, when the subject directs his eyes to the given control points R. For example, a certain control point P can be marked on the wall. To obtain the maximum possible contrast, for example, a black mark on the rest of the white surface can be selected as the control point P. The control point P, as a rule, is a cross or a luminous point or something else like that. The subject is required to fix his gaze on this control point P, and a video image is recorded in the field of view and his eye movements using both cameras 76, 77. In this way, several control points P can be set.
Since the center of visual attention on the recorded video image of the sequence of gaze samples in the subject’s field of view is set according to the known control points P, the correlation function K between the pupil coordinates (xa, ya) on the video image of the subject’s eye movements and the coordinates can be determined as the next step (xb, yb) of the corresponding center of the field of view B in the video image in its field of view. To this end, for each individual frame of the video image of the eye’s movements of the subject, the coordinates of the pupil (xa, ya) on the video image of the movements of his eyes are determined according to the method described above. Then determine the coordinates (xb, yb) of the control point P on the corresponding frame of the video image in the field of view of the subject. This is preferably done using an image recognition method and / or an image recognition method that determines the coordinates (xb, yb) of a control point P uniquely recognized by its contrast on a video image in the subject’s field of view. However, it is also possible to set the coordinates (xb, yb) of the control point P for each individual frame manually, for example, with a simple click of a computer mouse. This allows you to analyze the sequence of samples of views and under adverse conditions on the ground, when the automatic determination of the coordinates (xb, yb) of the control point P is impossible, for example, due to too heterogeneous background.
Thus, the coordinates of the pupil (xa, ya) on a separate frame of the video image of the subject’s eye movements can be correlated with the coordinates (xb, yb) of the control point P on the corresponding separate frame of the video image in his field of view. The corresponding coordinates in the video image of the subject’s eye movement and his field of vision are determined and stored for each individual frame. The coordinates of the pupil (xa, ya) on the video image of the subject’s eye movement and the coordinates (xb, yb) of the corresponding center B of visual attention in the video image in his field of view can be correlated with all the data sets obtained in this way, preferably by quadratic regression, and they can be used for correlation and other options, such as the linear regression method or stochastic models. The result is a correlation function K: (xa, ya) -> (xb, yb), which unambiguously correlates with the specific set of pupil coordinates (xa, ya) in the video image of the subject’s eyes the corresponding coordinates (xb, yb) of the center of B video image in his field of vision.
To achieve the greatest possible accuracy of the correlation function K, it is necessary to use at least 25 different positions of the control point P. Starting from 100 different positions of the control point, the achieved accuracy practically does not increase anymore, so a further increase in the number of positions of the control point is not advisable. Therefore, preferably 25 to 100 positions of the control point are used. Using the correlation function K defined in this way, all other video sequences of the same series of experiments can be calculated, i.e. in which there are no changes in the position of the cameras fixed on the subject’s head. Using the method of quantitative correlation of both pairs of coordinates, nonlinear relationships can also be determined.
After calibrating the system to determine the direction of gaze, it is possible to record and analyze individual sequences of eye movements of the subject. After the correlation function K has been determined, for each individual frame according to the coordinates of the pupil (xa, ya), the coordinates (xb, yb) of the corresponding center of visual attention B on the video image in its field of vision are extrapolated on the video image of the subject’s eyes.
The video image of the subject’s eye movement and the video image 9 of his field of vision are reduced to the final video image in a programmed way so that the calculated centers of visual attention are positioned as the centers of attention drawn by the subject’s gaze on video image 9 in his field of vision. Thanks to the calculated determination of the coordinates (xb, yb) of the centers of visual attention B according to the invention, it becomes possible to provide a particularly accurate representation of the center of attention to which the subject's eyes are drawn. The center of visual attention can be precisely marked on video image 9 in the subject's field of vision. Preferably, the center of visual attention on the video image 9 in the field of view of the subject is marked with visually clearly distinguishable markings, for example, in the form of a cross.
Using the method according to the invention, it is possible to determine which parts of the surrounding observer of the world he is paying his visual attention to, what areas of the environment the subject actually perceives and in which parts his gaze, although it glides, only briefly or briefly, or are they so far that there is no purposeful perception of the subjects. This means that the subject glanced at the site of his environment, but did not notice for himself the contents of this site. Sites in which an orderly perception took place are hereinafter referred to as “gaze fixation”. Sites where orderly perception took place, but orderly perception was absent, hereinafter referred to as "saccades".
In FIG. 2 shows a human eye 33 in a section, and also sites of various visual acuity are noted. An important role is played by the so-called foveal region 34, located only in a narrowly limited area around the central visual axis not marked on the figure, in which, as a matter of fact, the highest possible visual acuity is possible, which is why the ordered perception of visual irritations is connected. According to previously accepted definitions of the foveal region 34, it starts from the first angle of view 41 from the first radius and extends about 1 ° around the visual axis. However, as will be described later in this document, the first angle of view 41 of the foveal region 34 is largely dependent on the object or environment. The foveal region 34 is surrounded by the so-called parafoil region 35, which still provides recognition of large images. The so-called peripheral region 36 surrounding this parafeal region 35 is sensitive only to the perception of movements. Recognition of an image or object in this peripheral region 36 is not possible.
In the method according to the invention, at least indirectly following one after the other centers of visual attention 37, 38 in the comparison device are studied or compared for their compliance with at least the first fixation criterion 25. In relation to the comparison device, we can talk about any suitable device of this kind. Preferably, devices are used for this, which include electronic logic elements or so-called logic gates that allow comparison of input data using Boolean functions. Even more preferred are devices containing similar electronic logic elements in integrated form, in particular in the form of processors, microprocessors and / or programmable logic circuits. In a particularly preferred embodiment of the method, the comparison device can be implemented on a computer basis.
The comparison device processes the so-called visual coordinates, which can be abbreviated SKO in this document and which can be determined using at least the correlation function described above between the image in the field of view 79 and the image of the movements of the eye 78 of the subject, and the visual coordinates can be determined using other methods and techniques. In FIG. 1 under reference 2 presents an approximate list of possible visual coordinates for individual frames of the image in the subject’s field of view, abbreviated as Frm (frame) in the Cartesian coordinate system.
Regarding the first criterion 25 of fixation, we can talk about criteria of any kind, which allows you to distinguish between fixation and saccades. In one preferred embodiment of the method according to the invention, it is provided that the first fixing criterion 25 is a predetermined first distance 39 around the first center of visual attention 37, which determines the first relative distance 40 between the first center of 37 visual attention and the second center of 38 visual attention, and that if the first relative distance 40 is less than the first distance 39, the first and second centers of visual attention 37, 38 are assigned to the first fixation 48 of the subject’s gaze, until the second visual attention center 38 following the first center of visual attention 37 remains within the foveal region 34 of the first visual attention center 37 and, thus, within the ordered perception area of the first visual attention center 37, ordered perception is not interrupted and, therefore, the first fix criterion 25 is still executed. Therefore, we are talking about the first fixation of the 48 eyes of the subject. In a particularly preferred embodiment of the method according to the invention, it is provided that the first distance 39 is a first angle of view 41, which preferably describes a region 34 related to foveal vision, in particular a radius between 0.5 ° and 1.5 °, preferably about 1 ° , and that the distance between the first center of visual attention 37 and the second center of visual attention 38 is represented by the first relative angle 42. This makes it possible to particularly easily and accurately determine saccades or fixations in view 48 or 49, based on those established using the system to determine the direction of view of the visual coordinates. In FIG. 6 illustrates, by way of example, a first fixation 48 formed from a first sequence of four centers of visual attention 37, 38, 69, 70. In FIG. 6, the first distance 39, the first angle of view 41, the first relative distance 40 and the first relative angle 42 are also noted. Around each of the four centers of visual attention 37, the first circle 43 is marked, the radius of which is equal to the first distance 39, whereby it is clearly demonstrated that each subsequent center of visual attention 38, 69, 70 is inside the first circle 43, the radius of which is equal to the first distance 39 of the previous center of visual attention 37, 38, 69, so that the preferred first criterion 25 is fixed The action is executed. In order to adapt to different recognizable objects or different subjects and / or different test conditions while improving the invention, it is provided that the first fixing criterion 25, in particular the first distance 39 and / or the first angle of view 41, can be set arbitrarily.
In FIG. 7 shows a sequence of views in which not all centers 37, 38, 69, 70, 71, 72, 73, 74, 75 of visual attention satisfy the first criterion 25 of fixation. Each of the first four centers of visual attention 37, 38, 69, 70 meets the fixation criterion 25 and together they form the first fixation 48, while each of the next three centers of visual attention 71, 72, 73 does not meet the first fixation criterion 25. Only the fourth center subsequent to the first fixation 28, the center of visual attention 74 satisfies the first criterion 25 of fixation, in contrast to the third center following the first fixation 48, the center 73 of visual attention. The third, following the first fixation 48, center 73 of visual attention, thus, is the first center 73 of visual attention for the second fixation 49, collectively formed by three centers 73, 74, 75 of visual attention. In FIG. Figures 6 and 7 show preferably illustrative examples, because in a natural environment, fixations 48, 49 can also be found with many separate centers of visual attention. The area between the last center of visual attention 70 of the first fixation 48 and the first center of visual attention 73 of the second fixation 49 forms a saccade, so there is no perception in this area. The angle between the last center of visual attention 70 of the first fixation 48 and the first center of visual attention 73 of the second fixation 49 is also designated as the first angle 52 of the saccade.
In FIG. 1 is a flowchart of a method according to the invention, and in step 1, a video image 9 in the subject’s field of view and a video image of his eye movements are recorded using a system for determining the direction of view. At the 2nd stage of the method, the visual coordinates of the SKO are determined from the video image in the field of view of the subject and the video image of the movements of his eyes, which in the next step 4 of the patented method are compared in the comparison device with the specified, saved, read or arbitrarily set first fixing criterion 25. After that, separate so-called saccade or fixation 48 or 49 centers of visual attention 37, 38 can be issued for further evaluation, processing or visual presentation. In particular, it can be provided that the first and second centers of visual attention 37, 38 are issued marked as belonging to the first fixation 48 or the first saccade.
The comparison device compares two, at least indirectly following one after another frames of the video image in the field of view of the subject or the visual coordinates SKO associated with them. Preferably, it is hereby provided that the second frame of the video image in the subject’s field of view was recorded after a predetermined first period of time, in particular from 0.005 s to 0.1 s, preferably from 0.02 s to 0.04 s, immediately after the first frame video images in his field of vision. Due to the fact that the resolution of the human eye 33 in the perception of movement in the foveal region 34 is only about 25 Hz, it is preferably provided that the time interval between two immediately following one-shot frames of the video image in the field of view of the subject is approximately 0.04 s. Depending on the requirements for resolution, other frames of the video image can be recorded in the subject’s field of view, and the time interval between two immediately following frames of the video image in the field of view is reduced to achieve a higher resolution of the eye during the perception of movement, and / or a specified number of frames of the video image in the subject’s field of view can be skipped or recorded with a lower time resolution, as a result of which the resolution to spriyatiyu movement is reduced but also the amount of mathematical calculations is also reduced. By comparing successive frames of the video image in the subject’s field of view, one can achieve both a higher resolution in the perception of movement and simplify the design of the system, since it is possible to do without frame sampling systems and an intermediate drive.
In FIG. 3 is a flowchart of a particularly preferred embodiment of the method according to the invention, moreover, immediately following the steps of the method described above, according to FIG. 1, further processing of the obtained data is provided, depending on whether the center of visual attention 37, 38 is assigned to fixation 48, 49 or saccade. It is provided that the first relative distance 40 is issued along with the centers of visual attention marked as belonging to the first fixation 48 or the first saccade. Moreover, the data for the first output 10 are prepared in the form of a first diagram 11 and / or for the second output 5 on the video image 9 in the field of view of the subject, and it is preferably provided that the video image 9 in the field of view of the subject is recorded, recorded to determine the coordinates of the centers 37, 38 of the visual attention, and that visual attention centers on at least the first fixation 48 or at least on the first saccade 37, 38 of the visual attention on the video image 9 in the field of view, due to which it becomes possible to quickly and visually cial simple estimate of visual perception.
In FIG. 12 is a screen shot of a preferred user interface 55 of a computer program for implementing the method according to the invention, wherein a video image 9 is presented in the field of view of a test subject on the bottom left, in which, in accordance with the method described below, data relating to the affiliation of individual centers 37, 38 visual attention to fixation 48, 49 or saccade. On the left of the video image 9 in the field of view of the test subject, the first diagram 11 is displayed synchronously with it in time, and on the right next to the video image 9 in the field of view - also synchronously in time with the video image 9 in the field of view of the test subject - a fragment of the first chart 11. In addition, the preferred the user interface contains a number of controls and / or data entry.
In the first diagram 11, over the time changes of the video image 9, the first relative distance 40 between the two following one after the other centers of visual attention 37 or between the next one after the other centers of visual attention 37, 38, which are in the comparison device, is always displayed in the field of view were compared for compliance with the first criterion 25 fixation. In FIG. 8 shows a preferred embodiment of the first diagram, the time 53 or the number 54 of successive frames being shown on the abscissa axis, i.e. frames in the field of view of the recorded video image 9, and the first relative distance 40 or the first relative angle 42 is shown on the ordinate axis. Data on each first relative distance 40 between two consecutive frames of the video image in the subject’s field of view related to saccade or fixation 48 , 49, are subsequently issued for representing in color or brightness the individual first relative distances 40 or the first relative angles 42. According to such a first diagram 11, it is possible to quickly and easily check s 9 video in the field of view on the level of perception, in particular on the level of visual attention. In addition, it may be provided that a marker is provided on the first diagram 11 to mark the place currently represented on the video image 9 in the subject’s field of vision, the first diagram 11 being constantly re-determined from the current video image 9 in the field of view and / or constantly issued to indicate the area around the fixed marker in the form of a movable and variable first diagram 11.
In addition to providing data on whether the center of attention 37, 38 of the visual attention to fixation 48, 49 or saccade in the first diagram 11, it may be possible to provide corresponding data in the form of a specially adapted video image 9 in the subject’s field of vision, as shown in FIG. . 3 by blocks 6, 7 and 8. Preferably, three different data output modes are provided, each time only one of these three modes can be provided, although data can be simultaneously provided in two or three modes simultaneously.
In FIG. 9 shows a first preferred video output mode 6, which is also shown in a snapshot of the screen of FIG. 12, and together with the current visual attention center 37 in the presented current video image 9, a first circle 43 is formed in the subject’s field of view, located essentially uniformly around the center of visual attention 37, the radius of which corresponds to the first distance 39, and / or together with the current center 37 of the visual attention in the presented current video image 9 in the field of view of the test subject is given a second circle 44, located essentially evenly around the center 37 of the visual attention, glad the jesus of which corresponds to a predetermined second distance, the second distance being preferably a second angle of view, preferably describing a region 35, preferably responsible for paraffeal vision, in particular with a radius of up to 5 ° or more, and when viewing a video image 9 in the field of view of the test subject areas are recognized in which, due to the distribution of visual acuity around the central visual axis, an ordered or disordered perception of visual irritants is generally possible oi. Additionally, it can be provided that by combining the centers of visual attention 37, 38 following one after another, the first trajectories 45 of the subject's gaze movement are determined, which are presented at least temporarily in the video image 9 in the field of view of the subject, therefore, the trajectory 45 of the subject's gaze movements after a predetermined time has elapsed again gradually removed from the video image 9 in the field of vision, in particular, by their continuous attenuation, so that you can quickly and easily determine which areas of the video image zheniya 9 in sight from the observer or subject to a short period of time, depending on the characteristics of the person, remember him or left in his short-term memory.
A second preferred video output mode 7 is shown in FIG. 10, and it is provided that the image points 37 marked as being attributed to at least the first fixation 48 represent substantially evenly surrounded by the third circle 46, the radius of the third circle 46 being a function of the continuous duration over time of the first fixation 48 of the subject’s gaze, for which reason the third circle as the continuous duration of the corresponding fixation is constantly increasing. Additionally, it can be further provided that the saccades between two successive fixations 48, 49 are connected by a line passing through the centers of visual attention. Preferably, the individual latches 48, 49 or saccades shown in the image are again removed from the video image 9 in the field of view of the subject after a predetermined period of time. In order to be able to recognize differences between several simultaneously issued saccades or fixations 48, 49, it may be provided to mark them with different colors and / or shades of gray, and it may be provided to mark fixations depending on their order with different colors, shades of gray and / or the shape of the circles.
In FIG. 11 shows a third preferred mode 8 for outputting a video image 9 in a subject’s field of view, it is envisioned to present it in a darker manner and visual centers of visual attention marked at least for the first fix 48 to be substantially uniformly surrounded by a fourth circle 47, the area of the fourth circle 47 Compared to the darkened video image 9, it appears at least temporarily lighter in the field of view. This is a particularly preferable option, because - by the type of directional illuminator or searchlight - only areas that are actually quite well perceived or perceived by the test subject are clearly visible. All other areas appear darkened because they really were not properly visually perceived.
In addition to outputting the video image 9 processed according to the invention in the field of view of the subject or to output 12 of the first diagram 11 (FIG. 8), an evaluation of the entire sequence of the specified first segment or the entire video image 9 in the field of view may be provided, and the first choice 13 ( Fig. 3) the first segment of the video image 9 in the field of view. To this end, in the pre-processing unit 14, all subsequent centers of visual attention 37, 38, 69, 70 that meet the first fixation criterion 25 are compared with the first fixation 48, and the angular distance between the first center of visual attention 37 related to the first fixation 48 is determined , and the last center of visual attention 70 related to the first fixation 48, and issue as the first fixation angle 51 (Fig. 13). In addition to this, it is preferable to determine the angular distance between the last center of visual attention 70 related to the first fixation 48 and the first center of visual attention 73 relating to the second fixation 49, and give out as the first angle 52 of the saccade (Fig. 14). This allows you to purposefully measure the attention to certain set objects or scenes of the video image 9 in the field of view, since in this case, in addition to the first measurement result, depending on whether the center of visual attention 37 refers to fixation 48 or saccade, the second the result of the measurement by time or local fixation duration 48 or saccade. In a preferred embodiment of the method, it is provided that for a given first segment of video image 9, the frequency of certain fixations 48, 49 depending on the angle of fixation 51 is outputted to the field of view, and / or that for the first segment of video image 9, the frequency of certain saccades depending on angle 52 saccades or depending on time. Preferably, it is provided that the corresponding fixation criteria 25 or satisfying fixations 48, 49 are issued in the form of a first fixation diagram 15, and the saccades determined by the first fixation criterion 25 are issued in the form of a first saccade diagram 20. This allows you to quickly and easily evaluate the entire sequence or the first segment you specify. In FIG. 13, such a first fixation diagram 15 is shown, wherein the first fixation angle 51 is plotted on the abscissa axis, and the frequency 56 is plotted on the ordinate axis, at which fixations 48, 49 meet with the corresponding angle 51. Presented in FIG. 13, the first latch diagram 15 thus demonstrates latch fluctuations when traveling by car. In FIG. 14 is a first saccade diagram 20, with the first angle 52 of the saccade being plotted on the abscissa axis, and the frequency 56 at which the saccades meet with the corresponding angle 52 are plotted on the ordinate axis. FIG. 14, the first saccade diagram 20 thus demonstrates fluctuations in saccadic eye movements when traveling by car. Preferably, it may be provided that the user interface further comprises means for selecting a first segment of the video image 9 in the field of view.
It can also be provided that the first segment is depicted as a window of predetermined dimensions on both sides of the marker shown in the first diagram 11, and that the first fixation diagram 15 and / or the first saccade diagram 20 for this segment of constant length is continuously calculated and displayed, but moreover, constantly changing content.
In addition to or alternatively to issuing a first fixation diagram 15 and / or a first saccade diagram 20, it can preferably be provided that for a given first stretch of video image 9 in the field of view are all the subsequent centers of visual attention 37, 38, 69, 70 that satisfy the first fixation criterion 25, is jointly assigned to the first fixation 48 and that the first fixation duration 103 is determined between the first, the center of visual attention 37 assigned to the first fixation 48 and the last, related to the first fixation 48 Centralized 70 visual attention, as well as 56 that provides a frequency specific fixations 48, 49 depending on the length 103 of the first fixation. In FIG. 30 shows a particularly preferred mode of output in the form of a chart 100 of the duration of fixation, and on the abscissa axis the first duration of fixation 103 is plotted as the duration of fixation 48, 49 in time, and the number of frames 106 or frames of video image 9 in the subject’s field of view can be provided as equivalent scaling , and moreover, the frequency 56 is plotted on the ordinate axis, with which there are fixations 48, 49 of the corresponding duration 103 in the given first segment of video image 9 in the field test subject's view.
Further, it was particularly preferably provided that for the first segment of the video image 9 in the field of view the first duration 104 saccades is determined between the last, attributed to the first fixation 48 center of visual attention with the first, attributed to the second fixation 49 center of visual attention and that a frequency of 56 certain saccades depending on the first duration 104 saccades. In FIG. 31 shows a particularly preferred mode of output in the form of a diagram 101 of the saccade duration, the first saccade duration 104 as the duration of the saccade 48, 49 in time being plotted on the abscissa axis, the number of frames 106 or frames of the video image 9 in the subject’s field of view being provided as equivalent scaling and moreover, the frequency 56 is plotted on the ordinate axis, with which saccades of corresponding duration 104 are encountered in a given first segment of video image 9 in the field of view and pytuemogo. By issuing a frequency of 56 for saccades or fixations 48, 49 depending on the first duration 104 saccades or the first duration 103 fixation, it is possible to quickly and simply analyze what kind or quality of eye contact and visual attention were in the first segment of the video image. This allows you to quickly, simply and unequivocally recognize object and / or situation-dependent differences.
In the method according to the invention, in addition, time intervals during which the eyes remain closed can be automatically recognized. The reason for such periods of time is the so-called blinking, in which the pupil is temporarily blocked by the eyelid. The study of the first duration of 105 blinks as the duration of blinks in time, as well as the frequency with which blinks occur during an arbitrarily set first duration of 105 blinks, turned out to be very useful for assessing the relationships between the physiology of vision. In FIG. 32 shows an approximately preferred mode of output in the form of a blink diagram 102, the frequency 56 being issued, at which blinks occur for an arbitrary duration of 105. It was found that a conclusion can be made about the high degree of complexity of the situation or object based on the low blink rate or the first duration of 105 blinks, and vice versa. In addition, too low a blink rate can lead to drying out of the cornea and, at the same time, to eye disease and / or vision problems. Therefore, from all of the above, we can conclude that, starting with a certain degree of complexity of the current situation, we should expect a decrease in the ability to visual perception due to the low blink rate.
Additionally, in the method of FIG. 3 there are still possibilities for evaluating the received data, such as, for example, outputting data in accordance with other output modes 64, 65, 66, 67, 68, 87, 88, 89, 90, which will be described in detail below. Further, it may also be provided that the first fixing criterion 25 is replaced by the second fixing criterion 26, at least one predetermined segment of the video image 9 in the field of view is studied again, as shown by the dashed line that connects the fragment 13 of the specified first or second segment of the video image 9 in sight with a first criterion of 25 fixation.
As mentioned above, and also based on the definition of the foveal region 34 as a region in which an orderly perception is possible, the first angle of view 41 of the foveal region 34 is largely dependent on the object or environment. For example, well-known objects in an environment in which the subject expects to meet such an object (for example, an octagonal road sign of a mandatory stop) is very quickly perceived or recognized by the subject. At the same time, unexpected or unknown objects are not recognized and not perceived so quickly and unambiguously.
A method for measuring the recognition of preset object units, according to which, for a preset third segment of video image 9 in the field of view, all centers of attention related to the first preset object unit are stored in the first object intermediate drive 81, and the method described above is carried out using stored in the first object intermediate drive 81 centers of visual attention. Therefore, for a predetermined or selectable third segment of the video image 9, at least one object unit is selected in the field of view, however, a predetermined number of object units is preferably selected, for example, as shown in FIG. 4 and 5, five object units are selected. In this case, the user units are preferably selected by the user himself, although automatic selection of at least the first object unit may be provided. Regarding the first object unit, we can talk about the road sign of a mandatory stop, in relation to the second object unit, about the car, and the center line of the road marking can be chosen as the third object unit. An episode of a video image in the subject’s field of view, such as a turn passage, can also serve as an object unit according to the invention.
In FIG. 4, a method is presented, according to which, after sampling 13 of the third segment of the video image 9 in the field of view, this third segment of the video image 9 in the field of view is examined for the presence of centers of visual attention, which should be assigned to predefined object units or already assigned to them. As the centers of visual attention that should be assigned or already assigned to the first object units, this means all the centers of visual attention encountered between the first center of visual attention of the first, related to the first object unit of fixation and the last center of visual attention of the last, related to the first object unit of fixation on the third segment of the video image in the field of view of the subject. After sampling 13 of the third segment of the video image 9 in the field of view, it is examined for the presence of centers of visual attention (block 91), which should be assigned or already assigned to the first object unit. Moreover, such viewing and assigning individual centers of visual attention to individual object units can be done either manually by the user or automatically using a computer, for example, using a software package for the automatic recognition of preset optical samples, such as road signs of a mandatory stop, road markup, people and the like.
After that, processing and evaluation of the centers of visual attention pending in individual object intermediate drives 81, 82, 83, 84, 85 are performed, as shown in FIG. 4, according to the method described above. After processing this data, one fixation diagram 15, 16, 17, 18, 19 and one saccade diagram 20, 21, 22, 23, 24 are issued for each object intermediate drive. Therefore, in the preferred method of FIG. 4, preferably, a first fixation diagram 15, a second fixation diagram 16, a third fixation diagram 17, a fourth fixation diagram 18 and a fifth fixation diagram 19, as well as a first saccade diagram 20, a second saccade diagram 21, a third saccade diagram 22, a fourth saccade diagram 23 and fifth saccade chart 24. This allows you to distinguish and evaluate various objects in terms of the quality of their perception. In particular, this allows us to attribute the so-called “eye-attracting characteristic” to various objects, which determines how much an object attracts the attention of the subject. Therefore, there are objects that, by their appearance, attract the attention of the observer or fetter him, while other objects in no way act on the attention of the observer. Knowing what the properties of an object must be in order to attract the attention of an observer, or of what objects attract the attention of an observer, is important for many areas of everyday life, such as when making overhead pedestrian crossings, when designing protective clothing, when paving roads, but also when designing advertising media. Additionally, in the method of FIG. 4, there are also other possibilities for evaluating the received data, such as, for example, outputting data in accordance with other output modes 64, 65, 66, 67, 68, 87, 88, 89, 90, which will be described in detail below.
Known or expected objects, even with a significantly larger first angle of view 41, are fully recognized as such - compared to objects as yet unknown or unexpected. Therefore, the visual acuity, and with it the foveal region 34 for the first object or first environment can be more or less than for the second object or second environment. Therefore, the degree of visual acuity necessary for a particular object is a very meaningful value of the perception of the object or sequence of scenes, and the concept of “sequence of scenes” can refer to all time sequences, for example, driving through a street section or viewing an advertisement.
The larger the area around the central visual axis, within or close to which the object is recognized, the easier and faster this object is perceived by the observer, therefore, the higher the probability that the object is really perceived by the observer as such, even if the first criterion is not fulfilled for neighboring objects 25 fixation. For example, an observer, casting a cursory glance at the building, can flawlessly recognize the advertisement for a familiar producer of soft drinks or a familiar fast food network installed on its roof, without paying any attention to the shape of the roof itself.
Therefore, the invention also relates to a method for measuring the perception of specified object units, the method described above is also carried out for at least one second segment of the video image 9 defined in the field of view of at least one other than the first fixation criterion 25 of the second fixation criterion 26, wherein the quality of the set objects and / or sequences of eye movements of the subject in terms of their perception can be determined by the observer himself. In FIG. 5 shows a preferred embodiment of a similar method in the form of a flow chart, the individual steps of the method being shown as a joint dashed block 86. In a preferred embodiment of the invention, it is provided that the second region is identical to the third region, and it is particularly preferred that the corresponding the methods assembled in block 86 are applied to those stored or accumulated in the first object intermediate drive 81, assigned or attributable to a given first object unit of centers of visual attention, as shown in FIG. 5.
In the embodiment of the method of FIG. 5, it is provided that the second segment of the video image 9 in the field of view of the test person, or the contents of the first object intermediate drive 81, the second object intermediate drive 82, the third object intermediate drive 83, the fourth object intermediate drive 84 and / or the fifth object intermediate drive 85, one after the other others are processed in the comparison device 4 and in the preliminary processing device 14 of the results with various criteria 25, 26, 27, 28, 29 of fixing the gaze, that is, the last They are processed one after the other, respectively, with the first fixation criterion 25, the second fixation criterion 26, the third fixation criterion 27, the fourth fixation criterion 28 and the fifth fixation criterion 28, in the form of a closed loop 30 for varying the criterion for fixing the examinee’s gaze, and the results are saved in the first drive 31 and then issued.
In this case, it is preferable to provide the obtained data or the perception of the object dependent on the corresponding criterion 25, 26, 27, 28, 29 of fixation. In this case, it is preferably provided that the frequency of fixations 48, 49 depending on at least the first and second criteria 25, 26 of fixations is issued in the form of a first curve 58 with a constant first duration in time and in the form of a second curve 59 with a constant second duration time. In FIG. 15 shows such a second diagram, which is also called a fixation level diagram 32, in which the first distance 39 or the first angle of view 41 is plotted on the abscissa axis and the number of fixations 57 is plotted on the ordinate axis, each of which is represented by six curves 58, 59, 60, 61, 62, 63 is determined with a different first time duration, therefore, the first curve 58, the distance between the first frame 37 of the image in the field of view and the second frame 38 of the image in the field of view is a frame or image in the field of view, therefore, the second frame 38 and Image in the field of view is an image frame in the field of view that immediately follows the image frame 37 in the field of view. In the second curve 59, the distance between the first frame 37 of the image in the field of view and the second frame 38 of the image in the field of view is two frames. In the third curve 60, the distance between the first frame 37 of the image in the field of view and the second frame 38 of the image in the field of view is three frames. In the fourth curve 61, the distance between the first frame 37 of the image in the field of view and the second frame 38 of the image in the field of view is four frames. In the fifth curve 62, the distance between the first frame 37 of the image in the field of view and the second frame 38 of the image in the field of view is five frames. In the sixth curve 63, the distance between the first image frame 38 in the field of view and the second image frame 38 in the field of view is six frames. In FIG. 15, there are two different diagrams of the fixation level 32 relating to different scenes or objects. From such diagrams of fixation level 32, it is possible to quickly determine perceptual-specific differences between different objects depending on the first distance 39 or the first angle of view 41, as well as between the first time durations, and it is possible to scientifically evaluate or measure differences in the perception of objects. This makes it possible to attribute the so-called “eye-attracting characteristic” to various objects, which determines how much an object attracts the attention of the subject.
For further assessment and analysis of the behavior of the subject’s gaze and perception of the object, as mentioned above, other formats for issuing information can be additionally provided, as shown in FIG. 16-20, as well as FIG. 24-27.
In FIG. 16, preferably for the first object unit, all centers of visual attention are presented, therefore, all centers of visual attention stored in the first object intermediate storage are presented without special assessment and / or consideration of their significance. Thanks to such a representation in the form of so-called “points” 64, an experienced observer is able to draw a number of conclusions about the quality of the observed object from the point of view of its perception. Under the gray shaded area, both in a similar representation and in all other views shown in FIG. 16-20, as well as 24-27, for the sake of greater clarity, an image of the first object can also be attached, and it must be borne in mind that with dynamic approximation, the presented centers of visual attention do not necessarily have to be directed to the areas depicted in the background image.
In FIG. 18 shows, preferably for the first object unit, all centers of visual attention, therefore, all centers of visual attention stored in the first object intermediate storage are depicted, and all centers of visual attention related to one fixation are marked as such, and it is preferably provided that they Compared to the surrounding background, they have a perceptual contrast and / or a perceptual difference in brightness and / or are represented in a color different from the color of the surrounding background. The visual attention centers presented or issued in such a marked way are also called “fixed points” 66. This allows a particularly accurate and differentiated assessment of the qualities of the first object in terms of its recognition. In FIG. 18, in addition, a first coordinate system 97 is provided that characterizes the midpoint and / or focus of the centers of visual attention.
In FIG. 19 also shows all the centers of visual attention stored in the first object storage device, and all the centers of visual attention related to the same fixation of the set duration are marked as such, it is preferably provided that they, in comparison with the surrounding background, have a contrast that facilitates the perception and / or a perceptual difference in brightness and / or represented by a color different from the color of the surrounding background. The visual attention centers presented or issued in such a marked way are also called “weighted fixed points” 67. By changing the fixed duration of fixation, it is possible to quickly and easily analyze how the qualities of the first object in terms of its recognition vary depending on the duration of individual fixations. In FIG. 19, in addition, a first coordinate system 97 is also provided.
In FIG. 20 shows a preferred embodiment of a data output mode that can be applied in addition to the other output modes already described. Moreover, around the center 98 of the fixation points of the first coordinate system 97, an arbitrarily set number of circles is depicted. Preferably, and as presented here, a seventh circle 93 is shown whose diameter is such that the seventh circle 93 includes fifty percent of the centers of visual attention. In addition, another eighth circle 94 is shown, the diameter of which is such that the seventh circle 93 includes eighty-five percent of the centers of visual attention. The ninth circle 95 also depicted is formed so that it includes ninety-five percent of the centers of visual attention, and the tenth circle 96 is formed in such a way that it covers ninety-nine percent of the centers of visual attention. Such a representation, also called a "zonal angle" 68, can be combined with any other output modes, which allows an accelerated object-specific assessment of the quality of perception.
In FIG. 17, as well as in FIG. 16, the centers of visual attention stored in the first object intermediate drive are shown, and, in addition, the areas assigned to fixation after the previous “long” saccade are depicted as the sixth circle 92, the plane of which, in comparison with the surrounding background, has an easier perception contrast and / or perceptual difference in brightness and / or represented by a color different from the color of the surrounding background. The center of the sixth circle 92 is the midpoint of the centers of visual attention referred to the corresponding fixation. A similar mode of presentation is also called the “prevalence of certain signs of fixation” 65. The duration of a long saccade is determined by a given first angle 52 of the saccade. Alternatively, a saccade time period can also be set, above which the saccade is considered to be long. The diameter of the sixth circle can be set and its size is preferably in the area, which is preferably limited to the area 35 parafoveal vision. Thanks to this mode of presentation, it is possible to quickly and convincingly even for an inexperienced observer determine which particular sections of the object attract the attention of this latter with particular force. In addition, it may be provided that the sixth circle 92 is depicted only if the requirements necessary for the observer to recognize the object in terms of fixation 48, 49 and duration 103 of fixation are met. All this makes it easy and quick to recognize whether the observer glided over the object with just a passing glance, perceived it, or actually recognized it.
In FIG. 25 shows a tenth preferred embodiment of the dispensing mode 88, whereby exclusively saccades between individual fixations are shown, for which the last center of visual attention of the first fix is shown by a line connected to the first center of visual attention of the second fixation, and the duration of the saccade can be depicted in a different color, so that the observer can quickly Recognize areas with prolonged perceptual impairment.
In FIG. 24 shows a ninth preferred embodiment of the dispensing mode 87, wherein the field of view is covered by a raster of a given size and / or given shape, and individual segments of the raster 99 are marked taking into account the frequency of the centers of visual attention they encounter by giving them a given brightness, color and / or by structuring .
In FIG. 26 shows an eleventh preferred embodiment of a dispensing mode, wherein the methods for dispensing information according to FIG. 17, 19, 20, 24 and 25 are depicted with overlapping, which makes it possible to give out a lot of information in the form of only one image, and the observer gets the opportunity to especially easily and quickly evaluate an object or an individual scene. In FIG. 27 shows a twelfth preferred embodiment of the dispensing mode, this view, as shown in FIG. 26, for clarity, superimposed on the image frame of the first object - in this case, the first scene.
In addition to the methods for evaluating and / or outputting the data already described above, it is particularly preferable to provide another method for evaluating and / or outputting the data described below, which seems to be most suitable for detecting the complexity of the sequence of scenes. This is, as will be explained in the two examples shown in FIG. 28 and 29, on a particularly preferred combination of the methods for evaluating and / or outputting the data already described above, preferably extended with additional preferred methods for evaluating and / or outputting the data.
In FIG. 28 and 29, a preferred data output mask 50 is presented, wherein the controls and other data output fields have been removed from the image, preserving only the text description. Both video images 9 located one next to the other in the field of view are clearly visible, moreover, one of the video images 9 in the field of view is shown in FIG. 17, and another video image 9 in the field of view is shown in FIG. 25. In addition, there is still a first diagram 11, as well as a detailed image of such a first diagram 11. The data output mask 50 includes a first saccade diagram 20 and a first fixation duration diagram 100 for a study period of time, preferably 2 s, but with the possibility of arbitrary ask him. In addition, there is also a second diagram 107, which gives information about how many centers of visual attention - hence the frequency of centers of visual attention - are located at what first relative distance 40 around the central visual axis. In addition, preferably it can still be provided for each sequence of video images in the field of view of the current view to set the first duration 103 of fixation, angle 52 saccades, as well as the value of the complexity of the sequence, and the value of complexity is determined and issued as the sum of the relative angles 42 measured over a given period time, usually equal to one second. This allows you to easily and quickly determine whether the situation observed by the test subject is too complicated for his perception. As soon as the value of complexity exceeds a certain limit value, we can conclude that the ordered perception of objects no longer occurs. But in the field of traffic, such a situation can have truly unpredictable consequences. Using this method, which was described above, and such data processing, you can not only assess the situation, but also easily and quickly determine whether the subject is suitable for driving a vehicle.
In FIG. 33 - FIG. 36 shows examples of a preferred mask 108 for outputting data of a preferred analysis tool, with FIG. 33 and 34 form one unit or are subordinate to one another, and FIG. 35 and 36 also form one whole or are subordinate to one another. In FIG. 33 and 35 present one video image 9 in the field of view of the subject, which according to the first preferred embodiment of the output mode 6 of the video image 9 in the field of view is shown with the first and second circles 43, 44, as shown in FIG. 9, moreover, the other preferred options described above for outputting the video image 9 in the subject’s field of view can be provided. On the video image 9 in the field of view, there is the number of the current frame of the video image in the field of view or frame in the form of serial number 106, which allows you to accurately correlate the output frame of the video image 9 in the field of view. In addition, the statistical data of the current video image 9 is determined in the field of view, preferably calculated on a computer, and presented in the form of a first block 109 of statistical data for a section and a second block 110 of statistical data for a section, as well as a block 111 of past statistics and block 112 future statistics. Moreover, in the first and second blocks 109, 110 of statistical data on the plots, statistical data are presented, respectively, for a freely selectable temporary section of the video image 9 in the field of view of the subject. In a block 111 of past statistics, statistical data are presented for a specified period of time before the image frame shown at the corresponding moment in the field of view, and in a block 112 of future statistics, data for a specified period of time immediately following the frame of the image shown at the corresponding moment in the field view.
In separate statistics blocks 109, 110, 111, 112, that is, the first and second statistics blocks 109, 110 for plots, block 111 of past statistics, block 112 of future statistics, complexity, specific gravity of saccades, specific gravity of saccades, fixation coefficient are presented , saccade coefficient and specific weight of blinks, where MD means arithmetic mean, SD stands for standard deviation or standard deviation, min is the minimum value, max is the maximum value, 85% is the 85th percentile of the corresponding values for the selected value in the corresponding unit 109, 110, 111, 112 statistics of the time interval of the video image 9 in the field of view.
In this case, complexity indicates the sum of all gaze movements over a selected period of time in video image 9 in the subject's field of view, preferably in degrees / unit of time, therefore, ° / s. The specific gravity of the fixations indicates the time fraction of the selected period of time in the video image 9 in the field of view of the subject, which can be attributed to the fixations relative to the total duration in time of the selected period of time in the video image 9 in the field of view of the subject; and the specific gravity of saccades indicates the time fraction of the selected time period in the video image 9 in the field of view of the subject, which can be attributed to saccades relative to the total duration in time of the selected time period in the video image 9 in the field of view of the subject. The specific gravity of fixations and the specific gravity of saccades can take values from zero to unity, and in total they are unity, since only areas that do not contain blinks, that is, complete temporary darkening of the eye, are attracted for their assessment.
The fixation coefficient is the ratio of the specific gravity of fixations to the specific gravity of saccades at any given time, and the coefficient of saccades is the ratio of the specific gravity of saccades to the specific gravity of fixations at any moment of time. The specific weight of blinks is a fraction of the time occupied by blinking over a selected period of time.
The number of fixations, saccades, and blinks is represented in the corresponding statistics blocks 109, 110, 111, 112, preferably and, as shown, additionally in the form of discrete values.
In FIG. 34 presents statistics on the video image 9 in the field of view and on blocks 109, 110, 111, 112 statistics according to FIG. 33 in graphical form, and in FIG. 36 presents statistics on the video image 9 in the field of view and on blocks 109, 110, 111, 112 statistics according to FIG. 35 in graphical form. In this case, it is preferable, and as shown, to provide a first diagram 11 for representing fixations and saccades in a graphical form. In addition, the corresponding complexity value is presented on the complexity diagram 113. Other values of the specific gravity of fixations, the specific gravity of saccades, the coefficient of fixation and / or the coefficient of saccades are also presented in the overview diagram 114. The central double strip 115 serves to mark the presented place on the corresponding video image 9 in sight. In addition, blinking is represented both in the form of the value of blinking 116 in numerical terms, and as a strip of blinking 117.
The analysis tool according to FIG. 33-36 is particularly preferably provided for the detection and detailed study of places with loss of information due to excessively high complexity or the frequent foveal, central eye-catchers. Due to the issuance of particularly informative statistical data and the possibility of directly comparing them with the presented video image 9 in the field of view, it is possible to perform qualitative in-depth analyzes of the real perception of information, as well as an improved examination of various information losses and / or information defects. This allows you to determine the degree of visual perception, providing the possibility of further medical and neurophysiological studies.
In an improved embodiment of the method according to the invention, a joint assessment of visual perception parameters with individual stress parameters (human physiology data) and physical parameters of movement and condition can be provided, which allows the methods described above to be used in an even broader field of research in the field of stress and behavioral reactions.
In addition, the invention also relates to a method for controlling the visual perception of at least one user, preferably a person, whereby at least one first environmental video of the first user is captured using the at least one first camera for the first environmental video, this first environmental video is examined for the presence of at least one predetermined first sample, preferably a traffic sign, then using the method according to one of paragraphs 1 p about 20 determine whether the first fixation criterion 25 is fulfilled with respect to the centers of visual attention, which at least partially coincide with it, and that if the criterion of the first fixation is not fulfilled regarding the first sample, at least one control circuit and / or regulation. This allows the machine to control the area of the user's field of vision together with his visual behavior and to establish whether certain areas or patterns were perceived or perceived by the user. For example, a car can examine a section of a street or road for signs of traffic and see if the driver actually sensed the presence of these signs. If this does not happen, then the car can use the light or acoustic signaling to draw the driver’s attention to it or even stop on its own, if, for example, the driver does not notice a road sign for a mandatory stop.
To implement this method, it is necessary that the movements of the pupils of the user or driver are recorded, for which an appropriate system is provided to determine the direction of the gaze of the subject. Even if the best results can be achieved using systems to determine the direction of the gaze of the subject, which are fixedly fixed on his head, a system can be provided to determine the direction of gaze, which records the movements of the pupils or the direction of the user's gaze using several cameras located around him. Therefore, they find their application preferably in areas where the user wears safety glasses or a protective helmet even without them, because such a system for determining the direction of gaze can simply be built into a helmet or safety glasses. Possible applications are, for example, fast-moving machines, such as lathes or spinning machines, helmets for combat aircraft pilots, in which the aircraft itself determines the presence of targets or sources of danger and draws the pilot's attention to them only if the latter has not done so. Such systems can also be integrated into the racers' helmets and are accordingly optimized for recognizing flag signal patterns sent by line judges, etc.
Other features of the invention, except from the claims, may also come from the description and drawings, and individual features, in particular also the features of the various described embodiments of the method, in each case can be implemented individually or in the form of several combined in combination in at least one embodiment of the invention and / or in other areas, and any combination of features may be provided, which will be protected by themselves retirement. The division of the subject application into several parts does not in any way limit the statements made in these parts of the statements in the general legal force that they have for the invention.
1. determination of centers of visual attention or visual coordinates
2. input of visual coordinates
3. enter the fixation criterion
4. definition, fixation or saccade
5. second issue
6. first preferred dispensing mode
7. second preferred dispensing mode
8. third preferred dispensing mode
9. video in sight
10. first issue
11. first chart
12. first chart output
13. selection of the first segment of the video image in the field of view
14. pre-processing unit
15. first fix chart
16. second fixation diagram
17. third fixation chart
18. fourth fixation chart
19. fifth fixation chart
20. first saccade chart
21. second saccade chart
22. third saccade chart
23. fourth saccade chart
24. fifth saccade chart
25. first fixation criterion
26. second fixation criterion
27. third fixation criterion
28. fourth fixation criterion
29. fifth fixation criterion
30. closed loop method for varying the criterion of fixation
31. first drive
32. fix level chart
34. foveal region
35. paraphoveal region
36. peripheral area
37. first center of visual attention
38. second center of visual attention
39. first distance
40. first relative distance
41. first angle of view
42. first relative angle
43. first circle
44. second circle
45. the first trajectories of the gaze
46. third circle
47. fourth circle
48. first fix
49. second fix
50. data output mask
51. first angle of fixation
52. first angle saccade
54. the number of consecutive video frames in a field of view of the subject
57. number of fixations
58. first curve
59. second curve
60. third curve
61. fourth curve
62. fifth curve
63. sixth curve
64. points
65. the prevalence of certain signs of fixation
66. fixed points
67. weighted fixed points
68. zonal angle
69. third center of visual attention of the first fixation
70. The last spotlight of the first fixation
71. center of visual attention, between the first and second fixations
72. center of visual attention, between the first and second fixations
73. center of visual attention, the first center of visual attention of the second fixation
74. center of visual attention, the second center of visual attention of the second fixation
75. center of visual attention, third center of visual attention of the second fixation
76. first video camera
77. second video camera
78. image of eye movements
79. image in sight
80. test subject's head
81. first object intermediate storage
82. second object intermediate storage
83. third object intermediate drive
84. fourth object intermediate drive
85. fifth object intermediate drive
86. block
87. ninth preferred mode of issuance
88. Tenth preferred mode of issuance
89. Eleventh preferred mode of issuance
90. twelfth preferred mode of issuance
91. study of the video image in the subject’s field of vision for the presence of centers of visual attention, block FIG. four
92. sixth circle
93. seventh circle
94. eighth circle
95. ninth circle
96. tenth circle
97. first coordinate system
98. center of fixation points
99. raster segments
100. first fixation duration chart
101. first saccade duration chart
102. blinking chart
103. first fixation duration
104. first saccade duration
105. first blinking duration
106. number of frames
107. second chart
108. data output mask
109. first block of site statistics
110. second block of statistics on sites
111. block of past statistics
112. block of future statistics
113. complexity diagram
114. overview chart
115. double strip
116. meaning of blinking
117. streak of blinks
1. A method of measuring perception, in particular measuring individual visual attention, in which at least the first visual coordinates of the first center (37) of visual attention, referred to the first frame of the image in the field of view, are processed, which are determined by the system for determining the direction of view, and at least the second, referred to the second frame of the image in the subject's field of view, visual coordinates of the second center of visual attention (38), and the second frame of the image in the floor the subject’s vision is recorded after the first frame of the image in his field of vision, characterized in that a recorded video is recorded to determine the visual coordinates of the centers (37, 38) of visual attention using a system for determining the direction of the gaze, and the related images are presented, at least to the first fixation (48) or at least the first saccade, the centers of visual attention (37, 38) in the video image (9) in the subject's field of vision; the second visual coordinates of the second center of visual attention (38) are checked by the first visual coordinates of the first center (37) of visual attention in the comparison device for compliance with at least one first set criterion (25) of gaze fixation, and that the first and second centers (37 , 38) visual attention when meeting the first criterion (25) of gaze fixation is attributed to the first fixation (48), related to ordered perception, and is recorded as such, and that the first and second centers of visual attention (37, 38) esootvetstvii first criterion (25) of gaze fixation refers to the first saccade disordered perception and is recorded as such.
2. The method according to claim 1, characterized in that the first and second centers (37, 38) of visual attention are issued marked as related in the first fixation (48) or to the first saccade.
3. The method according to claim 1 or 2, characterized in that the first criterion (25) of fixation is a given first distance (39) around the first center (37) of visual attention, which determines the first relative distance (40) between the first center (37 ) of visual attention and the second center of visual attention (38), and also, if the first relative distance (40) is less than the first distance (39), the first and second centers of visual attention (37, 38) are referred to the first fixation (48), and the first distance (39) is the first angle (41) of view, which the subject preferably describes the region (34) responsible for foveal vision, in particular between 0.5 ° and 1.5 °, preferably about 1 °, and that the distance between the first center of visual attention (37) and the second center of visual attention (38) represented by the first relative angle (42).
4. The method according to claim 3, characterized in that the first criterion (25) for fixation, in particular the first distance (39), is preset.
5. The method according to claim 1, characterized in that the second frame of the image in the field of view of the test subject is recorded after a predetermined first period of time, in particular from 0.005 s to 0.1 s, preferably from 0.02 s to 0.04 s, immediately behind the first frame of the image in the subject’s field of vision.
6. The method according to claim 5, characterized in that the second frame of the image in the field of view of the subject is recorded immediately after the first frame of the image in the field of vision.
7. The method according to claim 3, characterized in that the first relative distance (40) is issued together with the centers of visual attention marked as belonging to the first fixation (48) or the first saccade.
8. The method according to claim 3, characterized in that the first relative distance (40) is issued in the first diagram (11) by the timing of the video image (9) in the field of view of the subject.
9. The method according to claim 1, characterized in that, together with the current center of visual attention in the presented current video image (9), the first circle (43) is issued in the field of view of the test subject, which is located essentially uniformly around the center of visual attention, radius which corresponds to the first distance (39).
10. The method according to claim 9, characterized in that, together with the current center of visual attention in the presented current video image (9), a second circle (44) is issued in the subject’s field of view, located essentially uniformly around the center of visual attention, radius which corresponds to a predetermined second distance, the second distance being the second angle of view, which is preferably limited to the area of paraffeal vision, and is in the range from 3 ° to 5 °.
11. The method according to claim 1, characterized in that by connecting the centers of visual attention following one after another (37, 38), the first trajectories (45) of the gaze movement, which are represented on the video image (9) in the subject’s field of view at least, are determined temporarily.
12. The method according to claim 1, characterized in that the centers of visual attention (37, 38, 69, 70) marked as belonging at least to the first fixation (48) of the subject's gaze are represented essentially uniformly surrounded by a third circle ( 46), and the radius of the third circle (46) is a function of continuous duration in time of the first fixation (48) of his gaze.
13. The method according to claim 1, characterized in that the video image (9) in the subject’s field of view is displayed darkly, which centers (37, 38, 69, 70) marked as belonging to at least the first fixation (48) of the subject’s gaze visual attention appear to be essentially uniformly surrounded by a fourth circle (47), and that the area of the fourth circle (47) compared with the darkened video image (9) in the subject’s field of view at least temporarily appears lighter.
14. The method according to claim 1, characterized in that for the given first segment of the video image (9) in the subject’s field of vision all the centers of visual attention following one after another that satisfy the first fixation criterion (25) are jointly referred to the first fixation (48), and that the angular distance between the first center of visual attention attributed to the first fixation (48) and the last center of visual attention referred to the first fixation (48) is determined and issued as the first angle (51) of fixation.
15. The method according to 14, characterized in that for the first segment of the video image (9) in the field of view of the subject determine the angular distance between the last referred to the first fixation (48) center of visual attention (70) and the first attributed to the second fixation (49) center of visual attention (73) and give out as a first angle (52) saccades.
16. The method according to 14 or 15, characterized in that for the first segment of the video image (9) in the field of view of the test subject, the frequency (56) of certain fixations (48, 49) depending on the angle of fixation is output.
17. The method according to clause 16, characterized in that for the first segment of the video image (9) in the field of view of the test subject give the frequency (56) of certain saccades depending on the angle of the saccade.
18. The method according to claim 1, characterized in that for the given first segment of the video image (9) in the subject’s field of view all the centers of visual attention following one after another that satisfy the first fixation criterion (25) are jointly referred to the first fixation (48), and that a first fixation duration (103) is determined between the first center of visual attention referred to the first fixation (48) and the last center of visual attention referred to the first fixation (48), and that the frequency (56) of certain fixations is given out as of the first duration (103) of fixation.
19. The method according to p. 18, characterized in that for the first segment of the video image (9) in the field of view of the test subject determine the first duration (104) saccades between the last referred to the first fixation (48) center of visual attention (70) and the first referred to the second fixation (49), the center of visual attention (73), and that the frequency (56) of certain saccades is given out depending on the first duration (104) of the saccade.
20. A method for measuring the recognizability of preset object units of visual perception, characterized in that for the preset third segment of the video image (9) in the subject’s field of view all the centers of visual attention related to the first preset object unit are stored in the first object intermediate storage device (81), and that the method PP-19 is carried out using the centers of visual attention stored in the first object intermediate storage (81).
21. A method for measuring the perception of preset object units of visual perception, characterized in that the method according to one of claims 1 to 19 is also carried out for at least one preset second segment of the video image (9) in the field of view of the subject, at least one preset different from the first fixation criterion (25), the second fixation criterion (26).
22. The method according to item 21, wherein the frequency of fixations (48, 49) depending on at least the first and second criteria (25, 26) of fixation is issued in the form of a first curve (58) with a constant first duration of time and in the form of a second curve (59) with a constant second duration in time.
23. A method for controlling the visual perception of at least one user, preferably a person, characterized in that at least one first video image of the environment of the first user is captured using the at least one first video camera for the first environment video, which is the first the video of the environment is examined for the presence of at least one predetermined first sample, preferably a traffic sign, then using the method according to one of claims 1-19, it is determined that whether the first fixation criterion (25) is applied to centers of visual attention that at least partially coincide with the first sample, and that if the criterion of the first fixation regarding the first sample is not met, at least one control and / or regulation system is activated .
RU2010100817/14A 2007-06-12 2008-06-12 Method of perception measurement RU2473301C2 (en)
AT0091107A AT505338B1 (en) 2007-06-12 2007-06-12 Procedure for performance measurement
ATA911/2007 2007-06-12
PCT/AT2008/000210 WO2008151346A1 (en) 2007-06-12 2008-06-12 Method for perception measurement
RU2010100817A RU2010100817A (en) 2011-07-20
RU2473301C2 true RU2473301C2 (en) 2013-01-27
ID=39930554
RU2010100817/14A RU2473301C2 (en) 2007-06-12 2008-06-12 Method of perception measurement
US (1) US8379918B2 (en)
EP (1) EP2157903B1 (en)
AT (1) AT505338B1 (en)
DK (1) DK2157903T3 (en)
ES (1) ES2401835T3 (en)
IL (1) IL202689A (en)
PT (1) PT2157903E (en)
RU (1) RU2473301C2 (en)
SI (1) SI2157903T1 (en)
WO (1) WO2008151346A1 (en)
RU2545428C1 (en) * 2014-03-12 2015-03-27 Федеральное государственное бюджетное учреждение "Научный центр неврологии" Российской академии медицинских наук (ФГБУ "НЦН" РАМН) Method for determining path of involuntary visual image attention offset
RU2677593C2 (en) * 2014-04-29 2019-01-17 МАЙКРОСОФТ ТЕКНОЛОДЖИ ЛАЙСЕНСИНГ, ЭлЭлСи Display device viewer gaze attraction
WO2011120969A1 (en) 2010-03-29 2011-10-06 Hochegger, Paul Concentration-enhancing drink
EP2807605A2 (en) * 2012-01-26 2014-12-03 Umoove Services Ltd. Eye tracking
DE102014223114A1 (en) * 2014-11-12 2016-05-12 Robert Bosch Gmbh A method for generating a warning signal for a motor vehicle driver
RU2322180C2 (en) * 2006-05-04 2008-04-20 Владимир Николаевич Пугач Method and device for carrying out spatial perception anomalies adjustment
EP1300108B1 (en) 2001-10-01 2007-02-28 Ernst Univ. Prof. Dipl.-Ing. Dr. Pfleger Method for obtaining, evaluating and analyzing sequences of vision
2007-06-12 AT AT0091107A patent/AT505338B1/en active
2008-06-12 SI SI200830910T patent/SI2157903T1/en unknown
2008-06-12 WO PCT/AT2008/000210 patent/WO2008151346A1/en active Application Filing
2008-06-12 PT PT87568200T patent/PT2157903E/en unknown
2008-06-12 DK DK08756820.0T patent/DK2157903T3/en active
2008-06-12 ES ES08756820T patent/ES2401835T3/en active Active
2008-06-12 EP EP08756820A patent/EP2157903B1/en active Active
2008-06-12 RU RU2010100817/14A patent/RU2473301C2/en active
2008-06-12 US US12/664,513 patent/US8379918B2/en active Active
2009-12-10 IL IL202689A patent/IL202689A/en active IP Right Grant
GAUDERER MW. Percutaneous endoscopic gastrostomy-20 years later: a historical perspective". J. Pediatr. Surg. 2001 36 (1) p.217-9. doi: 10.1053 / jpsu. 2001.20058. PMID 11150469. *
ЧЕРНОБАЙ А.Д. Методики диагностики свойств восприятия, внимания и памяти. - Владивосток, 2005. *
ЧЕРНОБАЙ А.Д. Методики диагностики свойств восприятия, внимания и памяти. - Владивосток, 2005. БОНДАРКО В.М. Оценка целостности зрительных объектов в зависимости от их размеров. Физиология человека. 1996, Т.22. №3. С.65-70. *
IL202689A (en) 2013-05-30
IL202689D0 (en) 2010-06-30
SI2157903T1 (en) 2013-05-31
RU2010100817A (en) 2011-07-20
DK2157903T3 (en) 2013-03-25
EP2157903A1 (en) 2010-03-03
WO2008151346A1 (en) 2008-12-18
EP2157903B1 (en) 2012-12-12
AT505338A1 (en) 2008-12-15
ES2401835T3 (en) 2013-04-24
AT505338B1 (en) 2009-03-15
PT2157903E (en) 2013-03-18
US20100183205A1 (en) 2010-07-22
US8379918B2 (en) 2013-02-19
North et al. 2009 Perceiving patterns in dynamic action sequences: Investigating the processes underpinning stimulus recognition and anticipation skill
Pelli 1987 The visual requirements of mobility
Lê et al. 2002 Seeing, since childhood, without ventral stream: a behavioural study