Patent Description:
Compared with traditional 2D displays, 3D displays are more compatible with human visual features, such that people feel more three-dimensional and immersive when watching scenes. The naked eye 3D technology is realized based on the disparity of the human eye, which means that there may be differences in the image between the left and right eyes when observing the same object. By doing some processing on the screen, the images with disparity are mapped to the left and right eyes of the person, and the human brain will merge into a three-dimensional image having a deep sense of depth.

If the naked eye 3D is applied to vehicle instruments, with its advantages of realism, stereoscopic effect, and no need to wear special glasses, it can display road condition information and vehicle condition information more intuitively and in real time, which can bring a better driving experience. However, the display of naked eye 3D has many limitations on the observation position. Generally, observers need to be fixed in the best place to observe the best display effect. When the naked eye 3D is applied to the vehicle instruments, the head of the operator will shift when observing road conditions, which can affect the display effect of naked eye 3D, such as the display screen refresh not keeping up; and the delayed refresh response of the naked eye 3D displaying may cause the operator to feel dizzy, which is extremely dangerous during driving.

A prior art <CIT> disclosed a local multi-view image display apparatus and method is provided. The local multi-view image display method may track a location of an observer, and locally display a multi-view input image on the tracked location.

A prior art <CIT> disclosed a multi-view autostereoscopic image display and a method of controlling an optimal viewing distance thereof are provided. The multi-view autostereoscopic image display includes a display panel displaying multi-view image data, a display panel driver writing the multi-view image data, a 3D optical element separating the optical axes of the multi-view image data, a viewing distance sensing unit sensing the positions of both eyes of a viewer, and a viewing distance extension controller that detects viewing zones where both eyes of the viewer are located by comparing the positions of both eyes of the viewer with positional information of predefined viewing zones, and selectively converts at least some of the multi-view image data according to a change in the positions of the viewing zones where both eyes of the viewer are located.

A prior art <CIT> disclosed a multi-view display controller determines view angles for each view of a multi-view media content for each viewer watching a multi-view display. The view angles determined for a viewer collectively define a viewer cone that displays the views onto the viewer. Media data of the multi-view media content is output together with information of the determined view angles to the multi-view display in order to allow each viewer to have the same experience of displayed media content regardless of where the viewer is positioned relative to the multi-view display.

A prior art <CIT> disclosed a method for adjusting imaging of a vehicle stereo display (<NUM>) for a vehicle (<NUM>). The method includes the steps: reading a first observer position (<NUM>) of a first observer (<NUM>) and at least one second observer position (<NUM>) of at least one second observer (<NUM>); determining, based on the first observer position (<NUM>) and the at least one second observer position (<NUM>), a first visual angle range (<NUM>) and at least one second visual angle range (<NUM>) which serve as multiple visual angle ranges (<NUM>, <NUM>; <NUM>); and providing a control signal, the control signal being used for controlling, based on the multiple visual angle ranges (<NUM>, <NUM>; <NUM>), a three-dimensional effect control layer (<NUM>) of the vehicle stereo display (<NUM>) so that imaging of the vehicle stereo display (<NUM>) can be adjusted.

Embodiments of the present application provide a method and a device for naked eye 3D displaying a vehicle instrument, which can solve the problem that the delayed refresh response of the naked eye 3D displaying may cause the operator to feel dizzy. In a first aspect, an embodiment of the present application provides a method for naked eye 3D displaying a vehicle instrument, and the method includes:.

As an example, the step of generating the corresponding real-time visual interweaving image according to the real-time eye position includes:.

It should be understood that in the step of determining the visual area interval according to the real-time eye position, which further includes:
calculating the visual area interval where the real-time eye position is located according to a deviation angle between the real-time eye position and the viewing angle of the preset operation center.

In a second aspect, an embodiment of the present application provides a device for naked eye 3D displaying a vehicle instrument, and the device includes:.

In a third aspect, an embodiment of the present application provides a computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor to implement the method for naked eye 3D displaying the vehicle instrument described in any one of the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer program product, when the computer program product runs on a terminal device, causes the terminal device to execute to implement the method for naked eye 3D displaying the vehicle instrument described in any one of the first aspect.

It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description in the first aspect, and which will not be further repeated here.

The beneficial effects of the embodiments of the present application compared to the prior art are:
In the embodiments of the present application, by collecting position information of an operator, predicting a deviation interval of the operator and generating and caching a viewing angle image set corresponding to the deviation interval, so as to compensate in response to the real-time visual interweaving image. When the operator experiences a head rotation or other deviation from the original position, the displayed naked eye 3D screen refresh speed is reduced from <NUM> to within <NUM>, which reduces the dizziness when watching the naked eye 3D screen, and greatly improves the experience effect of 3D screen.

In the embodiments of the present application, the human eye positioning unit is used to collect real-time eye position, and to generate the first interweaving image corresponding to the current visual area interval and display the same; the behavior recognition unit is used to obtain the human behavior information, the deviation interval of the operator is predicted and the second interweaving image corresponding to the deviation interval is generated and cache the second interweaving image, which greatly reduces the burden on a single camera and improves the refresh speed of displaying the naked eye visual interweaving image.

Of course, the implementation of any product in the present application does not necessarily require the simultaneous realization of all the advantages mentioned above.

The above description is only a summary of the technical solution of the present application. In order to have a clearer understanding of the technical means of the present application, it can be implemented in accordance with the content of the specification. In order to make the purpose, features, and advantages of the present application more obvious and understandable, the specific implementation methods of the present application are listed below.

In order to explain the embodiments of the present application more clearly, a brief introduction regarding the accompanying drawings that need to be used for describing the embodiments of the present application or the prior art is given below; it is obvious that the accompanying drawings described as follows are only some embodiments of the present application, for those skilled in the art, other drawings can also be obtained according to the current drawings on the premise of paying no creative labor.

In the following description, specific details such as specific system architecture, technology, etc. are presented for illustration rather than qualification in order to fully understand the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be realized in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits and methods are omitted so as not to prejudice the description of the present application with unnecessary details.

It is to be understood that when used in description of the present application and the accompanying claims, the term "includes" indicates the existence of the features, wholes, steps, operations, elements and/or components described, but does not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and/or collections thereof.

It should also be understood that the term "and/or" as used in the description of the present application and the accompanying claims means any combination of one or more of the items listed in relation to them and all possible combinations thereof, and includes such combinations.

As used in the description of the present application and the accompanying claims, the term "if" may be construed in the context to mean "when. " or "once" or "in response to determination" or "in response to detection". Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted, depending on the context, to mean "once determined" or "in response to determined" or "once detected [described condition or event]" or "in response to detected [described condition or event]".

In addition, the terms "first", "second", "third", etc. in the description of the present application and the accompanying claims are used only to distinguish the description and are not to be construed as indicating or implying relative importance.

References to "one embodiment" or "some embodiments" as described in the present application description, etc., imply the inclusion in one or more embodiments of the present application of particular features, structures or features described in combination with that embodiment. Thus, the words "in one embodiment", "in some embodiments", "in some further embodiments", "in some other embodiments", etc., which appear in differences in the specification, do not necessarily all refer to the same embodiments, but mean "one or more but not all embodiments" unless otherwise specifically emphasized. The terms "including", "containing", "having" and their variations all mean "including but not limited to" unless otherwise specifically emphasized.

When naked-eye 3D is applied to the vehicle instrument, the head of the operator will shift when observing the road condition, and the naked-eye 3D display screen refresh response is not timely, which may cause the operator to feel dizzy. The embodiment of the present application aims to provide a method for naked eye 3D displaying a vehicle instrument, which can predict the deviation interval of the operator and generate the corresponding viewing angle image set to compensate in response to the real-time visual interweaving image, thus improving the display effect of naked eye 3D.

The method for naked eye 3D displaying the vehicle instrument provided in the embodiment of the present application can be applied to on-board apparatus and other terminal apparatus. As an example rather than a limitation, when the terminal apparatus is a vehicle apparatus, the vehicle apparatus can also be the application of vehicle apparatus technology for intelligent design of the vehicle, the development of a display function of the apparatus, such as vehicle instrument panel, display screen, etc..

Take the terminal apparatus as an example of a vehicle instrument. <FIG> shows a block diagram of the partial structure of the vehicle instrument provided in the embodiment of the present application. As shown in <FIG>, the vehicle instrument includes: a display device <NUM>, a camera group <NUM>, a processor <NUM> and other components, the processor <NUM> and the display device <NUM> transmit data signals through active/wireless manner.

Specifically, the display device <NUM> includes a backlight for providing illumination, a grating for 3D imaging, and a imaging module for displaying the picture.

As an example rather than a limitation, the display device <NUM> includes a cover plate <NUM>, a 3D grating <NUM>, a Thin Film Transistor (TFT) module <NUM>, a backlight module <NUM>, and a housing <NUM>. The cover plate <NUM>, the 3D grating <NUM>, the TFT module <NUM> and the backlight module <NUM> are wrapped in the housing <NUM>, and the camera group <NUM> is arranged on the upper surface of the housing <NUM>.

Specifically, the camera group <NUM> can be a dual camera module, and the camera group <NUM> includes any one or more combinations of RGB cameras, structured light cameras and IR cameras. It is understood that the working principle of the camera is: the light emitted to the object is reflected on the surface of the object, the reflected light is transmitted through the lens to the image sensor, the image sensor receives the reflected light and converts the optical signal into an electrical signal to be transmitted to the analog-to-digital conversion circuit; the analog-to-digital conversion circuit converts the received analog electrical signal into digital electrical signal and transmits it to the digital signal processing chip for processing. The final processed signal is transmitted to the computer through the USB interface, and the original image can be displayed through the monitor. Therefore, through the camera group <NUM>, the facial and body image data of the vehicle, especially the operator, can be collected.

Alternatively, considering the implementation cost and the shooting of dark environment, the camera group <NUM> can be a combination of the RGB cameras and the IR cameras.

Specifically, a processor <NUM> May include one or more processors, such as a central processing unit (CPU), an application processor (AP), or a baseband processor and so on. The processor <NUM> can be the nerve center and command center of the wireless router. The processor <NUM> can generate the operation control signal according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions. Memory can be used to store computer executable program code, which includes instructions. The processor <NUM> performs various functional applications of network devices and data processing by running instructions stored in memory. The memory can include a storage program area and a storage data area, such as a storage visual interweaving image screen. For example, the memory can be double rate synchronous dynamic random access memory DDR or Flash flash, etc..

Although not indicated, the vehicle instrument can also include a power supply that supplies power to individual components, preferably, the power supply can be logically connected to the processor <NUM> through a power management system to manage charging, discharge, and power consumption and other function through the power management system.

It may be understood by those skilled in the art that the structure of the vehicle instrument shown in <FIG> does not constitute a limitation of the vehicle instrument and may include more or fewer parts than indicated, or may combine certain parts, or may be arranged differently.

The method for naked eye 3D displaying a vehicle instrument provided in the present application is illustrated by example in combination with specific embodiments. <FIG> shows the flowchart of the method for naked eye 3D displaying the vehicle instrument in an embodiment of the present application. As an example rather than a limitation, the method can be applied to the device for naked eye 3D displaying the vehicle instrument.

In step S201, collecting a real-time eye position of an operator in a real time, generating a corresponding real-time visual interweaving image according to the real-time eye position, and displaying the real-time visual interweaving image on a display interface.

In the embodiment, The collecting of the real-time eye position is obtained by image or video collecting by an image collection device equipped with an eye tracking system. The image collection device includes any one or several combinations of an infrared waterproof gun camera, an infrared hemisphere camera, a uniform ball machine, a high-speed ball machine, a wide dynamic camera, a video terminal, a video card and DVR (Digital Video Recorder). The image collection device can be selected according to the different environment and collecting requirements.

For example, the image collection device with the eye tracking system includes an infrared camera, an infrared illuminator, and eye tracking algorithms for pupil center detection and artifact elimination, and the image processing and the data collection are handled by specialized hardware or by computers or software. Infrared based lighting has several advantages: the lighting is largely invisible to participants, and artifacts from artificial light sources can be filtered by wavelength. The real-time eye position obtained by the image collection device with a human eye tracking system includes the three-dimensional coordinates of the human eye relative to the earth coordinate system.

In one embodiment, <FIG> shows a flowchart of a method for generating real-time visual interweaving images corresponding to the real-time eye position provided in an embodiment of the present application, as an example rather than a limitation. The specific steps are as follows:
In step S301, obtaining a standard visual area where a viewing angle of a preset operation center is located.

Specifically, the standard visual area is an angle range of several unit intervals on left and right sides of a horizontal direction of the viewing angle of the preset operation center, and each unit interval in the standard visual area is the visual area interval.

For example, the center point of the operation position is the preset operation center, the connection line between the preset operation center and the optical center of the dual camera is the viewing angle of the preset operation center, the distance between the eyes of the operator and the optical center of the dual camera at the operation position is the observation distance, the line center of the optical centers of the dual camera is the vertex, and the observation distance is the side length; a sector interval that covers the operator's action range can be divided, and the sector interval is the standard visual area. Viewing angle of +/-<NUM>° range of the preset operation center is used as the standard visual area. The standard visual area is divided into <NUM> unit intervals, that is, every <NUM> degrees is used as a visual area interval.

In step S302, calculating the visual area interval where the real-time eye position is located according to a deviation angle between the real-time eye position and the viewing angle of the preset operation center.

The earth coordinate data of the real-time eye position is extracted, and the earth coordinate data of the line center of optical center of the dual camera is calculated according to the positioning information of the dual camera, and then the distance between the real-time eye position and the line center of optical center of the dual camera and the deviation angle between the real-time eye position and the deviation angle of the viewing angle of the preset operation center are calculated by a triangulation method.

The visual area interval where the real-time eye position is located is determined according to the degree of the deviation angle and the division of the unit intervals in the standard visual area.

In step S303: generating a 3D model scene of the visual area interval in a graphics library.

For example, the graphics library can be an open graphics library (OpenGL), a Direct3D (3D graphics programming interface based on universal object mode of Microsoft) and other cross-language and cross-platform application programming interfaces for rendering 2D and 3D vector graphics.

Optionally, the open graphics library (OpenGL) is a cross-language, cross-platform application programming interface for rendering 2D and 3D vector graphics. In this embodiment, the OpenGL is used as the graphics library, the OpenGL engine environment is initialized, the data is prepared for rendering, and the corresponding 3D model scene is generated in the OpenGL according to the visual area interval where the real-time eye position is located.

In step S304, configuring a virtual view point position corresponding to the real-time human eye position in the graphics library, rendering in a real-time to generate the real-time visual interweaving image corresponding to the virtual view point position in the 3D model scene according to the virtual view point position.

In one embodiment, a virtual view point position corresponding to the view point of the actual human eye is configured in OpenGL according to the real-time eye position, and then a picture of the corresponding viewing angle is generated in real time and transmitted to the video memory, and then the LCD screen displays the picture.

Optionally, the Framebuffer uses a video output device to drive a video display device from a memory buffer containing complete frame data. In this embodiment, the Framebuffer is used as video memory, the real-time rendering of the generated images corresponding to the viewing angle is output to the display screen.

Optionally, a Liquid Crystal Display (LCD) is that a liquid crystal box is placed between two parallel glass substrates, a TFT (thin film transistor) is arranged on the lower substrate glass and a color filter is arranged on the upper substrate glass. By changing the signal and voltage on the TFT, the rotation direction of the liquid crystal molecule is controlled, so as to control whether the polarized light of each pixel is emitted or not and achieve the purpose of display. In this embodiment, LCD is used as the display screen to display the picture of the corresponding viewing angle described above.

It is understandable that OpenGL can also be used for local refresh in order to improve refresh efficiency when the virtual view point position changes little: the nodes whose states have changed during the rendering of the current frame are counted, the refresh area generated by all nodes with changed states is calculated, the refresh area corresponding to the screen area on the screen is calculated, the projection matrix, as well as the viewport and cropping area are arranged according to the screen area, and the obtained model data and texture data are submitted to the renderer for rendering, so as to obtain the corresponding real-time visual interweaving image.

In step S202, identifying whether the operator is engaged in human behavior, if so, obtaining human behavior information of the operator.

In one embodiment, since the human behavior of the operator being too large during driving is the main reason for the delayed response to the naked-eye 3D picture refresh, and the possible human behavior of the operator is mainly head turning and movement. Therefore, the camera is used to capture the face and main body posture information of the operator, it can extract the cached picture according to the human behavior of the operator, improve the refresh speed of the picture, and reduce the sense of dizziness when watching the naked eye 3D picture. <FIG> shows the method flowchart of identifying whether the operator has human behavior in the embodiment of the present application, as an example rather than a limitation. The specific steps are as follows:
In step S401, collecting posture key points of the operator in real time, and establishing a posture vector of a human main torso and an action vector of facial corner points according to the posture key points.

The camera is used to collect two-dimensional RGB image information of the human body, and no less than <NUM> key points of the human body are obtained from the two-dimensional RGB image according to the human posture estimation algorithm. By comparing with the standard human postures, the posture key points that can accurately describe human head rotation or upper body movement are obtained. The original data of posture key points in the image coordinate system is obtained using human posture estimation algorithms, and action vectors representing the main body posture vector and facial corners are constructed.

Optional, Openpose is an open source library of human posture recognition algorithms based on convolutional neural networks and supervised learning, which can realize posture estimation of human movements, facial expressions, finger movements, etc. In this embodiment, the Openpose is used to obtain the key points of the human body from the two-dimensional RGB image, and as an example rather than a limitation, the key points of the human body that number <NUM> (representing the nose), number <NUM> (representing the neck), number <NUM> (representing the right shoulder), number <NUM> (representing the left shoulder), number <NUM> (representing the right eye), number <NUM> (representing the left eye), etc. are taken as the posture key points.

In step <NUM>, calculating a deviation angle of a main torso and a head of the operator according to the posture vector of the human main torso and the action vector of the facial corner points;.

In step <NUM>, performing determination of human behavior according to the deviation angle of the main torso and head, if the deviation angle of the main torso and the head exceeds a preset value, the operator is determined to have human behavior , and the deviation angle of the main torso and the head is used as the human behavior information that represents a tilt posture of a human body.

In step S203, predicting a deviation interval of the operator according to the human behavior information, and generating and caching a viewing angle image set corresponding to the deviation interval.

In one embodiment, human posture algorithm is used to integrate and identify human behavior information to obtain the operator behavior trend probability value.

As an example rather than a limitation, the human behavior information is extracted, and the deviation angle of the main torso of the operator constitutes the moving feature vector, and the deviation angle of the head of the operator constitutes the turning feature vector. The trained support vector machine (SVM) is used to determine the behavior of the moving feature vector, and the output first classification result is x: <MAT>.

Similarly, a trained SVM can be used to determine the behavior of the turning feature vector, and the output second classification result is y: <MAT>.

The behavior trend probability value of the operator is the sum of the first classification result x and the second classification result y.

It can be understood that the eye position of the operator in the next unit time can be predicted according to the human behavior trend probability value. For example, when the trend probability value is -<NUM>, the eye position of the operator in the next unit time is predicted to be in a visual area interval to the left of the current visual area interval, that is, the deviation interval of the operator is a visual area interval to the left of the current visual area interval.

As an example rather than a limitation, the OpenGL can also be used as a graphics library to generate and cache the viewing angle image set corresponding to the deviation interval. The specific steps are as follows:.

Specifically, a number of view points are preset for each visual area interval. The preset view points of each visual area interval are evenly distributed in a circular direction in each visual area interval, with the line center of the optical centers of the dual camera as the vertex, and the angles between the preset view points of the adjacent visual area intervals are equal. The deviation angle between the preset view points of the visual area interval and the viewing angle of the preset operation center as the position information of the preset view points of the visual area interval. The view corresponding to the preset view point of the visual area interval is stored in memory in advance, and the viewing angle image set corresponding to the subsequent deviation interval is continuously refreshed in real time, so that the observer can see the best 3D picture at any time to further reduce the sense of dizziness. For example, <NUM> view points can be preset in each visual area interval.

In step S204, compensating in response to the real-time visual interweaving image on the display interface according to the viewing angle image set.

In one embodiment, <FIG> shows the method flowchart of compensating in response to a real-time visual interweaving image in an embodiment of the present application, as an example rather than a limitation. The specific steps are as follows:
In step S501, determining whether the real-time eye position and an eye position of the operator collected in a last frame are in a same visual area interval according to the real-time eye position.

In this embodiment, the earth coordinate data of the eye position of the operator in each frame collected by the camera can be calculated by the triangle manner to obtain the distance between the eye position of the operator and the line center of optical centers of the dual camera, as well as the deviation angle between the eye position of the operator and the viewing angle of the preset operation center. Then, the visual area interval in which the eye position of the operator is located is determined according to the unit interval division of the degree of deviation angle between the eye position of the operator and viewing angle of the preset operation center.

The visual area interval of the eye position of the operator in the last frame is cached, and the calculated real-time visual area interval of the eye position of the operator is compared with the visual area interval of the eye position of the operator in the last frame to determine whether the two are the same; if yes, then the real-time eye position of the operator and the eye position of the operator collected in the last frame are in a same visual area interval.

In step S502, determining whether the real-time eye position is located in the deviation interval when the real-time eye position and the eye position of the operator collected in the last frame are not located in the same visual area interval.

In step S503, taking a preset view point in the deviation interval closest to the real-time eye position as a preset view point in a target visual area interval when the real-time eye position is located in the deviation interval, and obtaining the target cache image matching the preset view point in the target visual area interval from the viewing angle image set.

In this embodiment, according to the deviation angle between the real-time eye position and the viewing angle of the preset operation center, the preset view point in the visual area interval closest to the real-time eye position is determined, and the nearest preset view point in the visual area interval is taken as the target preset view point, and the cache image corresponding to the target preset view point is extracted from the viewing angle image set as the target cache image.

In step S504, compensating in response to the real-time visual interweaving image according to the target cache image.

It can be understood that if the real-time eye position of the operator is not located in the deviation interval, the view corresponding to the nearest preset view point of the visual area interval of the real-time eye position is obtained from the memory, and the real-time visual interweaving image is compensated in response.

In another embodiment, considering that the brightness of the driving environment is too low, which will lead to poor naked eye 3D effect, and thus make the operator more prone to fatigue when viewing the naked eye 3D picture, the method for naked eye 3D displaying the vehicle instrument provided in the present application also includes a method to automatically turn off the naked eye 3D effect as an example rather than a limitation. The specific steps to automatically turn off the naked eye 3D effect are as follows:.

It should be understood that the sequence number of the steps in the above embodiments does not imply the order of execution, which shall be determined by its function and internal logic, and shall not constitute any limitation on the process of implementation in the embodiments of the present application.

<FIG> shows a structural block diagram of a device for naked eye 3D displaying a vehicle instrument corresponding to the method for naked eye 3D displaying a vehicle instrument in above embodiments, for ease of explanation, only the parts related to the embodiment of the present application are shown.

It should be noted that the information interaction and execution process among the above devices/units are based on the same idea as the embodiments of method in the present application, and their specific functions and technical effects can be detailed in the embodiments of the method, which will not be repeated here.

Those skilled in the art can clearly understand that, in order to describe the convenience and simplicity, only the division of the above functional units and modules are illustrated by examples, in practical application, the above functions can be assigned by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in a unit, and the integrated unit can be realized in the form of hardware or software functional units. In addition, the specific names of each functional unit and module are only for the convenience of distinguishing between each other, and are not used to limit the scope of protection of the present application. The specific working process of the units and modules in the above system can refer to the corresponding process in the above-mentioned embodiments of the method, which will not be repeated here.

The embodiment of the present application further provides a network device, which includes at least one processor, a memory, and a computer program stored in the memory and capable of running on at least one processor, which implements the steps in any embodiments of the method above when executing the computer program.

The embodiment of the present application further provides a computer-readable storage medium that stores a computer program that, when executed by a processor, realizes the steps in any embodiments of the above method.

The embodiment of the present application provides a computer program product that, when run on a mobile terminal, enables the mobile terminal to execute the steps in any embodiments of the above method.

If the integrated unit is achieved in the form of software functional units, and is sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, a whole or part of flow process of implementing the method in the aforesaid embodiments of the present application can also be accomplished by using computer program to instruct relevant hardware. When the computer program is executed by the processor, the steps in the various method embodiments described above can be implemented. Wherein, the computer program comprises computer program codes, which can be in the form of source code, object code, executable documents or some intermediate form, etc. The computer readable medium can include: any entity or device that can carry the computer program codes, recording medium, USB flash disk, mobile hard disk, hard disk, optical disk, computer storage device, ROM (Read-Only Memory), RAM (Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc. It needs to be explained that, the contents contained in the computer readable medium can be added or reduced appropriately according to the requirement of legislation and patent practice in a judicial district, for example, in some judicial districts, according to legislation and patent practice, the computer readable medium doesn't include electrical carrier signal and telecommunication signal.

In the aforesaid embodiments, the description of each of the embodiments is emphasized respectively, regarding a part of one embodiment which isn't described or disclosed in detail, please refer to relevant descriptions in some other embodiments.

Those skilled in the art may aware that, the elements and algorithm steps of each of the examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, or in combination with computer software and electronic hardware. Whether these functions are implemented by hardware or software depends on the specific application and design constraints of the technical solution. The skilled people could use different methods to implement the described functions for each particular application, however, such implementations should not be considered as going beyond the scope of the present application.

It should be understood that, in the embodiments of the present application, the disclosed device/terminal device and method could be implemented in other ways. For example, the device described above are merely illustrative; for example, the division of the units is only a logical function division, and other division could be used in the actual implementation, for example, multiple units or components could be combined or integrated into another system, or some features can be ignored, or not performed. In another aspect, the coupling or direct coupling or communicating connection shown or discussed could be an indirect, or a communicating connection through some interfaces, devices or units, which could be electrical, mechanical, or otherwise.

The units described as separate components could or could not be physically separate, the components shown as units could or could not be physical units, which can be located in one place, or can be distributed to multiple network elements. Parts or all of the elements could be selected according to the actual needs to achieve the object of the present embodiment.

Claim 1:
A method for naked eye 3D displaying a vehicle instrument, comprising:
collecting (<NUM>) a real-time eye position of an operator in a real time, generating a corresponding real-time visual interweaving image according to the real-time eye position, and displaying the real-time visual interweaving image on a display interface;
identifying (<NUM>) whether the operator is engaged in human behavior, if so, obtaining human behavior information of the operator; wherein the step of identifying whether the operator is engaged in human behavior comprises: collecting (<NUM>) posture key points of the operator in real time, and establishing a posture vector of a human main torso and an action vector of facial corner points according to the posture key points;
predicting (<NUM>) a deviation interval of the operator according to the human behavior information, and generating and caching a viewing angle image set corresponding to the deviation interval; wherein the step of predicting the deviation interval of the operator according to the human behavior information comprises: integrating and recognizing the human behavior information by a human posture algorithm to obtain a behavior trend probability value of the operator; and predicting the eye position of the operator in a next unit time according to the behavior trend probability value, and calculating the deviation interval of the operator according to the eye position of the operator in the next unit time; and
wherein the step of generating and caching the viewing angle image set corresponding to the deviation interval comprises: generating (<NUM>) a 3D model scene of the deviation interval in a graphics library; and rendering to generate a cached image corresponding to each preset view point in the deviation interval according to preset view points of several visual area intervals preset in the deviation interval, and taking the cached image corresponding to all the preset view points in the deviation interval as the viewing angle image set corresponding to the deviation interval; and
compensating (<NUM>) the real-time visual interweaving image on the display interface according to the viewing angle image set.