Display system, display method and image capture device

A display system includes a camera, a processor and a display. The camera is configured to shoot a first image and a second image in order. The processor is configured to generate a third image when a difference between the first image and the second image is larger than or equal to a preset difference value. The display is configured to display the first image and the third image in order when the difference is larger than or equal to the preset difference value. A display method and an image capture device are also disclosed herein.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to Taiwan Application Serial Number 110109817, filed Mar. 18, 2021, which is herein incorporated by reference in its entirety.

BACKGROUND

Technical Field

The present disclosure relates to a display technique. More particularly, the present disclosure relates to a display system, a display method and an image capture device.

Description of Related Art

In traditional display method, when zooming operations are performed to a digital image shot by a camera, the zooming operations may suffer from limits of resolution. When the image is zooming in to the limits of the resolution, the image becomes blurred. In some approaches, artificial intelligence is introduced to a super resolution model, such that the image is clarified. However, continuously performing operations by the super resolution model increases efficacy consumption of a system, and time consumed is longer. Thus, techniques associated with the development for overcoming the problems described above are important issues in the field.

SUMMARY

The present disclosure provides a display system. The display system includes a camera, a processor and a display. The camera is configured to shoot a first image and a second image in order. The processor is configured to generate a third image when a difference between the first image and the second image is larger than or equal to a preset difference value. The display is configured to display the first image and the third image in order when the difference is larger than or equal to the preset difference value. The third image is a high resolution version of the second image.

The present disclosure provides a display method. The display method includes: generating a first image and a second image in order; generating a ratio associated with a difference between the first image and the second image; when the ratio is larger than a preset ratio, displaying the first image; and when the ratio is smaller than the preset ratio, generating a high resolution version of the second image according to the second image, and displaying the high resolution version.

The present disclosure provides an image capture device. The image capture device includes a camera and a processor. The camera is configured to shoot a first image and a second image in order. The processor is configured to generate a third image when a difference between the first image and the second image is larger than or equal to a preset difference value. When the difference is larger than or equal to the preset difference value, the processor is further is configured to output the first image and the second image in order, and the third image is a high resolution version of the second image.

DETAILED DESCRIPTION

The terms applied throughout the following descriptions and claims generally have their ordinary meanings clearly established in the art or in the specific context where each term is used. Those of ordinary skill in the art will appreciate that a component or process may be referred to by different names. Numerous different embodiments detailed in this specification are illustrative only, and in no way limits the scope and spirit of the disclosure or of any exemplified term.

It is worth noting that the terms such as “first” and “second” used herein to describe various elements or processes aim to distinguish one element or process from another. However, the elements, processes and the sequences thereof should not be limited by these terms. For example, a first element could be termed as a second element, and a second element could be similarly termed as a first element without departing from the scope of the present disclosure.

In the following discussion and in the claims, the terms “comprising,” “including,” “containing,” “having,” “involving,” and the like are to be understood to be open-ended, that is, to be construed as including but not limited to. As used herein, instead of being mutually exclusive, the term “and/or” includes any of the associated listed items and all combinations of one or more of the associated listed items.

FIG.1is a schematic diagram of a display system100illustrated according to some embodiments of this disclosure. In some embodiments, the display system100is configured to display images, such as images M21-M23shown inFIG.1.

As illustratively shown inFIG.1, the display system100includes a camera110, a processor120and a display130. In some embodiments, the display system100is configured to shoot an object OB and display an image corresponding to the object OB. In the embodiment shown inFIG.1, the camera110and the processor120are included in an image capture device101.

In some embodiments, the camera110is configured to shoot the object OB to generate the corresponding images M11and M12. In some embodiments, the camera110is configured to shoot the object OB continuously, to generate the images M11and M12in order. In some embodiments, the camera110outputs the images M11and M12in a streaming manner. In some embodiments, the camera110shoots the object OB and outputs the images M11and M12simultaneously.

In some embodiments, the camera110is implemented as a document camera. In some embodiments, the camera110is an USB video class device, but not limited to this.

As illustratively shown inFIG.1, the camera110includes a camera lens112, a support114and a control panel116. In some embodiments, the camera lens112is configured to shoot the object OB. The support114is configured to support the camera lens112, such that the camera lens112is aligned with the object OB. The control panel116is configured to control at least one of the camera lens112or the support114. For example, the control panel116controls the support114to move the camera lens112to a position which is proper for shooting the object OB. In various embodiments, the support114may be implemented as a gooseneck type arm or a mechanical arm.

In some embodiments, the processor120is configured to process the images M11and M12shot by the camera110to generate at least one of the images M21, M22and M23. The images M21and M22correspond to the images M11and M12, respectively. In some embodiments, the image M23is a high resolution version of the image M12.

In some embodiments, the processor120is coupled to the camera110and the display130. For example, the processor120is coupled to the camera110and the display130through a universal serial bus (USB) to receive at least one of the images M11and M12, and transmits at least one of the images M21, M22and M23to the display130.

In some embodiments, the processor120stores application programs122, and operates according to the application programs122. In some embodiments, the application programs122are at least one of software or firmware. In some embodiments, the processor120is configured to process at least one of the images M11and M12according to the application programs122, such as zoom in, zoom out and/or crop. In some embodiments, the processor120is configured to generate the image M23according to the application programs122and the image M12. In some embodiments, the application programs122include super resolution operations using artificial intelligence. In some embodiments, the application programs122include super resolution operations using either one or combination of interpolation and neural network.

In some embodiments, the display130is configured to display at least one of the images M21, M22and M23.

FIG.2is a flowchart diagram of a display method200illustrated according to some embodiments of this disclosure. In some embodiments, the display method200is applied to the display system100shown inFIG.1, but embodiments of present disclosure are not limited to this. In various embodiments, the display method200may be applied to other kinds of display systems. For illustration purpose, operations of the display method200are described below with components of the display system100as an example.

As illustratively shown inFIG.2, the display method200includes operations S21-S28. In various embodiments, display methods provided by present disclosure include a part or combination of the operations S21-S28.

At the operation S21, the camera110shot the object OB to generate the image M11. The processor120transmits the image M21corresponding to the image M11to the display130. The display130displays the image M21.

At the operation S22, the camera110shot the object OB to generate the image M12.

At the operation S23, the processor120generates the image M22corresponding to the image M12according to the image M12, and determines whether a resolution of the image M22is smaller than or equal to a preset resolution. In some embodiments, the preset resolution is 160×120, but embodiments of present disclosure are not limited to this. In various embodiments, the preset resolution may be different numerical values.

If the processor120determines that the resolution of the image M22is smaller than or equal to the preset resolution at the operation S23, the display system performs the operation S24. At the operation S24, the processor determines whether a difference between the image M21and M22is larger than or equal to a preset difference value. In various embodiments, the processor120determines the difference between the image M21and M22based on various parameters. For example, the processor120determines the difference according to at least one of a pixel difference, a color difference or a feature value difference of the images M21and M22. In some embodiments, the processor120processes the image M21as a signal, processes the image M22as a noise, calculates a corresponding peak signal to noise ratio (PSNR), and determines the difference according to the PSNR.

If the processor120determines that the resolution of the image M22is larger than the preset resolution at the operation S23, the display system performs the operation S25. At the operation S25, the display130is configured to display the image M22.

If the processor120determines that the difference between the images M21and M22is smaller than the preset difference value at the operation S24, the display system performs the operation S26. At the operation S26, the display130is configured to display the image M21.

If the processor120determines that the difference between the images M21and M22is larger than or equal to the preset difference value at the operation S24, the display system performs the operation S27. At the operation S27, the processor120is configured to generate the image M23according to the image M22. At the operation S28, the display130is configured to display the image M23.

FIG.3is a schematic diagram of an image shot by the camera110illustrated according to some embodiments of this disclosure.FIG.3includes images301-303. Referring toFIG.2andFIG.3, operations of the display method200are described below with the images301-303.

In some embodiments, the image301corresponds to the images M11and M21, and the images302and303correspond to the images M12, M22and M23under different circumstances. In some embodiments, a difference between the images301and302is smaller than the preset difference value, and a difference between the images301and303is larger than the preset difference value. In some embodiments, in response to amplitude of variation of the object OB being small, the camera shoots the object OB and generates the images301and302in order according to the variation of the object OB. In response to amplitude of variation of the object OB being large, the camera shoots the object OB and generates the images301and303in order according to the variation of the object OB.

Three circumstances are described below as examples. In the three circumstances described below, a resolution of the image301is larger than the preset resolution.

In the first circumstance, resolutions of the images302and303are larger than the preset resolution. Correspondingly, the display system100performs the operation S25, and the display130displays the image302or303directly according to the variation of the object OB. In the first circumstance, the processor120does not perform the super resolution operation.

In the second circumstance, the variation of the object OB corresponds to the image302. Correspondingly, the display system100performs the operation S26, and the display130displays the image301. In the second circumstance, the processor120does not perform the super resolution operation.

In the third circumstance, the variation of the object OB corresponds to the image303. Correspondingly, the display system100performs the operations S27-S28, the processor120performs the super resolution operation to the image303to generate a high resolution version of the image303, and the display130displays the high resolution version of the image303. In which the high resolution version of the image303has a resolution higher than the preset resolution.

In the three circumstances described above, resolutions of images displayed by the display130are higher than the preset resolution.

In some approaches, a processor performs high resolution operations to images shot by a camera continuously, such that consumption of efficacy of a system is high, and operation time is long.

Compared to the above approaches, in some embodiments of present disclosure, the high resolution operations are not performed when the resolution of the image is larger than the preset resolution. The high resolution operations are also not performed, and the image301having a high resolution is displayed directly when the variation (such as the variation corresponding to the images301and302) of the object shot by the camera is small. As a result, under the condition that a quality of the image displayed by the display130is maintained, the display system100has a lower consumption of efficacy and shorter operation time.

FIG.4is a flowchart diagram of a display method400illustrated according to some embodiments of this disclosure. In some embodiments, the display method400is applied to the display system100shown inFIG.1, but embodiments of present disclosure are not limited to this. In various embodiments, the display method400may be applied to other kinds of display systems. For illustration purpose, operations of the display method400are described below with components of the display system100as an example.

As illustratively shown inFIG.4, the display method400includes operations S41, S499and S414, in which the operation S499includes operations S42-S413. In various embodiments, display methods provided by present disclosure include a part or combination of the operations S41-S414.

Referring toFIG.4andFIG.2, the display method400is an alternative embodiment of the display method200. The operations S41, S47S49and S410correspond to the operations S22, S23, S24and S27, respectively, and the operation S414corresponds to the operations S25, S26and S28. Therefore, some descriptions are not repeated for brevity.

Before the operation S41, the display130is configured to display a first image. At the operation S41, the camera110shoots the object OB to generate an original image of a second image, and transmit MJPEG format data of the original image to the processor120through an USB line transmission.

At the operation S499, the processor120provides the first image, the second image and a third image to the display130by the application program122according to the second image.

At the operation S414, the display130displays the first image, the second image and the third image from the processor120.

Further details of the operations S42-S413in the operation S499are described below. At the operation S42, a receiver in the processor120receives the original image shot by the camera110.

At the operation S43, a decoder in the processor120decodes the MJPEG format data of the original image to generate RGB image data of the original image.

At the operation S44, a buffer in the processor120stores the RGB image data of the original image.

At the operation S45, a user performs zoom in/out and crop operations to the original image to generate the second image corresponding to details those the user desires to see. In some embodiments, the second image has a resolution lower than a resolution of the original image.

At the operation S46, the buffer in the processor120stores the second image.

At the operation S47, the processor checks whether the resolution of the second image is smaller than or equal to the preset resolution. In the embodiment shown inFIG.4, the preset resolution is 160×120.

If the processor120determines that the resolution of the second image is larger than 160×120 at the operation S47, the processor120stores the second image into the buffer configured to store an image for displaying corresponding to the operation S413. If the processor120determines that the resolution of the second image is smaller than or equal to 160×120 at the operation S47, the operation S48is performed.

At the operation S48, a PSNR module in the processor120generates a corresponding PSNR value according to the second image and the first image. In which the PSNR module processes the first image as a signal and processes the second image as a noise, to generate the PSNR value. In response to a difference between the second image and the first image being smaller, the PSNR value is larger.

At the operation S49, the processor checks whether the PSNR value is smaller than or equal to a preset PSNR value. In the embodiment shown inFIG.4, the preset PSNR value is 30 dB, but embodiments of present disclosure are not limited to this.

If the processor120determines that the PSNR value is larger than 30 dB at the operation S49, the processor120stores the first image into the buffer corresponding to high resolution images corresponding to the operation S412. If the processor120determines that the resolution of the second image is smaller than or equal to 30 dB at the operation S49, the operation S410is performed.

At the operation S410, the processor120generates the third image by artificial intelligence according to the second image. The third image is a high resolution version of the second image. In various embodiments, the resolution of the third image may be twice, three times or four times of the resolution of the second image, but embodiments of present disclosure are not limited to this.

In some embodiments, the operation S410includes the operation S411. At the operation S411, the processor120generates the third image by a super resolution model of an efficient sub-pixel convolutional neural network (ESPCN) according to the second image.

At the operation S412, the buffer, in the processor120, corresponding to high resolution images stores the first image or the third image according to the operation S49.

At the operation S413, the buffer, in the processor120, configured to store an image for displaying stores the first image, the second image or the third image according to the operations S412and S47, and outputs the stored images to the display130.

At the operation S414, the display130displays the first image, the second image or the third image according to the image stored at the operation S413.

In summary, in some embodiments of present disclosure, by performing the operations S23, S24, S47and S49, the display system100may not perform the super resolution operation when the resolution of the image is higher than the preset resolution or the variation of the image is small, such that the display system100has a lower consumption of efficacy and a shorter operation time.