Patent Publication Number: US-2021192698-A1

Title: Image Processing Method, Electronic Device, and Non-Transitory Computer-Readable Storage Medium

Description:
CROSS-REFERENCE TO RELATED APPLICATION(S) 
     The present application is a continuation-application of International (PCT) Patent Application No. PCT/CN2019/092931, filed on Jun. 26, 2019, which claims priority of Chinese Patent Application No. 201811045659.3, filed on Sep. 7, the entire contents of both of which are hereby incorporated by reference. 
    
    
     TECHNICAL FIELD 
     The present disclosure relates to the field of computer technologies, and in particular to an image processing method, an electronic device, and a non-transitory computer-readable storage medium. 
     BACKGROUND 
     The electronic device can obtain an image by shooting, downloading, transmitting, etc. After the image is obtained, the electronic device can also perform some post-processing thereon, such as increasing the brightness of the image, adjusting the saturation of the image, or adjusting the color temperature of the image, etc. The electronic device can also add light effects to the image. The added light effects can simulate a change of light intensity, such that objects in the image may show a lighting effect. 
     SUMMARY 
     According to various embodiments of the present disclosure, an image processing method, an electronic device, and a non-transitory computer-readable storage medium are provided. 
     An image processing method, including: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
     An electronic device, including a memory and a processor. The memory stores a computer program; when the computer program is executed by the processor, the processor performs the following operations: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
     A non-transitory computer-readable storage medium, storing a computer program, wherein when the computer program is executed by a processor, the processor performs the following operations: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
     Details of one or more embodiments of the present disclosure are presented in the accompanying drawings and description below. Other features, purposes and advantages of the present disclosure will become apparent from the specification, the accompanying drawings, and the appended claims. 
    
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
       To further illustrate technical solutions of embodiments of the present disclosure, drawings needed for description of the embodiments will be briefly introduced. Obviously, the following drawings are only some embodiments of the present disclosure. To any one of skill in the art, other drawings may be obtained without any creative work based on the following drawings. 
         FIG. 1  is a schematic view of an application environment of an image processing method according to an embodiment of the present disclosure. 
         FIG. 2  is a flow chart of an image processing method according to an embodiment of the present disclosure. 
         FIG. 3  is a flow chart of an image processing method according to an embodiment of the present disclosure. 
         FIG. 4  is a schematic view of performing a light effect enhancement process on a three-dimensional model according to an embodiment of the present disclosure. 
         FIG. 5  is a flow chart of an image processing method according to an embodiment of the present disclosure. 
         FIG. 6  is a schematic view of a connected region according to an embodiment of the present disclosure. 
         FIG. 7  is a flow chart of an image processing method according to an embodiment of the present disclosure. 
         FIG. 8  is a block diagram of an image processing device according to an embodiment of the present disclosure. 
         FIG. 9  is a block diagram of an image processing circuit according to an embodiment of the present disclosure. 
     
    
    
     DETAILED DESCRIPTION 
     To make any one of skill in the art to understand the technical solutions of the present disclosure, the technical solutions provided by the present disclosure will be described in details by referring to the drawings and the embodiments. It should be understood that the specific embodiments described herein are only to explain the present disclosure, and are not used to limit the present disclosure. 
     Terms of “first”, “second”, and the like in the description of the present disclosure are to describe various elements, but the elements are not limited by these terms. These terms are only to distinguish an element from another element. For example, without departing from the scope of the present disclosure, a first client may be referred to as a second client, and similarly, the second client may be referred to as the first client. Both the first client and the second client are clients, but they are not the same client. 
     The present disclosure provides an image processing method, including: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
     In some embodiments, the detecting the one or more face regions in the image to be processed includes: dividing pixels in each of the one or more face regions into a plurality of pixel blocks, the plurality of pixel blocks being different from each other; obtaining a first average brightness value of pixels in each of the plurality of pixel block; forming a first pixel region with pixel blocks, wherein each of the pixel blocks forming the first pixel region has the first average brightness value greater than a brightness threshold; and forming the overexposed region based on the first pixel region. 
     In some embodiments, the forming the overexposed region based on the first pixel region includes: for each of the one or more face regions: obtaining a second pixel region in the face region, wherein the face region consists of the first pixel region and the second pixel region; binarizing the face region based on the first pixel region and the second pixel region; and determining the overexposed region based on the binarized face region. 
     In some embodiments, the binarizing the face region based on the first pixel region and the second pixel region includes: configuring brightness values of pixels in the first pixel region to a non-zero brightness value; and configuring brightness values of pixels in the second pixel region to zero. 
     In some embodiments, the determining the overexposed region based on the binarized face region includes: obtaining a connected region in the binarized face region; obtaining an area ratio of the connected region to the face region; and forming the overexposed region based on the connected region of which the area ratio is greater than an area threshold. 
     In some embodiments, the obtaining the connected region in the binarized face region includes: obtaining the binarized face region; performing expanding and corroding on the binarized face region sequentially; and obtaining the connected region in the binarized face region after the expanding and corroding. 
     In some embodiments, the obtaining the light effect intensity coefficient based on the overexposed region includes: obtaining a second average brightness value of pixels in the overexposed region; and obtaining the light effect intensity coefficient based on the second average brightness value. 
     In some embodiments, the obtaining the light effect intensity coefficient based on the second average brightness value includes: obtaining the brightness threshold for forming the overexposed region; and configuring a ratio of the brightness threshold to the second average brightness value as the light effect intensity coefficient. 
     In some embodiments, the obtaining the second average brightness value of pixels in the overexposed region and obtaining the light effect intensity coefficient based on the second average brightness value includes: in response to two or more face regions being detected in the image to be processed, obtaining the second average brightness value of the overexposed region in each face region; and obtaining the light effect intensity coefficient based on a maximum second average brightness average among the second average brightness values corresponding to the two or more face regions. 
     In some embodiments, the performing light enhancement processing on the image to be processed based on the target light effect model includes: obtaining a light effect enhancement parameter of a color channel value corresponding to each pixel in the image to be processed based on the target light effect model; and performing the light enhancement processing on the color channel value of each pixel based on the light effect enhancement parameter. 
     In some embodiments, the performing light enhancement processing on the image to be processed based on the target light effect model includes: obtaining a depth image corresponding to the image to be processed; obtaining a three-dimensional model corresponding to the face region by performing three-dimensional reconstruction based on the image to be processed and the depth image; and performing the light enhancement processing on the three-dimensional model based on the target light effect model. 
     In some embodiments, the method further includes: presetting a reference light effect model; and the obtaining the target light effect model based on the light effect intensity coefficient includes: adjusting the reference light effect model based on the light effect intensity coefficient and obtaining the target light effect model based on the reference light effect model and the light effect intensity coefficient. 
     The present disclosure further provides an electronic device, including a memory and a processor; wherein the memory stores a computer program; when the computer program is executed by the processor, the processor performs an image processing method, the image processing method including: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
     In some embodiments, the detecting the one or more face regions in the image to be processed includes: dividing pixels in each of the one or more face regions into a plurality of pixel blocks, the plurality of pixel blocks being different from each other; obtaining a first average brightness value of pixels in each of the plurality of pixel block; forming a first pixel region with pixel blocks, wherein each of the pixel blocks forming the first pixel region has the first average brightness value greater than a brightness threshold; and forming the overexposed region based on the first pixel region. 
     In some embodiments, the forming the overexposed region based on the first pixel region includes: for each of the one or more face regions: obtaining a second pixel region in the face region, wherein the face region consists of the first pixel region and the second pixel region; binarizing the face region based on the first pixel region and the second pixel region; and determining the overexposed region based on the binarized face region. 
     In some embodiments, the obtaining the light effect intensity coefficient based on the overexposed region includes: obtaining a second average brightness value of pixels in the overexposed region; and obtaining the light effect intensity coefficient based on the second average brightness value. 
     In some embodiments, the obtaining the second average brightness value of pixels in the overexposed region and obtaining the light effect intensity coefficient based on the second average brightness value includes: in response to two or more face regions being detected in the image to be processed, obtaining the second average brightness value of the overexposed region in each face region; and obtaining the light effect intensity coefficient based on a maximum second average brightness average among the second average brightness values corresponding to the two or more face regions. 
     In some embodiments, the performing light enhancement processing on the image to be processed based on the target light effect model includes: obtaining a light effect enhancement parameter of a color channel value corresponding to each pixel in the image to be processed based on the target light effect model; and performing the light enhancement processing on the color channel value of each pixel based on the light effect enhancement parameter. 
     In some embodiments, the performing light enhancement processing on the image to be processed based on the target light effect model includes: obtaining a depth image corresponding to the image to be processed; obtaining a three-dimensional model corresponding to the face region by performing three-dimensional reconstruction based on the image to be processed and the depth image; and performing the light enhancement processing on the three-dimensional model based on the target light effect model. 
     The present disclosure further provides a non-transitory computer-readable storage medium, storing a computer program, wherein when the computer program is executed by a processor, the processor performs operations of an image processing method, the image processing method including: obtaining an image to be processed; detecting one or more face regions in the image to be processed, and detecting an overexposed region in each of the one or more face regions; for each of the one or more face regions: obtaining a light effect intensity coefficient based on the overexposed region, and obtaining a target light effect model based on the light effect intensity coefficient, the target light effect model being a model that simulates a change in light; and performing light enhancement processing on the image to be processed based on the target light effect model. 
       FIG. 1  is a schematic view of an application environment of an image processing method according to an embodiment of the present disclosure. As shown in  FIG. 1 , the application environment includes an electronic device  10 . The electronic device  10  may collect an image to be processed through a camera  102  arranged on the electronic device  10 , may detect a face region of the collected image to be processed, and further detect an overexposed region in the face region. The electronic device  10  may obtain a light effect intensity coefficient based on the overexposed region, and obtain a target light effect model based on the light effect intensity coefficient. The electronic device  10  may perform a light effect enhancement processing on the image to be processed based on the target light effect model. In some embodiments, the electronic device  10  may be a personal computer, a mobile terminal, a personal digital assistant, a wearable electronic device, etc., and is not limited thereto. 
       FIG. 2  is a flow chart of an image processing method according to an embodiment of the present disclosure. As shown in  FIG. 2 , the image processing method includes operations  202  to  208 . 
     In operation  202 , an image to be processed is obtained. 
     In some embodiments, the image to be processed refers to an image required to be light enhancement processed. Specifically, the image to be processed may be a two-dimensional matrix including a plurality of pixels. Each pixel may have a corresponding pixel value. Different patterns are thus formed via an arrangement of the pixels with different pixel values. The resolution of the image to be processed may be expressed by the number of pixels arranged horizontally and that of pixels arranged vertically. For example, the resolution of the image to be processed may be 640×320, which means that the image to be processed is arranged with  640  pixels in each horizontal direction and  320  pixels in each longitudinal direction. 
     Specifically, the manner in which the electronic device obtains the image to be processed is not limited. For example, the electronic device may directly capture the image to be processed through the arranged camera, or receive the image to be processed sent by other electronic devices, or download the image to be processed from web pages, or directly find or look up the image to be processed from images stored locally in the electronic device, etc., which is not limited herein. 
     In operation  204 , a face region in the image to be processed is detected, and an overexposed region in the face region is detected. 
     After the image to be processed is obtained, a face detection may be performed on the image to be processed to extract a face region in the image to be processed. The face region refers to a region in which a face is located, and may be represented by a minimum rectangular region including the face region, or represented by a region included in a face contour, which is not limited herein. 
     The detecting the face region in the image to be processed may be implemented by any face detection algorithm. For example, the face detection algorithm may be an adaptive boosting (AdaBoost) algorithm, a single shot multibox detector (SSD) algorithm, or a convolutional neural networks (CNN) algorithm, which is not limited herein. 
     After the face region is detected, the electronic device may detect the overexposed region in the face region. The overexposed region refers to a region in which exposing is over-intensive. Generally, a pixel may be detected whether to be overexposed based on the brightness of the pixel. For example, the electronic device may obtain the brightness of each pixel in the face region and obtain a region including or formed by pixels with a brightness greater than a certain value, and the region formed by the pixels with the brightness greater than the certain value is the overexposed region. 
     In operation  206 , a light effect intensity coefficient is obtained based on or according to or corresponding to the overexposed region, and a target light effect model is obtained based on the light effect intensity coefficient. The target light effect model is a model that simulates a change in light. 
     When a light effect enhancement processing is performed on the image to be processed, the color, brightness, or the like, of the pixels in the image to be processed may be changed. Assuming that there is an overexposed region in the image to be processed, when the light effect enhancement processing is performed on the image to be processed, severe distortion may occur in the overexposed region. Therefore, the electronic device is required to first detect the overexposed region in the face region, and then adjust the light effect intensity coefficient for performing the light enhancement processing based on the overexposed region. 
     The target light effect model is a model that simulates changes in light, and the light effect enhancement processing can be performed on the image to be processed via the target light effect model. The light enhancement processing refers to the process of adding light effects to an image. Specifically, the target light effect model can simulate changes in the directions, intensities, and colors of light. The electronic device can add light in different directions, strengths, and colors to the image to be processed via the target light effect model. For example, the target light effect model can simulate the light changes produced by incandescent lights, and can also simulate the light changes of tungsten filament lights. The light colors produced by the incandescent lights are blue, and the light colors produced by the tungsten lights are yellow. 
     In some embodiments, after the overexposed region is detected, the intensity of the light effect enhancement processing may be adjusted according to or based on the overexposed region. Specifically, the electronic device may obtain the brightness of the overexposed region, adjust the light effect intensity coefficient of the target light effect model based on the brightness of the overexposed region, and perform the light effect enhancement processing based on the target light effect model. For example, the greater the brightness of the overexposed region, the less the light intensity coefficient obtained, and the less the intensity of the light effect enhancement process. 
     In operation  208 , a light enhancement processing is performed on the image to be processed based on the target light effect model. 
     In some embodiments, the target light effect model may be a model for performing the light enhancement processing on a partial region in the image to be processed, or a model for performing the light enhancement processing on the entire region in the image to be processed, which is not limited herein. For example, the electronic device may only perform the light effect enhancement processing on the face region in the image to be processed via the target light effect model, or may perform the light effect enhancement processing on the entire image to be processed via the target light effect model. 
     Specifically, the image to be processed may be a two-dimensional matrix including a plurality of pixels. Each pixel may have a corresponding pixel value. Therefore, after the electronic device obtains the target light effect model, a light effect enhancement parameter of each pixel in the image to be processed may be calculated based on the target light effect model. After the electronic device calculates the light effect enhancement parameter, the light effect enhancement process may be performed on each pixel point in the image to be processed based on the light effect enhancement parameter. Specifically, the electronic device may perform the light effect enhancement processing by superimposing or multiplying the image to be processed by utilizing the light effect enhancement parameter, which is not limited herein. It can be understood that the range of the pixel value in an image is generally [0,255], so the pixel value of the image to be processed after the light effect enhancement processing cannot be greater than 255. 
     For example, assuming that the image to be processed is H 0 (x, y) and the target light effect model is P(x, y), the image H(x, y) after the light effect enhancement processing is performed by superimposing can be expressed as H(x, y)=(1+P(x, y)) H 0 (x, y). The image after the light effect enhancement processing is performed by multiplying can be expressed as H(x, y)=P(x, y) H 0 (x, y). It can be understood that the light effect enhancement processing may also be implemented in other ways, which is not limited herein. 
     In some embodiments, when performing the light effect enhancement processing on the image to be processed, the electronic device may also perform different processing on each color channel in the image to be processed. Specifically, each pixel in the image to be processed may correspond to one or more color channel values. The electronic device may obtain by calculating the light effect enhancement parameter of the color channel value corresponding to each pixel based on the obtained target light effect model, and perform the light enhancement processing on the one or more color channel values of each pixel based on corresponding light effect enhancement parameter respectively. For example, the image to be processed corresponds to four color channels, the target light effect model includes four light effect sub-models, and each light effect sub-model corresponds to one color channel. In this case, the electronic device may calculate the light effect enhancement parameter of the color channel value corresponding to the image to be processed based on the light effect sub-models, and perform the light enhancement processing on the channel values based on corresponding light effect enhancement parameter. 
     It can be understood that after the electronic device performs different light effect enhancement processing on different color channel values, the obtained light effect enhancement effect of the image may be the same. For example, among the light effect enhancement parameters corresponding to three channels including a red (R) channel, /a green (G) channel, /and a blue (B) channel obtained by the electronic device, the light effect enhancement parameter corresponding to the R channel are greater than the light effect enhancement parameters of the G channel and the B channel. In this case, after the electronic device performs the light enhancement processing on the image to be processed based on the light effect enhancement parameters, a light effect enhanced image with an effect of reddish light compared to the image to be processed may be obtained. 
     In the image processing method described in the above embodiments, a face region in the image to be processed is detected, and an overexposed region in the face region is detected. A light effect intensity coefficient is obtained based on the overexposed region, and a target light effect model is obtained based on the light effect intensity coefficient. A light enhancement processing is performed on the image to be processed based on the target light effect model. After the overexposed region of the face region is detected, the intensity of the light effect enhancement processing is adjusted based on the overexposed region, such that the distortion of the face region caused by the light effect enhancement processing may not occur, and the accuracy of image processing may be improved. 
       FIG. 3  is a flow chart of an image processing method according to an embodiment of the present disclosure. As shown in  FIG. 3 , the image processing method includes operations  302  to  316 . 
     In operation  302 , an image to be processed is obtained. 
     In the embodiment, the light effect enhancement processing of the image to be processed may be automatically triggered by the electronic device or manually triggered by a user, which is not limited herein. For example, when the electronic device captures an image, the user can manually select whether to perform light enhancement processing on the captured image. When the user clicks a button for the light enhancement processing, the electronic device configures the captured image as the image to be processed and performs the light enhancement processing on the image to be processed. 
     In operation  304 , a face region in the image to be processed is detected, and pixels in the face region are divided into a plurality of pixel blocks, and the plurality of pixel blocks are different from each other. 
     The image to be processed may be a two-dimensional matrix including a plurality of pixels, so the detected face region also includes multiple pixels. After the electronic device detects the face region in the image to be processed, the electronic device may divide the pixels in the detected face region into different pixel blocks, separately obtain brightness values of the pixel blocks, and determine whether there is an overexposing based on the obtained brightness values. 
     It can be understood that the size of the pixel block is not limited here. The size of the pixel block may be expressed by m×n. The size of m×n indicates that there are m pixels in each horizontal direction in the pixel block, and n pixels in each vertical direction in the pixel block. The number of pixels in the horizontal direction and that of pixels in the vertical direction in the pixel block may be the same or different, which is not limited herein. For example, the pixel block may be 16×16 in size or 10×4 in size. 
     In operation  306 , a first average brightness value of pixels in each pixel block is obtained. 
     After the electronic device divides the face region into the different pixel blocks, each pixel block contains multiple pixels, and each pixel corresponds to a brightness value. The electronic device may obtain, for example, by means of counting and calculating, an average value of the brightness values of all the pixels in each pixel block as the first average brightness value. Therefore, each pixel block corresponds to a first average brightness value. The electronic device may determine the overexposed region based on the obtained first average brightness value. 
     In some embodiments, assuming that the pixel block is 16×16 in size, the electronic device may predefine a 16×16 in-size rectangular frame, and traverse the face region by using the 16×16 in-size rectangular frame. The specific traversal process is as follows. The electronic device defines a starting position in the face region, and places the rectangular frame at the starting position. The pixels in the rectangular frame thus form a pixel block, and the first average brightness value corresponding to the pixel block is obtained through counting and calculating. Then the rectangle frame is moved to a different position each time, and each time the pixels in the moved rectangle frame form a pixel block. In this way, the first average brightness value of each pixel block formed each time may be obtained. 
     In operation  308 , a first pixel region is formed with pixel blocks, and each of the pixel blocks forming the first pixel region has the first average brightness value greater than a brightness threshold, and an overexposed region is formed based on the first pixel region. 
     After the electronic device obtains the first average brightness values corresponding to each pixel block, the electronic device obtains the pixel blocks with the first average brightness value greater than the brightness threshold, and forms the first pixel region by utilizing the obtained pixel blocks. Pixels with excessively high brightness values may be caused by overexposure. Therefore, the electronic device may obtain an overexposed region based on the pixel blocks with the first average brightness value greater than the brightness threshold. 
     In operation  310 , a second average brightness value of pixels in the overexposed region is obtained, and a light effect intensity coefficient is obtained based on or by using or according to the second average brightness value. 
     After the electronic device determines the overexposed region, the electronic device may obtain the average value of the brightness values of all the pixels in the overexposed region to obtain the second average brightness value, and then obtain the light effect intensity coefficient based on the second average brightness value. Generally, the greater the second average brightness value, the less the light effect intensity coefficient, and the weaker the intensity of the corresponding light effect enhancement process. 
     Specifically, when the electronic device obtains the second average brightness value of the pixels in the overexposed region, the brightness values of all pixels in the overexposed region may be superimposed, the number of pixels in the overexposed region is counted, and then the sum of the brightness values is divided by the number of pixels to obtain the second average brightness value. For example, when the overexposed region includes 4 pixels and the brightness values are 201, 186, 158, and 165 respectively, the second average brightness value is then (203+186+158+165)/4=178. 
     In some embodiments, the operation of obtaining the light effect intensity coefficient may include: obtaining the light effect intensity coefficient based on the second average brightness value and the brightness threshold. Specifically, the light effect intensity coefficient may be obtained based on a ratio of the brightness threshold to the second average brightness value. Assuming that the second average brightness value is V 2  and the brightness threshold is T, then the obtained light efficiency intensity coefficient is r=T/V 2 . 
     For example, the brightness threshold may be T=240. After obtaining the first average brightness values V 1  of the pixel blocks, the electronic device may form the first pixel region by or with the pixel blocks of which first average brightness value V 1  is greater than 240, and then obtain the overexposed region based on the first pixel region. Further, the electronic device obtains the second average brightness value V 2  of the overexposed region, and obtains the light efficiency intensity coefficient r=240 /V 2  based on the second average brightness value and the brightness threshold. 
     In operation  312 , a target light effect model is obtained based on the light effect intensity coefficient. 
     In the embodiment provided by the present disclosure, the electronic device may preset a reference light effect model. The reference light effect model may simulate changes in light, and may specifically simulate changes in light color, direction, intensity, etc. After the electronic device obtains the light effect intensity coefficient, the light effect intensity of the reference light effect model may be adjusted based on the light effect intensity coefficient, thereby obtaining the target light effect model. 
     For example, assuming that the reference light effect model is P 0 (x, y), the light effect intensity coefficient is r, and the obtained target light effect model is P(x, y), then the formula for the target light effect model obtained by the electronic device based on the reference light effect model and the light effect intensity coefficient may be expressed as: P(x, y)=r×P 0 (x, y). 
     In operation  314 , a depth image corresponding to the image to be processed is obtained, and a three-dimensional model corresponding to the face region is obtained by performing three-dimensional reconstruction based on the image to be processed and the depth image. 
     In some embodiments, after obtaining the target light effect model, the electronic device may process a two-dimensional image or a three-dimensional model, which is not limited herein. The image to be processed is a two-dimensional image. After obtaining the target light effect model, the electronic device may directly process the image to be processed, or may process the three-dimensional model obtained by performing the three-dimensional reconstruction based on the image to be processed. 
     When the electronic device processes the three-dimensional model, the electronic device is required to perform three-dimensional modeling based on the image to be processed to obtain the three-dimensional model. Specifically, the electronic device obtains the depth image corresponding to the image to be processed, and then performs the three-dimensional reconstruction based on the image to be processed and the depth image. The image to be processed may be configured to represent information such as the color and texture of an object. The depth image may be configured to represent the distance between the object and an image obtaining device. 
     The electronic device may perform the three-dimensional modeling on the face region based on the image to be processed and the depth image, and obtain the three-dimensional model corresponding to the face region. Specifically, the three-dimensional model may be configured to represent a polygonal three-dimensional structure of the object. The three-dimensional model may generally be represented by a three-dimensional mesh (3D mesh) structure, and the mesh comprises or is even composed of point cloud data of the object. The point cloud data may generally include three-dimensional coordinate (XYZ), laser reflection intensity, and color information (RGB). Finally, the three-dimensional mesh is drawn based on the point cloud data. 
     In operation  316 , a light enhancement processing is performed on the three-dimensional model based on the target light effect model. 
     It can be understood that when the electronic device performs the light effect enhancement processing on the three-dimensional model, the target light effect model obtained is also a model to perform the light effect enhancement processing on the three-dimensional model. The preset reference light effect model is also a model to perform the light effect enhancement processing on the three-dimensional model. That is, the target light effect model is a model that simulates the change of light in three-dimensional space. After the electronic device obtains the three-dimensional model, the light effect enhancement processing may be performed on the three-dimensional model based on the target light effect model. 
       FIG. 4  is a schematic view of performing a light effect enhancement process on a three-dimensional model according to an embodiment of the present disclosure. As shown in  FIG. 4 , the electronic device performs the three-dimensional reconstruction on the face region to obtain a three-dimensional model  402 . The obtained three-dimensional model  402  may be represented in a spatial three-dimensional coordinate system xyz. The target light effect model applied by the electronic device for performing the light effect enhancement processing on the three-dimensional model  402  can simulate the change of light in the three-dimensional space. Specifically, the target light effect model may be represented in the three-dimensional space coordinate system xyz, that is, represented as a variation curve of the light generated by a light source center P in the spatial three-dimensional coordinate system xyz. 
     In some embodiment, as shown in  FIG. 5 , the determining the overexposed region may include the following operations. 
     In operation  502 , a second pixel region other than the first pixel region in the face region is obtained. That is to say, the face region consists of the first pixel region and the second pixel region. 
     The electronic device forms the first pixel region based on the pixel blocks of which the first average brightness value is greater than the brightness threshold in the face region, configures the region other than the first pixel region in the face region as the second pixel region, and determines the overexposed region based on the first pixel region and the second pixel region. 
     In operation  504 , the face region is binarized based on or by utilizing or according to the first pixel region and the second pixel region. 
     After the electronic device determines the first pixel region and the second pixel region, the electronic device performs a binarization process based on the first pixel region and the second pixel region. For example, when the electronic device sets all the brightness values of the pixels in the first pixel region to 1 and all the brightness values of the pixels in the second pixel region to 0, the face region can be binarized. 
     In operation  506 , an overexposed region based on the binarized face region is determined. 
     The binarized face region may be more easily distinguished from the first pixel region and the second pixel region. The electronic device determines the overexposed region based on the binarized face region. Specifically, since the first pixel region is a region including pixel blocks with higher brightness values, the first pixel region is considered to be more likely to be the overexposed region. The electronic device may compare the area of the first pixel region. When the area of the first pixel region is small, the first pixel region may be considered to be less likely to be the overexposed region. When the area of the first pixel region is large, the first pixel region may be considered to be more likely to be the overexposed region. In this way, the overexposed region may be formed based on the first pixel region with a larger area. 
     The electronic device may set the brightness values of all the pixels in the first pixel region to non-zero brightness values and sets the brightness values of all the pixels in the second pixel region to 0 to binarize the face region. The binarized face region thus obtained includes one or more connected regions. The electronic device may determine the overexposed region based on the area of the one or more connected regions. 
     Specifically, the electronic device obtains the connected regions in the binarized face region, obtains an area ratio of each connected region to the face region, and forms the overexposed region based on the connected regions of which the area ratio is greater than an area threshold. The area may be represented by the number of pixels included. The area of one connected region is the number of pixels contained in the connected region, and the area of the face region is the number of pixels contained in the face region. After the electronic device obtains the area of each connected region in the face region, the electronic device may obtain the area ratio of each connected region to the face region, and then determine the overexposed region based on the obtained area ratio. 
     In some embodiments, the electronic device may further perform a process of expanding and corroding the binarized face region, then obtain the connected regions in the face region after the process of expanding and corroding, obtain the area ratio of each connected region to the face region, and forms the overexposed region based on the connected regions with the area ratio greater than the area threshold. For example, the area of a connected region is S1, and the area of the face region is S2. Assuming that the ratio of the area of the connected region to that of the face region S1/S2 is greater than 0.1, the electronic device marks the connected region and finally forms the overexposed region based on the marked connected region. 
       FIG. 6  is a schematic view of a connected region according to an embodiment of the present disclosure. As shown in  FIG. 6 , the face region may be binarized. For example, the brightness values of all pixels in the first pixel region are set to 255, and the brightness values of all pixels in the second pixel region are set to 0. The binarized face region  60  is thus obtained. The binarized face region  60  may include a connected region  602  and a non-connected region  604 . 
     In some embodiments provided in the present disclosure, as shown in  FIG. 7 , the obtaining the light effect intensity coefficient may include the following operations. 
     In operation  702 , in response to two or more face regions being detected in the image to be processed, a second average brightness value of the overexposed region in each face region is obtained. 
     Specifically, when two or more face regions are detected in the image to be processed, the electronic device may detect the overexposed region in each face region separately, and obtain the second average brightness value of the overexposed region in each face region to obtain the light effect intensity coefficient based on the second average brightness value. 
     In operation  704 , the light effect intensity coefficient is obtained based on a maximum second average brightness average among the second average brightness values corresponding to the two or more face regions. 
     When the electronic device detects that there are two or more face regions, the electronic device may obtain the light effect intensity coefficient based on the face region with higher brightness. Specifically, the electronic device may obtain a maximum value of the second average brightness value corresponding to each face region obtained by statistics, and then obtain the light effect intensity coefficient based on the maximum average brightness value. For example, in case that the image to be processed includes two face regions, the second average brightness value corresponding to a face region A is 241, and the second average brightness value corresponding to the other face region B is 246, then, the electronic device may calculate the light effect intensity coefficient based on the second average brightness value 246 corresponding to the face region B. 
     In the image processing method provided in the above embodiments, the face region in the image to be processed may be detected, and the overexposed region in the face region may be detected. The light effect intensity coefficient is obtained based on the overexposed region, and the target light effect model is obtained based on the light effect intensity coefficient. Finally, three-dimensional modeling is performed based on the image to be processed and the corresponding depth image. The light effect enhancement processing is performed on the three-dimensional model based on the target light effect model. After the overexposed region of the face region is detected, the intensity of the light effect enhancement processing may be adjusted based on the overexposed region, such that the distortion of the face region caused by the light effect enhancement processing may be limited, improving the accuracy of image processing. 
     It should be understood that although the operations in the flowcharts of  FIGS. 2, 3, 5, and 7  are sequentially displayed in accordance with the directions of the arrows, these operations are not necessarily performed in the order indicated by the arrows. Unless explicitly stated in the present disclosure, the execution of these operations is not strictly limited, and these operations can be performed in other orders. Moreover, at least a part of the operations in  FIGS. 2, 3, 5, and 7  may include multiple sub-operations or multiple stages. The sub-operations or stages are not necessarily performed at the same time, but may be performed at different times. The execution order of the sub-operations or stages is not necessarily sequential, but may be performed in turn or alternately with other operations or at least a part of the sub-operations or stages of other operations. 
       FIG. 8  is a block diagram of an image processing device according to an embodiment of the present disclosure. As shown in  FIG. 8 , an image processing device  800  includes an image obtaining module  802 , an overexposure detection module  804 , a model obtaining module  806 , and a light effect processing module  808 . 
     The image obtaining module  802  is configured to obtain an image to be processed. 
     The overexposure detection module  804  is configured to detect a face region in the image to be processed, and detect an overexposed region in the face region. 
     The model obtaining module  806  is configured to obtain a light effect intensity coefficient based on the overexposed region, and obtain a target light effect model based on the light effect intensity coefficient. The target light effect model is a model that simulates a change in light. 
     The light effect processing module  808  is configured to perform light effect enhancement processing on the image to be processed based on the target light effect model. 
     In the image processing device provided in the embodiments, the face region in the image to be processed may be detected, and the overexposed region in the face region may be detected. The light effect intensity coefficient is obtained based on the overexposed region, and the target light effect model is obtained based on the light effect intensity coefficient. Finally, the light effect enhancement processing is performed on the image to be processed based on the target light effect model. After the overexposed region of the face region is detected, the intensity of the light effect enhancement processing may be adjusted based on the overexposed region, such that the distortion of the face region caused by the light effect enhancement processing may be limited, improving the accuracy of image processing. 
     In some embodiments, the overexposure detection module  804  is further configured to divide pixels in the face region into a plurality of pixel blocks, the plurality of pixel blocks being different from each other; obtain first average brightness value of pixels in each pixel blocks; form a first pixel region with pixel blocks, each of the pixel blocks forming the first pixel region having the first average brightness value greater than a brightness threshold; and form an overexposed region based on the first pixel region. 
     In some embodiments, the overexposure detection module  804  is further configured to obtain a second pixel region other than the first pixel region in the face region; binarize the face region based on or by utilizing or according to the first pixel region and the second pixel region; and determine the overexposed region based on the binarized face region. The face region consists of the first pixel region and the second pixel region. 
     In some embodiments, the overexposure detection module  804  is further configured to obtain connected regions in the binarized face region, and obtain an area ratio of each connected region to the face region; and form the overexposed region based on the connected regions with the area ratio greater than an area threshold. 
     In some embodiments, the model obtaining module  806  is further configured to obtain a second average brightness value of pixels in the overexposed region, and obtain the light efficiency intensity coefficient based on or by using or according to the second average brightness value. 
     In some embodiments, the model obtaining module  806  is further configured to, in response to two or more face regions being detected in the image to be processed, obtain a second average brightness value of the overexposed region in each face region; and obtain the light effect intensity coefficient based on a maximum second average brightness average among the second average brightness values corresponding to the two or more face region. 
     In some embodiments, the light effect processing module  808  is further configured to obtain a depth image corresponding to the image to be processed, perform three-dimensional reconstruction based on the image to be processed and the depth image, obtain a three-dimensional model corresponding to the face region; and perform light enhancement processing on the image to be processed based on the target light effect model. 
     The division of each module in the above image processing device is for illustration only. In other embodiments, the image processing device may be divided into different modules as needed to complete all or part of the functions of the above image processing device. 
     For the specific limitation of the image processing device, reference may be made to the foregoing description on the image processing method, and details are not described herein again. Each module in the above image processing device may be implemented in whole or in part by software, hardware, and a combination thereof. The above-mentioned modules may be embedded in the hardware form or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor calls and performs the operations corresponding to the above modules. 
     The implementation of each module in the image processing device provided in the embodiments of the present disclosure may be in the form of a computer program. The computer program can be run on a terminal or a server. The program module constituted by the computer program can be stored in the memory of a terminal or a server. When the computer program is executed by a processor, the operations of the method described in the embodiments of the present disclosure are implemented. 
     An embodiment of the present disclosure further provides an electronic device. The electronic device includes an image processing circuit. The image processing circuit may be implemented by hardware and/or software components, and may include various processing units that define an image signal processing (ISP) pipeline.  FIG. 9  is a block diagram of an image processing circuit according to an embodiment of the present disclosure. As shown in  FIG. 9 , for ease of description, only aspects of the image processing technology related to the embodiments of the present disclosure are shown. 
     As shown in  FIG. 9 , the image processing circuit includes an ISP processor  940  and a control logic  950 . An image data captured by an imaging device  910  is first processed by the ISP processor  940 . The ISP processor  940  analyzes the image data to capture image statistical information configured to determine one or more control parameters of the imaging device  910 . The imaging device  910  may include a camera including one or more lenses  912  and an image sensor  914 . The image sensor  914  may include a color filter array (such as a Bayer filter). The image sensor  914  may obtain light intensity and wavelength information captured by each imaging pixel of the image sensor  914 , and provide a set of raw image data that can be processed by the ISP processor  940 . A sensor  920  (such as a gyroscope) may provide processing parameters (such as image stabilization parameters) of the obtained image to the ISP processor  940  based on the interface type of the sensor  920 . The sensor  920  may be configured with a standard mobile imaging architecture (SMIA) interface, other serial or parallel camera interfaces, or a combination of the foregoing interfaces. 
     In addition, the image sensor  914  may also send the raw image data to the sensor  920 . The sensor  920  may provide the raw image data to the ISP processor  940  for processing based on the interface type of the sensor  920 , or the sensor  920  stores the raw image data in an image memory  930 . 
     The ISP processor  940  processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits. The ISP processor  940  may perform one or more image processing operations on the raw image data and collect statistical information about the image data. The image processing operations may be performed with a same or different bit depth accuracy. 
     The ISP processor  940  may also receive pixel data from the image memory  930 . For example, the sensor  920  sends the raw image data to the image memory  930 . The raw image data in the image memory  930  is then provided to the ISP processor  940  for processing. The image memory  930  may be a part of a memory device, a storage device, or a separate dedicated memory in the electronic device, and may include a direct memory access (DMA) feature. 
     When the raw image data from the image sensor  914  or from the sensor  920  or from the image memory  930  is received, the ISP processor  940  may perform one or more image processing operations, such as time-domain filtering. The image data processed by the ISP processor  940  may be sent to the image memory  930  for further processing before being displayed. The ISP processor  940  receives processing data from the image memory  930  and performs image data processing on the processing data in an original domain and in the RGB and YCbCr color spaces. The processed image data may be output to the display  980  for being viewed by a user and/or further processed by a graphics engine or a graphics processing unit (GPU). In addition, the output of the ISP processor  940  may also be sent to the image memory  930 , and the display  980  may read the image data from the image memory  930 . In some embodiments, the image memory  930  may be configured to implement one or more frame buffers. In addition, the output of the ISP processor  940  may be sent to an encoder/decoder  970  to encode/decode the image data. The encoded image data may be saved and decompressed before being displayed on a display  980 . 
     The image data processed by the ISP may be sent to a light effect module  960  to perform light effect processing on the image before being displayed. The light effect processing performed by the light effect module  960  on the image data may include obtaining a light effect enhancement parameter of each pixel in the image to be processed, and performing light effect enhancement processing on the image to be processed based on the light effect enhancement parameter. After the light effect module  960  performs the light effect enhancement processing on the image data, the image data after the light effect enhancement processing may be sent to the encoder/decoder  970  to encode/decode the image data. The encoded image data may be saved and decompressed before being displayed on the display  980 . It can be understood that the image data processed by the light effect module  960  may be directly sent to the display  980  for display without being sent to the encoder/decoder  970 . The image data processed by the ISP processor  940  may also be processed by the encoder/decoder  970  first, and then processed by the light effect module  960 . The light effect module  960  or the encoder/decoder  970  may be a central processing unit (CPU) or a GPU in a mobile terminal. 
     The statistical data determined by the ISP processor  940  may be sent to a control logic  950  unit. For example, the statistical data may include statistical information of the image sensor  914  such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, and shading correction of the lens  912 . The control logic  950  may include a processor and/or a microcontroller that executes one or more routines (such as firmware). The one or more routines may determine the control parameters of the imaging device  910  and the control parameters of the ISP processor  940  based on the received statistical data. For example, the control parameters of the imaging device  910  may include control parameters of the sensor  920  (such as gain, integration time for exposure control, image stabilization parameters, etc.), control parameters, lens  912  control parameters for flash of a camera (such as focal length for focus or zoom), or combinations of the parameters. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), and the parameters for correcting the shading of the lens  912 . 
     The following is an operation of implementing the image processing method provided by the foregoing embodiments by the image processing technology in  FIG. 9 . 
     An embodiment of the present disclosure further provides a computer-readable storage medium, specifically, one or more non-transitory computer-readable storage media storing computer-executable instructions. When the computer-executable instructions are executed by one or more processors, the operations of the method described in the embodiments of the present disclosure are implemented. 
     An embodiment of the present disclosure further provides a computer program product containing instructions. When the computer program product runs on a computer, the operations of the method described in the embodiments of the present disclosure are implemented. 
     Any reference to memory, storage, database, or other media mentioned in the present disclosure may include a non-transitory and/or a transitory memory. The non-transitory memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The transitory memory may include a random access memory (RAM), which is used as external cache memory. By way of illustration and not limitation, the RAM is available in various forms, such as a static RAM (SRAM), a dynamic RAM (DRAM), a synchronous DRAM (SDRAM), a dual data rate SDRAM (DDR SDRAM), an enhanced SDRAM (ESDRAM), a synchronous Link (Synchlink) DRAM (SLDRAM), a memory bus (Rambus) direct RAM (RDRAM), a direct memory bus dynamic RAM (DRDRAM), and a memory bus dynamic RAM (RDRAM). 
     The above embodiments are only to describe some implantations the present disclosure which are descried in specific and detailed ways. However, it cannot be interpreted as a limitation to the scope of the present disclosure. It should be noted that, those skilled in the art can still make any modifications and improvements without departing from the idea of the present disclosure. All these belong to the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the appended claims.