Patent Description:
Embodiments of this application relate to the field of terminal technologies, and in particular, to a multispectral sensor and an electronic device.

There is a difference between a multispectral imaging technology and full spectrum imaging or white light imaging. The multispectral imaging technology refers to separating different spectra for a plurality of times of imaging. A same object is collected and a multispectral image is obtained through an inconsistent degree of absorption and reflection of objects under different spectra. Then, detail enhancement may be performed on the multispectral image and processing may be performed on an algorithm of feature extraction, to find different details. The multispectral imaging technology is a photoelectric imaging technology and an application in machine vision.

With the explosive growth of electronic devices such as a smartphone or a tablet computer, the electronic device has more functions. As an imaging technology of the electronic device continues to develop, people have increasingly higher requirements for accuracy of color reproduction when taking photos under various conditions. Especially under different ambient lighting sources, it is easy to cause color distortion and affect image quality. When an electronic device equipped with a multispectral sensor is in a photo-taking mode, the multispectral sensor may provide spectral measurement, thereby improving the accuracy of color reproduction. However, the multispectral sensor in the electronic device has low signal-to-noise ratio and sensitivity, which affects spectral detection performance of the multispectral sensor.

<CIT> discloses a multispectral sensor array that can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., colour). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

<CIT> discloses a CMOS image sensor chip for a medical endoscope and a design method.

<CIT> discloses a multi-mode power-efficient light and gesture sensing in image sensors.

<CIT> discloses a semiconductor device and electronic apparatus.

<CIT> discloses a camera assembly and mobile electronic device.

<CIT> discloses a CMOS imaging device having optimized shape, and a method producing such a device by means of photocomposition.

<CIT> discloses an imaging system with an array of image sensors.

<CIT> discloses a two-dimensional solid-state imaging device.

<CIT> discloses a method, apparatus, and system for providing a rectilinear pixel grid with radially scaled pixels.

<CIT> discloses a colour image sensor with imaging elements imaging on respective regions of sensor elements.

Embodiments of this application provide a multispectral sensor and an electronic device, to improve a low signal-to-noise ratio and sensitivity of the multispectral sensor.

The invention provides a multispectral sensor, and the multispectral sensor includes two or more light channels. Each light channel includes a light entrance part, an optical lens, a filter part, and a sensor array. The light entrance part is configured to allow external light to enter the light channel. The optical lens is configured to change a transmission path of light to be incident on the filter part. The filter part is configured to allow light in a specific wavelength range to pass through and reach the sensor array. Orthographic projection of the sensor array is located in orthographic projection of the optical lens in an axial direction of the light entrance part. The sensor array includes at least three rows of photoelectric sensors. The at least three rows of photoelectric sensors are divided into a middle sensor group and two edge sesnor groups. The middle sensor group is located between the two edge sensor groups in a column direction of the sensor array. The middle sensor group comprises first photoelectric sensors. Each edge sensor group comprises second photoelectric sensors. The middle sensor group comprises two or more rows of first photoeletcric sensors. In a row direction of the sensor array, each row of first photoelectric sensors includes N first photoelectric sensors and N-<NUM> first gaps. Each first gap is formed between two adjacent first photoelectric sensors. A quantity of second photoelectric sensors in the rows of the edge sensor groups is N-<NUM>. The second photoelectric sensor is arranged corresponding to the first gap in the column direction, such that there is a second gap between adjacent second photoelectric sensors in the row direction, wherein the first gaps and the second gaps are not on a same straight line in the column direction.

In the multispectral sensor in embodiments of this application, the first photoelectric sensors and the second photoelectric sensors in the sensor array are arranged in a mutually misaligned manner. The first photoelectric sensor and the second photoelectric sensor are located in different regions. A quantity of second photoelectric sensors in a row is less than a quantity of first photoelectric sensors in each row in the middle sensor group, so that a second photoelectric sensor is not separately arranged in a corner region of the sensor array, which in turn may cause the sensor array to better retain a field of view and a quantity of regions in which the sensor array receives light, and discard the independently arranged photoelectric sensor in the corner region with poor detection performance. Therefore, the multispectral sensor in embodiments of this application is conducive to improving a case that a signal-to-noise ratio and sensitivity of the photoelectric sensor are reduced due to low illuminance of the light received by the photoelectric sensor arranged separately in the corner region, which is conducive to ensuring that the multispectral sensor has good detection sensitivity and high light energy utilization, and implements spectral detection with better comprehensive effects.

Preferably, the centers of each photoelectric sensor in a column are located on a same straight line, so that in a column direction, the photoelectric sensors are arranged regularly.

In a possible implementation, a shape and a size of each first photoelectric sensor are respectively the same as a shape and a size of each second photoelectric sensor, so that a photosensitive area of the first photoelectric sensor and a photosensitive area of the second photoelectric sensor are the same, and an angle range in which the first photoelectric sensor receives light and an angle range in which the second photoelectric sensor receives light are the same, which is conducive to improving accuracy of regional detection of a target scene by the sensor array.

Preferable, the center of each second photoelectric sensor and the centers of to adjacent first photoelectric sensors form an equilateral triangle. Therefore, in the edge sensor group, the second photoelectric sensor is not separately arranged in a partial region corresponding to a first photoelectric sensor at the outermost side, so that the sensor array does not receive light in the region, which is conducive to reducing possibility that the signal-to-noise ratio and the sensitivity are decreased due to the low illuminance received by the second photoelectric sensor arranged separately in the region, affecting spectral detection performance.

Preferably, a quantity of second photoelectric sensors in a row is three or more. A photosensitive area of at least one of the two second photoelectric sensors located at the outermost sides is greater than a photosensitive area of the first photoelectric sensors. Therefore, at least one of the two second photoelectric sensors located at the outermost side may compensate for the low illuminance in the corner region by increasing the photosensitive area, so that the sensor array may retain the field of view and the quantity of regions that receive light to a greater extent without the need to separately arrange one second photoelectric sensor in the corner region, which is conducive to ensuring that the multispectral sensor has good detection sensitivity and high light energy utilization, and implements spectral detection with better comprehensive effects.

Preferably, a photosensitive area of at least one of the two second photoelectric sensors located at the outermost sides is greater than a photosensitive area of the second photoelectric sensor located in a middle region between the two second photoelectric sensors located at the outermost sides.

In a possible implementation, a shape and a size of each second photoelectric sensor located in the middle region are respectively the same as a shape and a size of each first photoelectric sensor.

Preferably, there is a third gap between the first photoelectric sensors and the second photoelectric sensors in the column direction, thereby helping to reduce possibility of light crosstalk between the first photoelectric sensor and the second photoelectric sensor and ensuring that the sensor array has good detection accuracy.

Preferably, the middle sensor group includes two or more rows of first photoelectric sensors. There is a fourth gap between adjacent first photoelectric sensors in the column direction, thereby helping to reduce possibility of light crosstalk between the first photoelectric sensor and the second photoelectric sensor and ensuring that the sensor array has good detection accuracy.

Preferably, the centers of the first photoelectric sensors in each row of first photoelectric sensors are located on a same straight line in the row direction, so that each first photoelectric sensor is arranged in a regular and orderly manner in the row direction.

Preferably, the centers of the second photoelectric sensors in each row of second photoelectric sensors located on a same straight line in the row direction, so that each second photoelectric sensor is arranged in a regular and orderly manner.

Preferably, in the middle sensor group, each first photoelectric sensor is in a shape of a rectangle.

Preferably, the multispectral sensor includes two or more rows of light channels. Each light channel has a channel center. There is a fifth gap between two adjacent light channels in each row of light channels. In the two adjacent rows of light channels, one row of light channels are arranged corresponding to the fifth gap in the other row of light channels, and lines connecting the channel centers of the two adjacent light channels in the one row and the channel center of a corresponding light channel in the other row form a triangle , wherein the lines connecting the channel centers of two adjacent light channels in one row and the channel center of a light channel in an adjacent row form an equilateral triangle. Therefore, in the column direction, a length of a perpendicular line between channel centers of the two adjacent light channels in one row and the channel center of one light channel in the other row is less than a length of lines connecting any two of the three channel centers. Therefore, a distance between the two adjacent rows of light channels is less in the column direction, so that in a case of ensuring that the multispectral sensor has high detection performance, an overall area occupied by the sensor array is reduced, thereby improving space utilization, and being conducive to miniaturization design of the multispectral sensor. In this way, the multispectral sensor may be integrated into an electronic device with an overall compact structure.

Since the distance between the three light channels is equal, which is conducive to reducing possibility that the two adjacent light channels are prone to crosstalk due to the less distance between the two adjacent light channels in the three light channels, thereby ensuring detection accuracy and detection performance of the multispectral sensor.

According to a second aspect of this application, an electronic device is provided, comprising at least one of the multispectral sensors.

An electronic device in embodiments of this application may be referred to as user equipment (user equipment, UE), a terminal (terminal), or the like. For example, the electronic device may be a mobile terminal or a fixed terminal, such as a portable android device (portable android device, PAD), a personal digital assistant (personal digital assistant, PDA), a handheld device with a wireless communication function, a computing device, a vehicle-mounted device, a wearable device, a virtual reality (virtual reality, VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in self-driving (self-driving), a wireless terminal in remote medical (remote medical), a wireless terminal in a smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in a smart city (smart city), a wireless terminal in a smart home (smart home), or the like. The forms of the terminal device are not specifically limited in embodiments of this application.

In embodiments of this application, <FIG> schematically shows a structure of an electronic device <NUM> according to an embodiment. Referring to <FIG>, an example in which the electronic device <NUM> is a handheld device with a wireless communication function is used for description. For example, the handheld device with the wireless communication function may be a mobile phone.

<FIG> schematically shows a partially exploded structure of an electronic device <NUM>. Referring to <FIG>, the electronic device <NUM> in embodiments of this application includes a display assembly <NUM>, a housing <NUM>, a main board <NUM>, and an electronic component <NUM>. The display assembly <NUM> has a display region used for displaying image information. The display assembly <NUM> is mounted on the housing <NUM>, and a display region of the display assembly <NUM> is exposed to facilitate presenting image information to a user. The main board <NUM> is connected to the housing <NUM> and is located on an inner side the display assembly <NUM>, so that the main board <NUM> is not easily visible to the user outside the electronic device <NUM>. The electronic component <NUM> is arranged on the main board <NUM>. The main board <NUM> may be a printed circuit board (printed circuit board, PCB). For example, the electronic component <NUM> is soldered to the main board <NUM> through a soldering process. The electronic component <NUM> includes but is not limited to a central processing unit (central processing unit, CPU), an intelligent algorithm chip, or a power management chip (Power Management IC, PMIC).

<FIG> schematically shows a structure of a back surface of an electronic device <NUM>. Referring to <FIG> and <FIG>, the electronic device <NUM> further includes a camera module <NUM> and a multispectral sensor <NUM>. Both the camera module <NUM> and the multispectral sensor <NUM> are electrically connected to a main board <NUM>. In the electronic device <NUM>, the multispectral sensor <NUM> and the camera module <NUM> are arranged on a housing <NUM> in a mutually misaligned manner. The camera module <NUM> is configured to take photos and images of a target scene. The camera module <NUM> may include a plurality of lenses, for example, include but not is limited to, a wide-angle lens or a periscope telephoto lens. When taking photos of a target by using the electronic device <NUM>, the multispectral sensor <NUM> may collect ambient light and process and analyze the ambient light to obtain a multispectral image or a reconstructed multispectral image. The obtained multispectral image by collecting or the reconstructed multispectral image may be configured to perform qualitative analysis on composition of a to-be-photographed object. For example, a more accurate environmental color temperature may be obtained through the multispectral sensor <NUM>, and a color of the to-be-photographed object may be restored based on the environmental color temperature, which may reduce possibility of color distortion that affects image quality under different environments and mixed lighting sources. Alternatively, material composition identification may be performed through the multispectral sensor <NUM>. Alternatively, the multispectral sensor <NUM> may detect a frequency of the light source and adjust exposure time based on frequency information of the light source, thereby more accurately eliminating a stroboscopic phenomenon in the image. Therefore, multispectral image data collected based on the multispectral sensor <NUM> may be applied in a plurality of different usage scenarios.

<FIG> schematically shows a partial cross-sectional structure of a multispectral sensor <NUM>. <FIG> schematically shows a state in which a multispectral sensor <NUM> receives light. Referring to <FIG> and <FIG>, the multispectral sensor <NUM> includes a light channel <NUM> having an optical axis 71a. It should be noted that an angle between light incident on the light channel <NUM> along the optical axis 71a and the optical axis 71a is <NUM>°. The light channel <NUM> includes a light entrance part <NUM>, an optical lens <NUM>, a filter part <NUM>, and a sensor array <NUM>. A shape and a size of the light entrance part <NUM> are configured to define a field of view when the light entrance part <NUM> is at a focal plane of the optical lens <NUM>. The sensor array <NUM> includes a plurality of photoelectric sensors <NUM>. Each photoelectric sensor <NUM> may receive light from a part of regions in a target scene. External light enters the multispectral sensor <NUM> through the light entrance part <NUM>, then change a transmission path through the optical lens <NUM>, and then illuminate the filter part <NUM>. Then, light at different angles to the optical axis 71a passes through the filter part <NUM> and then respectively reaches different photoelectric sensors <NUM> in the sensor array <NUM>. It should be noted that the external light may be light directly from a light source (for example, the sun, a lighting device, or the like) in an external environment and light (for example, light reflected from a tree, a wall, a road, a to-be-photographed object, or the like) reflected or scattered by an object in the external environment.

In the related technology, <FIG> schematically shows a state in which one light channel <NUM> in a multispectral sensor <NUM> receives light. <FIG> schematically shows a top-view structure of a sensor array <NUM>. Referring to <FIG> and <FIG>, a plurality of photoelectric sensors <NUM> in the sensor array <NUM> are arranged in a rectangular alignment of rows and columns. In other words, a quantity of photoelectric sensors <NUM> arranged in each row is the same, so that the sensor array <NUM> has four corner regions 76a. A size of each photoelectric sensor <NUM> is the same. Light at different angles passes through an optical lens <NUM> and a filter part <NUM> and then reaches the photoelectric sensors <NUM> at different positions. Light illuminance received by each photoelectric sensor <NUM> is different. It should be noted that illuminance refers to intensity of light, namely, a luminous flux of light received per unit area. Among the plurality of photoelectric sensors <NUM>, the photoelectric sensor <NUM> that is closer to an optical axis 71a receives higher illuminance, and the photoelectric sensor <NUM> that is farther away from the optical axis 71a receives lower illuminance. Therefore, the photoelectric sensor <NUM> that is separately arranged in a corner region 76a of the sensor array <NUM> receives low illuminance, which may easily lead to a decrease in signal-to-noise ratio and sensitivity, thereby affecting overall spectral detection performance of the multispectral sensor <NUM>. The greater the field of view of the multispectral sensor <NUM>, the lower the illuminance received by the photoelectric sensor <NUM> located in the corner region 76a. The field of view refers to a maximum range that may be observed, usually expressed in an angle. The greater the field of view of the multispectral sensor <NUM>, the greater the observation range. When the multispectral sensor <NUM> is in a large field of view scene, light incident on the multispectral sensor <NUM> has a specific tilt. In addition, the farther away from the optical axis 71a (the closer to an edge of the maximum field of view), the less light enters the light entrance part <NUM>. Therefore, the farther away from the optical axis 71a, the lower the illuminance of the light in the corner region 76a. Therefore, the greater the field of view, the lower the illuminance received by the photoelectric sensor <NUM> in the corner region 76a away from the optical axis 71a, and the worse the spectral detection performance.

In the multispectral sensor <NUM> provided in embodiments of this application, the sensor array <NUM> may improve a case that a signal-to-noise ratio and sensitivity of the photoelectric sensor are reduced due to low illuminance of the light received by the photoelectric sensor in the corner region 76a, which is conducive to ensuring that the multispectral sensor <NUM> has good detection sensitivity, and implements spectral detection with better comprehensive effects.

An implementation of the multispectral sensor <NUM> provided in embodiments of this application is described below.

<FIG> schematically shows a top-view structure of a sensor array <NUM> according to an embodiment. Referring to <FIG> and <FIG>, the multispectral sensor <NUM> in embodiments of this application includes at least one or two or more light channels <NUM>. Each light channel <NUM> includes a light entrance part <NUM>, an optical lens <NUM>, a filter part <NUM>, and a sensor array <NUM>. The light entrance part <NUM>, the optical lens <NUM>, the filter part <NUM>, and the sensor array <NUM> are arranged in an array in an axial direction Z of the light entrance part <NUM>. The light channel <NUM> has an optical axis 71a. The optical axis 71a of the light channel <NUM> may coincide with an axis of the light entrance part <NUM>. The light entrance part <NUM> is configured to allow external light to enter the light channel <NUM>. For example, each light channel <NUM> includes one light entrance part <NUM>. The optical lens <NUM> is configured to change a transmission path of light to be incident on the filter part <NUM>. The filter part <NUM> is configured to allow light in a specific wavelength range to pass through and reach the sensor array <NUM>. The sensor array <NUM> receives light in a specific wavelength range and then detects and collects corresponding spectral information.

In the multispectral sensor <NUM> in embodiments of this application, along the axial direction Z of the light entrance part <NUM>, orthographic projection of the sensor array <NUM> is located in orthographic projection of the optical lens <NUM>. A circular dotted line on a periphery of the sensor array <NUM> in <FIG> is used for illustrating an outer contour of orthographic projection of the optical lens <NUM>. For example, a bottom surface of the optical lens <NUM> may be a flat surface, and a top surface may be a curved surface. The outer contour of the orthographic projection of the optical lens <NUM> may be in a shape of a circle. The sensor array <NUM> includes at least three rows of photoelectric sensors. For example, at least three rows of photoelectric sensors are arranged in an array. The at least three rows of photoelectric sensors are divided into a middle sensor group 76b and an edge sensor group 76c. The middle sensor group 76b is located between the two edge sensor groups 76c in a column direction Y of the sensor array <NUM>. The middle sensor group 76b includes a first photoelectric sensor <NUM>. The edge sensor group 76c includes a second photoelectric sensor <NUM>.

In a row direction X of the sensor array <NUM>, a row of first photoelectric sensors <NUM> includes N first photoelectric sensors <NUM> and N-<NUM> first gaps <NUM>, where N is an integer greater than or equal to two. For the middle sensor group 76b, the first gap <NUM> is formed between two adjacent first photoelectric sensors <NUM> in each row, thereby helping to reduce possibility of light crosstalk between the two adjacent first photoelectric sensors <NUM>. It should be noted that the row direction X and the column direction Y are perpendicular to each other. A quantity of second photoelectric sensors <NUM> in a row adjacent to the row of first photoelectric sensors <NUM> is N-<NUM>, so that a quantity of second photoelectric sensors <NUM> in a row is equal to a quantity of first gaps <NUM> in a row. The second photoelectric sensor <NUM> is arranged corresponding to the first gap <NUM>.

It should be noted that the second photoelectric sensor <NUM> is arranged corresponding to the first gap <NUM>, which means that the second photoelectric sensor <NUM> and the first gap <NUM> are arranged in a distributed manner in the column direction Y. A second gap <NUM> is formed between two adjacent second photoelectric sensors <NUM> in the row direction X. The second photoelectric sensor <NUM> is arranged corresponding to the first gap <NUM>, which means that the first gap <NUM> and the second gap <NUM> are not on a same straight line in the column direction Y, so that the first gap <NUM> may be opposite to one side of the second photoelectric sensor <NUM>. For example, the first gap <NUM> may be opposite to a middle part of one side of the second photoelectric sensor <NUM>.

In the multispectral sensor <NUM> in embodiments of this application, external light enters the multispectral sensor <NUM> through the light entrance part <NUM>, and then illuminate the filter part <NUM> through the optical lens <NUM>. Then, light at different angles to the optical axis 71a passes through the filter part <NUM> and then respectively reaches the first photoelectric sensor <NUM> and the second photoelectric sensors <NUM> that are at different positions in the sensor array <NUM>. External light cannot enter the multispectral sensor <NUM> from a region other than the light entrance part <NUM>, thereby reducing possibility that stray light is received by the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> and affects detection accuracy. In the sensor array <NUM>, the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> that are at different positions are configured to receive light from different regions in a target scene. In other words, each first photoelectric sensor <NUM> and each second photoelectric sensor <NUM> are configured to receive light in a predetermined angle range, rather than receive light in all angles, so that detection on different regions of the target scene may be implemented, to implement accurate color perception and spectral analysis on the target scene, especially a scene in which color temperatures of different regions of the target scene are significantly different. It should be noted that the target scene may be, but is not limited to, a person, an object, scenery, or a light source that may emit light. For example, in the sensor array <NUM>, the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> that are farther away from the optical axis 71a are configured to receive light closer to an edge region in the target scene. The first photoelectric sensor <NUM> that is closer to the optical axis 71a is configured to receive light that is farther away from the edge region in the target scene.

For example, the light entrance part <NUM> may be a circular hole. For example, the light entrance part <NUM> may be formed by drilling holes on a substrate <NUM> made of an opaque material. Alternatively, an opaque region and a transparent region are arranged on the substrate <NUM>. The transparent region forms the light entrance part <NUM>. The transparent region is a region that allows light of most or all wavelengths to pass through.

A central axis of the optical lens <NUM> coincides with an axis of the light entrance part <NUM>. The optical lens <NUM> has a collimating function, so that light emitted from the optical lens <NUM> is closer to the optical axis 71a of the light channel <NUM> than light incident on the optical lens <NUM>. For example, the optical lens <NUM> may be a wafer level optic (WLO). The wafer level optic is a micro-nano optical element made by using a semiconductor process to produce a micro-nano structure on a substrate wafer. For example, referring to <FIG>, the optical lens <NUM> may include two layers of wafer level optics. Alternatively, the optical lens <NUM> may also include three or more layers of wafer level optics. A quantity of wafer level optics is not specifically limited herein.

The filter part <NUM> is configured to allow light in a specific wavelength range to pass through and reach the sensor array <NUM>. For example, referring to <FIG>, when the light channel <NUM> is used as a different sensing channel, the filter part <NUM> may allow the light in a corresponding wavelength range in the spectrum to pass through. In <FIG>, a first channel to an eighth channel, a full spectrum (Clear) channel, a near infrared (NIR) channel, and an anti-flicker (Flicker) channel are different light channels <NUM> respectively, and each light channel <NUM> corresponds to light in a specific wavelength range. A wavelength range detected by each light channel <NUM> is not limited to the wavelength range shown in <FIG>, and may also be flexibly adjusted based on an actual product requirement. <FIG> schematically shows a predetermined quantity of light channels <NUM>, but is not used for limiting the quantity of light channels <NUM> in the multispectral sensor <NUM>. Any quantity of light channels <NUM> may be set based on an actual product requirement.

It may be understood that the light channel <NUM> may be used as a sensing channel of visible light, for example, the first channel to the eighth channel are sensing channels of visible light. The light channel <NUM> may also be used as the sensing channel of invisible light. For example, the invisible light may include but is not limited to ultraviolet, near-infrared (NIR), short-wave infrared (SWIR), infrared (IR), or long-wave infrared (LWIR).

For example, the filter part <NUM> may be a filter.

In embodiments of this application, an example in which in the column direction Y, the edge sensor group 76c is located on one side of the middle sensor group 76b is used for description. However, a specific arrangement manner of the middle sensor group 76b and the edge sensor group 76c is not limited. For example, in some examples, the edge sensor group 76c is located on one side of the middle sensor group 76b in the row direction X.

In some possible implementations, the multispectral sensor <NUM> includes a light-proof housing <NUM>. The optical lens <NUM>, the filter, and the sensor array <NUM> are arranged in the housing <NUM>.

In the multispectral sensor <NUM> in embodiments of this application, the sensor array <NUM> includes a middle sensor group 76b and an edge sensor group 76c. The edge sensor group 76c is arranged on one side of the middle sensor group 76b. The first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> in the sensor array <NUM> are arranged in a mutually misaligned manner. The first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are located in different regions. A quantity of second photoelectric sensors <NUM> in a row is less than a quantity of first photoelectric sensors <NUM> in each row, so that one complete second photoelectric sensor <NUM> is not separately arranged in a corner region 76a of the sensor array <NUM>, which in turn may cause the sensor array <NUM> to better retain a field of view and a quantity of regions in which the sensor array receives light, and discard the independently arranged photoelectric sensor in the corner region 76a with poor detection performance. Therefore, the multispectral sensor <NUM> in embodiments of this application is conducive to improving a case that a signal-to-noise ratio and sensitivity of the photoelectric sensor are reduced due to low illuminance of the light received by the photoelectric sensor arranged separately in the corner region 76a, which is conducive to ensuring that the multispectral sensor <NUM> has good detection sensitivity and high light energy utilization, and implements spectral detection with better comprehensive effects.

In some possible implementations, the middle sensor group 76b includes one or two or more rows of first photoelectric sensors <NUM>. Each of the two edge sensor groups 76c includes one or two or more rows of second photoelectric sensors <NUM>. For example, a quantity of first photoelectric sensors <NUM> in each row of the middle sensor group 76b is equal. a quantity of second photoelectric sensors <NUM> in each row in the edge sensor group 76c is less than a quantity of first photoelectric sensors <NUM> in each row in the middle sensor group 76b.

In some possible implementations, referring to <FIG>, the sensor array <NUM> may include four rows of photoelectric sensors. The middle sensor group 76b includes two rows of first photoelectric sensors <NUM>. For example, a quantity of first photoelectric sensors <NUM> in each row may be, but is not limited to, four, to be specific, a value of N is four. Each of the two edge sensor groups 76c includes one row of second photoelectric sensors <NUM>. For example, the two edge sensor groups 76c include the same quantity of second photoelectric sensors <NUM>. The quantity of second photoelectric sensors <NUM> in a row is one less than the quantity of first photoelectric sensors <NUM> in a row. For example, the quantity of second photoelectric sensors <NUM> in a row may be, but is not limited to, three.

In some possible implementations, the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are configured to convert an optical signal into an electrical signal (for example, a digital electrical signal or an analog electrical signal). The first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> may be photodiodes (photodiode). The photodiode may be a semiconductor device including one PN junction and has unidirectional conduction features.

In some possible implementations, referring to <FIG>, each first photoelectric sensor <NUM> in the middle sensor group 76b has a first center 761a. The first center 761a is an illumination center in which light enters a photosensitive plane of the first photoelectric sensor <NUM> after passing through the optical lens <NUM> and the filter part <NUM>. The first center 761a shown in <FIG> does not represent an actual physical structure. The middle sensor group 76b includes two or more rows of first photoelectric sensors <NUM>. The first centers 761a of each column of first photoelectric sensors <NUM> are located on a same straight line, so that in a column direction Y, each first photoelectric sensor <NUM> is arranged regularly. In some examples, the first photoelectric sensor <NUM> may be in a shape of a rectangle, such as a rectangle or a square. The first photoelectric sensor <NUM> may also be in a shape of a circle, an ellipse, or a regular polygon with more than four sides. When the first photoelectric sensor <NUM> is in a regular shape, the first center 761a may be a geometric center of the first photoelectric sensor <NUM>.

In some possible implementations, a shape and a size of the first photoelectric sensor <NUM> are the same as a shape and a size of the second photoelectric sensor <NUM> respectively, so that a photosensitive area of the first photoelectric sensor <NUM> and a photosensitive area of the second photoelectric sensor <NUM> are the same, and an angle range in which the first photoelectric sensor <NUM> receives light and an angle range in which the second photoelectric sensor <NUM> receives light are the same, which is conducive to improving accuracy of regional detection of a target scene by the sensor array <NUM>. The photosensitive area is a surface facing the optical lens <NUM> that may be used for receiving light. In some examples, the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> may be in a shape of a rectangle, such as a rectangle or a square. The first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> may also be in a shape of a circle, an ellipse, or a regular polygon with a quantity of sides greater than <NUM>. Specific shapes and sizes of the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are not limited herein.

In some examples, referring to <FIG>, each second photoelectric sensor <NUM> in the edge sensor group 76c has a second center 762a. The second center 762a is an illumination center in which light enters a photosensitive plane of the second photoelectric sensor <NUM> after passing through the optical lens <NUM> and the filter part <NUM>. The second center 762a shown in <FIG> does not represent an actual physical structure. For example, When the second photoelectric sensor <NUM> is in a regular shape, the second center 762a may be a geometric center of the second photoelectric sensor <NUM>.

In some examples, in the sensor array <NUM>, lines connecting a second center 762a of one second photoelectric sensor <NUM> and first centers 761a of two adjacent first photoelectric sensors <NUM> form an equilateral triangle. In the edge sensor group 76c, a vertical distance between second centers 762a of two adjacent second photoelectric sensors <NUM> is P in the row direction X. In the middle sensor group 76b, a vertical distance between first centers 761a of two adjacent first photoelectric sensors <NUM> in each row is P in the row direction X. A vertical distance between the second center 762a of the second photoelectric sensor <NUM> and the first center 761a of the first photoelectric sensor <NUM> is P/<NUM> in the row direction X. Therefore, in the edge sensor group 76c, the second photoelectric sensor <NUM> is not separately arranged in a partial region corresponding to the first photoelectric sensor <NUM> at the outermost side, so that the sensor array <NUM> does not receive light in the region, which is conducive to reducing possibility that the signal-to-noise ratio and the sensitivity are decreased due to the low illuminance received by the second photoelectric sensor <NUM> arranged separately in the region, affecting spectral detection performance. In addition, a quantity of second photoelectric sensors <NUM> is one less than a quantity of first photoelectric sensors <NUM> in each adjacent row. In addition, in the column direction Y, a part of second photoelectric sensors <NUM> located at the outermost side are arranged corresponding to a part of first photoelectric sensors <NUM> located at the outermost side, so that the sensor array <NUM> may retain the field of view and the quantity of regions in which the sensor array <NUM> receives light to a greater extent, which is conducive to ensuring that the multispectral sensor <NUM> has good detection sensitivity and high light energy utilization, and implements spectral detection with better comprehensive effects.

In some examples, the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are in a regular shape. For example, a regular polygon, a circle, or an ellipse. In the edge sensor group 76c, the second photoelectric sensor <NUM> is not separately arranged in a partial region corresponding to the first photoelectric sensor <NUM> at the outermost side. In addition, a quantity of second photoelectric sensors <NUM> is one less than a quantity of first photoelectric sensors <NUM> in each adjacent row. In addition, in the column direction Y, a part of second photoelectric sensors <NUM> located at the outermost side are arranged corresponding to a partial region of the first photoelectric sensor <NUM> located at the outermost side.

In some possible implementations, <FIG> schematically shows a top-view structure of a sensor array <NUM> according to an embodiment. Referring to <FIG>, there is a second gap <NUM> between two adjacent second photoelectric sensors <NUM> in the row direction X, thereby helping to reduce possibility of light crosstalk between the two adjacent second photoelectric sensors <NUM> and ensuring that the sensor array <NUM> has good detection accuracy. The second photoelectric sensor <NUM> is arranged corresponding to the first gap <NUM>, so that the first gap <NUM> and the second gap <NUM> are not on a same straight line in the column direction Y. For example, the second center 762a of the second photoelectric sensor <NUM> is located on a center line 701a of the first gap <NUM>. The center line 701a of the first gap <NUM> extends in the column direction Y. The center line 701a of the first gap <NUM> is an axis of symmetry of the first gap <NUM>. For example, a shape of the first gap <NUM> is the same as a shape of the second gap <NUM>. For example, when both the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are in a shape of a square of the same size, both the first gap <NUM> and the second gap <NUM> are in a shape of a strip, and a width of the first gap <NUM> and a width of the second gap <NUM> in the row direction X are equal.

In some possible implementations, there is a third gap <NUM> between the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> in the column direction Y, thereby helping to reduce possibility of light crosstalk between the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> and ensuring that the sensor array <NUM> has good detection accuracy. For example, a shape of the first gap <NUM> is the same as a shape of the third gap <NUM>. For example, when both the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are in a shape of a square of the same size, both the first gap <NUM> and the third gap <NUM> are in a shape of a strip, and a width of the first gap <NUM> and a width of the third gap <NUM> are equal.

In some possible implementations, the middle sensor group 76b includes two or more rows of first photoelectric sensors <NUM>. There is a fourth gap <NUM> between two adjacent first photoelectric sensors <NUM> in the column direction Y, thereby helping to reduce possibility of light crosstalk between the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> and ensuring that the sensor array <NUM> has good detection accuracy. For example, a shape of the first gap <NUM> is the same as a shape of the fourth gap <NUM>. For example, when the first photoelectric sensor <NUM> is in a shape of a square, both the first gap <NUM> and the fourth gap <NUM> are in a shape of a strip, and a width of the first gap <NUM> is equal to a width of the fourth gap <NUM>.

In some possible implementations, in the middle sensor group 76b, a quantity of first photoelectric sensors <NUM> arranged in each row is equal. The first centers 761a in each row of first photoelectric sensors <NUM> are located on a same straight line in the row direction X, so that each first photoelectric sensor <NUM> is arranged in a regular and orderly manner in the row direction X.

In some examples, the first centers 761a of each column of first photoelectric sensors <NUM> are located on a same straight line, so that in a column direction Y, each first photoelectric sensor <NUM> is arranged in a regular and orderly manner, so that each first photoelectric sensor <NUM> in the middle sensor group 76b is arranged in a matrix manner. Further, first photoelectric sensors <NUM> are evenly spaced in the row direction X and the column direction Y. A vertical distance between first centers 761a of two adjacent first photoelectric sensors <NUM> in each row is P in the row direction X. In the column direction Y, a vertical distance between the first centers 761a of the two adjacent first photoelectric sensors <NUM> in each row is P. For example, a shape of the first photoelectric sensor <NUM> may be, but is not limited to, a square or a circle, so that a shape and a width of the first gap <NUM> are the same as a shape and a width of the fourth gap <NUM> respectively.

In some possible implementations, in the edge sensor group 76c, second centers 762a of the second photoelectric sensors <NUM> are located on a same straight line in the row direction X, so that each second photoelectric sensor <NUM> is arranged in a regular and orderly manner. For example, a vertical distance between second centers 762a of two adjacent second photoelectric sensors <NUM> is P in the row direction X. A shape of the second photoelectric sensor <NUM> may be, but is not limited to, a square or a circle.

In some possible implementations, <FIG> schematically shows a top-view structure of a sensor array <NUM> according to an embodiment. Referring to <FIG>, a quantity of second photoelectric sensors <NUM> in a row may be three, to be specific, a value of N is four. It may be understood that the quantity of second photoelectric sensors <NUM> in a row may also be greater than four, to be specific, the value of N is an integer greater than or equal to five. a photosensitive area of at least one of the two second photoelectric sensors <NUM> located at the outermost side in the second photoelectric sensors <NUM> in a row is greater than a photosensitive area of the first photoelectric sensor <NUM> in the row direction. At least one of the two second photoelectric sensors <NUM> located at the outermost side may receive light in a greater angle range by increasing a photosensitive area. Therefore, at least one of the two second photoelectric sensors <NUM> located at the outermost side may compensate for the low illuminance in the corner region 76a by increasing the photosensitive area, so that the sensor array <NUM> may retain the field of view and the quantity of regions in which the sensor array <NUM> receives light to a greater extent without the need to separately arrange one second photoelectric sensor <NUM> in the corner region 76a, which is conducive to ensuring that the multispectral sensor <NUM> has good detection sensitivity and high light energy utilization, and implements spectral detection with better comprehensive effects. In addition, because a photosensitive area of at least one of the two second photoelectric sensors <NUM> at the outermost side is increased, an angle range in which light is received may be further increased, thereby increasing a detection range.

For example, in the edge sensor group 76c, a photosensitive area of the two second photoelectric sensors <NUM> located at the outermost side is greater than a photosensitive area of the first photoelectric sensor <NUM> in the row direction X. For example, a photosensitive area of each of the two second photoelectric sensors <NUM> located at the outermost side may be equal.

In some examples, the first photoelectric sensor <NUM> may be in a shape of a square. The second photoelectric sensor <NUM> located at the outermost side includes a rectangular region <NUM> and a fan-shaped region <NUM>. The fan-shaped region <NUM> of the second photoelectric sensor <NUM> is located at an outer side of the rectangular region <NUM>. An arc-shaped edge of the fan-shaped region <NUM> of the second photoelectric sensor <NUM> may be used as a boundary at a corner of the sensor array <NUM>. For example, the rectangular region <NUM> of the second photoelectric sensor <NUM> is in a shape of a rectangle. A photosensitive area of the rectangular region <NUM> of the second photoelectric sensor <NUM> may be less than a photosensitive area of the first photoelectric sensor <NUM>.

In some examples, in the edge sensor group 76c, a region between the two second photoelectric sensors <NUM> located at the outermost side is a middle region. In the edge sensor group 76c, a photosensitive area of at least one of the two second photoelectric sensors <NUM> located at the outermost side is greater than a photosensitive area of the second photoelectric sensor <NUM> located in a middle region in the row direction X. It should be noted that the second photoelectric sensors <NUM> in the middle region refer to all second photoelectric sensors <NUM> except the two second photoelectric sensors <NUM> at the outermost side. For example, a photosensitive area of the second photoelectric sensor <NUM> in the middle region may be equal to a photosensitive area of the first photoelectric sensor <NUM>. For example, a shape and a size of the second photoelectric sensor <NUM> located in the middle region are respectively the same as a shape and a size of the first photoelectric sensor <NUM>. For example, both the first photoelectric sensor <NUM> and the second photoelectric sensor <NUM> are in a shape of a square or a circle.

In some possible implementations, <FIG> schematically shows a top-view structure of a multispectral sensor <NUM> including a plurality of light channels <NUM> according to an embodiment. Referring to <FIG>, the multispectral sensor <NUM> includes two or more rows of light channels <NUM>. In embodiments of this application, two or more rows of light channels <NUM> may simultaneously obtain a plurality of optical signals in different wavelength ranges. Then a multispectral image is synthesized, thereby implementing real-time collection of different light channels <NUM> in multispectral image information, which is conducive to improving accuracy of the multispectral image and operating efficiency of signal collection. For example, each light channel <NUM> may include one light entrance part <NUM>, one filter part <NUM>, and one sensor array <NUM>.

In some possible implementations, at least one of the two or more rows of light channels <NUM> is a color channel of visible light. Two or more rows of light channels <NUM> include the color channel of visible light, so that the visible light may be received and detected. In some examples, two or more rows of light channels <NUM> may all be color channels of visible light. Alternatively, two or more rows of light channels <NUM> include color channels of visible light and sensing channels of invisible light. By selecting a corresponding filter part <NUM>, the light channel <NUM> may receive a channel in a corresponding wavelength range.

For example, the multispectral sensor <NUM> includes the same light channel <NUM>, for example, includes two or more light channels <NUM> with the same filter part <NUM>, so that two or more light channels <NUM> with the same filter part <NUM> may receive light in the same wavelength range.

For example, one of two or more rows of light channels <NUM> may be used as an anti-flicker (Flicker) channel. The anti-flicker (Flicker) channel may sample ambient light, to detect a frequency of the light source and adjust exposure time based on frequency information of the light source, thereby more accurately eliminating a stroboscopic phenomenon in the image, to obtain an image of higher definition.

For example, the multispectral sensor <NUM> may include eight light channels <NUM> or ten light channels <NUM>.

In some possible implementations, the light channel <NUM> has a channel center 71b. The channel center 71b is located on an axis of the light entrance part <NUM>. The channel center 71b shown in <FIG> does not represent an actual physical structure. A quantity of light channels <NUM> in each row is two or more. In the two adjacent rows of light channels <NUM>, in the column direction Y, light channels <NUM> in one row are arranged with light channels <NUM> in the other row in a mutually misaligned manner. In the two adjacent rows of light channels <NUM>, there is a connecting line between one channel center 71b in one row and one adjacent channel center 71b in the other row, and an angle between the connecting line and the column direction Y is not zero. There is a fifth gap <NUM> between two adjacent light channels <NUM> in each row of light channels <NUM>. In the two adjacent rows of light channels <NUM>, one row of the light channels <NUM> are arranged corresponding to the fifth gap <NUM> in the other row of the light channels <NUM>.

It should be noted that one row of the light channels <NUM> are arranged corresponding to the fifth gap <NUM> in the other row of the light channels <NUM>, which may mean that the light channels <NUM> and the fifth gap <NUM> are distributed in the column direction Y. One row of light channels <NUM> is arranged corresponding to the fifth gap <NUM> in the other row of light channels <NUM>, which may also mean that two adjacent fifth gaps <NUM> are not on a same straight line in the column direction Y, so that the fifth gap <NUM> may be opposite to an edge of the light channel <NUM>.

Lines connecting channel centers 71b of two adjacent light channels <NUM> in one row and a channel center 71b of the corresponding light channel <NUM> in the other row form a triangle. Therefore, in the column direction Y, a length of a perpendicular line between channel centers 71b of the two adjacent light channels <NUM> in one row and the channel center 71b of one light channel <NUM> in the other row is less than a length of lines connecting any two of the three channel centers 71b. Therefore, a distance between two adjacent rows of light channels <NUM> is less in the column direction Y, so that in a case of ensuring that the multispectral sensor <NUM> has high detection performance, an overall area occupied by the sensor array <NUM> is reduced, thereby improving space utilization, and being conducive to miniaturization design of the multispectral sensor <NUM>. In this way, the multispectral sensor <NUM> may be integrated into an electronic device <NUM> with an overall compact structure.

In some examples, the lines connecting the channel centers 71b of the two adjacent light channels <NUM> in the one row and the channel center 71b of the corresponding light channel <NUM> in the other row form an equilateral triangle, so that a distance D between any two of the three channel centers 71b is equal. Therefore, the distance between the three light channels <NUM> is equal, which is conducive to reducing possibility that the two adjacent light channels <NUM> are prone to crosstalk due to the less distance between the two adjacent light channels <NUM> in the three light channels <NUM>, thereby ensuring detection accuracy and detection performance of the multispectral sensor <NUM>.

In some possible implementations, in each row of light channels <NUM>, the channel centers 71b of the light channels <NUM> are located on a same straight line, so that each light channel <NUM> is arranged in a regular and orderly manner, which is conducive to ensuring that an overall size of the multispectral sensor <NUM> is regular. For example, each light channel <NUM> is evenly spaced.

In some possible implementations, an orthographic projection area of each optical lens <NUM> is the same, and a shape and a size of each light entrance part <NUM> are the same, which is conducive to ensuring consistency of the field of view of each light channel <NUM> and ensures the detection accuracy of the multispectral sensor <NUM>. For example, an outer contour of orthographic projection of each optical lens <NUM> is in a shape of a circle. The light entrance part <NUM> may be a circular hole or a tapered hole.

In the description of embodiments of this application, it should be noted that, unless otherwise explicitly stipulated and restricted, terms "installation", "joint connection", and "connection" should be understood broadly, which, for example, may be a fixed connection, or may be an indirect connection by using a medium, or may be an internal communication between two components, or may be an interactive relationship between two components. A person of ordinary skill in the art may understand the specific meanings of the foregoing terms in embodiments of this application according to specific situations.

In embodiments of this application, it is implied that an apparatus or element in question needs to have a particular orientation, or needs to be constructed and operated in a particular orientation, and therefore cannot be construed as a limitation on embodiments of this application. In the description of embodiments of this application, unless otherwise exactly and specifically ruled, "a plurality of" means two or more.

The terms such as "first", "second", "third", and "fourth" (if any) in the specification and claims of embodiments of this application and in the accompanying drawings are used for distinguishing between similar objects and not necessarily used for describing any particular order or sequence. It may be understood that the data used in such a way is interchangeable in proper circumstances, so that embodiments of this application described herein can be implemented in other sequences than the sequence illustrated or described herein. Moreover, the terms "include", "contain" and any other variants mean to cover the non-exclusive inclusion. For example, a process, method, system, product, or device that includes a list of steps or units is not necessarily limited to those steps or units, but may include other steps or units not expressly listed or inherent to such a process, method, product, or device.

"Plurality of" in this specification means two or more. The term "and/or" in this specification describes only an association relationship for describing associated objects and represents that three relationships may exist. In addition, the character "/" in this specification generally indicates an "or" relationship between the associated objects; and in formulas, the character "/" indicates a "division" relationship between the associated objects.

It may be understood that various numbers in embodiments of this application are merely used for differentiation for ease of description, and are not used to limit the scope of embodiments of this application.

Claim 1:
A multispectral sensor (<NUM>), comprising at least:
two or more light channels (<NUM>), wherein
each light channel (<NUM>) comprises a light entrance part (<NUM>), an optical lens (<NUM>), a filter part (<NUM>), and a sensor array (<NUM>), the light entrance part (<NUM>) is configured to allow external light to enter the light channel (<NUM>), the optical lens (<NUM>) is configured to change a transmission path of the light to be incident on the filter part (<NUM>), and the filter part (<NUM>) is configured to allow light in a specific wavelength range to pass through and reach the sensor array (<NUM>);
orthographic projection of the sensor array (<NUM>) is located in orthographic projection of the optical lens (<NUM>) in an axial direction of the light entrance part (<NUM>), the sensor array (<NUM>) comprises at least three rows of photoelectric sensors, the at least three rows of photoelectric sensors are divided into a middle sensor group (76b) and two edge sensor groups (76c), the middle sensor group (76b) is located between the two edge sensor groups (76c) in a column direction (Y) of the sensor array (<NUM>), the middle sensor group (76b) comprises first photoelectric sensors (<NUM>), and each edge sensor group (76c) comprises second photoelectric sensors (<NUM>);
the middle sensor group (76b) comprises two or more rows of first photoelectric sensors (<NUM>); and
in a row direction (X) of the sensor array (<NUM>), each row of first photoelectric sensors (<NUM>) comprises N first photoelectric sensors (<NUM>) and N-<NUM> first gaps (<NUM>), and each first gap (<NUM>) is formed between two adjacent first photoelectric sensors (<NUM>), a quantity of second photoelectric sensors (<NUM>) in the rows of the edge sensor groups is N-<NUM>, and the second photoelectric sensor (<NUM>) is arranged corresponding to the first gap (<NUM>) in the column direction, such that
there is a second gap (<NUM>) between two adjacent second photoelectric sensors (<NUM>) in the row direction (X); wherein the first gap (<NUM>) and the second gap (<NUM>) are not on a same straight line in the column direction (Y).