Patent ID: 12243285

DETAILED DESCRIPTION

Some examples are now described in more detail with reference to the enclosed figures. However, other possible examples are not limited to the features of these implementations described in detail. Other examples may include modifications of the features as well as equivalents and alternatives to the features. Furthermore, the terminology used herein to describe certain examples should not be restrictive of further possible examples.

Throughout the description of the figures same or similar reference numerals refer to same or similar elements and/or features, which may be identical or implemented in a modified form while providing the same or a similar function. The thickness of lines, layers and/or areas in the figures may also be exaggerated for clarification.

When two elements A and B are combined using an “or”, this is to be understood as disclosing all possible combinations, e.g., only A, only B as well as A and B, unless expressly defined otherwise in the individual case. As an alternative wording for the same combinations, “at least one of A and B” or “A and/or B” may be used. This applies equivalently to combinations of more than two elements.

If a singular form, such as “a”, “an” and “the” is used and the use of only a single element is not defined as mandatory either explicitly or implicitly, further examples may also use several elements to implement the same function. If a function is described below as implemented using multiple elements, further examples may implement the same function using a single element or a single processing entity. It is further understood that the terms “include”, “including”, “comprise” and/or “comprising”, when used, describe the presence of the specified features, integers, steps, operations, processes, elements, components and/or a group thereof, but do not exclude the presence or addition of one or more other features, integers, steps, operations, processes, elements, components and/or a group thereof.

FIG.1illustrates an example of an apparatus100for detecting a specular surface in a scene110. The specular surface is to be understood as a light-reflecting surface, e.g., light impinging on the specular surface is at least partly reflected from the specular surface and a resulting reflection retains its parallelism according to the law of reflection. The specular surface may exhibit a specific roughness or unevenness to be considered specular. For instance, the specular surface may have an average roughness that is limited to a specific maximum value relative to a wavelength of impinging light to be specular for the light. The specular surface may be, e.g., a surface of a liquid or a mirroring, even surface of a solid. For instance, the specular surface may be a surface of water, glass, or metal.

The apparatus100comprises an illumination device120configured to emit polarized light130towards the scene110. The illumination device120may comprise one or more light source such as one or more Light-Emitting Diode (LED) and/or one or more laser diode (e.g., one or more Vertical-Cavity Surface-Emitting Laser, VCSEL) for radiating the polarized light130. The illumination device120may emit polarized light of any wavelength, e.g., infrared light, visible light, or mixtures thereof.

The polarized light130is light oscillating (mainly) in a specific geometrical orientation, e.g., light exhibiting a specific polarization. The polarization refers to a direction of an electric field or magnetic field of the polarized light130. The emitted polarized light130may exhibit a linear (planar), circular, or elliptic polarization. In case of the linear polarization, the electric/magnetic field of the polarized light130oscillates at least mainly in a specific direction perpendicular to a direction of propagation of the polarized light130. The linear polarization may be described as an angle between the specific direction and a reference direction.

In case of the circular or elliptical polarization, the electric/magnetic field of the polarized light130rotates at a (mainly) constant rate in a plane perpendicular to the direction of propagation. During propagation of the polarized light130, a tip of a field vector of the electric/magnetic field describes a circle or an ellipse on the plane, respectively. The circular or elliptical polarization may be described based on a sense of rotation of the electric/magnetic field. If the electric/magnetic field rotates in a right-hand sense (clockwise) with respect to the direction of propagation, the polarized light130exhibits a right-handed circular polarization, while if the electric/magnetic field rotates in a left-hand sense (anti-clockwise), the polarized light130exhibits a left circular polarization.

The polarization of the polarized light130may be predefined or configurable due to a type, an operation mode, or an arrangement of the illumination device120. For instance, a polarization filter of the illumination device120may be placed in front of a light source of the illumination device120. The light source may radiate unpolarized light at least partly towards the polarization filter. The polarization filter may attenuate light not exhibiting a predefined (linear/circular/elliptic) polarization depending on a type of the polarization filter. An arrangement of the polarization filter regarding a reference plane may influence the angle or rotation sense of the polarization of the polarized light130regarding the reference plane. Thus, the polarization filter may be configured with regard to the type and arrangement of the polarization filter such that the polarization filter allows the polarized light130to pass.

The polarization filter may then direct the polarized light130to the scene110. The type or arrangement of the polarization filter may be changed or adjusted during an operation of the illumination device120, e.g., resulting into different operation modes of the illumination device120. Then, the polarization of the polarized light130may be configurable by switching between the different operation modes.

In some examples, the illumination device120may additionally comprise optical elements such as a waveplate (retarder) or an optical lens. In some examples, the illumination device120may comprise a first light source configured to emit the polarized light130towards the scene110a second light source configured to emit unpolarized light towards the scene110. For instance, the first light source and the second light source may illuminate the scene110independently, one with polarized and the other one with unpolarized light.

It is to be noted, that the scene110shown inFIG.1is meant for illustration. In other examples, the scene110may be of a different shape or arranged differently regarding the apparatus100than shown inFIG.1. The scene110may comprise objects of which one may have a specular surface.

Referring back toFIG.1, the apparatus100further comprises an imaging system140configured to capture a first image of the scene110based on light emanating from the scene110. The imaging system140may be any optical instrument capable of capturing (digital) images of the scene110. The imaging system140may comprise various components such as e.g., optics (e.g., one or more lenses) and electronic circuitry. In particular, the electronic circuitry may comprise one or more image sensor comprising each at least one photo-sensitive element or pixel (e.g., comprising a Photonic Mixer Device, PMD, or a Charge-Coupled Device, CCD). For example, each image sensor may comprise a plurality of photo-sensitive elements or pixels. For instance, the imaging system140may comprise one or more camera such as a digital camera or a time-of-flight camera. The imaging system140may be mainly sensitive to light of a wavelength of the polarized light130.

The light emanating from the scene110comprises one or more reflection132,134of the emitted polarized light130. The reflections132,134may be a directed or diffuse reflection (e.g., remission) of the emitted polarized light130. The reflections132,134result from the emitted polarized light130being reflected or backscattered from objects in the scene110. Characteristics of the reflections132,134such as polarization or light intensity may depend on physical or chemical properties of the objects, e.g., roughness of a surface of the objects, transparency, translucence of the object, or absorption of light by the objects. The characteristics of the reflections132,134may be specific for a material of the objects.

In case a specular surface is present in the scene110on which the emitted polarized light130impinges, a resulting reflection (e.g., reflection132,134) may exhibit a polarization corresponding to (but not necessarily matching) a polarization of the emitted polarized light130. For instance, if the emitted polarized light exhibits a right-handed circular polarization (as provided by the illumination device120) and impinges on the specular surface, then, the resulting reflection exhibits a left-handed circular polarization, thus, exhibiting a mirrored sense of rotation relative to the emitted polarized light130. The reversal of the sense of rotation is due to a reverse direction of propagation in comparison to the emitted polarized light130. Similarly, if the emitted polarized light exhibits a left-handed circular polarization (as provided by the illumination device120) and impinges on the specular surface, then, the resulting reflection exhibits a right-handed circular polarization. In other examples, the emitted polarized light130may exhibit a predefined linear polarization. If the emitted polarized light130with the predefined linear polarization impinges on the specular surface, then, the resulting reflection exhibits the predefined linear polarization, e.g., linear polarizations may be maintained after reflection.

By contrast, when the emitted polarized light130impinges on a non-specular surface, portions of the emitted polarized light130may be scattered (diffusely reflected). A resulting reflection (e.g., reflection132,134) may have an undefined or mixed polarization.

By way of illustration, inFIG.1, the polarized light130and the reflections132,134are indicated by light rays along example optical paths between the apparatus100and the scene110. In other examples, the polarized light130may comprise more light rays than shown inFIG.1. The light rays may run along different optical paths between the apparatus100and the scene110than shown inFIG.1. In other examples, the light emanating from the scene110may comprise less or more reflections than the ones shown inFIG.1. In general, the light emanating from the scene110may comprise n≥1 reflections.

The imaging system140is further configured to capture a second image of the scene110based on filtered light136. The apparatus100further comprises a polarization filter150configured to generate the filtered light136by filtering the light emanating from the scene110. The polarization filter150may filter the one or more reflection132,134of the emitted polarized light130. A data acquisition time for capturing the first image and the second image of the scene110may be synchronized with an emission time of the polarized light130.

The polarization filter150is an optical filter or polarizer that lets light exhibiting a specific polarization (the filtered light136) pass through while attenuating light of other polarizations. For instance, the polarization filter150may filter light of undefined or mixed polarization into light exhibiting a well-defined (predefined) polarization. The polarization filter150may be, for instance, of a dichroic, reflective, birefringent, scattering, or diffractive type. In case of a dichroic type, the polarization filter150may be a macromolecular foil plastically stretched into one direction. The direction of stretching may decide which polarization light exhibits that passes the polarization filter. Alternatively, the polarization filter150may be a wire grid polarizer or a polarizing prism, for instance.

The polarization filter150may direct the filtered light136to the imaging system140for capturing the second image. For instance, the polarization filter150may be placed in front of the imaging system140—at least from time to time.

Referring back toFIG.1, the apparatus100further comprises processing circuitry160configured to determine presence of the specular surface in the scene110based on a comparison of the first image and the second image. Example approaches of how the processing circuitry160may determine the presence of the specular surface in the scene110based on the comparison is explained with reference toFIG.5aandFIG.5b.

The processing circuitry160may be a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which or all of which may be shared, a digital signal processor (DSP) hardware, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The processing circuitry160may optionally be coupled to, e.g., read only memory (ROM) for storing software, random access memory (RAM) and/or non-volatile memory. The processing circuitry160is communicatively coupled to the imaging system140for transferring the first image and the second image from the imaging system140to the processing circuitry160.

The first image and the second image may relate to a digital image, e.g., a bitmapped or vector image. The first image and the second image may comprise pixels representing a discrete quantity of a property (such as light intensity, color) of light being captured by the imaging system140. The first image and the second image may comprise reflection data of a respective view of the scene110. A view represented by the first image may at least partly correspond to a view represented by the second image. The first image and the second image may be captured at the same time or at different times but at quick succession.

In order to infer presence of the specular surface from the comparison of the first image and the second image, the imaging system140captures the first image and the second image with different sensitivities to specular reflections of the emitted polarized light130.

For instance, if specular reflections occur, they may be captured in the first image but be mainly omitted in the second image. The different sensitivities may be realized by, e.g., capturing the first image without the polarization filter150and the second image with the polarization filter150. The polarization filter150may be selected and adjusted in accordance with a polarization of the emitted polarized light130. Furthermore, the apparatus100may be configured to pursue a specific filtering strategy.

For instance, a first filtering strategy may specify that the polarization filter150is intended to block specular reflections of the emitted polarized light130. Thus, the imaging system140may be intended to “omit” the specular reflections for capturing the second image, e.g., the second image is intended to not represent the specular reflections. For the first filter strategy, the polarization filter150may be selected or adjusted such that the polarization filter150attenuates (blocks) light exhibiting a polarization equal to the polarization of specular reflections of the emitted polarized light130. The polarization filter150may let pass light exhibiting a polarization differing from the polarization of the specular reflections. For instance, the emitted polarized light130may exhibit one of a right-handed circular polarization and a left-handed circular polarization. Pursuing the first filtering strategy, the polarization filter150may be configured to filter the other one of the right-handed circular polarization and the left-handed circular polarization out of the light emanating from the scene110. In other examples, the emitted polarized light130may exhibit a predefined linear polarization. Then, the polarization filter150may be configured to filter the light emanating from the scene110by attenuating light exhibiting the predefined linear polarization. In other words, the polarization filter150may be a circular polarization filter, or a linear polarization filter which filters light with a complementary polarization relative to the emitted polarized light130such that direct reflections of the emitted polarized light130are blocked.

A second filtering strategy may specify that the polarization filter150is intended to block non-specular reflections of the emitted polarized light130. Thus, the second image may be intended to represent specular reflections of the emitted polarized light130but to neglect at least partly the non-specular reflections. For instance, the emitted polarized light130may exhibit a circular polarization. Pursuing the second filtering strategy, the polarization filter150may be configured to filter the circular polarization out of the light emanating from the scene110. In other examples, the emitted polarized light130may exhibit a predefined linear polarization. Then, the polarization filter150may be configured to filter the light emanating from the scene110by attenuating light not exhibiting the predefined linear polarization.

Optionally, the imaging system140may be further configured to capture the first image of the scene based on light filtered differently than the filtered light136, e.g., filtered based on a different filtering strategy. The imaging system140may comprise, e.g., a second polarization filter to generate the differently filtered light. For instance, the imaging system140may capture the first image based on the first filtering strategy and the second image based on the second filtering strategy.

In conclusion, a difference between the first image and the second image may indicate presence of specular reflection. For instance, the apparatus100may detect water or other objects with specular surfaces in a scene. For this purpose, the apparatus100may combine conventional imaging and polarization imaging.

In some examples, the apparatus100may be applied for determining presence of water on a roadway. For instance, the processing circuitry160may be further configured to determine reflection characteristics of the specular surface based on a comparison of the first image and the second image. If presence of a specular surface is determined, the processing circuitry160may classify a material forming the specular surface based on the reflection characteristics. The processing circuitry160may be configured to classify the material as, e.g., water, snow, oil, metal, or glass. The processing circuitry160may be further configured to determine whether the specular surface is located on a roadway. If it is determined that the specular surface is located on the roadway, the processing circuitry160may estimate a friction coefficient of a vehicle on the roadway based on the classified material.

Furthermore, the apparatus100may distinguish water levels based on a comparison of polarized and non-polarized images of a scene. The apparatus100may determine the presence of water on the roadway to predict a friction coefficient of vehicles on the roadway for driving assistance applications or traffic management, for instance. Similarly, the apparatus100may be used to distinguish snow from rain droplets when monitoring driving conditions of the roadway.

In other examples, the apparatus100may be applied for detecting sweat on a skin of a human. For instance, the processing circuitry160may be further configured to, if presence of the specular surface is determined, determine whether the specular surface is located on the skin of the human. If it is determined that the specular surface is located on the skin of the human, the processing circuitry160may classify the specular surface as sweat. Sweat detection may be an additional feature for smartphones, HVAC (heating, ventilation, and air conditioning) devices, or fitness devices.

FIG.2illustrates another example of an apparatus200for detecting a specular surface in a scene (not shown). The scene may be located right of the apparatus200(inFIG.2). The apparatus200comprises an illumination device220configured to emit polarized light towards the scene. The illumination device220is oriented to the right (inFIG.2) to emit the polarized light towards the scene.

The apparatus200further comprises an imaging system comprising a first camera240a. The first camera240ais placed above the illumination device220(inFIG.2). The first camera240ais configured to capture a first image of the scene. The first camera240amay be any type of camera, e.g., a conventional camera or a time-of-flight camera.

An aperture242ais placed in front of the first camera240a. The aperture242amay be an optical device with an opening to limit light emanating from the scene to a bundle of light rays that focus on an image plane of the first camera240a. The opening may determine a first field of view, e.g., a field of view of the first camera240a. In other words, the first camera240ais configured to capture the first image of the scene by capturing light emanating from the scene in the first field of view. The light emanating from the scene comprises one or more reflection of the emitted polarized light.

The imaging system further comprises a second camera240b. The second camera240bis placed below the illumination device220(inFIG.2). The second camera240bis configured to capture a second image of the scene. The second camera240bmay be any type of camera, e.g., a conventional camera or a time-of-flight camera.

An aperture242bis placed in front of the second camera240b. The aperture242bmay determine a second field of view, e.g., a field of view of the second camera240b. The second camera240bis configured to capture the second image of the scene by capturing light emanating from the scene in the second field of view. The second camera240bis configured to capture the second image based on filtered light.

The first camera240aand the second camera240bare oriented to the right (inFIG.2) such that the first camera240aand the second camera240bcapture the first image and the second image, respectively, based on light emanating from right of the apparatus200. In other words, the illumination device220, the first camera240aand the second camera240bare aligned to the scene right of the apparatus200. Thus, the first camera240aand the second camera240bmay mainly capture direct reflections of the emitted polarized light. The first field of view and the second field of view may at least partly overlap, e.g., the first camera240aand the second camera240bmay be at least partly oriented to a common section of the scene.

The apparatus200further comprises a polarization filter250which is placed in front of the second camera240b, more specifically, in front of the aperture242bof the second camera. The polarization filter250is configured to generate the filtered light by filtering the light emanating from the scene. The polarization filter250may block specular reflections occurring in the scene. A difference (comparison) between the first image and the second image may indicate presence of the specular reflections.

The apparatus200may represent a simple setup for detecting specular surfaces: two imagers, the first camera240aand the second camera240b, one without a polarization filter and one with a polarization filter (250), looking at nearly the same field of view. The illumination device220is configured to illuminate the scene with polarized light. A first image is captured without a polarization filter, a second image is captured with a polarization filter.

The setup of the apparatus200may enable a simultaneous capture of the first image and the second image. This may be beneficial for applications in dynamic environments where the apparatus200moves relative to the scene, such as automotive applications.

In other examples, an arrangement of the first camera240a, the second camera240b, and the illumination device may be different than the one shown inFIG.2. For instance, a position of the first camera240aand a position of the second camera240bmay be swapped.

FIG.3illustrates another example of an apparatus300for detecting a specular surface in a scene (not shown). The scene may be located right of the apparatus300(inFIG.3). An illumination device (not shown inFIG.3) of the apparatus300is configured to emit polarized light towards the scene.

The apparatus300comprises a first camera340arotated 90 degrees relative to a second camera340b. A polarization filter350is placed in front of the aperture of the second camera340b. The polarization filter350generates filtered light by filtering the second portion of light and directs the filtered light to the second camera340b.

The apparatus300further comprises a beam splitter370. The first camera340aand the second camera340bare oriented (with their apertures) towards the beam splitter370. The beam splitter370is configured to direct a first portion of the light emanating from the scene to the first camera340aand direct a second portion of the light emanating from the scene to the polarization filter350. In other words, the beam splitter370directs an image of the scene to both cameras, the first camera340aand the second camera340b. The beam splitter370may be an optical device for splitting a beam of the light emanating from the scene into two beams. The beam splitter370may, e.g., comprise a half-silvered mirror or two triangular glass prisms glued together at their base.

The first camera340ais configured to capture a first image of the scene based on the first portion of the light emanating from the scene. The light emanating from the scene comprises one or more reflection of the emitted polarized light. The second camera340bis configured to capture a second image of the scene based on the filtered light. The first camera340aand the second camera340bmay be any type of camera, e.g., a conventional camera or a time-of-flight camera.

The apparatus300further comprises a focusing lens380and an aperture382placed in front of the focusing lens. The focusing lens380is placed in front of the beam splitter370such that it focuses light emanating from the scene onto the beam splitter. The aperture382is oriented towards the scene. The aperture382may limit the light entering the focusing lens380and, therefore, determine a field of view of the first camera340aand the second camera340b.

In other examples, the apparatus300may comprise other optical elements than the focusing lens380and the aperture382shown inFIG.3. The first camera340aand the second camera340bmay be arranged otherwise than shown inFIG.3, for example, their positions may be swapped.

The apparatus300may further comprise processing circuitry configured to determine presence of the specular surface based on a comparison between the first image and the second image.

A setup of the apparatus300shown inFIG.3may be advantageous since a field of view of the first camera340amay correspond to a field of view of the second camera340b, e.g., the first image and the second image may show the same view of the scene. This may be helpful since only sections of the scene that are represented in both images may be taken into consideration for a comparison of the first image and the second image for detecting the specular surface in the scene. Furthermore, in the setup shown inFIG.3, the first camera340aand the second camera340bmay share common optical elements, such as the lens380. Therefore, the setup may be cost-efficient.

FIG.4aandFIG.4billustrate a side view and a front view of another example of an apparatus400for detecting a specular surface in a scene. The scene may be located right of the apparatus400inFIG.4a. The apparatus400comprises an illumination device (not shown) configured to emit polarized light towards the scene.

The apparatus400comprises a camera440oriented (with its aperture) to the scene. The camera440is configured to capture a first image and a second image of the scene. The apparatus400may switch between a first configuration for capturing the first image and a second configuration for capturing the second image.

For the first configuration which is shown inFIG.4a, a polarization filter450is placed in front of the camera440, e.g., between the aperture of the camera440and the scene. While the first configuration is set, the camera440captures the second image of the scene based on light emanating from the scene and being filtered by the polarization filter450. Thus, the polarization filter450is placed in front of the camera440while capturing the second image of the scene. The light emanating from the scene comprises one or more reflection of the emitted polarized light. In some examples, the polarization filter450may be configured to attenuate specular reflections of the emitted polarized light such that the camera440captures mainly non-specular reflections of the emitted polarized light and/or unpolarized light emanating from the scene in the first configuration.

For the second configuration, the polarization filter450is placed offset to the front of the camera440while capturing the first image of the scene. Consequently, the camera440captures the first image based on light emanating from the scene and not being filtered by the polarization filter450. Instead, a conventional aperture442is placed in front of the camera440.

To change between the first configuration and the second configuration, the apparatus400comprises a mechanical assembly configured to move the polarization filter450with respect to the camera440. The mechanical assembly comprises a first aperture (the conventional aperture442) and a second aperture444mechanically coupled to a rotatable shaft490. The polarization filter450is integrated into the second aperture444. The first aperture442and the second aperture444are attached to the rotatable shaft490via a disc446. The first aperture442and the second aperture444are integrated on opposite sides of the disc446. A motor492may rotate the shaft490relative to an axis a which points towards the scene. A rotation of the shaft490may cause the disc446to rotate relative to the axis a. Rotating the disc446may cause the polarization filter450to shift its position relative to the camera440.

A setup of the apparatus400shown inFIG.4aandFIG.4bmay be advantageous since only one camera is needed for capturing the first image as well as the second image. Hence, an alignment of several cameras in order to capture a common section of the scene in the first image and in the second image may be unnecessary.

When changing to the first configuration, the motor492may be controlled to rotate the disc446to a position where the polarization filter450is placed in front of the camera440. The camera440may be synchronized with a controller of the motor492such that the camera440captures the second image when the polarization filter450is placed in front of the camera440. Similarly, when changing to the second configuration, the motor492may be controlled to rotate the disc446to a position where the first aperture442is placed in front of the camera440.

In other examples, the mechanical assembly of the apparatus400may be arranged differently than shown inFIG.4aandFIG.4b. For instance, the mechanical assembly may move the first aperture442and the second aperture444linearly along an axis parallel to the scene. The disc446may be of a different shape than shown inFIG.4b, e.g., elongated, or rectangular.

FIG.5aandFIG.5billustrate an example first image500a(FIG.5a) and an example second image500b(FIG.5b). The first image500aand the second image500bare to be understood as a visualization of a first image and a second image captured by an imaging system of an apparatus for detecting a specular surface in a scene, e.g., apparatus100,200,300, or400, e.g., the first image500aand the second image500bshow a simplified data structure of image data generated by the apparatus. Pixels of the image data are shown as a two-dimensional structure inFIG.5aandFIG.5b. The pixels may be arranged in the two-dimensional structure according to coordinates associated with the pixels.

The first image500aand the second image500bare captured at the same time or nearly at the same time (e.g., within a few milliseconds of time difference) by the imaging system. The first image500aand the second image500brepresent at least partly a common section of the scene, e.g., for capturing the first image500athe imaging system may have a field of view at least partly overlapping a field of view of the imaging system for capturing the second image500b. In case a view recorded by the first image500ais shifted relative to a view recorded by the second image500b, the shift between the two views may be taken into consideration for comparing the first image500aand the second image500b.

In the example ofFIG.5andFIG.5b, the first image500aand the second image500bare captured based on a filtering strategy corresponding to the first filtering strategy described above, e.g., the first image500ais captured by the imaging system without filtering a polarization of light emanating from the scene, wherein the light emanating from the scene comprises one or more reflection of polarized light emitted by the apparatus. The second image500bis captured by the imaging system based on filtered light. The filtered light is generated by a polarization filter of the apparatus by attenuating specular reflections of the polarized light. In other words, the first image500ais captured without the polarization filter and the second image500bis captured with polarization filter. In other examples of the present disclosure, the first image500aand second image500bmay be captured based on a different filtering strategy.

The first image500acomprises a structure510aexhibiting a certain light intensity, represented by a dark area inFIG.5a. The structure510amay correspond to a reflection of the polarized light at a specular surface in the scene. The second image500bcomprises a structure510bof less light intensity than the structure510a, indicated by a dotted area inFIG.5b. Pixel coordinates of the structure510amay correspond to pixel coordinates of the structure510b, e.g., the structure510aand the structure510bmay represent the same section of the scene. The structure510bmay correspond to a reflection of unpolarized light at the specular surface in the scene or to a reflection of the polarized light and/or the unpolarized light at a non-specular surface beneath the specular surface (in case a material forming the specular surface is transparent). A decrease of light intensity of the structure510brelative to the structure510amay be due to the polarization filter that decreases an amount of light impinging on a sensitive area of the imaging system.

A processing circuitry of the apparatus may compare the first image500aand the second image500bfor determining presence of a specular surface in the scene. The processing circuitry may determine the presence of the specular surface in the scene by determining a difference between a light intensity distribution in the first image510aand a light intensity distribution in the second image510b. In the example ofFIG.5aandFIG.5b, the processing circuitry may compare a light intensity of the structure510aand a light intensity of the structure510b. If a difference between the light intensity of the structure510aand the light intensity of the structure510bexceeds a certain threshold, the processing circuitry may generate data indicating that a specular surface is detected.

The processing circuitry may, e.g., compare reflection characteristics derived from the first image500aand reflection characteristics derived from the second image500b. For instance, if water is present in the scene, a reflection of the polarized light on a surface of the water may cause different reflection characteristics recorded in the first image500aand the second image500b.

In some examples, the processing circuitry may generate a light intensity histogram based on the first image500aand the second image500b. The processing circuitry may sort light intensity values of the first image500aand the second image500bby size resulting in a first light intensity distribution of the first image500aand a second light intensity distribution of the second image500b.

FIG.6a,FIG.6bandFIG.6cillustrate example light intensity histograms600a,600band600cfor a dry scene (600a), a moist scene (600b) and a wet scene (600c). The light intensity histograms600a,600band600cshow a number of occurrences (pixels) on the vertical axis over a light intensity value (pixel value) on the horizontal axis, e.g., they illustrate how many pixels of an image of the (dry, moist, or wet) scene represent a certain light intensity value or range of light intensity values.

The light intensity histograms600a,600band600ccomprise a first light intensity distribution610-1and a second light intensity distribution610-2. The first light intensity distribution610-1refers to a first image of the (dry, moist, or wet) scene captured without a polarization filter, such as the first image500a, and the second light intensity distribution610-2refers to a second image of the scene captured with a polarization filter, such as the second image500b. The polarization filter may attenuate specular reflections of polarized light.

The dry scene may show objects with a mainly non-specular surface. The moist scene may show at least some objects with a specular surface (e.g., water). The wet scene may show objects with a larger specular surface compared to the moist scene.

In all three light intensity histograms600a,600band600c, the first light intensity distribution610-1results in a broader curve compared to the second light intensity distribution610-2, e.g., a standard deviation of the first light intensity distribution610-1is higher. Secondly, the curve of the first light intensity distribution610-1results in a more flattened curve compared to the second light intensity distribution610-2, e.g., a peak of the curve of the first light intensity distribution610-1is lower. Thirdly, the curve of the first light intensity distribution610-1is shifted to a higher light intensity range compared to the second light intensity distribution610-2, e.g., a mean value of the first light intensity distribution610-1is higher. This may be due to the light intensity values corresponding to a specular reflection of the polarized light being mainly dropped (filtered out) in the second image. In some examples, the deviations in the first light intensity distribution610-1compared to the second light intensity distribution610-2may indicate that a specular surface in the scene is transparent and, therefore, the second image may comprise light intensity values corresponding to a non-specular surface beneath the specular surface of the scene which may lead to more occurrences of the light intensity values corresponding to a non-specular surface in the second image.

A shift of the curve of the first light intensity distribution610-1along the horizontal axis relative to a curve of the second light intensity distribution610-2is bigger in the light intensity histogram600athan in the light intensity histograms600band600c. Besides, the curve of the first light intensity distribution610-1is more pointed in the light intensity histograms600band600cthan in the light intensity histogram600a. This may be due to a larger total area of specular surfaces in the moist scene (600b) and the wet scene (600c) compared to the dry scene (600c).

There may be mathematical relation between the total area of specular surface in the scene and a difference between a mean value, a peak and/or a standard deviation of the first light intensity distribution610-1and the second light intensity distribution610-2. Thus, a processing circuitry may use the mathematical relation to infer from a comparison of the first light intensity distribution610-1(first image) and the second light intensity distribution610-2(second image) if a specular surface is present in the scene (and, optionally, how big the total area of the specular surface is). For instance, if the difference falls below a certain threshold, the processing circuitry may determine that a specular surface is present in the scene. Additionally, the processing circuitry may infer from a comparison of the first image and the second image if the specular surface belongs to a transparent object.

Referring back toFIG.5aandFIG.5b, alternatively to the above-mentioned techniques, a processing circuitry may be configured to determine the presence of the specular surface in the scene by determining a difference between at least one of a sum, a standard deviation, a mean value of light intensities of the first image500aand the second image500b. For instance, the processing circuitry may calculate a sum of light intensities (pixel values) of the first image500aand a sum of light intensities (pixel values) of the second image500b. As the polarization filter applied for capturing the second image500bremoves specular reflections, a corresponding light intensity value (direct reflection value) may only partly be recorded in the second image500b. Thus, the processing circuitry may determine a difference in the sum of light intensities of the first image500aand the sum of light intensities of the second image500b. If the difference exceeds a certain threshold, the processing circuitry may generate data indicating a specular surface is detected.

In some examples, the processing circuitry may be configured to convolute the first image500aand the second image500b. For instance, the light intensities of the first image500aand the light intensities of the second image500bmay be convoluted with a filter-kernel. Convoluting may be performed by adding light intensities of each pixel to light intensities of neighboring pixels, weighted based on the filter-kernel. The filter-kernel is a matrix of real numbers used for weighting pixel data. The processing circuitry may be further configured to apply edge detection to the convoluted first image500aand the convoluted second image500b. Edge detection is a mathematical method for detecting edges or curves in a digital image by identifying pixels at which light intensities change sharply (or has discontinuities) relative to neighboring pixels. The processing circuitry may be further configured to determine the presence of the specular surface based on comparing at least one detected edge of the first image500aand at least one detected edge of the second image500b. For instance, the processing circuitry may detect sharp edges at the structure510ain the first image500aand weaker or no edges at the structure510bin the second image500b. The processing circuitry may determine whether a specular surface is present based on a difference in intensity, in shape, or in location of the detected edges between the first image500aand the second image500b.

In other examples, the first image500aand the second image500bmay be captured by at least one time-of-flight camera of the imaging system. In this case, the processing circuitry may be further configured to, if presence of the specular surface is determined, determine a distance between the specular surface and a non-specular surface beneath the specular surface based on the comparison of the first image500aand the second image500b. The time-of-flight camera may provide measurement data indicating a time difference between an emission of the polarized light and a capturing time when a reflection of the polarized light impinges on a sensitive area of the time-of-flight camera. A distance between the imaging system and objects in the scene which caused the reflection may be inferred from the measurement data. For instance, if a transparent material with a specular surface such as water is present in the scene, the first image500amay represent measurement data generated based on specular reflections at a specular surface of the water. The second image500bmay represent measurement data generated based on non-specular reflections of light passing through the water. The non-specular reflection may be caused by a reflection at a non-specular surface beneath the water, such as a ground where the water is located on. The processing circuit may determine a distance between the imaging system and the specular surface of the water and a distance between the imaging system and the non-specular surface based on the measurement data. Hence, the processing circuit may infer a water level or depth of water by subtracting the distances derived from the first image500aand from the second image500b.

In some examples, the processing circuitry may be configured to determine reflection characteristics of the specular surface based on the comparison of the first image500aand the second image500b. For instance, the processing circuitry may determine the reflection characteristics by deriving a transparency or a spectral reflectance of a material forming the specular surface based on the comparison. For deriving the transparency or the spectral reflectance, the processing circuitry may compare light intensities and wavelengths of the first image500a(without polarization filter) and light intensities and wavelengths, recorded by the second image500b(with polarization filter). If the processing circuitry determines presence of the specular surface, the processing circuitry may further be configured to classify the material forming the specular surface based on the reflection characteristics. Since reflection characteristics may be material-specific, the processing circuitry may compare the reflection characteristics with one or more predefined reflection characteristics being related to one or more candidate materials. The processing circuitry may classify the material as, e.g., water, snow, oil, metal, or glass. The processing circuitry may alternatively classify the material by applying an object recognition algorithm (computer vision) to the first image500aand the second image500b.

In some examples, the processing circuitry may be further configured to, if presence of the specular surface is determined, determine whether the specular surface is located on a roadway. For instance, the processing circuitry may determine, based on the first image500aand second image500b, if a reflection characteristic indicated by pixels representing a surrounding of the detected specular surface matches (known) reflection characteristics of the roadway. The processing circuitry may further be configured to, if it is determined that the specular surface is located on the roadway, estimate a friction coefficient of a vehicle on the roadway based on a material forming the specular surface. For instance, the processing circuitry may have classified the material as water. Since the friction coefficient is material-specific, the processing circuitry may derive the friction coefficient from the classification of the material, e.g., by extracting the friction coefficient of water from a look-up-table. In case the specular surface is formed by a transparent material such as water, the processing circuitry may additionally determine a depth of the transparent material (a water level) as described above. Then, the processing circuitry may determine the friction coefficient based on the classified material and on the depth of the classified material.

It is to be noted that the first image500aand the second image500bshown inFIG.5aandFIG.5bare meant as an example. In other examples, the first image500aand the second image500bmay show a different scene without specular surfaces or with more specular surfaces than shown inFIG.5aandFIG.5b. In other examples, the first image500aand the second image500bmay show objects in the scene, they may comprise any information about light emanating from the scene, e.g., measurement data of a time-of-flight camera, a light intensity, or a wavelength (color) of the light. A processing circuitry may use any information captured by the first image500aand the second image500bto infer if a specular surface is present in the scene.

FIG.7illustrates an example of a vehicle700comprising an apparatus710for detecting a specular surface in a scene. For instance, the scene may be a roadway on which the vehicle700may drive. The apparatus710may be, e.g., the apparatus100,200,300, or400. The vehicle may be any apparatus for transporting people or cargo. For instance, the vehicle may comprise wheels driven by an engine (and optionally a powertrain system). In particular, the vehicle may be an automobile, a train, a truck, a motorcycle, or a tractor.

The apparatus710comprises an illumination device720configured to emit polarized light towards the scene. In some examples, the illumination device720may be integrated into a headlight of the vehicle700. In this case, the illumination device720may comprise a first light source configured to emit the polarized light and a second light source configured to emit unpolarized light. The second light source may be a conventional headlight for illuminating a surrounding of the vehicle700.

The apparatus710further comprises an imaging system740. For instance, the imaging system740may comprise one or more camera (imager) which are implemented in a front of the vehicle700. The first light-source may emit light which is polarized and modulated. The camera may be sensitive to the polarized and modulated light. The camera may generate a first image without a polarization filter and based on reflections of the polarized and modulated light and a second image with a polarization filter.

A processing circuitry760of the apparatus710may be configured to determine presence of the specular surface based on a comparison of the first image and the second image. The processing circuitry may be further configured to, if presence of the specular surface is determined, to determine whether the specular surface is located on a roadway. And, if it is determined that the specular surface is located on the roadway, estimate a friction coefficient of the vehicle700, especially of wheels of the vehicle, on the roadway based on a classified material forming the specular surface.

The estimated friction coefficient may be input to an advanced driver assistance system (ADAS) of the vehicle700. The ADAS may estimate a brake path based on a velocity of the vehicle700and the estimated friction coefficient. If the estimated brake path exceeds a certain threshold, the ADAS may output a warning signal or automatically reduce the velocity.

FIG.8illustrates a flowchart of an example of a method800for operating an apparatus for detecting a specular surface in a scene. The apparatus comprises an illumination device, an imaging system, a polarization filter, and processing circuitry, such as the apparatus100,200,300, or400.

The method800comprises emitting810polarized light towards the scene, capturing820a first image of the scene based on light emanating from the scene. The light emanating from the scene comprises one or more reflection of the emitted polarized light. The method800further comprises generating830filtered light by filtering the light emanating from the scene through the polarization filter, capturing840a second image of the scene based on the filtered light and determining850presence of the specular surface in the scene based on a comparison of the first image and the second image.

More details and aspects of the method800are explained in connection with the proposed technique or one or more examples described above, e.g., with reference toFIG.1. The method800may comprise one or more additional optional features corresponding to one or more aspects of the proposed technique, or one or more examples described above.

The method800may allow a detection of specular surfaces in the scene which may be in particular useful for water detection in automotive applications or for fitness devices with sweat detection.

A basic idea of the implementation to combine conventional imaging and polarization imaging may be applicable in other application fields besides for detecting a specular surface in a scene. For instance, techniques described above, e.g., with reference toFIG.1, may be used for determining reflection characteristics of objects in the scene. This may be useful for material classification since reflection characteristics are material specific. Examples for material classification are described hereinafter with reference toFIG.9andFIG.10.

FIG.9illustrates an example of an apparatus900for classifying a material in a scene910. The apparatus900comprises an illumination device920configured to emit polarized light930towards the scene910. A portion of the emitted polarized light930may impinge on a surface of the material and be reflected off of the surface.

The apparatus900further comprises an imaging system940configured to capture a first image of the scene910based on light emanating from the scene910. The light emanating from the scene910comprises one or more reflection of the emitted polarized light930, e.g., reflection934and reflection932. The reflection may be caused by parts of the emitted polarized light being reflected off of the material.

The imaging system940is further configured to capture a second image of the scene based on filtered light936. The apparatus900further comprises a polarization filter950configured to generate the filtered light by filtering the light emanating from the scene910.

The illumination device920, the imaging system940and the polarization filter950may be setup and configured analogously to the illumination devices, imaging systems and polarization filters described above with respect to the apparatuses100,200,300, and400. Hence, it is referred to the above description for the further structural details of the illumination device920, the imaging system940and the polarization filter950.

The apparatus900further comprises processing circuitry960configured to determine reflection characteristics of the material based on a comparison of the first image and the second image and classify the material based on the reflection characteristics. The processing circuitry960may be configured to determine the reflection characteristics of the material by determining a difference between at least one of a sum, a standard deviation, a mean value of light intensities of the first image and the second image. An example approach of how the processing circuitry960may determine the reflection characteristics is explained with reference toFIG.5aandFIG.5b.

The processing circuitry960may be configured to classify the material by comparing the determined reflection characteristics of the material with one or more predefined reflection characteristic being related to one or more candidate material. For instance, the processing circuitry960may access a database of candidate materials which registers the candidate materials with respective reflection characteristics. The processing circuitry960may compare entries of the database with the determined reflection characteristics. If one of the entries lies within a predefined tolerance range around the determined reflection characteristics, the processing circuitry960may select a corresponding candidate material as match for the material.

The apparatus900may be used for material classification, e.g., in industrial or medical applications. The apparatus900may be advantageous since it classifies materials optically without mechanically or chemically affecting the materials.

In some examples, the processing circuitry960may be configured to determine whether the determined reflection characteristics correspond to predefined reflection characteristics of human skin. For instance, the processing circuitry960may access a data storage storing a value range of reflection characteristics which are typical for human skin. If it is determined that the determined reflection characteristics correspond to the predefined reflection characteristics of human skin, the processing circuitry960may be configured to classify the material as human skin. In other words, if the determined reflection characteristics lie within the value range, the processing circuitry960may declare the material as human skin.

On the one hand, if the material is classified as human skin, the apparatus900may be configured to perform a face recognition process. On the other hand, if the material is not classified as human skin, the apparatus900may be configured to output data indicating that the material in the scene is not part of a human.

In the latter case, the apparatus900may measure how deep light enters into the human skin in the illuminated scene before being reflected towards the imaging system940. Since human skin exhibits predefined reflection characteristics, they may be compared with reflection characteristics derived from a comparison of the (normal intensity) first image and the (filtered) second image. The first image and the second image may be placed in an amplitude/light intensity histogram to compare the resulting reflection characteristics with the predefined reflection characteristics of human skin.

The apparatus900, as described in the latter, may be used for anti-spoofing in face recognition processes. This may be useful for smartphones or other devices with a user login based on face recognition (face-ID). The apparatus900may prevent an unlocking of the concerned device if an unauthorized user tries to deceive the face recognition by wearing a mask of an authorized user.

FIG.10illustrates a flowchart of an example of a method1000for operating an apparatus for classifying a material in a scene, such as the apparatus900. The apparatus comprises an illumination device, an imaging system, a polarization filter, and processing circuitry.

The method1000comprises emitting1010polarized light towards the scene and capturing1020a first image of the scene based on light emanating from the scene. The light emanating from the scene comprises one or more reflection of the emitted polarized light. The method1000further comprises generating1030filtered light by filtering the light emanating from the scene through the polarization filter and capturing1040a second image of the scene based on the filtered light. The method1000further comprises determining1050reflection characteristics of the material based on a comparison of the first image and the second image and classifying1060the material based on the reflection characteristics.

More details and aspects of the method1000are explained in connection with the proposed technique or one or more examples described above, e.g., with reference toFIG.9. The method1000may comprise one or more additional optional features corresponding to one or more aspects of the proposed technique, or one or more examples described above.

The method1000may allow a classification of a material in the scene which may be in particular useful for anti-spoofing.

ASPECTS

The following aspects pertain to further implementations:

Implementation (1) is an apparatus for detecting a specular surface in a scene comprising an illumination device configured to emit polarized light towards the scene, an imaging system configured to capture a first image of the scene based on light emanating from the scene wherein the light emanating from the scene comprises one or more reflection of the emitted polarized light and wherein the imaging system is further configured to capture a second image of the scene based on filtered light. The apparatus comprises a polarization filter configured to generate the filtered light by filtering the light emanating from the scene and processing circuitry configured to determine presence of the specular surface in the scene based on a comparison of the first image and the second image.

Implementation (2) is the apparatus of implementation (1) wherein the emitted polarized light exhibits one of a right-handed circular polarization and a left-handed circular polarization, and wherein the polarization filter is configured to filter the other one of the right-handed circular polarization and the left-handed circular polarization out of the light emanating from the scene.

Implementation (3) is the apparatus of implementation (1) wherein the emitted polarized light exhibits a predefined linear polarization, and wherein the polarization filter is configured to filter the light emanating from the scene by attenuating light exhibiting the predefined linear polarization.

Implementation (4) is the apparatus of any one of implementations (1) to (3) wherein the imaging system comprises a first camera configured to capture the first image of the scene and a second camera configured to capture the second image of the scene wherein the polarization filter is placed in front of the second camera.

Implementation (5) is the apparatus of implementation (4) wherein the first camera is configured to capture the first image of the scene by capturing light emanating from the scene in a first field of view and wherein the second camera is configured to capture the second image of the scene by capturing light emanating from the scene in a second field of view and wherein the first field of view and the second field of view at least partly overlap.

Implementation (6) is the apparatus of implementation (4) or (5) wherein the imaging system further comprises a beam splitter configured to direct a first portion of the light emanating from the scene to the first camera and direct a second portion of the light emanating from the scene to the second camera.

Implementation (7) is the apparatus of any one of implementations (4) to (6) wherein at least one of the first camera and the second camera is a time-of-flight camera.

Implementation (8) is the apparatus of any one of implementations (1) to (3) wherein the imaging system comprises a camera configured to capture the first image and the second image of the scene and a mechanical assembly configured to move the polarization filter with respect to the camera wherein the polarization filter is placed in front of the camera while capturing the second image of the scene and wherein the polarization filter is placed offset to the front of the camera while capturing the first image of the scene.

Implementation (9) is the apparatus of implementation (8), wherein the mechanical assembly comprises a first aperture and a second aperture mechanically coupled to a rotatable shaft, and wherein the polarization filter is integrated into the second aperture.

Implementation (10) is the apparatus of implementation (8) or (9) wherein the camera is a time-of-flight camera.

Implementation (11) is the apparatus of implementation (7) or (10) wherein the processing circuitry is further configured to, if presence of the specular surface is determined, determine a distance between the specular surface and a non-specular surface beneath the specular surface based on the comparison of the first image and the second image.

Implementation (12) is the apparatus of any one of implementations (1) to (11) wherein the illumination device comprises a first light source configured to emit the polarized light towards the scene and a second light source configured to emit unpolarized light towards the scene.

Implementation (13) is the apparatus of any one of implementations (1) to (12) wherein the processing circuitry is configured to determine the presence of the specular surface in the scene by determining a difference between a light intensity distribution in the first image and a light intensity distribution in the second image.

Implementation (14) is the apparatus of any one of implementations (1) to (13) wherein the processing circuitry is configured to determine the presence of the specular surface in the scene by determining a difference between at least one of a sum, a standard deviation, a mean value of light intensities of the first image and the second image.

Implementation (15) is the apparatus of any one of implementations (1) to (14) wherein the processing circuitry is configured to convolute the first image and the second image, apply edge detection to the convoluted first image and the convoluted second image and determine the presence of the specular surface based on comparing at least one detected edge of the first image and at least one detected edge of the second image.

Implementation (16) is the apparatus of any one of implementations (1) to (15) wherein the processing circuitry is further configured to determine reflection characteristics of the specular surface based on a comparison of the first image and the second image and, if presence of the specular surface is determined, classify a material forming the specular surface based on the reflection characteristics.

Implementation (17) is the apparatus of implementation (16) wherein the processing circuitry is further configured to classify the material as at least one of water, snow, oil, metal, glass.

Implementation (18) is the apparatus of implementation (16) or (17) wherein the processing circuitry is further configured to, if presence of the specular surface is determined, determine whether the specular surface is located on a roadway and, if it is determined that the specular surface is located on the roadway, estimate a friction coefficient of a vehicle on the roadway based on the classified material.

Implementation (19) is the apparatus of any one of implementations (1) to (15) wherein the processing circuitry is further configured to, if presence of the specular surface is determined, determine whether the specular surface is located on skin of a human and, if it is determined that the specular surface is located on the skin of the human, classify the specular surface as sweat.

Implementation (20) is a vehicle comprising the apparatus for detecting a specular surface in a scene according to any one of implementations (1) to (17) wherein the processing circuitry is further configured to, if presence of the specular surface is determined, determine whether the specular surface is located on a roadway and, if it is determined that the specular surface is located on the roadway, estimate a friction coefficient of the vehicle on the roadway based on a classified material forming the specular surface.

Implementation (21) is the vehicle of implementation (20) wherein the illumination device is integrated into a headlight of the vehicle.

Implementation (22) is a method for operating an apparatus for detecting a specular surface in a scene wherein the apparatus for detecting the specular surface comprises an illumination device, an imaging system, a polarization filter, and processing circuitry. The method comprises emitting polarized light towards the scene, capturing a first image of the scene based on light emanating from the scene wherein the light emanating from the scene comprises one or more reflection of the emitted polarized light. The method further comprises generating filtered light by filtering the light emanating from the scene through the polarization filter, capturing a second image of the scene based on the filtered light and determining presence of the specular surface in the scene based on a comparison of the first image and the second image.

Implementation (23) is an apparatus for classifying a material in a scene comprising an illumination device configured to emit polarized light towards the scene, an imaging system configured to capture a first image of the scene based on light emanating from the scene wherein the light emanating from the scene comprises one or more reflection of the emitted polarized light and wherein the imaging system is further configured to capture a second image of the scene based on filtered light. The apparatus further comprises a polarization filter configured to generate the filtered light by filtering the light emanating from the scene; and processing circuitry configured to determine reflection characteristics of the material based on a comparison of the first image and the second image and classify the material based on the reflection characteristics.

Implementation (24) is the apparatus of implementation (23) wherein the emitted polarized light exhibits one of a right-handed circular polarization and a left-handed circular polarization and wherein the polarization filter is configured to filter the other one of the right-handed circular polarization and the left-handed circular polarization out of the light emanating from the scene.

Implementation (25) is the apparatus of implementation (23) wherein the emitted polarized light exhibits a predefined linear polarization and wherein the polarization filter is configured to filter the light emanating from the scene by attenuating light exhibiting the predefined linear polarization.

Implementation (26) is the apparatus of any one of implementations (23) to (25) wherein the imaging system comprises a first camera configured to capture the first image of the scene and a second camera configured to capture the second image of the scene wherein the polarization filter is placed in front of the second camera.

Implementation (27) is the apparatus of any one of implementations (23) to (26) wherein the first camera is configured to capture the first image of the scene by capturing light emanating from the scene in a first field of view and wherein the second camera is configured to capture the second image of the scene by capturing light emanating from the scene in a second field of view and wherein the first field of view and the second field of view at least partly overlap.

Implementation (28) is the apparatus of implementation (26) or (27) wherein the imaging system further comprises a beam splitter configured to direct a first portion of the light emanating from the scene to the first camera and direct a second portion of the light emanating from the scene to the second camera.

Implementation (29) is the apparatus of any one of implementations (23) to (25) wherein the imaging system comprises a camera configured to capture the first image and the second image of the scene and a mechanical assembly configured to move the polarization filter with respect to the camera wherein the polarization filter is placed in front of the camera while capturing the second image of the scene and wherein the polarization filter is placed offset to the front of the camera while capturing the first image of the scene.

Implementation (30) is the apparatus of implementation (29) wherein the mechanical assembly comprises a first aperture and a second aperture mechanically coupled to a rotatable shaft and wherein the polarization filter is integrated into the second aperture.

Implementation (31) is the apparatus of any one of implementations (23) to (30) wherein the illumination device comprises a first light source configured to emit the polarized light towards the scene and a second light source configured to emit unpolarized light towards the scene.

Implementation (32) is the apparatus of any one of implementations (23) to (31) wherein the processing circuitry is configured to determine the reflection characteristics of the material by determining a difference between a light intensity distribution in the first image and a light intensity distribution in the second image.

Implementation (33) is the apparatus of any one of implementations (23) to (32) wherein the processing circuitry is configured to determine the reflection characteristics of the material by determining a difference between at least one of a sum, a standard deviation, a mean value of light intensities of the first image and the second image.

Implementation (34) is the apparatus of any one of implementations (23) to (33) wherein the processing circuitry is configured to classify the material by comparing the determined reflection characteristics of the material with one or more predefined reflection characteristic, the one or more predefined reflection characteristic being related to one or more candidate material.

Implementation (35) is the apparatus of any one of implementations (23) to (34) wherein the processing circuitry is configured to determine whether the determined reflection characteristics correspond to predefined reflection characteristics of human skin and, if it is determined that the determined reflection characteristics correspond to the predefined reflection characteristics of human skin, classify the material as human skin.

Implementation (36) is the apparatus of implementation (35) wherein the apparatus is further configured to, if the material is classified as human skin, perform a face recognition process.

Implementation (37) is the apparatus of implementation (35) or (36) wherein, if the material is not classified as human skin, the apparatus is configured to output data indicating that the material in the scene is not part of a human.

Implementation (38) is a method for operating an apparatus for classifying a material in a scene, wherein the apparatus comprises an illumination device, an imaging system, a polarization filter, and processing circuitry. The method comprises emitting polarized light towards the scene and capturing a first image of the scene based on light emanating from the scene wherein the light emanating from the scene comprises one or more reflection of the emitted polarized light. The method further comprises generating filtered light by filtering the light emanating from the scene through the polarization filter, capturing a second image of the scene based on the filtered light, determining reflection characteristics of the material based on a comparison of the first image and the second image and classifying the material based on the reflection characteristics.

The aspects and features described in relation to a particular one of the previous aspects may also be combined with one or more of the further aspects to replace an identical or similar feature of that further aspect or to additionally introduce the features into the further aspect.

Aspects may further be or relate to a (computer) program including a program code to execute one or more of the above methods when the program is executed on a computer, processor, or other programmable hardware component. Thus, steps, operations, or processes of different ones of the methods described above may also be executed by programmed computers, processors, or other programmable hardware components. Aspects may also cover program storage devices, such as digital data storage media, which are machine-, processor- or computer-readable and encode and/or contain machine-executable, processor-executable or computer-executable programs and instructions. Program storage devices may include or be digital storage devices, magnetic storage media such as magnetic disks and magnetic tapes, hard disk drives, or optically readable digital data storage media, for example. Other aspects may also include computers, processors, control units, (field) programmable logic arrays ((F)PLAs), (field) programmable gate arrays ((F)PGAs), graphics processor units (GPU), application-specific integrated circuits (ASICs), integrated circuits (ICs) or system-on-a-chip (SoCs) systems programmed to execute the steps of the methods described above.

It is further understood that the disclosure of several steps, processes, operations, or functions disclosed in the description or claims shall not be construed to imply that these operations are necessarily dependent on the order described, unless explicitly stated in the individual case or necessary for technical reasons. Therefore, the previous description does not limit the execution of several steps or functions to a certain order. Furthermore, in further aspects, a single step, function, process, or operation may include and/or be broken up into several sub-steps, -functions, -processes or -operations.

If some aspects have been described in relation to a device or system, these aspects should also be understood as a description of the corresponding method. For example, a block, device or functional aspect of the device or system may correspond to a feature, such as a method step, of the corresponding method. Accordingly, aspects described in relation to a method shall also be understood as a description of a corresponding block, a corresponding element, a property or a functional feature of a corresponding device or a corresponding system.

The following claims are hereby incorporated in the detailed description, wherein each claim may stand on its own as a separate aspect. It should also be noted that although in the claims a dependent claim refers to a particular combination with one or more other claims, other aspects may also include a combination of the dependent claim with the subject matter of any other dependent or independent claim. Such combinations are hereby explicitly proposed, unless it is stated in the individual case that a particular combination is not intended. Furthermore, features of a claim should also be included for any other independent claim, even if that claim is not directly defined as dependent on that other independent claim.