Image processing device, image processing method, and image presentation system

The present disclosure relates to an image processing device, an image processing method, a program, and an image presentation system capable of presenting a more suitable image to the interior of a vehicle.An image processing unit generates a presentation image to be presented to the interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling. The present disclosure can be applied to, for example, a projector type presentation device.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a U.S. National Phase of International Patent Application No. PCT/JP2021/005165 filed on Feb. 12, 2021, which claims priority benefit of Japanese Patent Application No. JP 2020-034197 filed in the Japan Patent Office on Feb. 28, 2020. Each of the above-referenced applications is hereby incorporated herein by reference in its entirety.

TECHNICAL FIELD

The present disclosure relates to an image processing device, an image processing method, a program, and an image presentation system, and in particular, to an image processing device, an image processing method, a program, and an image presentation system capable of presenting more suitable images to the interior of a vehicle.

BACKGROUND ART

PTL 1 discloses a technology of generating a developed image in which a fisheye image is developed on a cylindrical surface by converting a fisheye image captured through a fisheye lens. According to this technology, a three-dimensional position of a subject can be estimated from a developed image with small distortion.

CITATION LIST

Patent Literature

JP 2012-226645 A

SUMMARY

Technical Problem

However, when an image that does not correspond to a situation outside a vehicle that is traveling is presented as an image presented to the interior of the vehicle, a user who views the image may feel uncomfortable.

The present disclosure was made in view of such a situation and enables more suitable images to be presented to the interior of a vehicle.

Solution to Problem

An image processing device of the present disclosure is an image processing device including an image processing unit configured to generate a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

An image processing method of the present disclosure is an image processing method including generating, by an image processing device, a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

A program of the present disclosure is a program for causing a computer to execute processing of generating a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

An image presentation system of the present disclosure is an image presentation system including an image processing device including an image processing unit configured to generate a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling, and a presentation device including a presentation unit configured to present the presentation image to an interior of the second vehicle.

In the present disclosure, a presentation image to be presented to the interior of the second vehicle that is traveling is generated on the basis of a vehicle external image obtained by capturing an environment outside the first vehicle that is traveling.

DESCRIPTION OF EMBODIMENTS

Hereinafter, modes for carrying out the present disclosure (hereinafter referred as embodiments) will be described. The description will be made in the following order.

1. Overview of technology according to present disclosure

2. First embodiment (correction of fisheye camera image)

3. Second embodiment (fisheye camera image correction and object recognition processing)

4. Third embodiment (correction of front camera image)

5. Fourth embodiment (image reproduction corresponding to traveling speed)

6. Fifth embodiment (image correction and image reproduction corresponding to traveling speed)

7. Modified examples

8. Configuration example of computer

1. Overview of Technology According to Present Disclosure

(Configuration of Image Processing Device)

FIG.1is a block diagram showing a configuration of an image processing device to which the technology according to the present disclosure (the present technology) is applied.

The image processing device1ofFIG.1is configured as a projector-type presentation device that realizes interactive image presentation. The image processing device1presents an image generated by predetermined image processing to a user by projecting the image through a projector in a vehicle such as an automobile, for example.

The image processing device1includes an input unit10, a graphics display processing unit20, an output unit30, an image processing unit40, and a storage unit50.

The input unit10includes a sensor group such as an image sensor, a depth sensor, a touch sensor, and a speed sensor, a general input device and a communication device and receives an image projected in the vehicle, a user operation, a vehicle speed, and the like as inputs. As an image sensor capable of acquiring an image, a visible light camera, an infrared camera, or the like is used. As a depth sensor capable of acquiring3D information, a stereo camera, a time of flight (ToF) sensor, or the like is used. Input information such as various types of sensor data input through the input unit10is supplied to the graphics display processing unit20.

The graphics display processing unit20executes processing of displaying graphics to the user on the basis of input information from the input unit10. The graphics display processing unit20is configured as a control layer of a general operating system (OS) that controls drawing of multiple pieces of content such as windows for displaying applications and distributes an event such as a touch operation to each piece of content. The input information supplied to the graphics display processing unit20is also supplied to the image processing unit40.

The output unit30is composed of a projector as one or a plurality of presentation units and presents an image to the user.

The image processing unit40executes predetermined image processing on the basis of the input information supplied via the graphics display processing unit20. An image obtained by image processing is presented by the output unit30via the graphics display processing unit20.

The storage unit50stores information and the like necessary for image processing executed by the image processing unit40.

Meanwhile, the configuration ofFIG.1may be configured as an image presentation system1including an image processing device having at least the image processing unit40and a presentation device having at least the output unit30.

(Application Example of Image Processing Device)

Here, an example of applying the image processing device1ofFIG.1to a configuration in which an image is projected to the interior of a vehicle will be described.

FIG.2andFIG.3are a top view and a side view of a vehicle80equipped with the image processing device1.

InFIG.2andFIG.3, projectors81,82, and83corresponding to the output unit30of the image processing device1ofFIG.1are installed in the interior of the vehicle80.

The projector81is installed near the center in the vertical and horizontal directions at the rear end in the interior of the vehicle. The projector82is installed in the upper part of the right side surface in the rear part in the interior of the vehicle. The projector83is installed in the upper part of the left side surface in the rear part in the interior of the vehicle.

FIG.4is a diagram illustrating positions of presentation regions (projection surfaces) on which an image is projected in the interior of the vehicle80.

When the ceiling92is used as a presentation region in the interior91of the vehicle80, a projected image93from the projector81is projected on the ceiling92. When the vehicle80is equipped with a sunroof, a slide panel that shields the sunroof is used as a presentation region.

When a left side glass94of a rear seat is used as a presentation region, a projected image95from the projector82is projected on the left side glass94. Further, when a right side glass96of the rear seat is used as a presentation region, a projected image97from the projector83is projected on the right side glass96.

In addition to the ceiling92, the left side glass94, and the right side glass96of the rear seat, an armrest98at the center of the rear seat, a headrest99of a driver's seat, a headrest100of a passenger seat, a side glass101on the side of the passenger seat, and a side glass102on the side of the driver's seat may be used as presentation regions.

In this case, a projected image from any of the projectors81to83is projected on the armrest98, the headrest99of the driver's seat, and the headrest100of the passenger seat. Further, a projected image from any of the projectors82and83is projected on the side glass101on the side of the passenger seat and the side glass102on the side of the driver's seat.

With such a configuration, all areas of the vehicle interior91can be interactively used as presentation regions, and a screen can be provided as needed while utilizing the texture of the interior finishing of the vehicle interior91. Further, it is possible to utilize a wide area such as a ceiling as a presentation region at a low cost as compared with a conventional liquid crystal monitor or the like by using a projector.

In recent years, due to increasing safety standards for vehicles and expectations of purchasers, car manufacturers and the like have needed to reach above-average goals such as “having lightweight and durable vehicles”. On the other hand, a projector that can present a large image while saving space is considered to be useful.

(Operation of Image Processing Unit) Here, the operation flow of the image processing unit40included in the image processing device1will be described with reference to the flowchart ofFIG.5. Processing ofFIG.5is executed by being triggered by an instruction of a user to present an image, or the like in the vehicle80that is traveling.

In step S1, the image processing unit40of the image processing device1acquires a vehicle external image input through the input unit10. The vehicle external image is an image obtained by capturing an environment outside a predetermined vehicle (first vehicle) that is traveling. The predetermined vehicle may be another vehicle different from the vehicle81or may be the same vehicle as the vehicle80(vehicle80itself). Further, the vehicle external image may be an image captured in the past from a predetermined vehicle that is traveling or may be an image captured in real time from a predetermined vehicle that is currently running.

In step S2, the image processing unit40generates an image (hereinafter referred to as a presentation image) to be presented to the interior91of the vehicle80(second vehicle) that is traveling, on the basis of the acquired vehicle external image. The presentation image is an image corresponding to a situation outside the vehicle80.

In step S3, the image processing unit40outputs the generated presentation image to the graphics display processing unit20. The presentation image output to the graphics display processing unit20is presented to the interior91of the vehicle80by the output unit30.

According to the above processing, since a presentation image corresponding to a situation outside the vehicle is generated as an image presented to the interior91of the vehicle80that is traveling, it is possible to present a more suitable image to the interior of the vehicle.

Hereinafter, each embodiment of the image processing unit40will be described.

2. First Embodiment

FIG.6is a block diagram showing a configuration example of an image processing unit40A according to a first embodiment of the present technology.

The image processing unit40A generates a presentation image presented to the ceiling92, which is a projection surface of the vehicle interior91, on the basis of a vehicle external image obtained by capturing an environment outside the vehicle80that is traveling.

The image processing unit40A includes a vehicle external image acquisition unit111and a clipping unit112.

The vehicle external image acquisition unit111acquires a vehicle external image from a camera having a fisheye lens (hereinafter referred to as a fisheye camera) configured as the input unit10and supplies the vehicle external image to the clipping unit112.

FIG.7is a diagram showing arrangement of the fisheye camera.

As shown inFIG.7, the fisheye camera130is provided on the roof (outside the ceiling) of the vehicle80and captures an image in the zenith direction from the vehicle80that is traveling. The image captured by the fisheye camera130(hereinafter referred to as a fisheye camera image) is a moving image reflecting the entire surroundings of the vehicle80in the zenith direction of the vehicle80. That is, the vehicle external image acquisition unit111acquires a fisheye camera image as a vehicle external image.

Here, the fisheye camera130is used instead of a central projection type camera having a normal lens in order to increase the angle of view.

The clipping unit112corrects the vehicle external image (fisheye camera image) from the vehicle external image acquisition unit111for fitting to the ceiling92, which is a projection surface of the vehicle interior91, and outputs the corrected vehicle external image as a presentation image. By presenting the presentation image reflecting the vehicle external in the zenith direction to the ceiling92, the user is enabled to feel as if he/she is in an open car.

Next, the operation flow of the image processing unit40A will be described with reference to the flowchart ofFIG.8.

In step S11, the vehicle external image acquisition unit111acquires a fisheye camera image from the fisheye camera.

In step S12, the clipping unit112clips the fisheye camera image.

For example, it is assumed that a fisheye camera image140reflecting a building around the vehicle80that is traveling as shown inFIG.9has been acquired from a fisheye camera130. When the fisheye camera image140has been projected on the ceiling92of the vehicle interior91as it is, distortion of the circumference becomes conspicuous.

Therefore, the clipping unit112generates an enlarged image150by enlarging the fisheye camera image140and clips an area CL101corresponding to a projection surface (ceiling92) of the vehicle interior91on the basis of the center of the fisheye camera image140.

Accordingly, a presentation image with less distortion is output. However, since the presentation image obtained by clipping the area CL101is affected by characteristics of the fisheye lens, for example, the top portion of the building that is originally a straight line is distorted.

Therefore, as shown inFIG.10, the clipping unit112enlarges the fisheye camera image140, generates a distortion-corrected image160by distortion-correcting the fisheye camera image140, and clips an area CL102corresponding to the projection surface (ceiling92) of the vehicle interior91. Here, distortion correction is based on the premise that the curvature of the fisheye lens is known and uniform and is performed regardless of an individual difference of the fisheye lens.

With the above-described configuration and processing, it is possible to output a presentation image with less distortion.

3. Second Embodiment

FIG.11is a block diagram showing a configuration example of an image processing unit40B according to a second embodiment of the present technology.

The image processing unit40B generates a presentation image presented to the ceiling92, which is a projection surface of the vehicle interior91, on the basis of a vehicle external image obtained by capturing an environment outside the vehicle80that is traveling.

The image processing unit40B includes a vehicle external image acquisition unit211, a clipping unit212, an object recognition unit213, and a correction processing unit214.

The vehicle external image acquisition unit211and the clipping unit212have the same functions as the vehicle external image acquisition unit111and the clipping unit112ofFIG.6. Therefore, a fisheye camera image acquired by the vehicle external image acquisition unit211is enlarged and clipped (distortion-corrected) by the clipping unit112and supplied to the object recognition unit213.

The object recognition unit213performs object recognition processing on at least a part of the clipped fisheye camera image and supplies the processing result to the correction processing unit214along with the clipped fisheye camera image.

For example, with respect to a captured image220as shown in the upper part ofFIG.12, the object recognition unit213determines attributes of subjects (objects) on a pixel-by-pixel basis according to semantic segmentation and divides the captured image220according to the attributes. Accordingly, a processed image230as shown in the lower part ofFIG.12is obtained. In the processed image230, cars, a road, a sidewalk, a house, trees, the sky, and the like are distinguished as attributes of subjects.

The object recognition unit213can also perform object recognition processing by other methods as well as semantic segmentation.

The correction processing unit214corrects/repairs the clipped fisheye camera image and outputs it as a presentation image on the basis of the object recognition processing result from the object recognition unit213and object information accumulated in the object information definition unit215. The object information definition unit215is realized in the storage unit50, for example, in the form of a relational database or a look-up table.

Next, the operation flow of the image processing unit40B will be described with reference to the flowchart ofFIG.13.

Since processing of steps S21and S22in the flowchart ofFIG.13is the same as processing of steps S11and S12in the flowchart ofFIG.8, description thereof will be omitted.

That is, when a fisheye camera image is clipped in step S22, the object recognition unit213performs object recognition processing on at least a part of the clipped fisheye camera image in step S23.

In step S24, the correction processing unit214corrects the clipped fisheye camera image on the basis of object information accumulated in the object information definition unit215.

For example, as shown inFIG.14, it is assumed that a presentation image240in which the area CL102has been clipped is acquired from the distortion-corrected image160described with reference toFIG.10.

The object recognition unit213extracts a part surrounded by a rectangular frame240A indicated by a broken line from the presentation image240to acquire an extracted image250. Then, the object recognition unit213divides the extracted image250according to attributes of objects by performing object recognition processing on the extracted image250. The obtained processed image260is divided into areas of a building, a wood, a sky and a lamp.

Then, the correction processing unit214corrects the presentation image240on the basis of the object recognition processing result from the object recognition unit213and object information accumulated in the object information definition unit215to acquire a corrected image270shown inFIG.15.

FIG.16is a diagram showing an example of object information.

Object information OJ201shown inFIG.16is information representing whether or not each object has a side or a surface parallel to a road (ground plane) on which a vehicle travels. The example ofFIG.16shows that a building has sides and faces parallel to the road, whereas wood, sky, and lamp do not have sides and faces parallel to the road.

Here, the correction processing unit214corrects the presentation image240such that the top side of the building recognized in the presentation image240becomes parallel to (a straight line with respect to) the road using the information representing that “the building has sides and surfaces parallel to the road”.

In the corrected image270obtained in this way, a part thereof is missed as indicated by a black area in the figure. Therefore, for example, the correction processing unit214acquires a repaired image280by performing image repairing according to inpainting on the corrected image270and outputs the repaired image280as a presentation image.

With the above-described configuration and processing, it is possible to output a more distortion-free presentation image.

FIG.17is a block diagram showing a configuration example of an image processing unit40C according to a third embodiment of the present technology.

The image processing unit40C generates a presentation image presented to the ceiling92, which is a projection surface of the vehicle interior91, on the basis of a vehicle external image obtained by capturing an environment outside the vehicle80that is traveling.

The image processing unit40C includes a vehicle external image acquisition unit311, a vanishing point detection unit312, a panel superimposition unit313, a clipping unit314, a synthesis unit315, and a blur processing unit316.

The vehicle external image acquisition unit311acquires a vehicle external image from a front camera configured as the input unit10and supplies it to the vanishing point detection unit312.

FIG.18is a diagram showing arrangement of the front camera.

As shown inFIG.18, the front camera320is provided at the upper end of the windshield or the front end of the ceiling inside the vehicle80and captures an image in the traveling direction of the vehicle80that is traveling. The image captured by the front camera320(hereinafter referred to as a front camera image) is a moving image reflecting a forward view of the vehicle80in the traveling direction. That is, the vehicle external image acquisition unit311acquires the front camera image as a vehicle external image.

The vanishing point detection unit312detects a vanishing point from the front camera image from the vehicle external image acquisition unit311. For example, the vanishing point detection unit312acquires edge information from the front camera image. The vanishing point detection unit312outputs straight lines by performing a Hough transform on the acquired edge information and obtains intersections of the output straight lines. The vanishing point detection unit312obtains a range in which a large number of obtained intersections are gathered, averages the coordinates of the intersections in the range, and sets the averaged coordinates as a vanishing point.

The panel superimposition unit313superimposes a one-point perspective panel on a position based on the vanishing point detected by the vanishing point detection unit312in the front camera image.

Here, the one-point perspective panel will be described with reference toFIG.19.

InFIG.19, a vanishing point VP is detected from a front camera image FV, and a one-point perspective panel330is superimposed such that it matches a perspective line toward the vanishing point VP. The one-point perspective panel330is an image for identifying an area corresponding to the windshield, the left and right side glasses of the front seat, and the ceiling of the vehicle80in the front camera image FV when the front camera image FV is regarded as a perspective view drawn by the one-point perspective method.

Specifically, the one-point perspective panel330includes a front panel330F corresponding to the windshield of the vehicle80, a left side panel330L corresponding to the left side glass of the front seat, a right side panel330R corresponding to the right side glass of the front seat, and a ceiling panel330T corresponding to the ceiling.

Returning to description ofFIG.17, the clipping unit314clips the area corresponding to the presentation region (ceiling92) of the vehicle80in the front camera image, for example, at predetermined time intervals such as seconds or frames. Region images clipped at predetermined time intervals are sequentially supplied to the synthesis unit315.

The synthesis unit315sequentially synthesizes (combines) the region images from the clipping unit314to generate a synthesize image and supplies the synthesis image to the blur processing unit316.

The blur processing unit316performs blur processing on the synthesis image from the synthesis unit315and outputs it as a presentation image. Even if there is no camera that captures an image in the zenith direction outside the vehicle, a presentation image reflecting the area corresponding to the ceiling92in the front camera image is presented to the ceiling92, and thus the user is enabled to feel as if he/she is in an open car.

Next, the operation flow of the image processing unit40C will be described with reference to the flowchart ofFIG.20.

In step S31, the vehicle external image acquisition unit311acquires a front camera image from the front camera.

In step S32, the vanishing point detection unit312detects a vanishing point from the front camera image.

In step S33, the panel superimposition unit313superimposes a one-point perspective panel on a position based on the vanishing point in the front camera image.

For example, it is assumed that a front camera image340reflecting the scenery in the traveling direction of the vehicle80as shown inFIG.21has been acquired from the front camera320. The front camera image340reflects architecture such as buildings on both sides of a road, vehicles traveling in front of the vehicle80, vehicles stopped, and road signs installed beside the road.

When the front camera image340is acquired, a vanishing point VP is detected from the front camera image340as shown inFIG.22, and a one-point perspective panel330is superimposed on a position based on the vanishing point VP in the front camera image340, as shown inFIG.23.

When the one-point perspective panel330is superimposed on the front camera image340, the clipping unit314clips an area CL301that is a part of a ceiling panel330T corresponding to the ceiling92of the vehicle80in the front camera image340at predetermined time intervals, as shown inFIG.24, to acquire a region image350in step S34. In the example ofFIG.24, the area CL301corresponds to the front end of the ceiling in the ceiling panel330T.

In step S35, the synthesis unit315sequentially synthesizes region images350clipped at predetermined time intervals. Specifically, as shown inFIG.25, five region images350(t-4) to350(t) acquired at time t-4to time t are synthesized such that they are arranged in order from the top.

Thereafter, the blur processing unit316performs blur processing using, for example, Gaussian filtering, on the synthesis image in which the region images350(t-4) to350(t) have been synthesized to acquire a processed image360and outputs it as a presentation image in step S36.

FIG.26is a diagram showing an example of projection of a presentation image in the vehicle80.

FIG.26shows a windshield371, the left and right side glasses372L and372R of the front seat, and the ceiling373viewed from the rear seat of the vehicle80.

The scenery in front of the vehicle80at time t is as viewed from the windshield371, and a presentation image (processed image360) output at time t is projected on the ceiling373that is a projection surface.

When the vehicle80is traveling through automatic driving, the windshield371can be used as a projection surface in addition to the ceiling373. In this case, an image in which an area corresponding to the front panel330F of the one-point perspective panel330has been clipped at time t in the front camera image340is projected on the windshield371as a presentation image.

Further, when the left and right side glasses372L and372R are used as projection surfaces, an image in which areas corresponding to the left side panel330L and the right side panel330R of the one-point perspective panel330have been clipped at time t in the front camera image340is projected on the left and right side glasses372L and372R as a presentation image.

According to the above-described configuration and processing, an image according to the concept of one-point perspective projection method is output from the front camera image as a presentation image, and thus an acceleration perceived by a person can match a mindset felt from the presentation image, and discomfort and car sickness can be prevented.

In the above-described configuration and processing, since the vehicle80(front camera320) is moving forward, the scenery in front of the vehicle80reflected in the region image350becomes large at predetermined time intervals. Therefore, in the region images350(t-4) to350(t) shown inFIG.25, the space between buildings built on both sides of the road in front of the vehicle80is spread over time and thus the outlines of the buildings that are originally straight lines perpendicular to the road are tilted.

Therefore, a configuration in which the outline of a building recognized in a synthesis image in which region images has been synthesized is corrected such that it is perpendicular using information representing that “the building has an outline perpendicular to the road” will be described.

FIG.27is a block diagram showing another configuration example of the image processing unit40C of the present embodiment.

The image processing unit40C′ ofFIG.27includes an object recognition unit381and a correction processing unit382in addition to the same components as those of the image processing unit40C ofFIG.17.

The object recognition unit381performs object recognition processing on the front camera image340from the vehicle external image acquisition unit311in the same manner as the object recognition unit213inFIG.11and supplies the processing result to the correction processing unit382.

The correction processing unit382corrects and repairs a synthesis image generated by the synthesis unit315sequentially synthesizing region images on the basis of the object recognition processing result from the object recognition unit381and object information accumulated in the object information definition unit383and supplies the corrected and repaired synthesis image to the blur processing unit316. The object information definition unit383is configured in the same manner as the object information definition unit215ofFIG.11.

That is, the correction processing unit382corrects the synthesis image such that the outline of the building recognized in the front camera image340is perpendicular using the information representing that “the building has an outline perpendicular to the road”.

The blur processing unit316performs blur processing on the corrected/repaired synthesis image from the correction processing unit382and outputs it as a presentation image. When correction/repairing is performed by the correction processing unit382with high accuracy, the blur processing unit316may be omitted.

With the above-described configuration, it is possible to output a more distortion-free and natural presentation image.

FIG.28is a block diagram showing a configuration example of an image processing unit40D according to a fourth embodiment of the present technology.

The image processing unit40D generates a presentation image corresponding to a traveling speed of the vehicle80on the basis of a traveling speed of a predetermined vehicle that is traveling, acquired from a vehicle external image of an environment outside of the vehicle.

For example, when a vehicle external image captured from a vehicle that has traveled (that is traveling) in a completely different place is projected as the projected image93projected on the ceiling92of the vehicle80described with reference toFIG.4, the image processing unit40D generates a presentation image to be reproduced in accordance with a traveling speed of the vehicle80.

Accordingly, it is possible to bring physical acceleration change of the user to match acceleration change in the presentation image, and thus the user is enabled to feel as if he/she is driving in a different place.

The image processing unit40D includes an image acquisition unit411, a speed estimation unit412, and a presentation control unit413.

The image acquisition unit411acquires a vehicle external image of an environment outside of a vehicle that has traveled (that is traveling) in a different place, which has been captured (which is being captured), and supplies the image to the speed estimation unit412.

For example, as shown inFIG.29, a vehicle external image from a vehicle420that has traveled (that is traveling) in a different place is transmitted to the vehicle80via a cloud server431connected to a predetermined network such as the Internet, and thus a vehicle external image may be acquired.

Further, a vehicle external image may be acquired by recording the vehicle external image from the vehicle420that has traveled in a different place in a predetermined recording medium432and reading it in the vehicle80.

InFIG.29, when a vehicle external image obtained by capturing an environment outside a vehicle that has traveled in a different place is acquired in advance, the vehicle80and the vehicle420may be different vehicles or may be the same vehicle.

Further, as a vehicle external image of an environment outside a vehicle that has traveled in a different place, which has been captured in advance, a presentation image (the image-processed fisheye lens image or the front camera image) generated by the image processing units40A to40C (40C′) of the first to third embodiments described above may be acquired.

The speed estimation unit412executes speed estimation processing.

Specifically, the speed estimation unit412performs object recognition processing on the vehicle external image from the image acquisition unit411and estimates a traveling speed of the vehicle420on the basis of the processing result and object information accumulated in the object information definition unit414. The object information definition unit414is realized in the storage unit50, for example, in the form of a relational database or a look-up table.

The estimated traveling speed is supplied to the presentation control unit413. When metadata of the vehicle external image includes the traveling speed of the vehicle420, the traveling speed of the vehicle420included in the metadata of the vehicle external image is supplied to the presentation control unit413as it is.

The presentation control unit413executes image presentation processing. Specifically, the presentation control unit413generates a presentation image corresponding to the traveling speed of the vehicle80on the basis of the traveling speed of the vehicle420from the speed estimation unit412. The generated presentation image is output to the graphics display processing unit20and is presented to the interior91of the vehicle80by the output unit30.

Next, the operation flow of the image processing unit40D will be described with reference to the flowchart ofFIG.30.

In step S41, the vehicle external image acquisition unit411acquires a vehicle external image.

In step S42, the speed estimation unit412executes speed estimation processing.

In step S43, the presentation control unit413executes image presentation processing.

According to the above-described configuration and processing, it is possible to present a presentation image corresponding to a situation outside the vehicle80to the interior of the vehicle80that is traveling.

(Flow of Speed Estimation Processing)

Here, first, the flow of speed estimation processing executed by the speed estimation unit412in step S42of the flowchart ofFIG.30will be described with reference to the flowcharts ofFIG.31andFIG.32. Speed estimation processing is started, for example, when the user selects an image to be presented in the vehicle interior91and the image is acquired by the image acquisition unit411.

In step S101, the speed estimation unit412determines whether or not speed information indicating the traveling speed of the vehicle420(the vehicle whose vehicle external image has been captured) has been added as metadata to a vehicle external image from the image acquisition unit411.

If it is determined in step S101that the speed information has been added to the vehicle external image, the vehicle external image to which the speed information has been added is provided to the presentation control unit413as it is, and processing ends.

On the other hand, if it is determined in step S101that the speed information has not been added to the vehicle external image, processing proceeds to step S102in which the speed estimation unit412performs object recognition processing on the vehicle external image.

For example, when the front camera image340shown inFIG.21has been acquired as a vehicle external image, the speed estimation unit412performs object recognition processing on the front camera image340to divide the front camera image340according to attributes of objects as shown inFIG.33. The obtained processed image440is divided into areas of buildings, cars, roads, and signs.

In step S103, the speed estimation unit412determines whether or not object information of an object that attracts attention (hereinafter referred to as an object of interest) among the objects recognized by object recognition processing performed on the vehicle external image is present in the object information definition unit414.

FIG.34is a diagram showing an example of object information.

The object information OJ401shown inFIG.34is information representing whether or not each object can move and whether or not each object is an object of a specified size. An object of a specified size refers to an object having a generally set size. In the example ofFIG.34, a building and a road are “unavailable” to move and are not objects of specified sizes (have “invalid” sizes), a vehicle is “available” to move and is an object of a specified size (has a “valid” size), and a road sign is “unavailable” to move and is an object of a specified size (has a “valid” size). With respect to an object having a “valid” size, the actual size of the object is also defined in object information. Such object information is used to determine a speed estimation target object that is an object used for speed estimation, as will be described later.

As shown inFIG.34, the object information OJ401may include information representing whether or not each object has a side or a surface parallel to a road on which a vehicle travels.

If it is determined in step S103that the object information corresponding to the object of interest is present in the object information definition unit414, processing proceeds to step S104.

In step S104, the speed estimation unit412determines whether or not the object of interest is “unavailable” to move in the object information corresponding to the object of interest. Here, an object moving toward the vehicle80is not a speed estimation target object, and a non-moving object such as a road sign can be a speed estimation target object.

If it is determined in step S104that the object of interest is “unavailable” to move, processing proceeds to step S105.

In step S105, the speed estimation unit412determines whether or not the size of the object of interest is a certain size or more. For example, it is determined whether or not the vertical and horizontal lengths of the object of interest in the vehicle external image are greater than 20 px (pixels). Here, in order to avoid decrease in the reliability of the estimated traveling speed, an object having a large area of the object of interest in the vehicle external image can be a speed estimation target object.

If it is determined in step S105that the size of the object of interest is equal to or greater than the certain size, processing proceeds to step S106in which the speed estimation unit412adds the object of interest to speed estimation target object candidates that are candidates for a speed estimation target object.

On the other hand, if it is determined in step S103that the object information corresponding to the object of interest is not present in the object information definition unit414, if it is determined in step S104that the object of interest is “available” to move, or if it is determined in step S105that the size of the object of interest is not equal to or greater than the certain size, processing up to step S106is skipped.

Then, in step S107, the speed estimation unit412determines whether or not processing of steps S103to S106has been executed on all objects recognized by object recognition processing performed on the vehicle external image.

If processing of steps S103to S106has not been executed on all the objects, processing returns to step S103and processing of steps S103to S106is repeated.

On the other hand, if processing of steps S103to S106has been executed on all the objects, processing proceeds to step S108ofFIG.32.

In step S108, the speed estimation unit412determines a speed estimation target object from among the speed estimation target object candidates.

Here, when objects having “valid” and “invalid” sizes are present together in object information of a plurality of speed estimation target object candidates, an object having a “valid” size is preferentially determined as a speed estimation target object. In addition, when objects having any of “valid” and “invalid” sizes are present in the object information of the plurality of speed estimation target object candidates, an object having a larger size may be preferentially determined as a speed estimation target object.

When no objects have been added to the speed estimation target object candidates, no speed estimation target object is determined.

In step S109, the speed estimation unit412determines whether or not a speed estimation target object has been determined.

If it is determined in step S109that the speed estimation target object has been determined, processing proceeds to step S110in which the speed estimation unit412determines whether or not the size of the speed estimation target object is “valid”.

If it is determined in step S110that the size of the speed estimation target object is “valid”, the processing proceeds to step S111in which the speed estimation unit412calculates the absolute speed (actual speed) of the vehicle420as the traveling speed of the vehicle420.

FIG.35is a diagram showing an example of calculation an absolute speed. In the example ofFIG.35, it is assumed that, among objects reflected in the front camera image340, a road sign having object information defined as “unavailable” to move, having a “valid” size, and having an actual size is 60 cm in diameter is determined as a speed estimation target object.

In the example ofFIG.35, parts of the front camera image340at time t and time t+1 one second later are shown, and a state in which the road sign approaches the vehicle420(front side) from time t to time t+1 is shown. Specifically, as shown inFIG.35, the road sign having a size (vertical and horizontal lengths) of 30 px is moving 300 px per second in the front camera image340.

In this case, an actual distance in which the road sign has approached the vehicle80in one second is 300 (px)×0.6 (m)/30 (px)=6 (m). That is, the moving speed (km/h) of the vehicle420is 21.6 km/h converted from 6 m/s, which is the absolute speed of the vehicle420.

As described above, the absolute speed of the vehicle420is calculated on the basis of the amount of movement of the object of the specified size in the vehicle external image. If there are a plurality of objects of specified sizes, absolute speeds may be calculated on the basis of the amount of movement of each object and the average value or median of the absolute speeds may be used as the final absolute speed of vehicle420.

Returning to the flowchart ofFIG.32, if it is determined in step S110that the size of the speed estimation target object is not “valid”, that is, if the size of the speed estimation target object is “invalid”, processing proceeds to step S111.

In step S111, the speed estimation unit412calculates a relative speed based on a moving speed of a predetermined object in the vehicle external image as the traveling speed of the vehicle420. In this case, although the actual size of the speed estimation target object is unknown, it is possible to calculate the moving speed (px/km) of the speed estimation target object in the vehicle external image. Therefore, a value obtained by multiplying the moving speed of the speed estimation target object in the vehicle external image by a predetermined coefficient, for example, is set to be the relative speed of the vehicle420.

On the other hand, when it is determined in step S109that the speed estimation target object has not been determined, that is, when no objects have been added to the speed estimation target object candidates, processing ends without estimation of the traveling speed of the vehicle420.

Speed information representing the traveling speed (absolute speed or relative speed) of the vehicle420estimated as described above is added to the vehicle external image acquired by the image acquisition unit411and supplied to the presentation control unit413.

(Flow of image presentation processing) Next, the flow of image presentation processing executed by the presentation control unit413in step S43of the flowchart ofFIG.30will be described with reference to the flowchart ofFIG.36. Image presentation processing is started, for example, by the user instructing presentation of an image.

In step S201, the presentation control unit413acquires the traveling speed of the vehicle80that is traveling from a speed sensor configured as the input unit10.

In step S202, the presentation control unit413determines whether or not speed information indicating the traveling speed of the vehicle420(the vehicle whose vehicle external image has been captured) has been added to a vehicle external image from the speed estimation unit412.

If it is determined in step S202that the speed information has been added to the vehicle external image, processing proceeds to step S203.

In step S203, the presentation control unit413determines whether or not a vehicle external image that matches the traveling speed of the vehicle80, specifically, a vehicle external image to which speed information indicating a traveling speed that matches the traveling speed of the vehicle80has been added, is present.

If it is determined in step S203that a vehicle external image that matches the traveling speed of the vehicle80is present, processing proceeds to step S204in which the presentation control unit413outputs the vehicle external image that matches the traveling speed of the vehicle80as a presentation image as it is.

On the other hand, if it is determined in step S203that no vehicle external image that matches the traveling speed of the vehicle80is present, processing proceeds to step S205.

In step S205, the presentation control unit413determines whether or not a vehicle external image slower than the traveling speed of the vehicle80, specifically, a vehicle external image to which speed information indicating a traveling speed slower than the traveling speed of the vehicle80has been added is present.

If it is determined in step S205that a vehicle external image slower than the traveling speed of the vehicle80is present, processing proceeds to step S206in which the presentation control unit413outputs a presentation image in which the vehicle external image is reproduced at a high speed corresponding to the traveling speed of the vehicle80.

On the other hand, if it is determined in step S205that no vehicle external image slower than the traveling speed of the vehicle80is present, that is, if a vehicle external image faster than the traveling speed of the vehicle80is present, processing proceeds to step S207.

In step S207, the presentation control unit413outputs a presentation image in which the vehicle external image is reproduced at a low speed corresponding to the traveling speed of the vehicle80.

If it is determined in step S202that the speed information has not been added to the vehicle external image, processing proceeds to step S208in which the presentation control unit413outputs the vehicle external image as a presentation image as it is, that is, regardless of the traveling speed of the vehicle80.

After each of steps S204, S206, S207, and S208, the presentation control unit413determines whether or not the user has instructed end of image reproduction in the interior91of the vehicle80that is traveling in step S209.

If it is determined in step S209that end of reproduction has not been instructed, processing returns to step S201and subsequent processing is repeated. On the other hand, if it is determined in step S209that end of reproduction has been instructed, processing ends.

Here, an example of image reproduction corresponding to the traveling speed of the vehicle80will be described.

(Example of image reproduction when absolute speed has been calculated)

FIGS.37A,37B, and37Care diagrams showing an example of image reproduction corresponding to the traveling speed of the vehicle80when the absolute speed of the vehicle420has been calculated. This example is also applied when metadata of a vehicle external image includes the traveling speed of the vehicle420.

In each ofFIGS.37A,37B, and37C, the vehicle80travels at 10 km/h in a certain time period and travels at 20 km/h in the subsequent time period.

FIG.37Ashows an example of image reproduction when a vehicle external image that matches the traveling speed of the vehicle80is present. In the example ofFIG.37A, a vehicle external image to which speed information indicating that the absolute speed of the vehicle420is 10 km/h has been added (hereinafter referred to as a vehicle external image at 10 km/h, or the like) and a vehicle external image at 20 km/h are present.

In this case, the vehicle external image at 10 km/h is reproduced at 1× speed as a presentation image while the vehicle80is traveling at 10 km/h. Further, the vehicle external image at 20 km/h is reproduced at 1× speed as a presentation image while the vehicle80is traveling at 20 km/h. In the example ofFIG.37A, the vehicle external image at 10 km/h and the vehicle external image at 20 km/h are crossfade reproduced with the traveling speed of the vehicle80switched therebetween.

Meanwhile, unnaturalness of image switching can be further reduced by performing crossfade reproduction with a black image in a single black color interposed between two vehicle external images.

FIG.37Bshows an example of image reproduction when a vehicle external image slower than the traveling speed of the vehicle80is present. In the example ofFIG.37B, a vehicle external image at 5 km/h and a vehicle external image at 20 km/h are present.

In this case, particularly, the vehicle external image at 5 km/h is repeatedly reproduced at 2× speed as a presentation image according to frame thinning out or the like while the vehicle80is traveling at 10 km/h. In the example ofFIG.37B, although the vehicle external image at 5 km/h is repeatedly reproduced because the reproduction time of the vehicle external image at 5 km/h is less than the time when the vehicle80is traveling at 10 km/h, the vehicle external image at 5 km/h need not be repeatedly reproduced when the reproduction time thereof is sufficiently long. In the example ofFIG.37B, the vehicle external image at 5 km/h and the vehicle external image at 20 km/h are crossfade reproduced with the traveling speed of the vehicle80switched therebetween.

FIG.37Cshows an example of image reproduction when a vehicle external image faster than the traveling speed of the vehicle80is present. In the example ofFIG.37C, only vehicle external images at 20 km/h are present.

In this case, particularly, vehicle external images at 20 km/h are reproduced at 0.5× speed as presentation images according to frame interpolation or the like while the vehicle80is traveling at 10 km/h. In the example ofFIG.37C, the vehicle external images at 20 km/h are reproduced at a changing reproduction speed with the traveling speed of the vehicle80switched therebetween.

According to the above-described operation, it is possible to bring physical acceleration change of the user to match acceleration change in a presentation image, and thus the user is enabled to feel as if he/she is driving in a different place.

(Example of image reproduction when relative speed has been calculated)

FIGS.38A,38B, and38Care diagrams showing an example of image reproduction corresponding to the traveling speed of the vehicle80when the relative speed has been calculated instead of the absolute speed of the vehicle420.

Similarly toFIGS.37A,37B, and37C, the vehicle80travels at 10 km/h in a certain time period and 20 km/h in the subsequent time period in each ofFIGS.38A,38B, and38C.

In the example ofFIGS.38A,38B, and38C, it is assumed that, in a vehicle external image to which speed information representing the relative speed of the vehicle420has been added, the lowest relative speed is s and this relative speed s corresponds to 5 km/h of the vehicle80.

FIG.38Ashows an example of image reproduction when a vehicle external image that matches the traveling speed of the vehicle80is present. In the example ofFIG.38A, a vehicle external image to which speed information indicating that the relative speed of the vehicle420is2shas been added (hereinafter referred to as a vehicle external image having a relative speed of2s, or the like) and a vehicle external image having a relative speed of4sare present.

In this case, the vehicle external image having the relative speed of2sis reproduced at 1× speed as a presentation image while the vehicle80is traveling at 10 km/h. Further, the vehicle external image having the relative speed of4sis reproduced at 1× speed as a presentation image while the vehicle80is traveling at 20 km/h. In the example ofFIG.38A, the vehicle external image having the relative speed of2sand the vehicle external image having the relative speed of4sare crossfade reproduced with the traveling speed of the vehicle80switched therebetween.

FIG.38Bshows an example of image reproduction when a vehicle external image slower than the traveling speed of the vehicle80is present. In the example ofFIG.38B, a vehicle external image having a relative speed of s and a vehicle external image having a relative speed of4sare present.

In this case, particularly, the vehicle external image having the relative speed of s is repeatedly reproduced at 2× speed as a presentation image according to frame thinning out or the like while the vehicle80is traveling at 10 km/h. In the example ofFIG.38B, although the vehicle external image having the relative speed of s is repeatedly reproduced because the reproduction time of the vehicle external image having the relative speed of s is less than the time during which the vehicle80is traveling at 10 km/h, the vehicle external image having the relative speed of s need not be repeatedly reproduced if the reproduction time thereof is sufficiently long. In the example ofFIG.38B, the vehicle external image having the relative speed of s and the vehicle external image having the relative speed of4sare also crossfade reproduced with the traveling speed of the vehicle80switched therebetween.

FIG.38Cshows an example of image reproduction when a vehicle external image faster than the traveling speed of the vehicle80is present. In the example ofFIG.38C, only vehicle external images having a relative speed of4sis present.

In this case, particularly, the vehicle external images having the relative speed of4sare reproduced at 0.5× speed as presentation images according to frame interpolation or the like while the vehicle80is traveling at 10 km/h. In the example ofFIG.38C, the vehicle external images having the relative speed of4sare reproduced at a changing reproduction speed with the traveling speed of the vehicle80switched therebetween.

According to the above-described operation, even if the absolute speed of the vehicle420has not been calculated, it is possible to bring physical acceleration change of the user to match acceleration change in a presentation image and reduce the discomfort.

In the above description, the lowest relative speed of s in the vehicle external image of the vehicle420corresponds to 5 km/h of the vehicle80.

The present disclosure is not limited thereto, and in the example ofFIGS.38A,38B, and38C, a relative speed of a vehicle external image may be associated with the traveling speed of the vehicle80on the basis of a legal speed on a traveling route of automatic driving when the vehicle80is traveling according to automatic driving. The legal speed on the traveling route of automatic driving is acquired from, for example, map information input through the input unit10, and the like.

For example, when vehicle external images having relative speeds of s, 2 s, 4 s, and 8 s are present, the highest relative speed of 8 s is caused to correspond to a maximum legal speed on a traveling route of automatic driving. Further, the intermediate value between the relative speed of s and the relative speed of 8 s may be caused to correspond to a traveling speed at the time of switching from manual driving to automatic driving. In the latter case, reproduction of a vehicle external image is started at the timing of switching from manual driving to automatic driving.

In addition, a relative speed of a vehicle external image may be associated with the traveling speed of the vehicle80by performing object recognition processing in real time on an image of an environment outside the vehicle, captured from the vehicle80that is traveling, and calculating the relative speed on the basis of street trees, buildings, signboards, and the like that are not objects of specified sizes.

FIG.39is a block diagram showing a configuration example of an image processing unit40E of a fifth embodiment of the present technology.

The image processing unit40E generates a presentation image corresponding to a traveling speed of the vehicle80on the basis of a traveling speed of a predetermined vehicle that is traveling, acquired from a vehicle external image of an environment outside of the vehicle. In the image processing unit40E, a fisheye lens image or a front camera image before being subjected to image processing is acquired as a vehicle external image as in the image processing units40A to40C (40C′) of the first to third embodiments described above.

The image processing unit40E ofFIG.39is different from the image processing unit40D ofFIG.28in that a vehicle external image processing unit511is provided instead of the image acquisition unit411.

The vehicle external image processing unit511is configured as any of the image processing units40A,40B, and40C (40C′) of the first to third embodiments described above.

Next, the operation flow of the image processing unit40E will be described with reference to the flowchart ofFIG.40.

Since processing of steps S512and S513in the flowchart ofFIG.40is the same as processing of steps S42and S43in the flowchart ofFIG.30, description thereof will be omitted.

That is, in step S511, the vehicle external image processing unit511executes image processing on a vehicle external image. Specifically, the vehicle external image processing unit511acquires a fisheye lens image or a front camera image and performs image processing according to the operation of any one of the image processing units40A,40B, and40C (40C′) of the first to third embodiments described above. Thereafter, speed estimation processing and image presentation processing described above are executed on the fisheye lens image or the front camera image that has been subjected to image processing.

According to the above-described configuration and processing, even when a presentation image generated on the basis of a fisheye lens image or a front camera image is reproduced, it is possible to bring physical acceleration change of the user to match acceleration change in the presentation image.

7. Modified Examples

The following configuration can also be applied to the above-described embodiments.

(Other Examples of Disposition of Projector)

When the ceiling92is used as a presentation region in the interior91of the vehicle80, as shown inFIG.41, the projected image93from a projector611provided on the headrest99of the driver's seat may be projected on the ceiling92. In the example ofFIG.41, the projector611may be provided on the headrest100of the passenger seat instead of the headrest99of the driver's seat, or may be provided to both the headrests99and100.

(Other Examples of Output Unit)

As a presentation region in the interior91of the vehicle80, a flat panel or a flexible image display (liquid crystal display, organic electroluminescence (EL), or the like) may be provided as the output unit30and a presentation image may be displayed on the image display.

8. Configuration Example of Computer

The above-described series of processing can also be performed by hardware or software. When the series of processing is performed by software, a program for the software to be installed from a program recording medium to a computer embedded in dedicated hardware or a general-purpose personal computer.

FIG.42is a block diagram showing a hardware configuration example of a computer that executes a program to perform the above-described series of processing.

The above-described image processing device1is realized by a computer900having the configuration shown inFIG.42.

A CPU901, a ROM902, and a RAM903are connected through a bus904.

An input/output interface905is further connected to the bus904. An input unit906including a keyboard and a mouse and an output unit907including a display and a speaker are connected to the input/output interface905. In addition, a storage unit908including a hard disk, a non-volatile memory, and the like, a communication unit909including a network interface and the like, and a drive910that drives a removable medium911are connected to the input/output interface905.

In the computer900having the above configuration, for example, a CPU901performs the above-described series of processes by loading a program stored in the storage unit908to the RAM903via the input/output interface905and the bus904and executing the program.

The program executed by the CPU901is recorded on, for example, the removable medium911or is provided via a wired or wireless transfer medium such as a local area network, the Internet, or a digital broadcast to be installed in the storage unit908.

The program executed by the computer900may be a program that performs processing chronologically in the order described in the present specification or may be a program that performs processing in parallel or at a necessary timing such as a called time.

In the present specification, a system means a set of a plurality of constituent elements (devices, modules (components), or the like) and all the constituent elements may be located or not located in the same casing. Accordingly, a plurality of devices accommodated in separate housings and connected via a network, and one device in which a plurality of modules are accommodated in one housing are both systems.

The embodiments of the present technology are not limited to the above-described embodiments, and various changes can be made without departing from the gist of the present technology.

The advantageous effects described in the present specification are merely exemplary and are not limited, and other advantageous effects may be achieved.

Furthermore, the present disclosure can be configured as follows.

(1) An image processing device including an image processing unit configured to generate a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

(2) The image processing device according to (1), wherein the image processing unit generates the presentation image corresponding to a traveling speed of the second vehicle on the basis of a traveling speed of the first vehicle acquired from the vehicle external image.

(3) The image processing device according to (2), wherein the image processing unit outputs the vehicle external image as the presentation image when the traveling speed of the first vehicle matches the traveling speed of the second vehicle.

(4) The image processing device according to (3), wherein the image processing unit outputs the vehicle external image at a reproduction speed corresponding to the traveling speed of the second vehicle as the presentation image when the traveling speed of the first vehicle does not match the traveling speed of the second vehicle.

(5) The image processing device according to any one of (2) to (4), wherein the traveling speed of the first vehicle is included in metadata of the vehicle external image.

(6) The image processing device according to any one of (2) to (4), wherein the image processing unit estimates the traveling speed of the first vehicle on the basis of a processing result of object recognition processing performed on the vehicle external image.

(7) The image processing device according to (6), wherein, when an object of a specified size has been detected by the object recognition processing, the image processing unit calculates an absolute speed of the first vehicle on the basis of an amount of movement of the object of the specified size in the vehicle external image.

(8) The image processing device according to (6) or (7), wherein, when an object of a specified size has not been detected by the object recognition processing, the image processing unit calculates a relative speed based on a moving speed of a predetermined object in the vehicle external image.

(9) The image processing device according to any one of (1) to (8), wherein the vehicle external image is a fisheye camera image obtained by capturing an image in a zenith direction from the first vehicle, and the image processing unit generates the presentation image by clipping an area based on the center of the fisheye camera image.

(10) The image processing device according to (9), wherein the image processing unit clips the fisheye camera image that has been distortion-corrected.

(11) The image processing device according to (10), wherein the image processing unit generates the presentation image by correcting an object in the fisheye camera image according to a processing result of object recognition processing performed on at least a part of the clipped fisheye camera image.

(12) The image processing device according to any one of (1) to (8), wherein the vehicle external image is a front camera image obtained by capturing an image in the traveling direction of the first vehicle, and the image processing unit generates the presentation image by sequentially synthesizing area images obtained by clipping an area corresponding to a presentation region of the presentation image of the second vehicle in the front camera image at predetermined time intervals.

(13) The image processing device according to (12), wherein the image processing unit clips the area based on a vanishing point detected from the front camera image.

(14) The image processing device according to (13), wherein the image processing unit generates the presentation image by performing blur processing on a synthesis image obtained by sequentially synthesizing the area images.

(15) The image processing device according to any one of (1) to (14), wherein the presentation region of the presentation image includes a ceiling inside the second vehicle.

(16) The image processing device according to any one of (1) to (15), wherein the first vehicle and the second vehicle are different vehicles.

(17) The image processing device according to any one of (1) to (15), wherein the first vehicle and the second vehicle are the same vehicle.

(18) An image processing method including

generating, by an image processing device, a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

(19) A program for causing a computer to execute processing of generating a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling.

(20) An image presentation system including

an image processing device including an image processing unit configured to generate a presentation image to be presented to an interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling, and

a presentation device including a presentation unit configured to present the presentation image to an interior of the second vehicle.

REFERENCE SIGNS LIST