Abstract:
Provided are an image converter, a camera, an image conversion method, and a program, wherein a panorama image can be partially enlarged or reduced, while maintaining the characteristics of the panorama image that images can be joined into a cylindrical shape, or a wide range (up to 360 degrees) can be observed simultaneously. This image converter adopts a configuration wherein the image conversion apparatus includes: an image input unit that inputs a panorama image; and an image enlargement/reduction unit that enlarges/reduces the panorama image by making the enlargement ratio of the desired area within the panorama image different in a way that makes the enlargement ratio change successively at successive areas of the panorama image. In this configuration, the image enlargement/reduction unit enlarges/reduces the image such that the width, in the longitudinal direction of the panorama image, of the image after the enlargement/reduction fits into the original panorama image.

Description:
TECHNICAL FIELD  
       [0001]    The present invention relates to an image conversion apparatus, a camera, an image conversion method and a recording medium storing a program therein, for converting a panoramic image. 
       BACKGROUND ART  
       [0002]    A digital still camera has been known which continuously captures images while rotating an imaging direction 360 degrees and combines the captured images to generate a panoramic image in which images corresponding to a turn are connected together. In addition, a technique has been known which captures a 360-degree image using a plurality of lenses or captures a 360-degree image from above using a super-wide-angle lens and generates a panoramic image in which images corresponding to a turn are connected together. 
         [0003]    As the technique according to the related art related to the invention, Patent Literature (hereinafter, abbreviated as “PTL”) 1 and PTL 2 disclose an apparatus which designates any portion of a panoramic image and displays the enlarged image of the designated portion separately from the panoramic image. PTL 3 discloses a technique which captures a plurality of captured images while moving a lens in the horizontal direction and the vertical direction and connecting the captured images in the horizontal direction and the vertical direction to create a panoramic image. PTL 4 discloses an apparatus which displays a panoramic image that is captured at a plurality of imaging points as a balloon in the bird&#39;s eye view of the map image and can zoom in and out the bird&#39;s eye view. PTL 5 discloses a technique which partially changes the magnification of a horizontally long image that is captured using a wide-angle lens, to enlarge or reduce the image. 
       CITATION LIST  
     Patent Literature 
       [0000]    
       
         PTL 1 
         Japanese Patent Application Laid-Open No. 2003-092750 
         PTL 2 
         Japanese Patent Application Laid-Open No. 2005-148265 
         PTL 3 
         Japanese Patent Application Laid-Open No. 2007-159047 
         PTL 4 
         Japanese Patent Application Laid-Open No. 2007-110675 
         PTL 5 
         Japanese Patent No. 4279643 
       
     
       SUMMARY OF INVENTION  
     Technical Problem 
       [0014]    In the panoramic image including the images corresponding to one turn, in some cases, the photographer or the viewer wants to enlarge a portion of interest and to display the enlarged portion. In addition, 360-degree panoramic images have a characteristic that allows a continuous image to be generated by connecting band-shaped images together in a cylindrical shape. For this reason, the viewer may imagine a panoramic image in a cylindrical shape even from planar panoramic images by connecting the images together in his or her mind Therefore, in general, there arises a demand to maintain the characteristic allowing the images to be connected together in a cylindrical shape, even when the portion of interest is enlarged. 
         [0015]    In addition, when a wide range (360°) is monitored, there arises a demand to observe a partially enlarged portion while viewing the whole. 
         [0016]    There is no such enlargement feature that satisfies this demand. 
         [0017]    An object of the invention is to provide an image conversion apparatus, a camera, an image conversion method, and a recording medium storing a program therein, each makes it possible to partially enlarge or reduce a panoramic image while maintaining the characteristic of panoramic images, which allows panoramic images to be connected together in a cylindrical shape or to be observed in a wide range (up to 360°) at the same time. 
       Solution to Problem 
       [0018]    An image conversion apparatus according to an aspect of the present invention includes: an image receiving section that receives a panoramic image; and an image enlargement/reduction section that enlarges or reduces the panoramic image while varying a magnification of a desired area of the panoramic image such that the magnification continuously varies in a continuous area of the panoramic image, wherein a width of an image which has been enlarged and reduced by the image enlargement/reduction section is fit into the panoramic image in a longitudinal direction. 
       Advantageous Effects of Invention 
       [0019]    According to the invention, the image enlargement/reduction section can partially enlarge or reduce a panoramic image. In addition, the image enlargement/reduction section enlarges or reduces an image such that the magnification is not discontinuous within a range in which the viewing direction of the panoramic image is continuous. Therefore, it is possible to maintain the characteristic of panoramic images, which allows panoramic images to be connected together in a cylindrical shape or to be observed in a wide range (up to 360°) at the same time. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0020]      FIG. 1  is a block diagram illustrating the configuration of a camera according to an embodiment of the invention; 
           [0021]      FIG. 2  is a diagram illustrating a three-dimensional mapping space for describing the preparatory stage of a standard projection process; 
           [0022]      FIG. 3  is a diagram illustrating a panoramic image projected to a cylindrical surface illustrated in  FIG. 2 ; 
           [0023]      FIG. 4  is a diagram illustrating a three-dimensional mapping space for describing a first example of the standard projection process; 
           [0024]      FIG. 5  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 4 ; 
           [0025]      FIG. 6  is a diagram illustrating a three-dimensional mapping space for describing a second example of the standard projection process; 
           [0026]      FIG. 7  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 6 ; 
           [0027]      FIG. 8  is a diagram illustrating a three-dimensional mapping space for describing a third example of the standard projection process; 
           [0028]      FIG. 9  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 8 ; 
           [0029]      FIG. 10  is a diagram illustrating a three-dimensional mapping space for describing a fourth example of the standard projection process; 
           [0030]      FIG. 11  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 10 ; 
           [0031]      FIG. 12  is a diagram illustrating a three-dimensional mapping space for describing a fifth example of the standard projection process; 
           [0032]      FIG. 13  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 11 ; 
           [0033]      FIG. 14  is a diagram illustrating a three-dimensional mapping space for describing a zoom projection process for a panoramic image; 
           [0034]      FIG. 15  is a diagram illustrating a relative distance between a first cylindrical surface (original image surface) and a second cylindrical surface (projection surface) used for the zoom projection process; 
           [0035]      FIG. 16A  is a diagram illustrating a panoramic image before the zoom projection process, and  FIG. 16B  is a diagram illustrating a panoramic image after the zoom projection process; 
           [0036]      FIGS. 17A to 17C  are diagrams illustrating first to third processing steps of generating display data from the panoramic image after the zoom projection process; 
           [0037]      FIGS. 18A to 18C  are diagrams illustrating first to third display examples of a panoramic image; 
           [0038]      FIG. 19  is a diagram illustrating a three-dimensional mapping space for describing a first variation of the zoom projection process; 
           [0039]      FIG. 20  is a diagram illustrating a panoramic image after the zoom projection process illustrated in  FIG. 19 ; 
           [0040]      FIG. 21  is a diagram illustrating a three-dimensional mapping space for describing a second variation of the zoom projection process; 
           [0041]      FIG. 22  is a diagram illustrating a panoramic image after the zoom projection process illustrated in  FIG. 21 ; 
           [0042]      FIG. 23  is a diagram illustrating a three-dimensional mapping space for describing a third variation of the zoom projection process; 
           [0043]      FIG. 24A  is a diagram illustrating a panoramic image before the zoom projection process illustrated in  FIG. 23 , and  FIG. 24B  is a diagram illustrating a panoramic image after the zoom projection process illustrated in  FIG. 23 ; 
           [0044]      FIG. 25  is a diagram illustrating variations (a- 1 ) to (a- 6 ) of the relative arrangement between the first cylindrical surface and the second cylindrical surface for zoom projection and panoramic images (b- 1 ) to (b- 6 ) corresponding to relative arrangement after zoom projection; 
           [0045]      FIGS. 26A to 26C  are diagrams respectively illustrating first to third examples of a method for designating an enlargement direction; 
           [0046]      FIG. 27  is a diagram illustrating a display example of a panoramic image in which a scale display area indicating a magnification in each viewing direction is added to the panoramic image; 
           [0047]      FIGS. 28A to 28C  are conceptual diagrams respectively illustrating first to third display examples in which a panoramic image is divided into a plurality of stages; 
           [0048]      FIGS. 29A and 29B  are diagrams respectively illustrating a plurality of panoramic images for an object tracking function which are acquired in time series; 
           [0049]      FIGS. 30A and 30B  are diagrams respectively illustrating a plurality of time-series panoramic images after a zoom projection process which is also used as the object tracking function; 
           [0050]      FIGS. 31A and 31B  are each a diagram illustrating a display example of a plurality of time-series panoramic images when the object tracking function is used; 
           [0051]      FIG. 32A  is a diagram illustrating a variation of the panoramic image enlargement/reduction process and illustrating a panoramic image before a panoramic image enlargement/reduction process, and  FIG. 32B  is a graph illustrating the magnification in each viewing direction; 
           [0052]      FIG. 33  is a conceptual diagram illustrating a process of enlarging or reducing a panoramic image in a longitudinal direction; 
           [0053]      FIG. 34  is a diagram illustrating a panoramic image after the enlargement/reduction process in the longitudinal direction; 
           [0054]      FIG. 35A  is a diagram illustrating a panoramic image before an enlargement/reduction process in a lateral direction, and  FIG. 35B  is a graph illustrating the magnification in each viewing direction; 
           [0055]      FIG. 36  is a conceptual diagram illustrating a process of enlarging or reducing a panoramic image in the lateral direction; and 
           [0056]      FIG. 37  is a diagram illustrating a panoramic image after the enlargement/reduction process in the longitudinal direction and the lateral direction. 
       
    
    
     DESCRIPTION OF EMBODIMENTS  
       [0057]    Hereinafter, an embodiment of the invention will be described with reference to the drawings. 
         [0058]      FIG. 1  is a block diagram illustrating the configuration of a camera according to the embodiment of the invention. 
         [0059]    As illustrated in  FIG. 1 , the camera according to this embodiment includes, for example, imaging section  11  that captures a panoramic image, standard projection section  12  that performs a standard projection process, which will be described below, for the panoramic image, zoom projection section  13  that serves as an image enlargement/reduction section, input receiving section  14  that receives an operation input from the outside through an operation button, zoom projection setting section  15  that sets various settings of the zoom projection process on the basis of the operation input, image output section  16  that generates display data and outputs image data, and display  17  that receives the display data from the image output section  16  and displays the display data. 
         [0060]    Imaging section  11  may have a configuration which performs panorama development for an omni-directional image that is captured by an omni-directional camera using, for example, a fish-eye lens or a mirror, to obtain a panoramic image as the original image. Alternatively, imaging section  11  includes a plurality of lenses which are arranged in a plurality of directions and an imaging element which converts an optical image formed by the plurality of lenses into electric signals, and is thus configured to be capable of capturing a 360-degree image in all directions using the plurality of lenses. In addition, imaging section  11  connects a plurality of image data items captured by the plurality of lenses to generate image data of a panoramic image in which images corresponding to 360° are connected together. Imaging section  11  outputs the image data of the panoramic image to standard projection section  12 . Imaging section  11  may have a configuration which includes a direction sensor or a gyro sensor, which allows the user to perform continuous imaging in all directions (360°), and which connects a plurality of image data items obtained by the continuous imaging to obtain the panoramic image. Alternatively, imaging section  11  may have a variety of known configurations capable of obtaining a 360-degree panoramic image. 
         [0061]    Zoom projection setting section  15  sets a magnification and an enlargement direction among the viewing directions of the panoramic image on the basis of an operation instruction which is input from the user through input receiving section  14 . Then, zoom projection setting section  15  supplies data indicating the enlargement direction and the magnification to zoom projection section  13 . 
         [0062]    Zoom projection setting section  15  allows the user to input the viewing direction to be enlarged, using, for example, the following process. That is, first, zoom projection setting section  15  displays the panoramic image before zoom projection and a pointer image indicating the enlargement direction on display  17  in an overlapped manner. Then, zoom projection setting section  15  moves the pointer image on the basis of the operation input through input receiving section  14  and determines the viewing direction indicated by the pointer image at the time of the operation input to be the enlargement direction on the basis of an operation for determining the enlargement direction which is input through input receiving section  14 . The input of the magnification is determined by allowing the user to select any one of a plurality of magnifications of 1, 2, and 5 through input receiving section  14 . Alternatively, the input of the magnification may be determined by allowing the user to select one from the continuous magnification. 
         [0063]    Standard projection section  12  receives the image data of the panoramic image from imaging section  11  (image input section) and performs a standard projection process of changing the height of the point of view of the panoramic image or the direction of the field of view, depending on the content of the input data from zoom projection setting section  15 . Then, standard projection section  12  outputs the processed image data of the panoramic image to zoom projection section  13 . The standard projection process will be described in detail below. 
         [0064]    Zoom projection section  13  performs a zoom projection process of enlarging or reducing a portion of the range of the panoramic image, according to the content of the input data from zoom projection setting section  15 , while maintaining the characteristic of panoramic images, which allows the images in all directions (hereinafter, referred to as the viewing directions) of the entire circumference of the panoramic image to be continuously connected together. Then, zoom projection section  13  outputs the processed image data of the panoramic image to image output section  16 . The projection process will be described in detail below. 
         [0065]    Image output section  16  receives the image data of the cylindrical panoramic image from zoom projection section  13  and performs image processing for cutting the panoramic image at any position and placing the panoramic image in a planar shape to generate display data. Then, image output section  16  outputs the display data to display  17  and display  17  displays the display data. 
         [0066]    [Standard Projection Process] 
         [0067]      FIG. 2  is a diagram illustrating a three-dimensional mapping space for describing a preparatory stage of the standard projection process performed by standard projection section  12 , and  FIG. 3  is a diagram illustrating a panoramic image projected onto a cylindrical surface illustrated in  FIG. 2 . 
         [0068]    The standard projection process changes the height of the point of view or the inclination of the horizontal plane of the panoramic image, with almost no change in the magnification of the panoramic image obtained by imaging section  11 . Here, the horizontal plane is not a plane perpendicular to the direction of gravity, but is a plane indicated by the trajectory of a vector when each viewing direction in a turn of the panoramic image is represented by the vector. 
         [0069]    When the standard projection process starts, standard projection section  12  constructs cylindrical surface  40  (a side surface of cylinder  40 A), which is a projection source, in a virtual three-dimensional mapping space, as illustrated in  FIG. 2 . Then, standard projection section  12  continuously maps panoramic image  70  supplied from imaging section  11  to cylindrical surface  40 . Panoramic image  70  is mapped such that images in all directions forming panoramic image  70  are connected to each other on cylindrical surface  40 . 
         [0070]    Central horizontal line L 1  of panoramic image  70  is mapped to the height of central point O of cylindrical surface  40 . In the standard projection process, point of view VP, which is the height of the changed point of view is designated to, for example, an arbitrary height of central axis  45  by the user. Strip-shaped portion VPa of panoramic image  70  is an image portion corresponding to the height of point of view VP. In addition, in the standard projection process, the user designates a point of interest (central point of display), that is, one or a plurality of points P 1  to P 4  at any positions on panoramic image  70  and the point of interest is converted so as to be the center of image (consequently, the inclination of the horizontal plane is changed). 
         [0071]      FIG. 4  is a diagram illustrating a three-dimensional mapping space for describing a first example of the standard projection process and  FIG. 5  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 4 . In the first example of the standard projection process, only one point P 1  on panoramic image  70  is designated. 
         [0072]    In this case, as illustrated in  FIG. 4 , standard projection section  12  constructs cylindrical surface  50   a  (a side surface of cylinder  50 Aa), which is a projection destination, in the virtual three-dimensional mapping space such that cylindrical surface  50   a  has the same diameter (the diameter of cylinder  40 A) as cylindrical surface  40 , which is a projection source, central point O overlaps that of cylindrical surface  40 , and segment O-P 1  is perpendicular to central axis  55   a.  In this case, when the point of view is designated, the position of center O is the position of point of view VP. 
         [0073]    After cylindrical surface  50   a  is constructed, standard projection section  12  performs a process of projecting panoramic image  70  from cylindrical surface  40 , which is a projection source, to cylindrical surface  50   a,  which is a projection destination. In the projection process, central point O is a projection point of view and each pixel of cylindrical surface  40  is projected to cylindrical surface  50   a.  Alternatively, projection may be performed using central axis  55   a  as a projection center such that the pixels are not spread in the longitudinal direction. 
         [0074]    As illustrated in  FIG. 5 , panoramic image  80   a  in which point P 1  designated on original panoramic image  70  overlaps central horizontal line L 2  is generated by the standard projection process. In addition, panoramic image  80   a  is generated in which the horizontal plane is inclined such that a line of sight differently rises and falls in the direction of point P 1  and a direction opposite to the direction. 
         [0075]    In projected panoramic image  80   a,  an image at the upper end or the lower end of any one of all viewing directions is absent. However, the upper and lower end portions of the images in all viewing directions are trimmed to generate strip-shaped panoramic image  80   a  and panoramic image  80   a  can be transmitted to zoom projection section  13 . 
         [0076]      FIG. 6  is a diagram illustrating a three-dimensional mapping space for describing a second example of the standard projection process and  FIG. 7  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 6 . In the second example of the standard projection process, two points P 1  and P 2  on panoramic image  70  are designated. 
         [0077]    In this case, standard projection section  12  constructs cylindrical surface  50   b  (a side surface of cylinder  50 Ab), which is a projection destination, in the virtual three-dimensional mapping space such that cylindrical surface  50   b  has the same diameter as cylindrical surface  40 , which is a projection source, central point O overlaps that of cylindrical surface  40 , and triangle O-P 1 -P 2  is parallel to the bottom of cylinder  50 Ab. Then, standard projection section  12  projects panoramic image  70  from cylindrical surface  40  to cylindrical surface  50   b,  as described above. Standard projection section  12  sets central point O as the position of point of view VP when point of view VP is not designated. 
         [0078]    According to the standard projection process, as illustrated in  FIG. 7 , panoramic image  80   b  is generated in which points P 1  and P 2  designated on original panoramic image  70  overlap central horizontal line L 2   b.  Since the direction of points P 1  and P 2  is at the center of image  80   b,  panoramic image  80   b  is generated in which the line of sight differently rises and falls in the opposite direction of the points and the horizontal plane is inclined. 
         [0079]      FIG. 8  is a diagram illustrating a three-dimensional mapping space for describing a third example of the standard projection process and  FIG. 9  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 8 . In the third example of the standard projection process, two points P 1  and P 2  on panoramic image  70  and point of view VP are designated. 
         [0080]    In this case, standard projection section  12  constructs cylindrical surface  50   c  (a side surface of cylinder  50 Ac), which is a projection destination, in the virtual three-dimensional mapping space such that cylindrical surface  50   c  has the same diameter as cylindrical surface  40 , which is a projection source, triangle P 1 -P 2 -VP is parallel to the bottom of cylinder  50 Ac, and point of view VP is a new central point. Then, standard projection section  12  projects panoramic image  70  from cylindrical surface  40  to cylindrical surface  50   c,  as described above. 
         [0081]    According to the standard projection process, as illustrated in  FIG. 9 , panoramic image  80   c  is generated in which points P 1  and P 2  designated on original panoramic image  70  overlap central horizontal line L 2   c  and the image of center horizontal line L 2   c  is an image viewed from point of view VP. 
         [0082]      FIG. 10  is a diagram illustrating a three-dimensional mapping space for describing a fourth example of the standard projection process and  FIG. 11  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 10 . In the fourth example of the standard projection process, three points P 1 , P 2 , and P 3  on panoramic image  70  are designated. 
         [0083]    In this case, standard projection section  12  constructs cylindrical surface  50   d  (a side surface of cylinder  50 Ad), which is a projection destination, in the virtual three-dimensional mapping space such that cylindrical surface  50   d  has the same diameter as cylindrical surface  40 , which is a projection source, triangle P 1 -P 2 -P 3  is parallel to the bottom of cylinder  50 Ad, and a new central point overlaps triangle P 1 -P 2 -P 3 . Then, standard projection section  12  projects panoramic image  70  from cylindrical surface  40  to cylindrical surface  50   d,  as described above. 
         [0084]    According to the standard projection process, as illustrated in  FIG. 11 , panoramic image  80   d  is generated in which points P 1 , P 2 , and P 3  designated on original panoramic image  70  overlap central horizontal line L 2   d.    
         [0085]      FIG. 12  is a diagram illustrating a three-dimensional mapping space for describing a fifth example of the standard projection process and  FIG. 13  is a diagram illustrating a panoramic image after the standard projection process illustrated in  FIG. 12 . In the fifth example of the standard projection process, points P 1  to P 4  more than three points on panoramic image  70  are designated. 
         [0086]    In this case, standard projection section  12  constructs cylindrical surface  50   e  (a side surface of cylinder  50 Ae), which is a projection destination, in the virtual three-dimensional mapping space such that cylindrical surface  50   e  has the same diameter as cylindrical surface  40 , which is a projection source, a specific plane (a plane including horizontal line L 2   e ) which has an overall short distance to each of designated points P 1  to P 4  is parallel to the bottom of cylinder  50 Ae, and a new central point overlaps the specific plane. The specific plane can be calculated by, for example, a least-square method such that the sum of squares of the distances between the specific plane and designated points P 1  to P 4  is the minimum. Then, standard projection section  12  projects panoramic image  70  from cylindrical surface  40  to cylindrical surface  50   e,  as described above. 
         [0087]    According to the standard projection process, as illustrated in  FIG. 13 , panoramic image  80   e  is generated in which points P 1  to P 4  designated on original panoramic image  70  are overall close to central horizontal line L 2   e.    
         [0088]    Then, panoramic images  80   a  to  80   e  which are generated by the standard projection process as described above, are transmitted to zoom projection section  13  and the following zoom projection process is performed. 
         [0089]    [Zoom Projection Process] 
         [0090]      FIG. 14  is a diagram illustrating a three-dimensional mapping space for describing a panoramic image zoom projection process.  FIG. 15  is a diagram illustrating the relative distance between a first cylindrical surface and a second cylindrical surface used in the zoom projection process. An image subjected to an alignment process, such as a process of changing the height of the point of view or the inclination of the horizontal plane output from the standard projection section, is mapped to the first cylindrical surface and the second cylindrical surface is a projection surface.  FIG. 16A  is a diagram illustrating a panoramic image before the zoom projection process which is obtained from the standard projection section and  FIG. 16B  is a diagram illustrating a panoramic image after the zoom projection process. 
         [0091]    The zoom projection process is performed by zoom projection section  13  as follows. That is, first, as illustrated in  FIG. 14 , zoom projection section  13  constructs first cylindrical surface  20  (a side surface of cylinder  20 A) and second cylindrical surface  30  (a side surface of cylinder  30 A) in the three-dimensional mapping space. First cylindrical surface  20  and second cylindrical surface  30  are constructed such that the central axes (the central axes of cylinders  20 A and  30 A) thereof are parallel to each other and the length of second cylindrical surface  30  in the longitudinal direction is longer than that of first cylindrical surface  20 . In addition, first cylindrical surface  20  and second cylindrical surface  30  are arranged such that entire first cylindrical surface  20  is included between the upper end and the lower end of second cylindrical surface  30  as seen from the longitudinal direction. First cylindrical surface  20  and second cylindrical surface  30  are arranged such that central axis  25  of first cylindrical surface  20  is displaced from the center of second cylindrical surface  30  as seen from the horizontal direction (a direction along the upper surface or the lower surface of cylinders  20 A and  30 A) and is included in the cylinder of second cylindrical surface  30 . 
         [0092]    The three-dimensional mapping space is a virtual three-dimensional space which is constructed on a memory. The displacement direction and the amount of displacement of first cylindrical surface  20  and second cylindrical surface  30  are determined on the basis of data for the enlargement direction and the magnification supplied from zoom projection setting section  15 . 
         [0093]    When first cylindrical surface  20  and second cylindrical surface  30  are constructed as described above, zoom projection section  13  maps panoramic image  80  (see  FIG. 16A ) supplied from standard projection section  12  to first cylindrical surface  20 . Panoramic image  80  is mapped such that all 360-degree images forming panoramic image  80  are connected to each other on first cylindrical surface  20 . 
         [0094]    Then, zoom projection section  13  performs a process of projecting and mapping each pixel on first cylindrical surface  20  to second cylindrical surface  30  using central point O (central point O of central axis  25  of cylinder  20 A) of first cylindrical surface  20  as a projection point of view. For example, zoom projection section  13  enlarges a column of pixels  22  which overlaps straight line a in  FIG. 14  to a row of pixels  32  which overlaps straight line b and projects the enlarged row of pixels. In addition, zoom projection section  13  reduces a row of pixels  21  which overlaps straight line d in  FIG. 14  to a column of pixels  31  which overlaps straight line c and projects the reduced row of pixels. Zoom projection section  13  continuously projects pixels in the other range in the same manner as described above. Then, zoom projection section  13  enlarges or reduces the image projected onto second cylindrical surface  30  to obtain panoramic image  90  (see  FIG. 16B ). 
         [0095]    As illustrated in  FIG. 16B , panoramic image  90  in which all 360-degree images in all viewing directions are included, images in some directions are enlarged, images in directions opposite to the directions are reduced, and the magnification is not discontinuous in a continuous range is obtained by the zoom projection process. In  FIG. 16B , the left and right ends of panoramic image  90  are cut. However, in the stage in which projection to second cylindrical surface  30  is performed, the left end and the right end of panoramic image  90  are connected to each other. Therefore, the magnifications at the two cut portions are equal to each other. 
         [0096]    The magnification of each portion of panoramic image  90  is determined by the displacement direction and the amount of displacement of first cylindrical surface  20  and second cylindrical surface  30 . For example, as illustrated in  FIGS. 14 and 15 , the magnification of the image of portions which overlap straight lines a and b is “distance Ob/distance Oa” and the magnification of the image of portions which overlap straight lines c and d is “distance Oc/distance Od”. Zoom projection section  13  is configured so as to change the displacement direction and the amount of displacement of first cylindrical surface  20  and second cylindrical surface  30  depending on data for the enlargement direction and the magnification input from zoom projection setting section  15  and generate panoramic image  90  which is enlarged or reduced in the designated enlargement direction and at the designated magnification. Zoom projection section  13  displaces first cylindrical surface  20  and second cylindrical surface  30  in a direction in which the distance between a point indicating the designated enlargement direction and central point O is the largest. In addition, zoom projection section  13  determines the amount of displacement of first cylindrical surface  20  and second cylindrical surface  30  on the basis of the designated magnification. 
         [0097]    The zoom projection method can be changed in various ways. For example, first cylindrical surface  20  and second cylindrical surface  30  may be constructed so as to have different radii, may be arranged such that the central axes thereof overlap each other, and may displace the projection point of view from the center. Then, the zoom projection process may be performed. This zoom projection process makes it possible to enlarge or reduce the panoramic image at the same magnification in each viewing direction in a turn of the panoramic image. 
         [0098]    [Display Data Generation Process] 
         [0099]      FIGS. 17A to 17C  are diagrams illustrating first to third processing steps of generating display data from the panoramic image after the zoom projection process. 
         [0100]    Image output section  16  performs the display data generation process using data for panoramic image  90  after the zoom projection process. In the display data generation process, first, as illustrated in  FIG. 17A , image output section  16  performs a cutting process of dividing panoramic image  90  into a plurality of equal parts in the longitudinal direction. For example, image output section  16  cuts panoramic image  90  into image fragments A and C and fragment B at the positions represented by a one-dot chain line in  FIG. 17A . As illustrated in  FIG. 17B , image output section  16  performs a process of arranging fragments A to C in, for example, a plurality of stages (for example, two stages) so as to correspond to display frame  17 A of display  17 . Then, image output section  16  trims portions which are removed into the upper and lower ends of display frame  17 A and an overlap portion between upper fragment B and lower fragments A and C such that panoramic image  90  has a two-stage configuration as illustrated in  FIG. 17C  and generates display data for an image in display frame  17 A. Here, one end and the other end of cut portion  92  of panoramic image  90  have the same magnification and it is possible to continuously connect the images. The same applies to cut portion  93 . In the trimming of the portions which are removed from display frame  17 A, when a negligibly small portion of panoramic image  90  in the longitudinal direction is also trimmed, it is possible to maintain the operation of connecting the panoramic image in a cylindrical shape in one&#39;s head. 
         [0101]      FIGS. 18A to 18C  are diagrams respectively illustrating the first to third display examples of the panoramic image. When the display data generated by the image output section  16  is output to display  17  as described above, a display image illustrated in FIGS.  18 A to  18 C is output to the display  17 .  FIG. 18A  illustrates an example of the display image when a zoom projection magnification is 1 (no zoom),  FIG. 18B  illustrates an example of the display image when the magnification is 2 in the direction of object  95 , and  FIG. 18C  illustrates an example of the display image when the magnification is 5 in the direction of object  95 . When the selection of the enlargement direction or the magnification is switched by input receiving section  14 , the display images illustrated in  FIGS. 18A to 18C  are switched. 
         [0102]    In the panoramic image illustrated in  FIG. 17A , in practice, the ends of the data mapped onto the projection surface (second cylindrical surface  30 ) of zoom projection section  13  are connected to each other. When the data is cut out, 360-degree data is not necessarily used as panoramic image data, but a substantially 360-degree area may be used. 
         [0103]    [Variation of Zoom Projection Process] 
         [0104]      FIG. 19  is a diagram illustrating a three-dimensional mapping space for describing a first variation of the zoom projection process and  FIG. 20  is a diagram illustrating a panoramic image after the zoom projection process. 
         [0105]    In the first variation of the zoom projection process, first cylindrical surface  20  to which a panoramic image before zoom projection is mapped and second cylindrical surface  30  to which the panoramic image is zoomed and projected are constructed by the same method as that in the above-mentioned zoom projection process (see  FIG. 14 ). In the first variation, as illustrated in  FIG. 19 , projection point of view O 1  is set to the height of the upper end of first cylindrical surface  20  and the projection process is performed. 
         [0106]    According to the zoom projection process, as illustrated in  FIG. 20 , panoramic image  90   a  after the zoom projection process can have a shape in which the upper end is straight in all viewing directions (360°), an enlarged portion swells downward, and a reduced portion shrinks upward. In the zoom projection process, it is possible to obtain panoramic image  90   a  in which the magnification is not discontinuous in a continuous range. 
         [0107]      FIG. 21  is a diagram illustrating a three-dimensional mapping space for describing a second variation of the zoom projection process and  FIG. 22  is a diagram illustrating a panoramic image after the zoom projection process. 
         [0108]    In the second variation of the zoom projection process, first cylindrical surface  20  to which a panoramic image before zoom projection is mapped and second cylindrical surface  30  to which the panoramic image is zoomed and projected are constructed by the same method as that in  FIG. 14 . In the second variation, as illustrated in  FIG. 21 , projection point of view O 2  is set to the height of the lower end of first cylindrical surface  20  and a projection process is performed. 
         [0109]    According to the zoom projection process, as illustrated in  FIG. 22 , panoramic image  90   b  after the zoom projection process can have a shape in which the lower end is straight in all viewing directions (360°), an enlarged portion swells upward, and a reduced portion shrinks downward. In the zoom projection process, it is possible to obtain panoramic image  90   b  in which the magnification is not discontinuous in a continuous range. 
         [0110]      FIG. 23  is a diagram illustrating a three-dimensional mapping space for describing a third variation of the zoom projection process and  FIGS. 24A and 24B  are diagrams illustrating panoramic images before and after the zoom projection process, respectively. 
         [0111]    In the third variation of the zoom projection process, zoom projection section  13  constructs first cylindrical surface  20   a  and second cylindrical surface  30   a  as follows. That is, zoom projection section  13  constructs first cylindrical surface  20   a  and second cylindrical surface  30   a  such that first cylindrical surface  20   a  to which the panoramic image before zoom projection is mapped is elongated in the longitudinal direction and second cylindrical surface  30   a  to which the panoramic image is zoomed and projected is shortened in the longitudinal direction. The construction method of zoom projection section  13  is not particularly limited, but zoom projection section  13  constructs first cylindrical surface  20   a  and second cylindrical surface  30   a  so as to have the same diameter (cylinders  20 Aa and  30 Aa have the same diameter). In addition, zoom projection section  13  arranges first cylindrical surface  20   a  and second cylindrical surface  30   a  such that second cylindrical surface  30   a  is disposed between the upper end and the lower end of first cylindrical surface  20   a  as viewed from the longitudinal direction and central axis  25  of first cylindrical surface  20   a  is disposed inside second cylindrical surface  30   a  as viewed from the horizontal direction. 
         [0112]    After the cylindrical surfaces are constructed, zoom projection section  13  maps panoramic image  80   h  in which 360-degree images in all directions are connected so as to fill up the entire circumference of first cylindrical surface  20   a.  As illustrated in  FIG. 24A , an image with a large width (a large number of pixels) in the longitudinal direction is applied as panoramic image  80   h.  Then, zoom projection section  13  projects panoramic image  80   h  of first cylindrical surface  20   a  onto second cylindrical surface  30   a,  using central point O of first cylindrical surface  20   a  as a projection point of view. Since panoramic image  80   h  before projection has a large width in the longitudinal direction, a portion of the upper side or the lower side of panoramic image  80   h  is cut and panoramic image  80   h  is projected onto entire first cylindrical surface  20   a.  Therefore, as illustrated in  FIG. 24B , panoramic image  90   h  after projection has a constant width in the longitudinal direction. In panoramic image  90   h,  an enlarged portion has a narrow field of view as if it is zoomed in and a reduced portion has a wide field of view as if it is zoomed out. When the mapping is performed, panoramic image  90   h  after projection can have the same width (vertical direction), regardless of a zoom factor. Therefore, it is possible to change the impression of a displayed image. 
         [0113]      FIG. 25  is a diagram illustrating the relationship between the relative arrangement between first cylindrical surface  20   a  and second cylindrical surface  30   a  and panoramic image  90   h  after zoom projection. In  FIG. 25 , plan views denoted by (a- 1 ) to (a- 6 ) illustrate the first to sixth examples of the relative arrangement, respectively, and in  FIG. 25 , diagrams dented by (b- 1 ) to (b- 6 ) are diagrams illustrating the panoramic images corresponding to the first to sixth examples of the relative arrangement, respectively. 
         [0114]    In the third variation of the zoom projection process, as illustrated in (a- 1 ) to (a- 6 ) of  FIG. 25 , the direction in which the second cylindrical surface  30  is displaced from the center of first cylindrical surface  20   a  is changed in various ways to enlarge or reduce the panoramic image in various directions as illustrated in (b- 1 ) to (b- 6 ) of  FIG. 25 . 
         [0115]      FIGS. 26A to 26C  are plan views illustrating the first to third examples of a method for designating the enlargement direction. In the third variation of the zoom projection process, when the enlargement direction and the magnification are input through input receiving section  14 , it is possible to perform the zoom projection process corresponding to the input enlargement direction and magnification. For example, in the example illustrated in  FIG. 26A , arbitrary point P 1  of panoramic image  80   h  mapped to first cylindrical surface  20   a  and a magnification (which is represented by the length of an arrow in  FIG. 26 ) are input through input receiving section  14 . In this case, as illustrated in  FIGS. 26A to 26C , second cylindrical surface  30   a  is displaced by an amount corresponding to the magnification in the direction including designated point P 1  and the zoom projection process is performed. Therefore, it is possible to obtain panoramic image  90   h  in which the direction of point P 1  is enlarged. 
         [0116]    In the example illustrated in  FIG. 26B , two arbitrary points P 1  and P 2  of panoramic image  80   h  mapped to first cylindrical surface  20   a  and a magnification in each direction are input through input receiving section  14 . In this case, as illustrated in  FIG. 26B , second cylindrical surface  30   a  is displaced in the direction in which two vectors v 1  and v 2  based on the inputs in two directions are synthesized and with the length of the vectors and the zoom projection process is performed. Therefore, it is possible to obtain panoramic image  90   h  in which two designated directions are enlarged. Vectors v 1  and v 2  are defined so as to indicate the directions of designated points P 1  and P 2  and a length corresponding to each designated magnification. 
         [0117]    In the example illustrated in  FIG. 26C , two arbitrary points P 1  and P 2  of panoramic image  80   h  and a magnification in each direction are input through input receiving section  14 , similarly to the example illustrated in  FIG. 26B . In this example, the cross-sectional shape of second cylindrical surface  30   a  is not limited to a circular shape, but second cylindrical surface  30   a  swells so as to be away from central point O only in the designated enlargement direction. However, the length of the entire circumference of second cylindrical surface  30   a  is limited so as not to be changed. When second cylindrical surface  30   a  is configured in this way and the zoom projection process is performed, it is possible to obtain panoramic image  90   h  in which a plurality of designated enlargement directions are partially enlarged. In this example, the length of the entire circumference of second cylindrical surface  30   a  is limited so as not to be changed. However, when the length of the entire circumference is changed, a panoramic screen may be standardized such that the length thereof in the horizontal direction is n times (n=2, 3, 4, . . . ). During display, a panoramic image may be divided into images with a length of 1/n and the divided images may be output to the screen (see  FIGS. 28A to 28C ). 
         [0118]    [Variation of Display of Panoramic Image] 
         [0119]      FIG. 27  illustrates a display example in which a scale indicating a magnification in each viewing direction is added to a panoramic image. 
         [0120]    When a plurality of directions of panoramic image  90   h  are partially enlarged, as illustrated in  FIG. 27 , scale display (magnification display image)  98  indicating the magnification of panoramic image  90   h  in each viewing direction may be added and panoramic image  90   h  may be displayed. Scale display  98  enables the viewer to intuitively understand an enlarged portion and a reduced portion. 
         [0121]    Scale display portion  98  indicates a magnification in each viewing direction using the display of scales and the scale interval is proportional to the magnification at a corresponding position. Scale display portion  98  is performed by adding scale images to the panoramic image before zoom projection at regular intervals and zooming and projecting the panoramic image for each scale image. In addition, the scale display may be configured such that the magnification is indicated by, for example, the gradation of a color (for example, a color closer to red indicates a higher magnification and a color closer to blue indicates a lower magnification) or color density. 
         [0122]      FIGS. 28A to 28C  are conceptual diagrams respectively illustrating the first to third display examples of a panoramic image. First, as described with reference to  FIG. 17 , the panoramic image is a horizontally long image. Therefore, image output section  16  may cut the panoramic image into a plurality of parts with an equal length in the lateral direction along cutout lines which extend in the longitudinal direction and may display the cut parts in a plurality of stages. In  FIGS. 28A to 28C , a panoramic image in which 360-degree images are connected to each other is divided into two image blocks  101  and  102  or three or more image blocks  111  to  113  and the divided image blocks are displayed in a plurality of stages. The left end and the right end of each of image blocks  101  and  102  or image blocks  111  to  113  are connected to the left end or the right end of the other corresponding image block  101  and  102  or the other image blocks  111  to  113  represented by dotted arrows in  FIGS. 28A to 28C . The display in a plurality of stages makes it possible to effectively use display frame  17 A of display  17 . 
         [0123]    Image output section  16  can slightly shift the cutting position of the panoramic image in the lateral direction to perform continuous display, thereby revolving (rolling) the display of the panoramic image in a plurality of stages in the lateral direction, as illustrated in  FIGS. 28A to 28C . In the display example illustrated in  FIG. 28A , two image blocks  101  and  102  are moved in the same rolling direction. In the display example illustrated in  FIG. 28B , second image block  102  is reversed in the horizontal direction or in the vertical direction and the horizontal direction such that the first and the image blocks are moved in the opposite rolling direction. As such, since the panoramic image includes image block  102  which is reversed in the horizontal direction, continuous portions of the image are arranged close to each other at the left end and the right end of each of image blocks  101  and  102 . Therefore, it is easy for the viewer to imagine how panoramic images are connected in a cylindrical shape. In the display example illustrated in  FIG. 28C , second image block  112  is reversed in the horizontal direction or in the vertical direction and the horizontal direction, the rolling directions of the first and second image blocks and the rolling directions of the second and third image blocks are reversed, and the images are moved in the reversed rolling direction. Likewise, it is possible to roll the images in the three-stage display configuration. 
         [0124]    In this variation, image output section  16  performs the process of cutting the image for the panoramic image supplied from zoom projection section  13 , arranges cut image blocks  101  and  102  or image blocks  111  to  113  in a plurality of stages, and generates display data. Therefore, it is possible to display the panoramic image illustrated in  FIGS. 28A to 28C . 
         [0125]    [Example of Cooperation between Object Tracking Function and Panoramic Image Enlargement/Reduction Function] 
         [0126]      FIGS. 29A and 29B ,  31 A and  31 B, and  32 A and  32 B are diagrams illustrating an example of the cooperation between an object tracking function and a panoramic image enlargement/reduction function.  FIGS. 29A and 29B  are diagrams respectively illustrating a plurality of panoramic images  120   a  and  120   b  which are periodically acquired by the object tracking function (times t 1  and t 2 ).  FIGS. 30A and 30B  are diagrams respectively illustrating a plurality of panoramic images  121   a  and  121   b  after a zoom projection process used with the object tracking function.  FIGS. 31A and 31B  are diagrams respectively illustrating display examples  122   a  and  122   b  of a plurality of panoramic images when the object tracking function is used. 
         [0127]    The object tracking function designates a specific object (for example, a person) in a captured image as a tracking object, searches for the designated tracking object from another captured image, and detects the position of the designated tracking object. In order to search for the tracking object, an arithmetic processing apparatus performs pattern recognition for the color or shape of the tracking object and compares each portion of a captured image, which is a search target, with the pattern of the tracking object. Then, the position of a portion of the image with the identical pattern is output as the position of the tracking object. 
         [0128]    In this embodiment, the object tracking function is added to zoom projection section  13  and input receiving section  14  can be used to designate an arbitrary object in one captured image as the tracking object. The object tracking function is not necessarily provided in zoom projection section  13 , and can be implemented by a method which receives the captured image output from imaging section  11  and inputs the position of the tracking object in the image to input receiving section  14 . 
         [0129]    Zoom projection section  13  receives a plurality of panoramic images  120   a  and  120   b  which are periodically obtained by imaging section  11 , searches for the designated tracking object (in this embodiment, portrait G), and detects the position of the designated tracking object. When the position of the tracking object is detected, zoom projection section  13  rolls panoramic images  120   a  and  120   b  such that the position is substantially at the center. Then, zoom projection section  13  performs the zoom projection process such that the center is enlarged and generates panoramic images  121   a  and  121   b  illustrated in  FIGS. 30A and 30B . Then, zoom projection section  13  outputs image data for the panoramic images to image output section  16 . 
         [0130]    Image output section  16  divides each of panoramic images  121   a  and  121   b  into two parts, generates display data for the divided parts, and outputs the display data to display  17 . In this way, as illustrated in  FIGS. 31A and 31B , display examples  122   a  and  122   b  of the two-stage panoramic image in which portrait which is a tracking target, is enlarged at the upper center are obtained. 
         [0131]    Since the object tracking process and the panoramic image enlargement process are continuously performed for a plurality of panoramic images which are continuously captured, image display can be performed in which a moving tracking object is displayed substantially at a constant position and the background is moved with the movement of the tracking object. 
         [0132]    [Variation of Panoramic Image Enlargement/Reduction Process] 
         [0133]    In the above-described embodiment, the panoramic image is enlarged or reduced by the zoom projection process such that the magnification is continuous in all directions) (360°). However, the method for enlarging or reducing the panoramic image is not limited to the zoom projection process. For example, the enlargement/reduction method can be implemented by an image conversion process of the following arithmetic processing apparatus. 
         [0134]      FIGS. 32A and 32B  to  37  are diagrams illustrating variations of the panoramic image enlargement/reduction process.  FIG. 32A  is a diagram illustrating a panoramic image before the enlargement/reduction process.  FIG. 32B  is a graph illustrating a magnification in each viewing direction.  FIG. 33  is a conceptual diagram illustrating an enlargement/reduction process in the longitudinal direction in this variation.  FIG. 34  is a diagram illustrating a panoramic image after the enlargement/reduction process in the longitudinal direction. 
         [0135]    In this variation, first, as illustrated in  FIGS. 32A and 32B , the magnification of panoramic image  130  obtained by imaging section  11  in each viewing direction is designated. The magnification is set so as not to be discontinuous in the range in which the viewing direction is continuous. Since the left end and the right end of panoramic image  130  are aligned in the same viewing direction, the magnification is set such that the magnification of the left end is equal to that of the right end. Data for the magnification in each viewing direction is stored as function data or table data in, for example, zoom projection setting section  15  and zoom projection setting section  15  appropriately selects the data on the basis of the enlargement direction and magnification designated by the user. 
         [0136]    When the magnification is designated, the arithmetic processing apparatus performs an image conversion process of extending or reducing each one of rows of pixels  131   a  to  131   c  of panoramic image  130  at the designated magnification in the longitudinal direction to obtain new pixels, as illustrated in  FIG. 33 . When the number of pixels in the longitudinal direction is greater than a predetermined value due to the extension or reduction process, the arithmetic processing apparatus trims an extra number of pixels. When the number of pixels in the longitudinal direction is less than the predetermined value, the arithmetic processing apparatus adds, for example, predetermined color pixels to make up a deficiency. 
         [0137]    The enlargement/reduction process in the longitudinal direction is performed to enlarge or reduce original panoramic image  130  at the designated magnification in the longitudinal direction, thereby obtaining panoramic image  132 , as illustrated in  FIG. 34 . 
         [0138]      FIG. 35A  is a diagram illustrating a panoramic image before an enlargement/reduction process in a lateral direction and  FIG. 35B  is a graph illustrating a magnification in each viewing direction.  FIG. 36  is a conceptual diagram illustrating the enlargement/reduction process in the lateral direction.  FIG. 37  is a diagram illustrating a panoramic image after the enlargement/reduction process in the longitudinal and lateral directions. 
         [0139]    When the enlargement/reduction process in the longitudinal direction is performed, the arithmetic processing apparatus performs an image conversion process of enlarging or reducing panoramic image  132  in the lateral direction. The magnification in each viewing direction which is used in the enlargement/reduction process in the longitudinal direction is also used in the enlargement/reduction process in the lateral direction, as illustrated in  FIG. 35B . 
         [0140]    In the enlargement/reduction process in the lateral direction, as illustrated in  FIG. 36 , for all rows of pixels  133   a  to  133   a  and  133   b  to  133   b  of panoramic image  132 , the arithmetic processing apparatus performs an image conversion process of reducing rows of pixels  133   a  to  133   a  at the designated magnification in the lateral direction to obtain new rows of pixels  134   a  and  134   a  and an image conversion process of enlarging rows of pixels  133   b  to  133   b  at the designated magnification to obtain new rows of pixels  134   b  to  134   b.  Here, the enlargement and/or the reduction are performed in the order of the longitudinal direction and the lateral direction. However, the enlargement and the reduction may be performed in the longitudinal direction and the lateral direction at the same time. 
         [0141]    The enlargement/reduction process in the lateral direction makes it possible to obtain panoramic image  135  which is enlarged or reduced at the designated magnification in the longitudinal direction and the lateral direction, on the basis of panoramic image  132  which is enlarged or reduced only in the longitudinal direction, as illustrated in  FIG. 37 . In the enlargement/reduction process, it is also possible to obtain panoramic image  135  which is enlarged or reduced in the longitudinal direction and the lateral direction in a continuous magnification in the range in which the viewing direction is continuous. In addition, the continuous magnifications of the left end and the right end where panoramic image  135  is cut are equal to each other. 
         [0142]    As described above, according to the camera of the above-described embodiment and the image conversion apparatus thereof (zoom projection section  13 , input receiving section  14 , zoom projection setting section  15 , and image output section  16 ), it is possible to continuously enlarge or reduce the entire panoramic image, which includes the images captured in each viewing direction in one turn, at different magnifications in each viewing direction. In addition, the magnification is continuous in the range in which the viewing direction is continuous. Therefore, it is possible to enlarge the point of interest in the panoramic image and display the panoramic image using the function of enlarging or reducing the panoramic image. In addition, the viewer can easily connect the enlarged or reduced panoramic images in a cylindrical shape in the head and imagine a perspective of the entire circumference. 
         [0143]    According to the camera of the above-described embodiment and the image conversion configuration thereof, it is possible to easily generate a panoramic image which is naturally and smoothly enlarged or reduced, using the process of zoom projection section  13  that projects a panoramic image from a cylindrical surface to another cylindrical surface. 
         [0144]    In the above-described embodiment, the camera includes imaging section  11  and display  17 . However, an image conversion apparatus including zoom projection section  13 , input receiving section  14 , zoom projection setting section  15 , and image output section  16  may be separately provided. 
         [0145]    In the above-described embodiment, the standard projection section is used to position a desired area in the vicinity of the center of the screen and the zoom projection section is used to enlarge the desired area. However, the process of the standard projection section may not be performed and only the process of the zoom projection section may be performed to enlarge the desired area. 
         [0146]    In the above-described embodiment, the standard projection section and the zoom projection section are used to perform projection in two stages. However, a projection surface capable of implementing the standard projection section and the zoom projection section at a time may be used. Specifically, for example, it is possible to perform both positioning and zooming at a time by moving up and down cylinder  20 A illustrated in FIG.  14  depending on the height of the line of sight, and inclining cylinder  20 A depending on the inclination of the horizontal direction. 
         [0147]    In the above-described embodiment, an input image is a 360-degree panoramic image. However, the image which is input and then subjected to the zoom process is not limited to the 360-degree image. For example, the invention can be applied to a 270-degree wide-angle image, a 180-degree wide-angle image, a 120-degree wide-angle image, and wide-angle images captured at other angles. 
         [0148]    An example in which the input image is a 270-degree wide-angle image will be described. In this example, the same process as that performed for the panoramic image is performed for the input 270-degree wide-angle image before processing except that the 270-degree wide-angle image replaces the panoramic image on first cylindrical surface  20  illustrated in  FIG. 14 . When the standard projection process is performed, a wide-angle image before processing may be mapped to cylindrical surface  40  illustrated in  FIG. 2 . As such, it is possible to zoom in a necessary portion while maintaining (displaying) the range of 270 degrees, which is the entire range of the input image in the horizontal direction. 
         [0149]    However, since the range of the input image is 270 degrees, the image is continuous from 0 degree to 270 degrees, but a portion from 270 degrees to 0 degree is not continuous. This is the characteristics of the input image, and is not due to the characteristics of the process. 
         [0150]    As such, according to the invention, it is possible to zoom in a necessary portion while maintaining (displaying) the entire range of an input wide-angle image in the horizontal direction, and it is possible to enlarge a portion and display the enlarged portion while understanding the entire image. Therefore, understanding of the entire image and recognition of a detailed portion are possible at the same time, which in turn results in significant convenience. 
         [0151]    The components described in the above embodiment including standard projection section  12 , zoom projection section  13 , zoom projection setting section  15 , and image output section  16  may be formed by hardware. In addition, these components may be formed by software which is implemented by the execution of a program by a computer. The program may be recorded on a computer-readable recording medium. The recording medium may be a non-transitory recording medium such as a flash memory. 
         [0152]    The disclosure of Japanese Patent Application No. 2011-144116, filed on Jun. 29, 2011, including the specification. drawings and abstract, is incorporated herein by reference in its entirety. 
       INDUSTRIAL APPLICABILITY  
       [0153]    The invention can be appropriately applied to image input apparatuses such as still cameras and video cameras, or image processing apparatuses. 
       Reference Signs List 
       [0000]    
       
           11  Imaging section 
           13  Zoom projection section 
           14  Input receiving section 
           15  Zoom projection setting section 
           16  Image output section 
           17  Display 
           20 ,  20   a  First cylindrical surface 
           30 ,  30   a  Second cylindrical surface 
           70 ,  80 ,  80   h,    90 ,  90   a,    90   b,    90   h,    130 ,  132 ,  135  Panoramic image 
           98  Scale display (magnification display image)