Image management system, image management method, and program

An image management system includes a reception unit and transmission unit. The reception unit receives, from a first communication terminal, link information that is transmitted from the image management system and is managed in a link information management system. The transmission unit transmits, to the first communication terminal, a view script and image data corresponding to the link information. The image data is received from a second communication terminal.

FIELD

The present invention relates to an image management system, an image management method, and a program.

BACKGROUND

Recently, a special digital camera to obtain a 360° full-spherical panoramic image with one-time capturing has been provided (see Patent Literature 1).

In addition, when a subject is a real estate property or the like, it is convenient for a user who looks for a property using the internet if it is possible to view a full-spherical panoramic image instead of a partial image of the subject. Thus, a service provider who provides property information to the user has a need of desiring to provide the full-spherical panoramic image to the user looking for the property in order to achieve differentiation from other service providers.

SUMMARY

Technical Problem

However, an application configured to view a specific image, such as the full-spherical panoramic image, is not necessarily installed in a communication terminal of the user. Thus, there occurs a problem that it is difficult to achieve the differentiation from other service providers even when the service provider constructs the system capable of providing the specific image unless the specific image can be viewed on the user side.

Solution to Problem

The invention according to claim1provides an image management system that communicates with a first communication terminal via a communication network and includes an image storing unit that stores therein image data and a view script for viewing of the image data; a reception unit that receives, from the first communication terminal, link information including image identification information for identifying the image data; and a transmission unit that transmits, to the first communication terminal, the view script and the image data specified by the image identification information included in the link information received by the reception unit.

Advantageous Effects of Invention

According to the present invention, the user of the communication terminal can view the specific image even if the application configured to view the specific image is not installed at the communication terminal. Accordingly, the service provider can improve the service to the user, and thus, can achieve an effect that it is possible to achieve the differentiation from other service providers.

DESCRIPTION OF EMBODIMENTS

Overview of Embodiment

First, the outline of the present embodiment will be described with reference toFIGS. 1 to 15.FIG. 1is a schematic diagram of an image sharing system according to the present embodiment.

As illustrated inFIG. 1, the image sharing system according to the present embodiment includes a capturing device1, a plurality of communication terminals (3a,3b), an image management system5, and a link information management system7. The communication terminals (3a,3b) are used by users (A, B), respectively. In addition, the present embodiment illustrates a case where the capturing device1is operated by the user A. Incidentally, an arbitrary communication terminal of the plurality of communication terminals (3a,3b) will be referred to as a “communication terminal3”, hereinafter. The image management system5is managed by an administrator X. The link information management system7is managed by an administrator Y. For example, the user A corresponds to each realtor in a certain area. The user B corresponds to a general user who looks for a target property for purchase, trade, lease or the like of a real estate property. The administrator X is a provider of an image (full-spherical panoramic image) in the image sharing system who provides, to the user B, image data acquired from the user A. The administrator Y is a service provider of real estate information who provides property information to the user B via a communication network9such as the internet.

In addition, the capturing device1is a digital camera configured to obtain the full-spherical (360°) panoramic image. The capturing device1may be a general digital camera, or the communication terminal3may be a digital camera in a case where a camera is attached to the communication terminal3. In the present embodiment, the capturing device1will be described as the digital camera configured to obtain the full-spherical panoramic image in order to facilitate the description. The communication terminal3is a computer such as a smartphone, a tablet terminal, a notebook-type personal computer, a desktop-type personal computer, and a personal data assistance (PDA). Herein, the communication terminal3ais expressed as the smartphone, and the communication terminal3bis expressed as a notebook personal computer (PC), for example. Further, the image management system5and the link information management system7are server computers.

In addition, the capturing device1can communicate with the communication terminal3according to a short-range wireless technology such as a near field communication (NFC) standard, BlueTooth (registered trademark), and wireless fidelity (WiFi). Further, the communication terminal3can communicate with the image management system5and the link information management system7via the communication network9. The communication network9is constructed using: wireless communication network such as 3rd generation (3G), worldwide interoperability for microwave access (WiMAX), and long term evolution (LTE); respective base stations (9a,9b); and the Internet. Wired-communication may be performed between the capturing device1and the communication terminal3, and between the communication terminal3and the communication network9.

The communication terminal3ais an example of a second communication terminal, and the communication terminal3bis an example of a first communication terminal.

Next, the exterior of the capturing device1will be described with reference toFIGS. 2-1 to 2-3.FIG. 2-1is a left side view of the capturing device,FIG. 2-2is a front view of the capturing device, andFIG. 2-3is a plan view of the capturing device.

As illustrated inFIG. 2-1, the capturing device1has a size of being held by one hand of a man. In addition, an imaging element103ais provided on a front surface side (front side) and an imaging element103bis provided on a back surface side (rear side) in an upper part of the capturing device1as illustrated inFIGS. 2-1, 2-2, and 2-3. In addition, an operation unit115such as a shutter button is provided on the front surface side of the capturing device1as illustrated inFIG. 2-2.

Next, a use status of the capturing device1will be described with reference toFIG. 3.FIG. 3is a use image view of the capturing device. The capturing device1is used to capture a subject around a user by being held by the user's hand as illustrated inFIG. 3. In this case, each of the imaging element103aand the imaging element103billustrated inFIGS. 2-1 to 2-3images the subject around the user, thereby obtaining two hemispheric images.

Next, a description will be given regarding images captured by the capturing device1and a composite image thereof with reference toFIGS. 4-1 to 4-3.FIG. 4-1is a view illustrating a hemispheric image (the front side) captured by the capturing device,FIG. 4-2is a view illustrating a hemispheric image (the rear side) captured by the capturing device, andFIG. 4-3is a view illustrating an image expressed by Mercator projection (hereinafter, referred to as an “Mercator image”).

As illustrated inFIG. 4-1, the image obtained by the imaging element103abecomes the hemispheric image (the front side) curved by a fisheye lens102ato be described later. In addition, the image obtained by the imaging element103bbecomes the hemispheric image (the rear side) curved by a fisheye lens102bto be described later as illustrated inFIG. 4-2. Further, the hemispheric image (the front side), and the hemispheric image (the rear side) inverted by 180 degrees are composed by the capturing device1, whereby the Mercator image is created as illustrated inFIG. 4-3.

Next, a description will be given regarding data of a sharing selection image to be transmitted to the communication terminal3from the capturing 1 with reference toFIGS. 5-1, 5-2 and 6.FIG. 5-1is a view illustrating the image expressed by the Mercator projection including, as a part, a sharing selection image, andFIG. 5-2is a view illustrating the sharing selection image. In addition,FIG. 6is a view of a captured image selection list illustrating the sharing selection image.

The sharing selection image data as illustrated inFIG. 5-2is created by the capturing device1using the part indicated by a broken line on the Mercator image illustrated inFIG. 5-1. The sharing selection image data is transmitted from the capturing device1to the communication terminal3a. Further, a sharing image selection list SL showing each sharing selection image CE is displayed on a display315of the communication terminal3aas illustrated inFIG. 6. For example, a building in a commercial district is displayed as the sharing selection image CE, and a date and time (11:21, Sep. 20, 2011) on which an original image of the sharing selection image CE (the captured image illustrated inFIG. 5-1) is captured is displayed.

Next, the outline of a process of registering and acquiring image data according to the present embodiment will be described with reference toFIGS. 6 to 14.FIG. 6is the view of the captured image selection list showing the sharing selection images. In addition,FIG. 7is a diagram illustrating the process of registering and acquiring image data.FIG. 7illustrates a state where browsing software of a full-spherical panoramic image is installed in the communication terminal3a, but is not installed in the communication terminal3b.

First, when the user A selects the desired sharing selection image CE illustrated inFIG. 6, the communication terminal3aacquires, from the capturing device1, the original image (captured image) of the sharing selection image CE selected as above (Step S1). Further, the communication terminal3auses open graphics library for embedded systems (OpenGL ES) to create a full-spherical panoramic image as illustrated inFIG. 8from the captured image (the Mercator image) illustrated inFIG. 5-1(Step S2). The OpenGL ES is a graphics library which is used to visualize 2-dimensions (2D) and 3-dimensions (3D) data.FIG. 8is a view illustrating a full-spherical panoramic image. The full-spherical panoramic image may be a still image or a moving image. For example, the full-spherical panoramic image as illustrated inFIG. 8is created by pasting the Mercator image illustrated inFIG. 5-1on a stereo sphere.

Next, a description will be given regarding a process of creating and displaying an image of a predetermined area (hereinafter, referred to as a “predetermined area image”) in the full-spherical panoramic image with reference toFIGS. 7, 9, 10-1 and 10-2.FIG. 9is a view illustrating positions of a virtual camera and the predetermined area when the full-spherical panoramic image is formed in a three-dimensional sphere. A virtual camera IC corresponds to a position of a viewpoint of the user who views the image with respect to the full-spherical panoramic image displayed as the three-dimensional sphere.FIG. 10-1is a stereoscopic view ofFIG. 9, andFIG. 10-2is a view illustrating the communication terminal with the display on which the predetermined area image is displayed. The full-spherical panoramic image illustrated inFIG. 8is expressed using a three-dimensional stereo sphere CS. When the full-spherical panoramic image generated in this manner is assumed to be the stereo sphere CS, the virtual camera IC is positioned at a center of the full-spherical panoramic image as illustrated inFIG. 9and can perform upward, downward, rightward, and leftward rotation from the center and three-axis rotation of rotation (ROLL) from the viewpoint of the center. A predetermined area T in the full-spherical panoramic image is specified by predetermined area information on the position of the virtual camera IC in the full-spherical panoramic image. The predetermined area information is represented by a coordinate x (rH), a coordinate y (rV), and an angle of view α (angle). In addition, zooming of the predetermined area T can be expressed by widening or narrowing a range (arc) of the angle of view α.

Further, the image of the predetermined area T in the full-spherical panoramic image as illustrated inFIG. 10-1is displayed on the display315of the communication terminal3aas the predetermined area image as illustrated inFIG. 10-2. In this case, the predetermined area image is a partial image P0which is a part of the full-spherical panoramic image. The partial image P0is an image expressed using predetermined area information (x, y, α)=(0, 0, 34) of initial setting (default) in the full-spherical panoramic image illustrated inFIG. 8.

Displayed on the display315A are an image display area3110to display the predetermined area image, a thumbnail display area3120to display a thumbnail of the predetermined area image, a comment display area3130to display a property name, a name of the user A, and the like.

Next, when the user A desires to display a predetermined area image of an interest on the display315, if the communication terminal3acan be operated using a touch panel, the desired predetermined area image as illustrated inFIG. 11can be displayed by moving a finger up, down, right, and left while touching the display315with the finger. In addition, if the communication terminal3ais a personal computer or the like, the desired predetermined area image as illustrated inFIG. 11can be displayed by performing input operation using a mouse or the like and moving the mouse up, down, right, and left. The predetermined area image in this case is a partial image P1which is a part of the full-spherical panoramic image.

Herein, a relationship between the predetermined area information and the predetermined area image will be described with reference toFIG. 12.FIG. 12is a diagram illustrating the relationship between the predetermined area information and the predetermined area image.

As illustrated inFIG. 12, a center point CP in the case of a diagonal view angle2L of the predetermined area T expressed using the angle of view a of the virtual camera IC serves as a (x, y) parameter of the predetermined area information. In the present embodiment, when the user A operates the display315while touching the display with the finger to cause the predetermined area image (the partial image P1) as illustrated inFIG. 11to be shown, for example, the predetermined area information (x, y, α)=(230, 439, 35) is obtained.

In addition, f represents a distance between the virtual camera IC and the center point CP. InFIG. 12A, a trigonometric function expressed by the following Formula (1) is generally established.
Lf=tan(α/2)  (Formula 1)

Next, as illustrated inFIG. 7, the communication terminal3atransmits image data and related information to the image management system5via the communication network9, and then, also transmits the predetermined area information (Step S3). This image data is the Mercator image illustrated inFIG. 4-3. The related information is information relating to a property, for example, a property name, price, area, a dwelling year, address, and the like. The predetermined area information is predetermined area information (x=230, y=439, α=35) representing the predetermined area image (partial image P1) illustrated inFIG. 11. Accordingly, the image management system5assigns, to the image data, image identification (ID) for identifying the image data and manages the image data and the image ID in an associated manner (Step S4). Further, the image management system5creates link information (Step S4). This link information includes a URL of the image management system5, the image ID, and the predetermined area information as illustrated inFIG. 13. Furthermore, the image management system5creates thumbnail data of the image data (Step S4). The URL is an example of specific information. In addition, the image management system5manages a view script. This view script is a program capable of causing a special image to be displayed even in a browser which is not compatible with JavaScript (registered trademark) or restricts a function in order to enhance appearance of the special image and operability according to recent Web service. In the present embodiment, the full-spherical panoramic image is used as an example of the special image.

Next, the image management system5transmits the link information and the thumbnail data to the link information management system7(Step S5). In response to this, the link information management system7manages the link information, the thumbnail data, and the related information in an associated manner (Step S6). Not only the related information but also a related image is managed in an associated manner. The related image includes a floor plan of the property. The floor plan is created by the user A or the administrator Y. For example, when the user A creates the floor plan, data of the floor plan is provided to the administrator Y by the user A. As a providing method, the related image is provided together with the related information through the image management system5using an electronic mail or the image sharing system.

Further, when the communication terminal3bof the user B is connected to the link information management system7and requests display of a property details screen, the link information management system7transmits the related information, the link information, and the thumbnail data to the communication terminal3bof the user B (Step S7).

In this case, a property details screen3200as illustrated inFIG. 14is displayed in the communication terminal3b. User personal information (herein, a “realtor name”, “address” and “a phone number” of the realtor)3210aand related information3210bof a property, a floor plan3220as a related image of the property, a display area3230of a full-spherical panoramic image, a thumbnail display area3240, and a plurality of thumbnails (3240a,3240b,3240c) of the single property are displayed on the property details screen3200. That is, each of the thumbnails (3240a,3240b,3240c) is an image obtained by downsizing the predetermined area image (the partial image P1) illustrated inFIG. 11, and is not an image obtained by downsizing the predetermined area image (the partial image P0) illustrated inFIG. 10-2.

Next, when the user B operates the communication terminal3band selects a desired thumbnail (herein, the thumbnail3240a), the communication terminal3btransmits the link information to the image management system5(Step S8). In response to this, the image management system5transmits the image data corresponding to the image ID extracted from the link information, the predetermined area information extracted from the link information, and the view script to the communication terminal3b(Step S9). Further, a process of specifying the predetermined area T in the image data using the view script is performed in the communication terminal3b. Accordingly, not the full-spherical panoramic image as illustrated inFIG. 8but the predetermined area image in the full-spherical panoramic image is displayed in the communication terminal3bas illustrated in the display area3230of the full-spherical panoramic image inFIG. 15.

<<Hardware Configuration of Embodiment>>

Next, hardware configurations of the capturing device, the communication terminal, and the image management system will be described in detail with reference toFIGS. 16 to 18.

First, the hardware configuration of the capturing device1will be described with reference toFIG. 16. Incidentally,FIG. 16is a hardware configuration view of the capturing device. Hereinafter, the capturing device1is assumed to be an omnidirectional capturing device which uses two imaging elements, but the number of imaging elements may be another value of three or more. In addition, the capturing device1is not necessarily a device dedicated for omnidirectional capturing, and a retrofit omnidirectional capturing unit may be attached to a general digital camera or smartphone to have substantially the same function as the capturing device1.

As illustrated inFIG. 16, the capturing device1is configured of an imaging unit101, an image processing unit104, an imaging control unit105, a CPU (central processing unit)111, a ROM (read only memory)112, an SRAM (static random access memory)113, a DRAM (dynamic random access memory)114, the operation unit115, a network I/F116, a communication unit117, an antenna117a, and an electronic compass118.

Among these, the imaging unit101includes wide-angle lenses (so-called fisheye lens)102aand102bhaving an angle of view of 180° or more to image each hemispheric image, and the two imaging elements103aand103bwhich are provided in response to the wide-angle lenses, respectively. The imaging elements103aand103binclude an image sensor, such as a CMOS (complementary metal oxide semiconductor) sensor and a CCD (charge coupled device) sensor, which converts an optical image obtained by the fisheye lens into image data of an electrical signal and outputs the converted data, a timing generation circuit which generates a horizontal or vertical synchronization signal and a pixel clock of the image sensor, a register group in which various commands and parameters required for operation of the imaging element are set, and the like.

Each of the imaging elements103aand103bof the imaging unit101is connected to an image processing unit104via a parallel I/F bus. Meanwhile, the imaging elements103aand103bof the imaging unit101are connected to the imaging control unit105via another serial I/F bus (an I2C bus or the like). The image processing unit104and the imaging control unit105are connected to the CPU111via a bus110. Further, the bus110is also connected with the ROM112, the SRAM113, the DRAM114, the operation unit115, the network I/F116, the communication unit117, the electronic compass118, and the like.

The image processing unit104takes the image data output from the imaging elements103aand103bvia the parallel I/F bus, performs predetermined processing on the respective image data, and then, creates data of the Mercator image as illustrated inFIG. 4-3by a process of composing these image data.

The imaging control unit105sets the command and the like to the register groups of the imaging elements103aand103busing the imaging control unit105as a master device and the imaging elements103aand103bas slave devices, and using the I2C bus. The necessary command or the like is received from the CPU111. In addition, the imaging control unit105takes status data of the register groups of the imaging elements103aand103bsimilarly using the I2C bus and transmits the data to the CPU111.

In addition, the imaging control unit105instructs the imaging elements103aand103bto output the image data at a timing at which a shutter button of the operation unit115is pressed. Depending on capturing devices, there is also a case of including a preview display function using a display or a function corresponding to moving image display. In this case, the output of the image data from the imaging elements103aand103bis continuously performed at a predetermined frame rate (frames/minute).

In addition, the imaging control unit105also functions as a synchronization control unit which obtains synchronization of output timings of the image data of the imaging elements103aand103bin cooperation with the CPU111as will be described later. Incidentally, the capturing device1is not provided with a display unit in the present embodiment, but may be provided with the display unit.

The CPU111controls the overall operation of the capturing device1and executes a required process. The ROM112stores various programs for the CPU111. The SRAM113and the DRAM114are work memories, and store a program to be executed by the CPU111, data in the middle of being processed, and the like. In particular, the DRAM114stores image data in the middle of being processed by the image processing unit104and data of a processed Mercator image.

The operation unit115is a generic term of various types of operation buttons, a power switch, a shutter button, and a touch panel having both functions of a display and operation. The user inputs various capturing modes, capturing conditions, and the like by operating the operation button.

The network I/F116is a generic term of interface circuits (USB I/F and the like) between externally-attached media such as an SD card and a personal computer and the like. In addition, it is also considered a case where any wired or wireless network interface is given as the network I/F116regardless. The Mercator image data stored in the DRAM114is recorded in the externally-attached media via the network I/F116or transmitted to an external device such as the communication terminal3via the network I/F116serving as the network I/F if necessary.

The communication unit117performs communication with the external device such as the communication terminal3based on the short-range wireless technology, such as WiFi (wireless fidelity) and NFC, via the antenna117aprovided in the capturing device1. The Mercator image data can be also transmitted to the external device such as the communication terminal3using the communication unit117.

The electronic compass118calculates an azimuth and inclination (Roll rotation angle) of the capturing device1based on magnetism of the earth, and outputs azimuth and inclination information. This azimuth and inclination information is an example of metadata according to Exif, and is used for image processing such as image correction of a captured image. The metadata also includes the thumbnail of the image data, the capturing date and time of the image, and data capacity of the image data.

Next, the hardware configuration of the communication terminal3awill be described with reference toFIG. 17. Incidentally,FIG. 17is a hardware configuration view of the communication terminal3ain the case of the smartphone.

As illustrated inFIG. 17, the communication terminal3aincludes a CPU301which controls the overall operation of the communication terminal3a, a ROM302which stores a basic input and output program, a RAM (random access memory)303which is used as a work area of the CPU301, an EEPROM (electrically erasable and programmable rom)304which performs read or write of data according to control of the CPU301, a CMOS sensor305serving as an imaging element which images a subject according to control of the CPU301to obtain image data, an electronic magnetic compass and a gyro compass which detect terrestrial magnetism, various acceleration and azimuth sensors306such as an acceleration sensor, and a media driver308which controls read or write (store) of data with respect to recording media307such as a flash memory. Further, it is configured such that the recording media307to read data that has been already recorded or newly write and store data according to control of the media driver308are attachable and detachable.

Incidentally, an operating system (OS) executed by the CPU301, other programs, and various types of data are stored in the EEPROM304. In addition, a CCD sensor may be used instead of the CMOS sensor305.

Further, the communication terminal3aincludes a voice input unit311which converts voice into a voice signal, a voice output unit312which converts a voice signal into voice, an antenna313a, a communication unit313which performs communication with the nearest base station9aand the like by a wireless communication signal using the antenna313a, a GPS reception unit314which receives a GPS signal including positional information (latitude, longitude, and altitude) of the communication terminal3aby a GPS (global positioning systems) satellite and an IMES (indoor messaging system) serving as an indoor GPS, a display315such as liquid crystal and an organic EL which displays an image of a subject, various icons, and the like, a touch panel316, which is placed on the display315and configured using a pressure sensitive type or an electrostatic type panel, and detects a touch position on the display315according to touch using a finger or a touch pen, and a bus line310such as an address bus and a data bus for electrical connection of the above-described respective units.

Incidentally, the voice input unit311includes a microphone to input voice, and the voice output unit312includes a speaker to output voice.

Next, hardware configurations of the communication terminal3b, the image management system5, and the link information management system7in the case of a notebook PC will be described with reference toFIG. 18. Incidentally,FIG. 18is a hardware configuration view of the communication terminal, the image management system5, and the link information management system7in the case of the notebook PC. Since all the communication terminal3b, the image management system5, and the link information management system7are general computers, the configuration of the image management system5will be described, and the configurations of the communication terminal3band the link information management system7will not be described hereinafter.

The image management system5includes a CPU501which controls the overall operation of the image management system5, a ROM502which stores a program used to drive the CPU501such as an IPL, a RAM503which is used as work area of the CPU501, an HD504which stores various data such as a program of the image management system5, an HDD (hard disk drive)505which controls read or write of various data with respect to the HD504according to control of the CPU501, a media driver507which controls read or write (store) of data with respect to the recording media506such as a flash memory, a display508which displays various types of information such as a cursor, a menu, a window, a letter, an image, and the like, a network I/F509for data communication using the communication network9, a keyboard511including a plurality of keys for input of a letter, a numeric value, various instructions, and the like, a mouse512which performs selection and execution of various instructions, selection of a processing target, movement of a cursor, and the like, a CD-ROM drive514which controls read or write of various data with respect to a CD-ROM (compact disc read only memory)513as an example of a detachable recording media, and a bus line510such as an address bus and a data bus for electrical connection of the above-described respective components as illustrated inFIG. 18.

<<Functional Configuration of Embodiment>>

Next, a functional configuration of the present embodiment will be described with reference toFIG. 19.FIG. 19is each functional block diagram of the communication terminal3, the image management system5, and the link information management system7forming a part of the image sharing system according to the present embodiment. InFIG. 19, the communication terminal3, the image management system5, and the link information management system7can perform data communication via the communication network9.

<Functional Configuration of Communication Terminal>

As illustrated inFIG. 19, the communication terminal3includes a transmitting and receiving unit31, an operational input receiving unit32, a display control unit33, and a storing and reading unit39. These respective units are functions or units which are implemented by any one of the respective components illustrated inFIG. 16that operates depending on a command from the CPU111according to a program for the communication terminal3of the SRAM113loaded on the DRAM114.

In addition, the communication terminal3includes a storage unit3000which is constructed using the ROM112, the SRAM113, and the DRAM114illustrated inFIG. 16.

(Each Functional Configuration of Communication Terminal)

Next, the respective functional configurations of the communication terminal3will be described in more detail with reference toFIGS. 17 and 19.

The transmitting and receiving unit31of the communication terminal3is implemented mainly by processing of the communication unit313and the CPU301illustrated inFIG. 17, and performs transmission and reception of various data (or information) with the image management system5or the link information management system7via the communication network9.

The operational input receiving unit32is implemented mainly by processing of the touch panel316and the CPU301, and receives various types of selection or input from the user.

The display control unit33is implemented mainly by processing of the CPU301, and performs control to display various images, letters and the like on the display315.

The storing and reading unit39stores various data (or information) in the storage unit3000or read the various data (or information) from the storage unit3000.

<Functional Configuration of Image Management System>

Next, each functional configuration of the image management system5will be described in detail with reference toFIGS. 18 and 19. The image management system5includes a transmitting and receiving unit51, an identification information allocating unit52, a thumbnail creating unit53, a link information creating unit54, an extracting unit55, and a storing and reading unit59. These respective units are functions or units which are implemented by any one of the respective components illustrated inFIG. 18that operates depending on a command from the CPU501according to a program for the image management system5of the HD504loaded on the RAM503.

In addition, the image management system5includes a storage unit5000which is constructed by the RAM503and the HD504illustrated inFIG. 18. An image management DB5001configured using an image management table to be described later is constructed in the storage unit5000. A thumbnail management DB5002configured using a thumbnail management table to be described later is constructed in the storage unit5000. Further, the above-described view script is stored in the storage unit5000.

FIG. 20is a conceptual diagram illustrating the image management table. In the image management table, a user ID for identifying a user, an image ID for identifying image data, and a file name of image data are stored and managed in an associated manner. This image data is data of the full-spherical panoramic image. The user ID is an example of user identification information capable of uniquely identifying the user. The user identification information also includes a service use number, an employee number, a student ID number, a national ID number based on a citizen's total numbering system. The image ID is an example of image identification information.

FIG. 21is a conceptual diagram illustrating the thumbnail management table. In this thumbnail management table, a thumbnail ID for identifying a thumbnail, the image ID, and a file name of thumbnail data are stored and managed in an associated manner. The thumbnail ID is an example of thumbnail identification information.

(Each Functional Configuration of Image Management System)

Next, each functional configuration of the image management system5will be described in detail with reference toFIGS. 18 and 19.

The transmitting and receiving unit51of the image management system5is implemented mainly by processing of the network I/F509and the CPU501illustrated inFIG. 18, and performs transmission and reception of various data (or information) with the communication terminal3or the link information management system7via the communication network9.

The identification information allocating unit52is implemented mainly by processing of the CPU501illustrated inFIG. 18, and allocates the image ID to image data and adds the image ID to a header section of the image data in order to manage the image data of the Mercator image, for example, received by the transmitting and receiving unit51. In addition, the identification information allocating unit52allocates the thumbnail ID to thumbnail data created by the thumbnail creating unit53and adds the thumbnail ID to a header section of the thumbnail data.

The thumbnail creating unit53is implemented mainly by processing of the CPU501illustrated inFIG. 18, and creates the thumbnail data using the predetermined area T in the image data as illustrated inFIGS. 9 to 12based on the image data represented by the image ID received by the transmitting and receiving unit51and the predetermined area T represented by the predetermined area information received by the transmitting and receiving unit51.

The link information creating unit54is implemented mainly by processing of the CPU501illustrated inFIG. 18, and creates the link information illustrated inFIG. 13by linking an URL of the image data represented by the image ID received by the transmitting and receiving unit51, the image ID allocated by the identification information allocating unit52, and the predetermined area information received by the transmitting and receiving unit51.

The extracting unit55is implemented mainly by processing of the CPU501illustrated inFIG. 18, and extracts the image ID and the predetermined area information from the link information received by the transmitting and receiving unit51.

The storing and reading unit59stores various data (or information) in the storage unit5000or read the various data (or information) from the storage unit5000.

<Functional Configuration of Link Information Management System>

Next, the functional configuration of the link information management system7will be described in detail with reference toFIGS. 18 and 19. The link information management system7includes a transmitting and receiving unit71, a screen creating unit72, and a storing and reading unit79. These respective units are functions or means which are implemented by any one of the respective components illustrated inFIG. 18that operates depending on a command from the CPU501according to a program for the link information management system7of the HD504loaded on the RAM503.

In addition, the link information management system7includes a storage unit7000which is constructed by the RAM503and the HD504illustrated inFIG. 18. In this storage unit7000, a user management DB7001configured using a user management table to be described later, an interested party management DB7002configured using an interested party management table, and a property management DB7003configured using a property management table.

FIG. 22is a conceptual diagram illustrating the user management table. In the user management table, the user ID, a password used for user authentication, a user image (image of a store or the like) representing an image of the user, and the user personal information (the name, the address, the phone number, and the like of the user) are managed in an associated manner.

FIG. 23is a conceptual diagram illustrating the property management table. In the property management table, the user ID, the link information, the file name of the thumbnail data, and the above-described related information are managed in associated manner for each property ID. The property ID is an example of property identification information configured to specify the property.

(Each Functional Configuration of Link Information Management System)

Next, each functional configuration of the link information management system7will be described in detail with reference toFIG. 19.

The transmitting and receiving unit71of the link information management system7is implemented mainly by processing of the network I/F509and the CPU501illustrated inFIG. 18, and performs transmission and reception of various data (or information) with the communication terminal3or the image management system5via the communication network9.

The screen creating unit72is implemented mainly by processing of the CPU501illustrated inFIG. 18, and creates the property details screen as illustrated inFIG. 14based on the property management table.

The storing and reading unit79stores various data (or information) such as the image data in the storage unit7000or read the various data (or information) such as the image data from the storage unit7000.

<<Process or Operation of Embodiment>>

Next, a description will be given regarding a process of uploading the image data of the captured image illustrated inFIG. 4-3performed by the user A using the communication terminal3awith reference toFIG. 24.FIG. 24is a sequence diagram illustrating the process of uploading the image data.

Protocol of communication performed among the communication terminal3, the image management system5, and the link information management system7via the communication network9is HTTP communication based on hypertext communication protocol (HTTP). The communication terminal3acorresponds to an HTTP client, and the image management system5and the link information management system7correspond to an HTTP server.

First, the user A takes, from the capturing device1, the image data of the captured image illustrated inFIG. 4-3in the storage unit3000of the communication terminal3a. Further, when the user A selects image data to be uploaded, the operational input receiving unit32of the communication terminal3areceives selection of the image data to be uploaded (Step S11).

Next, the transmitting and receiving unit31of the communication terminal3arequests registration of the image by transmitting the user ID of the user A and the image data to be uploaded to the image management system5via the communication network9(Step S12). Accordingly, the transmitting and receiving unit51of the image management system5receives the user ID and the image data.

Next, the identification information allocating unit52of the image management system5allocates the image ID to the image data received in Step S12and adds the image ID to the header section of the image data (Step S13).

Next, the storing and reading unit59stores and manages the user ID received in Step S12, the file name of the image data, and the image ID allocated in Step S13in the image management table (seeFIG. 20) in an associated manner, and stores and manages the image data in the storage unit5000(Step S14).

Next, the transmitting and receiving unit51performs notification of completion of registration by transmitting the image ID allocated in Step S13to the communication terminal3avia the communication network9(Step S15). Accordingly, the transmitting and receiving unit31of the communication terminal3areceives the image ID. Further, the storing and reading unit39of the communication terminal3astores and manages the image ID (Step S16). When the user A or the user B downloads the image data in this state, the predetermined area image (the partial image Pd as illustrated inFIG. 10-2is displayed on the display315, and it is difficult for the user A or the user B to immediately recognize which image data has been downloaded. Thus, the user A makes the downloaded image data easily understandable through processing in Step S21and its subsequent steps to be described later.

Next, a process of creating and uploading the thumbnail will be described with reference toFIG. 25.FIG. 25is a sequence diagram illustrating the process of creating and uploading the thumbnail.

As illustrated inFIG. 25, the user A selects the image data to be downloaded, whereby the operational input receiving unit32of the communication terminal3areceives selection of the image data to be downloaded in the communication terminal3a(Step S21). Accordingly, the storing and reading unit39reads the image ID of the selected image data from the storage unit3000.

Next, the transmitting and receiving unit31of the communication terminal3arequests the image by transmitting the image ID of the image data to be requested to the image management system5via the communication network9(Step S22). Accordingly, the transmitting and receiving unit51of the image management system5receives the image ID.

Next, the storing and reading unit59of the image management system5searches the image management table (seeFIG. 20) using the image ID received in Step S22as a search key to extract the file name of the corresponding image data, and reads the image data having the file name from the storage unit5000(Step S23).

Next, the transmitting and receiving unit51transmits the image data read in Step S23described above and the image ID received in Step S22described above to the communication terminal3avia the communication network9(Step S24). Accordingly, when the transmitting and receiving unit31of the communication terminal3areceives the image data and the image ID, the download of the image data is completed. In this state, the default predetermined area image (the partial image P0) as illustrated inFIG. 10-2is still displayed in the communication terminal3a.

Further, when the operational input receiving unit32receives the operation of the user A, the display control unit33changes the predetermined area image from the predetermined area image (the partial image Pd as illustrated inFIG. 10-2to the predetermined area image (the partial image P1) as illustrated inFIG. 11in the communication terminal3a(Step S25). At this time, the operational input receiving unit32also receives not only input of the above-described related information from the user A but also a request for setting the predetermined area image illustrated inFIG. 11to the default display (Step S25).

Next, the transmitting and receiving unit31instructs the image management system5to register the link information by transmitting the image ID, the predetermined area information representing the partial image P1, the related information, and the user ID to the image management system5via the communication network9(Step S26). Accordingly, the transmitting and receiving unit51of the image management system5receives the image ID, the predetermined area information representing the partial image P1, the related information, and the user ID.

Next, the storing and reading unit59searches the image management table (seeFIG. 20) using the image ID received in Step S26as a search key to extract the file name of the corresponding image data, and reads the image data having the file name from the storage unit5000based on this file name (Step S27). Further, the thumbnail creating unit53creates the thumbnail data using the predetermined area T in the image data as illustrated inFIGS. 9 to 12based on the image data read in Step S27and the predetermined area T represented by the predetermined area information received in Step S26(Step S28).

Next, the identification information allocating unit52allocates the thumbnail ID to thumbnail data created in Step S28and adds the thumbnail ID to the header section of this thumbnail data (Step S29). Further, the storing and reading unit59performs management by storing the thumbnail ID allocated in Step S29, the image ID received in Step S26described above, and the thumbnail data created in Step S28described above in the thumbnail management table (seeFIG. 21) in an associated manner (Step S30).

Next, the link information creating unit54creates the link information illustrated inFIG. 13by linking the URL of the image data represented by the image ID received in Step S26, the image ID received in Step S26, and the predetermined area information received in Step S26(Step S31).

Next, a process of uploading the thumbnail and the link information will be described with reference toFIG. 26.FIG. 26is a sequence diagram illustrating the process of uploading the thumbnail and the link information.

First, the transmitting and receiving unit51of the image management system5requests registration of the link information in the link information management system7by transmitting the link information created in Step S31described above, and the related information and the user ID received in Step S26described above to the link information management system7via the communication network9(Step S41). Accordingly, the transmitting and receiving unit71of the link information management system7receives the link information, the related information, and the user ID.

Next, the storing and reading unit79of the link information management system7performs the registration (management) by storing the user ID, the link information, and the related information received in Step S41described above for each of the property ID's in the property management table (seeFIG. 23) in an associated manner (Step S42). The related image is created by the user A or the administrator Y, and is associated with the property ID by the storing and reading unit79as described above. In this state, however, the management of the thumbnail data is not performed in the link information management system7. Thus, the transmitting and receiving unit71requests a URL of the thumbnail data by accessing the image management system5specified by the URL included in the link information (Step S43). Accordingly, the transmitting and receiving unit51of the image management system5receives the request of the URL of the thumbnail data.

Next, the transmitting and receiving unit51of the image management system5transmits the URL of the thumbnail data to the link information management system7via the communication network9(Step S44). Accordingly, the transmitting and receiving unit71of the link information management system7receives the URL of the thumbnail data.

Next, the transmitting and receiving unit71of the link information management system7requests the thumbnail data by accessing the image management system5specified by the URL of the thumbnail data (Step S45). Accordingly, the transmitting and receiving unit51of the image management system5receives the request of the thumbnail data.

Next, the transmitting and receiving unit51of the image management system5transmits the thumbnail data to the link information management system7via the communication network9(Step S46). Accordingly, the transmitting and receiving unit71of the link information management system7receives the thumbnail data. Further, the storing and reading unit79adds and stores the file name of the thumbnail data received in Step S46described above in a field section of the file name of the thumbnail data in the property management table (seeFIG. 23) and stores and manages the thumbnail data in the storage unit7000(Step S47).

Next, a process of downloading the image data will be described with reference toFIG. 27.FIG. 27is a sequence diagram illustrating the process of downloading the image data.

First, the operational input receiving unit32of the communication terminal3breceives a request of a property list from the user B, the transmitting and receiving unit31transmits the request of the property list to the link information management system7(Step S51). Accordingly, the transmitting and receiving unit71of the link information management system7receives the request of the property list.

Next, the storing and reading unit79of the link information management system7reads each piece of user personal information (real estate business operator name or the like) from the user management table see (FIG. 22), and reads each of the property ID's, each piece of the related information, and each of the related images from the property management table (seeFIG. 23) (Step S52). Further, the screen creating unit72creates the property list based on the respective data read in Step S52(Step S53). The property ID is embedded for each of the properties in the data of the property list. Thereafter, the transmitting and receiving unit71transmits the data of the property list created in Step S53to the communication terminal3b(Step S54). Accordingly, the transmitting and receiving unit31of the communication terminal3breceives the data of the property list.

Next, the display control unit33displays the property list and receives selection of a desired property from the user B in the communication terminal3b(Step S55). Further, the transmitting and receiving unit31of the communication terminal3btransmits a request of the property details screen to the link information management system7(Step S56). At this time, the transmitting and receiving unit31of the communication terminal3btransmits the property ID of the property for which selection has been received in Step S55. Accordingly, the transmitting and receiving unit71of the link information management system7receives the request of the property details screen together with the property ID.

Next, the screen creating unit72creates the property details screen as illustrated inFIG. 14(Step S57). Herein, a method of creating the property details screen will be described. First, the storing and reading unit79searches the property management table (seeFIG. 23) using the property ID transmitted in Step S56described above as a search key to read the user ID, the link information, the file name of the thumbnail data, the related information, and the related image which correspond to the property ID. In addition, the storing and reading unit79searches the user management table (seeFIG. 22) using the above-described user ID as a search key to read the corresponding user personal information. Further, the screen creating unit72creates the above-described property details screen3200as illustrated inFIG. 14using the link information, the file name of the thumbnail data, the related information and the related image, and the user personal information. The above-described link information is embedded in the thumbnails (3240a,3240b,3240c), and a hyperlink is established.

Next, the transmitting and receiving unit71of the link information management system7transmits data of the property details screen created in Step S57to the communication terminal3bvia the communication network9(Step S58). Accordingly, the transmitting and receiving unit31of the communication terminal3breceives the data of the property details screen. Further, the property details screen as illustrated inFIG. 14is displayed on the display508of the communication terminal3b.

Next, the operational input receiving unit32of the communication terminal3beventually receives selection of the link information by receiving selection of a desired thumbnail from the user B (Step S59).

Next, the transmitting and receiving unit31of the communication terminal3brequests the image data by transmitting the link information selected in Step S59described above to the image management system5(Step S60). Accordingly, the transmitting and receiving unit51of the image management system5receives the link information.

Next, the extracting unit55of the image management system5extracts the image ID and the predetermined area information from the link information received in Step S60described above (Step S61). Further, the storing and reading unit59searches the image management table (seeFIG. 20) using the image ID extracted in Step S61as a search key to extract the corresponding file name of the image data, and reads the image data of the file name from the storage unit5000(Step S62). Further, the storing and reading unit59also reads the view script from the storage unit5000(Step S62).

Next, the transmitting and receiving unit51transmits the image data and the view script read in Step S62and the image ID and the predetermined area information extracted from the link information in Step S61to the communication terminal3bvia the communication network9(Step S63). Accordingly, the transmitting and receiving unit31of the communication terminal3breceives the image data, the view script, the image ID, and the predetermined area information.

Next, the display control unit33of the communication terminal3bactivates the view script received in Step S63, and creates and displays the predetermined area image (the partial image P1) using the predetermined area T in the image data as illustrated inFIG. 15based on the image data and the predetermined area information (Step S64).

Main Effect of Present Embodiment

As described above, the image management system5transmits the view script, configured to view the full-spherical panoramic image, as well as transmits the image data to the communication terminal3baccording to the present embodiment. Accordingly, the user B of the communication terminal3bcan view the full-spherical panoramic image of the property even if an application for viewing of the full-spherical panoramic image is not installed in the communication terminal3b. Accordingly, the administrator Y (service provider) can improve the service with respect to the user, and thus, the effect of enabling achievement of differentiation from other service providers is obtained.

Supplement of Embodiment

Although the URL representing a location of the image management system5on the communication network9is included in the link information as illustrated inFIG. 13in the above-described embodiment, the invention is not limited thereto. For example, the link information may be expressed only using the image ID and the predetermined area information without including the URL. In this case, the user operates the communication terminal3and inputs the URL.

Further, the image management system5and the link information management system7according to the above-described embodiment may be implemented in a single computer or may be implemented in a plurality of computers by dividing the units (the functions, means, or the storage units) and allocating the units as desired to the computers.

In addition, both the recording media, such as CD-ROM, in which each program of the above-described embodiment is stored and the HD504in which the programs are stored can be provided domestically or abroad as program products.

REFERENCE SIGNS LIST

1CAPTURING DEVICE3aCOMMUNICATION TERMINAL3bCOMMUNICATION TERMINAL5IMAGE MANAGEMENT SYSTEM7LINK INFORMATION MANAGEMENT SYSTEM9COMMUNICATION NETWORK9aBASE STATION9bBASE STATION31TRANSMITTING AND RECEIVING UNIT32OPERATIONAL INPUT RECEIVING UNIT33DISPLAY CONTROL UNIT39STORING AND READING UNIT51TRANSMITTING AND RECEIVING UNIT (EXAMPLE OF TRANSMISSION UNIT, EXAMPLE OF RECEPTION UNIT)52IDENTIFICATION INFORMATION ALLOCATING UNIT53THUMBNAIL CREATING UNIT (EXAMPLE OF THUMBNAIL CREATING UNIT)54LINK INFORMATION CREATING UNIT (EXAMPLE OF LINK INFORMATION CREATING UNIT)55EXTRACTING UNIT (EXAMPLE OF EXTRACTING UNIT)59STORING AND READING UNIT71TRANSMITTING AND RECEIVING UNIT72SCREEN CREATING UNIT79STORING AND READING UNIT315DISPLAY3000STORAGE UNIT5000STORAGE UNIT5001IMAGE MANAGEMENT DB (EXAMPLE OF IMAGE MANAGEMENT UNIT)5002THUMBNAIL MANAGEMENT DB (EXAMPLE OF THUMBNAIL MANAGEMENT UNIT)7000STORAGE UNIT7001USER MANAGEMENT DB (EXAMPLE OF USER MANAGEMENT UNIT)7003PROPERTY MANAGEMENT DB (EXAMPLE OF PROPERTY MANAGEMENT UNIT)

CITATION LIST

Patent Literature

Patent Literature 1: JP 2014-131215 A