Display control system, display control device, display control method, and program

Labor of photographing images of an object can be reduced in a case where the images of the object viewed from a viewpoint moving along with an orbit are displayed. Image obtaining means of a display control system obtains a plurality of image data pieces generated by photographing an object from a plurality of photographing positions that are different from one another in photographing directions. Information obtaining means obtains photograph information relating to the photographing positions of the respective image data pieces in a three-dimensional space based on the image data pieces. Image selecting means selects some of the image data pieces based on the photograph information of the respective image data pieces and orbit information relating to an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space. Display control means displays, on display means, the image data pieces selected by the image selecting means in an order according to the orbit.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a National Stage of International Application No. PCT/JP2015/059995 filed on Mar. 30, 2015. The contents of the above document is incorporated herein by reference in its entirety.

TECHNICAL FIELD

The present invention relates to a display control system, a display control device, a display control method, and a program.

BACKGROUND ART

A technique for accurately presenting condition of an object by shooting the object from various positions has been known. For example, Patent Literature 1 describes serially photographing by a camera an object on a turn table that turns at a predetermined speed, and displaying a video photographed by the camera on a display unit.

CITATION LIST

Patent Document

SUMMARY OF INVENTION

Technical Problem

However, conventionally, images are displayed only along with an orbit on which the object is photographed by the camera, and thus the orbit of the camera actually photographing the object needs to be the same as the orbit of a viewpoint on the display unit. As such, in order that the display unit displays images of the object viewed from the viewpoint moving along various orbits, the object needs to be photographed by moving the camera by the number of orbits, which takes a lot of labor.

One or more embodiments of the present invention have been conceived in view of the above, and an object thereof is to provide a display control system, a display control device, a display control method, and a program capable of reducing labor of photographing an object in a case where images of the object viewed from a viewpoint moving along with an orbit are displayed.

Solution to Problem

In order to solve the above described problems, a display control system according to the present invention includes image obtaining means for obtaining a plurality of image data pieces generated by photographing an object from a plurality of photographing positions that are different from one another in photographing directions, information obtaining means for obtaining photograph information relating to the photographing positions of the respective image data pieces in a three-dimensional space based on the image data pieces, image selecting means for selecting some of the image data pieces based on the photograph information of the respective image data pieces and orbit information relating to an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space, and display control means for displaying, on display means, the image data pieces selected by the image selecting means in an order according to the orbit.

The display control device according to the present invention includes information obtaining means for obtaining content stored in storage means that stores a plurality of image data pieces and photograph information in association with one another, the plurality of image data pieces being generated by photographing an object from a plurality of photographing positions that are different from one another in photographing directions, and the photograph information being related to the photographing positions of the respective image data pieces in a three-dimensional space, image selecting means for selecting some of the image data pieces based on the photograph information of the respective image data pieces and orbit information relating to an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space, and display control means for displaying, on display means, the image data pieces selected by the image selecting means in an order according to the orbit.

A display control method according to the present invention includes an image obtaining step for obtaining a plurality of image data pieces generated by photographing an object from a plurality of photographing positions that are different from one another in photographing directions, an information obtaining step for obtaining photograph information relating to the photographing positions of the respective image data pieces in a three-dimensional space based on the image data pieces, an image selecting step for selecting some of the image data pieces based on the photograph information of the respective image data pieces and orbit information relating to an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space, and a display control step for displaying, on display means, the image data pieces selected in the image selecting step in an order according to the orbit.

A program according to the present invention causes a computer to function as information obtaining means for obtaining content stored in storage means that stores a plurality of image data pieces and photograph information in association with one another, the plurality of image data pieces being generated by photographing an object from a plurality of photographing positions that are different from one another in photographing directions, and the photograph information being related to the photographing positions of the respective image data pieces in a three-dimensional space, image selecting means for selecting some of the image data pieces based on the photograph information of the respective image data pieces and orbit information relating to an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space, and display control means for displaying, on display means, the image data pieces selected by the image selecting means in an order according to the orbit.

An information storage medium according to the present invention is a computer-readable information storage medium that stores the program described above.

In an embodiment of the present invention, the display control system further includes orbit obtaining means for obtaining the orbit information based on three-dimensional coordinates designated by a user.

In an embodiment of the present invention, the display control system further includes feature point detecting means for detecting three-dimensional coordinates of a plurality of feature points regarding the object based on at least one of the image data pieces, and the orbit obtaining means obtains the orbit information based on three-dimensional coordinates of a feature point designated by the user among from the plurality of feature points.

In an embodiment of the present invention, the orbit obtaining means obtains the orbit information about the viewpoint that moves while fixating on the three-dimensional coordinates of the feature point designated by the user.

In an embodiment of the present invention, the display control system further includes photograph determining means for determining whether the feature point designated by the user is photographed in the respective image data pieces based on the image data pieces, and the image selecting means selects some of the image data pieces based on the photograph information of the respective image data pieces, the orbit information, and a determination result of the photograph determining means.

In an embodiment of the present invention, the photograph information of the respective image data pieces includes photographing position information of the respective image data pieces, the orbit information includes orbit position information of the viewpoint, and the image selecting means selects some of the image data pieces based on distances among positions indicated by the photographing position information of the respective image data pieces and positions indicated by the orbit position information.

In an embodiment of the present invention, the photograph information of the respective image data pieces includes photographing direction information of the respective image data pieces, the orbit information includes viewing direction information about the viewpoint from the orbit, and the image selecting means selects some of the image data pieces based on deviations among directions indicated by the photographing direction information of the respective image data pieces and directions indicated by the viewing direction information.

In an embodiment of the present invention, the image selecting means includes means for calculating evaluation values weighing the deviations more than the distances based on the distances and the deviations of the respective image data pieces, and selects some of the image data pieces based on the evaluation values of the respective image data pieces.

In an embodiment of the present invention, the photograph information of the respective image data pieces includes the photographing position information of the respective image data pieces, and the image selecting means selects some of the image data pieces such that the distances of the positions indicated by the photographing position information of the respective image data pieces selected by the image selecting means are within a predetermined range based on the photographing position information of the respective image data pieces.

In an embodiment of the present invention, the display control means determines at least either of display positions and display sizes of the respective image data pieces selected by the image selecting means such that at least either of a deviation of the display position and a deviation of the display size of the object displayed on the display means is within a predetermined range.

Advantageous Effects of Invention

According to the present invention, it is possible to reduce labor of photographing images of an object in a case where the images of the object viewed from a viewpoint moving along with an orbit are displayed.

DESCRIPTION OF EMBODIMENTS

[1. Overall Configuration of Display Control System]

An embodiment of the present invention will be described below in detail with reference to the accompanying drawings. This embodiment is described by example of a case in which a bidder checks image data of an item exhibited by a seller in an Internet auction.

FIG. 1is a diagram illustrating an overall configuration of a display control system in this embodiment. As shown inFIG. 1, the display control system1includes a display control server10(display control device), a seller terminal20, and a bidder terminal30. The display control server10, the seller terminal20, and the bidder terminal30are connected to one another through a network2so that data are mutually transmitted and received.

The display control server10is a server computer. The display control server10includes a control unit11, a storage unit12, and a communication unit13. The control unit11includes, for example, one or more microprocessors. The control unit11performs processing according to a program and data stored in the storage unit12. The storage unit12includes a main storage unit and an auxiliary storage unit. For example, the main storage unit is a RAM, and the auxiliary storage unit is a hard disk or a solid-state drive. The communication unit13is a communication interface such as a network card. The communication unit13performs data communication through the network2.

The seller terminal20is a computer operated by the seller, such as, a mobile phone (including smart phone), a portable information terminal (including tablet computer), or a personal computer. The seller terminal20includes a control unit21, a storage unit22, a communication unit23, an operation unit24, and a display unit25. The control unit21, the storage unit22, and the communication unit23respectively share the same hardware configuration with the control unit11, the storage unit12, and the communication unit13, and thus duplicated explanation will be omitted.

The operation unit24is an operating member for the seller to perform operation, and a pointing device such as a touch panel and a mouse. The operation unit24sends an operation of the seller to the control unit21. The display unit25is, for example, a liquid crystal display unit or an organic EL display unit. The display unit25displays a screen as indicated by the control unit21.

The seller terminal20is connected to a camera26through, for example, the communication unit23. The camera26is photographing means for photographing an object and generating image data, and is, for example, a digital camera or a mobile terminal with camera (smart phone and tablet terminal). The camera26inputs image data into the seller terminal20. The camera26may be included in the seller terminal20.

The bidder terminal30is a computer operated by the bidder. The bidder terminal30includes a control unit31, a storage unit32, a communication unit33, an operation unit34, and a display unit35. The bidder terminal30may share the same hardware configuration with the seller terminal20. The control unit31, the storage unit32, the communication unit33, the operation unit34, and the display unit35may be the same as the control unit21, the storage unit22, the communication unit23, the operation unit24, and the display unit25, respectively.

The program and the data are described as being stored in the storage unit12, the storage unit22, or the storage unit32, but may be provided to the storage unit12, the storage unit22, or the storage unit32through the network2. It is not necessary to be limited to the above-mentioned example, and, various types of computer hardware may be applied to the hardware configuration of the display control server10, the seller terminal20, and the bidder terminal30. For example, the display control server10, the seller terminal20, and the bidder terminal30may each comprise a reader (e.g., optical disc drive and memory card slot) for reading a computer-readable information storage medium. In this case, a program or data stored in an information storage medium may be provided to the storage unit12, the storage unit22, or the storage unit32through a reader.

[2. Overview of Processing in Display Control System]

Next, overview of the processing performed in the display control system1will be discussed. In this embodiment, when the seller exhibits an item in an Internet auction, the seller photographs the item using the camera26in order to inform the bidder of a condition of the item.

FIG. 2illustrates a scene in which the seller photographs an item. As shown inFIG. 2, the seller photographs the item with the camera26from various photographing positions while changing a positional relationship between the item and the camera26. In other words, the seller photographs the item while changing photographing directions of the camera26. The photographing direction is a direction toward a fixation point from the position of the camera26, and also a direction to which a lens of the camera26is directed.

The seller may photograph the item in still image mode for generating an image data piece one by one, or in moving image mode for generating moving image data including multiple images. The seller uploads image data together with exhibition related information, such as a description of the item, thereby exhibiting the item in an Internet auction. The bidder displays an item screen for bidding the item on the display unit35of the bidder terminal30.

FIG. 3is a diagram illustrating an example of an item screen. As shown inFIG. 3, the item screen40displays an item image41, thumbnail images42A to42C (hereinafter these are collectively referred to as thumbnail images42), and biding related information43, such as current price of the item. The item image41is one of the image data pieces uploaded by the seller. The thumbnail images42are generated by reducing the image data piece of the item image41.

The bidder can change the image data piece displayed on the item image41by selecting one of the thumbnail images42. Here, the image data piece indicated by the thumbnail image42A is displayed in the item image41. In this regard, thumbnail images42may be generated from all the image data pieces uploaded by the seller and displayed on the item screen40, or generated from only some of the image data pieces and displayed on the item screen40.

The bidder sees the item screen40to check the condition of the item. However, depending on the item image41, it is sometimes unable to fully check the desired parts due to lighting or photographing positions. As such, in the display control system1, when the bidder clicks on a part that the bidder especially wants to check in the item image41with a cursor44, the item images41are continuously displayed as if the camera26moves while fixating on such part.

FIG. 4is a diagram illustrating a scene in which the item images41are continuously displayed. Here, a watch is exhibited as an example of an item, andFIG. 4shows a case where the bidder clicks on a dial plate of the watch in the item image41. As shown inFIG. 4, for example, the item images41A to41E are continuously displayed as if the camera26moves from left to right viewed from the front while fixating on the dial plate. In this way, the bidder can check the condition of the dial plate of the watch from various directions. In the following, details of the processing will be discussed.

[3. Functions Implemented in Display Control System]

FIG. 5is a functional block diagram showing an example of functions implemented in the display control system1. As shown inFIG. 5, in the display control system1, an image obtaining unit50, a feature point detecting unit51, an information obtaining unit52, a data storing unit53, an orbit obtaining unit54, a photograph determining unit55, an image selecting unit56, and a display control unit57are implemented. In this embodiment, a case is explained in which these functions are implemented in the display control server10. The image obtaining unit50is implemented mainly by the control unit11and the communication unit13, the data storing unit53is implemented mainly by the storage unit12, and other functions are implemented mainly by the control unit11.

In this embodiment, the image obtaining unit50, the feature point detecting unit51, the information obtaining unit52, the data storing unit53, the orbit obtaining unit54, the photograph determining unit55, the image selecting unit56, and the display control unit57respectively correspond to image obtaining means, feature point detecting means, information obtaining means, storage means, orbit obtaining means, photograph determining unit, image selecting means, and display control means according to the present invention.

The image obtaining unit50obtains a plurality of image data pieces that are generated by photographing the item from photographing positions that have different photographing directions from one another. As explained previously with reference toFIG. 2, the photographing positions have different photographing directions to the item from one another. In this embodiment, the camera26generates each image data piece and inputs the generated image data piece into the seller terminal20. As such, the image obtaining unit50receives the plurality of image data pieces sent from the seller terminal20through the network2. The image obtaining unit50provides an image data piece with an image data ID, by which to uniquely identify the image data piece, and stores the image data piece in the data storing unit53.

When the camera26photographs an item in the moving image mode, the image obtaining unit50may obtain a plurality of image data pieces based on the moving image data. In this case, the image obtaining unit50extracts one of frames in the moving image data as one image data piece. In this case, the image obtaining unit50may extract image data pieces at predetermined frame intervals, or extract image data pieces for all of the frames.

The feature point detecting unit51detects a plurality of feature points (in this embodiment, both of two-dimensional coordinates and three-dimensional coordinates) of the item based on a plurality of image data pieces. A feature point is a spot that is identifiable on the surface of the object by the computer, and for example, an outline or a corner of the object. The feature point is also described as an interest point or a vertex. Here, the feature point detecting unit51detects feature points in every image data piece obtained by the image obtaining unit50.

For example, the feature point detecting unit51extracts feature points using a corner detection method. As a corner detecting method, for example, Moravec corner detection or Harris corner detection may be used. For example, the feature point detecting unit51sets pixels in an image data piece as target pixels, detects an outline of the object from the difference between pixel values of the target pixels and peripheral pixels, and detects positions at the outline as feature points.

In this embodiment, the feature point detecting unit51labels feature points detected from each image data piece. For example, the feature point detecting unit51matches feature points of respective image data pieces, and determines if a feature point is a newly detected feature point or the same as the already detected feature point. The feature points may be matched based on pixel values of the feature points or positional relationship with other feature points. When a new feature point is detected from an image data piece, the feature point detecting unit51provides the feature point with a feature point ID to identify the feature point. When the same feature point as the already detected feature point is detected, the feature point detecting unit51does not provide the feature point with a feature point ID.

Here, the feature point detecting unit51stores, for every image data piece, feature point IDs of feature points detected from an image data piece and positions (two-dimensional coordinates in a screen coordinates system) of the feature points in the image in the data storing unit53. The information obtaining unit52described below uses two-dimensional coordinates of each feature point in order to obtain photograph information. The feature point detecting unit51also calculates three-dimensional coordinates of each feature point, and stores them in the data storing unit53, as subsequently described in detail.

For a detecting method of a feature point from image data, various known methods for detecting feature points can be applied. For example, the feature point detecting unit51may specify an area in the same color in an image data piece using blob analysis and determine the center of the area as a feature point, or detect a pixel of a predetermined pixel value (i.e., a pixel of a specified color) as a feature point. Alternatively, for example, the feature point detecting unit51may detect an entire outline of an object as a feature point.

The information obtaining unit52obtains photograph information regarding a photographing position of each image data piece in a three-dimensional space based on a plurality of image data pieces. The photograph information comprises at least one of photographing position information and photographing direction information of an image data piece. The photographing position information is three-dimensional coordinates indicating a photographing position of an image data piece. The photographing direction information is vector information indicating a photographing direction of an image data piece or three-dimensional coordinates indicating a fixation point. Here, a case will be explained in which photographing direction information is vector information.

The information obtaining unit52obtains photograph information for each image data piece by analyzing each image data piece. Here, as an example of a method for obtaining photograph information, a method for using positional relationship of feature points will be discussed.

For example, assume that a seller photographs an item with a camera26at a reference photographing position in a reference photographing direction. In the following, an image data piece obtained in this way is referred to as a reference image data piece. For example, the reference image data piece is photographed from a position at a predetermined distance away from the item in a front direction. The reference photographing position and the reference photographing direction may be determined in advance. The information obtaining unit52first obtains the reference photographing position and the reference photographing direction in a three-dimensional space.

FIG. 6is a diagram illustrating a three-dimensional space. As shown inFIG. 6, three axes (XWaxis, YWaxis, ZWaxis) perpendicular to one another are set in the three-dimensional space. The information obtaining unit52obtains a photographing position P0, which is away from the origin OWin a predetermined direction (here, ZWaxis positive direction) by a predetermined distance, as a reference photographing position. The information obtaining unit52then obtains a photographing direction V0, which indicates a negative direction of the ZWaxis, as a reference photographing direction.

The information obtaining unit52calculates photograph information of an image data piece based on positional relationship among two-dimensional coordinates of respective feature points of the image data piece and two-dimensional coordinates of respective feature points of the reference image data piece. For example, the information obtaining unit52calculates a photographing position PNand a photographing direction VN(N is a natural number) of an image data piece based on deviations of two-dimensional coordinates of respective feature points.

FIG. 7is a comparison of two-dimensional coordinates of feature points. InFIG. 7, the reference image data piece is “DT0”, the image data piece to obtain the photograph information is “DTN”, and each feature point is shown as QK(K is a natural number and K=0 to 8 inFIG. 7). The information obtaining unit52obtains a vector connecting two-dimensional coordinates of respective feature points QKin the reference image data piece DT0to two-dimensional coordinates of respective feature points QKin the image data piece DTNand performs predetermined matrix operations, thereby calculating a vector ΔV1indicating a deviation between the photographing positions P0and PNand a vector ΔV2indicating a deviation between the photographing directions V0and VN.

Referring back toFIG. 6, the information obtaining unit52sets a position shifted by the vector ΔV1from the photographing position P0as the photographing position PN, and a direction shifted by the vector ΔV2from the reference photographing direction V0as the photographing direction VN. The information obtaining unit52performs the same calculation for each image data piece so as to calculate photograph information, and stores the information in the data storing unit53.

When the information obtaining unit52obtains the photograph information, the feature point detecting unit51detects three-dimensional coordinates of the feature points QKof the item based on at least one of the image data pieces. For example, the feature point detecting unit51calculates three-dimensional coordinates of the feature points QKby coordinate-transforming the two-dimensional coordinates of the feature points QKof the reference image data piece DT0based on the photographing position P0and the photographing direction V0. The three-dimensional coordinates of respective feature points calculated by the feature point detecting unit51are stored in the data storing unit53.

FIG. 8is a diagram representing relationship among feature points and photograph information in the three-dimensional space. For example, in a case where 16 image data pieces including the reference image data piece are uploaded, as shown inFIG. 8, the information obtaining unit52obtains photographing positions P0to P15and photographing directions V0to V15of respective image data pieces, and the feature point detecting unit51detects feature points Q0to Q8. The positional relationship among the photographing positions P0to P15and the photographing directions V0to V15with respect to the feature points Q0to Q8corresponds to the positional relationship among the photographing positions and the photographing directions of the camera26when the item was photographed by the bidder.

For a method of obtaining photograph information, various known methods can be applied. For example, the photograph information may be obtained not by using the reference image data piece, but by comparing image data pieces. Alternatively, for example, the display control server10may prepare an image data piece indicating a reference shape of the object in advance, and estimate the photograph information by detecting differences from the reference shape in size and direction.

The data storing unit53stores various kinds of data necessary for displaying the item screen40. For example, the data storing unit53stores image data pieces obtained by the image obtaining unit50in association with respective image data IDs. Further, the data storing unit53stores a photograph information database in which the photograph information obtained by the information obtaining unit52is stored and a feature point database in which the three-dimensional coordinates of the feature points QKcalculated by the feature point detecting unit51are stored.

FIG. 9is a diagram illustrating an example of data stored in the photograph information database. As shown inFIG. 9, the photograph information database stores image data IDs, photograph information (photographing positions PNand photographing directions VN), and feature point IDs in association with one another. Here, the feature point IDs indicate the feature points detected in the image data pieces having the image data IDs among all of the feature points. For example, all of feature points Q0to Q8are detected in the reference image data piece having an image data ID “0”, and the feature point Q6is not detected in the image data piece having an image data ID “2” due to, for example, reflection of light. Although omitted inFIG. 9, two-dimensional coordinates of feature points in image data pieces may be stored in association with feature point IDs.

FIG. 10is a diagram illustrating an example of data stored in the feature point database. As shown inFIG. 10, the feature point database stores feature point IDs and three-dimensional coordinates of feature points QKin association with one another. In this embodiment, three-dimensional coordinates of feature points QKare the same in respective image data pieces, and thus are stored in the feature point database, and two-dimensional coordinates of feature points QKdiffer for respective image data pieces, and thus are stored in the photograph information database.

The data storing unit53may store data other than described above. For example, the data storing unit53may store data of thumbnail images of image data pieces, exhibition related information, and biding related information. Further, the information obtaining unit52may be capable of obtaining content stored in the data storing unit53.

The orbit obtaining unit54obtains orbit information regarding an orbit of a viewpoint that moves while changing a viewing direction in the three-dimensional space based on at least either of the bidder's operation and the orbit calculation algorithm. The orbit calculation algorithm is written in a program, and includes a numerical expression for calculating the orbit. The orbit may be determined only by the bidder's operation, or only by the orbit calculation algorithm, although in this embodiment, a case in which the orbit is determined based on both of these cases will be discussed.

The viewpoint in the three-dimensional space is a viewpoint on the item screen40(i.e., a viewpoint on a viewer), and also can be described as a virtual camera in the three-dimensional space. The orbit of the viewpoint is a change in the position of the viewpoint or the viewing direction. The orbit of the viewpoint has a start point and an end point. The start point and the end point may be different positions from each other, or the same position. The orbit of the viewpoint may be described as a path moving from the start point to the end point.

The orbit information includes at least either of orbit position information of the viewpoint and viewing direction information of the viewpoint from the orbit. In this embodiment, the orbit information includes both of the orbit position information and the viewing direction information, but may include only one of them.

The orbit position information indicates changes in positions of the viewpoint in the three-dimensional space. For example, the orbit position information may include three-dimensional coordinates of each position on the orbit, or a numerical expression indicating the orbit. The viewing direction information indicates changes in viewing directions in the three-dimensional space. For example, the viewing direction information may include vectors indicating viewing directions of respective positions on the orbit, or three-dimensional coordinates indicating fixation points at the respective positions.

In this embodiment, the orbit obtaining unit54obtains the orbit information based on the three-dimensional coordinates designated by the bidder. For example, the orbit obtaining unit54obtains the orbit information based on the three-dimensional coordinates of the feature point QKdesignated by the bidder among the plurality of feature points QK. The bidder designates a position in the item image41on the item screen40, thereby designating the feature point QK.

Here, an example is explained in which the image data piece having an image data ID “1” is displayed in the item image41, and the bidder designates a part around the dial plate in the item image41. The orbit obtaining unit54obtains the two-dimensional coordinates designated by the bidder, and specifies the feature point QKin the vicinity thereof. Here, the orbit obtaining unit54specifies the feature point Q0assuming that the bidder designated the feature point Q0on the dial plate of the watch. Then, the orbit obtaining unit54calculates the orbit information based on the photograph information of the image data piece and the specified feature point Q0.

FIG. 11is a diagram for explaining a calculating method of orbit information. The calculating method described below is defined in the orbit calculation algorithm. The orbit obtaining unit54first calculates a rotation axis L2perpendicular to a line L1connecting the photographing position P1of the image data piece having the image data ID “1” to the feature point Q0. As shown inFIG. 11, the rotation axis L2passes through the feature point Q0. The orbit obtaining unit54calculates orbit T through which the photographing position P1passes when the photographing position P1is rotated by a predetermined angle θ left and right (horizontal direction when the feature point Q0is viewed from the photographing position P1) with the rotation axis L2as a reference.

Although there are a plurality of straight lines that are perpendicular to the line L1and pass through the feature point Q0, any one of these straight lines may be defined as the rotation axis L2. For example, the orbit obtaining unit54may determine the rotation axis L2based on a direction designated by the bidder in the three-dimensional space. For example, the bidder uses the operation unit34to designate a direction in which the photographing position P1rotates. The orbit obtaining unit54then specifies the rotation axis L2perpendicular to the direction designated by the bidder. For example, in a case where the bidder designates a horizontal direction when the feature point Q0is viewed from the photographing position P1, as shown inFIG. 11, the orbit obtaining unit54specifies the rotation axis L2that is perpendicular to the line L1, passes through the feature point Q0, and is perpendicular to the horizontal direction designated by the bidder. The orbit obtaining unit54may specify the rotation axis L2based not on the direction designated by the bidder, but on the predetermined direction. When the predetermined direction is a horizontal direction, as shown inFIG. 11, the orbit obtaining unit54specifies the rotation axis L2that is perpendicular to the line L1, passes through the feature point Q0, and is perpendicular to the horizontal direction, which is the predetermined direction.

For example, the orbit position information includes three-dimensional coordinates of a plurality of points TM(M is a natural number, and M=1 to 5 inFIG. 11) on the orbit T. Here, point T1is a start point and point T5is an end point. Each point TMis a position of a viewpoint in the three-dimensional space, and the orbit T is a path in which the viewpoint moves from the point T1to the point T5. The orbit obtaining unit54calculates a viewing direction UMof a viewpoint for each point TM. Here, viewing directions U1to U5are directions respectively setting the feature point Q0as the fixation point from the points T1to T5. The viewing direction information includes vector information of the calculated viewing directions UM.

As described above, the orbit obtaining unit54obtains the orbit information of the viewpoint that moves in a way that the viewpoint is fixed on the three-dimensional coordinates of the feature point Q0designated by the bidder. In this regard, “the viewpoint that moves in a way that the viewpoint is fixed” means that the viewpoint changes its position (inFIG. 11, from point T1to point T5) while the fixation point of the viewpoint is kept at the feature point Q0. In other words, the viewpoint changes its position while keeping the state in which the range of the viewpoint includes the feature point Q0.

The photograph determining unit55determines whether the feature point QKdesignated by the bidder is photographed in each image data piece based on the image data pieces. The photograph determining unit55refers to the photograph information database and determines whether the feature point QKdesignated by the bidder is detected in respective image data pieces.

The photograph determining unit55may specify an area occupied by the item in the three-dimensional space, and determine whether the area is comprised in the photographing range of the image data piece. In this case, the photograph determining unit55first specifies the area occupied by the item in the three-dimensional space based on the three-dimensional coordinates of the feature points QK. For example, the photograph determining unit55specifies the interior of the three-dimensional space obtained by connecting each of the feature points QKas the area occupied by the item. The photograph determining unit55then determines whether the area occupied by the item is included in a visual field calculated based on photographing positions PNand photographing directions VNof respective image data pieces. The visual field is an area defined by a photographing position PN, a photographing direction VN, and a viewing angle (field angle). The viewing angle may be determined in advance, or calculated by analyzing an image data piece.

The image selecting unit56selects some of image data pieces based on photograph information of respective image data pieces and orbit information about an orbit T when a viewpoint in the three-dimensional space moves while changing a viewing direction. The image data pieces selected by the image selecting unit56are image data pieces that relate to the orbit information and should be displayed on the item screen40. The image selecting unit56selects the image data pieces based on differences (positional relationship) between the photograph information of respective image data pieces and the orbit information obtained by the orbit obtaining unit54.

For example, the image selecting unit56selects some of the image data pieces based on distances DNbetween photographing positions PNindicated by the photographing position information of respective image data pieces and positions TMindicated by the orbit position information. For example, the image selecting unit56selects some of the image data pieces based on deviations θNamong photographing directions VNindicated in the photographing direction information of respective image data pieces and viewing directions UMindicated in the viewing direction information. The deviation θNmay represent a directional deviation, for example, an angle or a vector.

In this embodiment, a case is explained in which the image selecting unit56includes an evaluation value calculating unit56A that calculates evaluation values ENobtained by weighting deviations θNmore than distances DNbased on distances DNand deviations θNof respective image data pieces, and selects some of the image data pieces based on the evaluation values ENof the respective image data pieces. The evaluation value calculating unit56A corresponds to means for calculating evaluation values according to the present invention.

FIG. 12is a diagram representing relationship among photographing positions PNand photographing directions VNof respective image data pieces, and the orbit T. For example, the evaluation value calculating unit56A calculates distances D0to D15between each of photographing positions P0to P15and the orbit T. Here, the orbit information stores three-dimensional coordinates of points T1to T5on the orbit T. As such, the evaluation value calculating unit56A calculates the distances D0to D15between each of the photographing positions P0to P15and the nearest point among the points T1to T5.

The evaluation value calculating unit56A calculates deviations θ0to θ15among the photographing directions V0to V15and the viewing directions U1to U5from the orbit T. Here, the orbit information stores the viewing directions U1to U5from the respective points T1to T5on the orbit T. As such, the evaluation value calculating unit56A calculates the deviations θ0to θ15between each of photographing positions P0to P15and the nearest direction among the viewing directions U1to U5.

The evaluation value calculating unit56A substitutes the distances DNand deviations θNcalculated as described above for numerical expressions, thereby calculating evaluation values ENof respective image data pieces. The evaluation value ENmay be described as similarity between the photograph information and the orbit information. In other words, the evaluation value ENmay be described as an index value indicating whether an image data piece should be displayed. Here, when a numerical value of an evaluation value ENis higher, the photograph information and the orbit information have more similarities. That is, when a numerical value of an evaluation value ENis higher, a degree to display an image data piece gets higher.

The numerical expressions used for calculating evaluation values ENare written in the program. For example, the evaluation value calculating unit56A calculates an evaluation value ENby substituting a distance DNand a deviation θNfor the following expression 1. As indicated in the expression 1, when the distance DNand the deviation θNare smaller, the evaluation value ENis greater. In the expression 1, a coefficient of the distance DNis greater than a coefficient of the deviation θN. That is, the deviation θNis weighted more than the distance DN.
EN=CD*(DMAX−DN)+Cθ*(θMAX−θN)  (Expression 1)
CD,Cθ: predetermined coefficient. Here, CD<Cθ.
DMAX: predetermined maximum value of distance DNM.
θMAN: predetermined maximum value of deviation θNM.

In a case of positional relationship shown inFIG. 12, for example, the image data pieces at the photographing positions P0and P6to P11have large distances D0and D6to D11and large deviations θ0and θ6to θ11, and thus evaluation values E0and E6to E11are small. On the other hand, at least either of the distances D6to D11and the deviations θ6to θ11of the image data pieces at the photographing positions P1to P5and P12to P15are small, and thus the evaluation values E1to E5and E12to E15are relatively large. In this regard, although the photographing positions P2and P3are photographed from the similar directions, the photographing position P2is closer to the orbit T, and thus the evaluation value E2is larger than the evaluation value E3. Further, although between the photographing positions P4and P5, P5is closer to the reference orbit T, the photographing direction V5is remarkably deviated from the reference viewing direction U1, and thus evaluation value E4is larger than the evaluation value E5. The image selecting unit56obtains a predetermined number of image data pieces in descending order of evaluation values EN. For example, the image selecting unit56selects five image data pieces at the photographing positions P4, P2, P1, P13, and P12.

The calculating method of evaluation values ENis not limited to the above example. In this embodiment, the evaluation value ENmay be calculated by assigning more weights to the deviation θNthan the distance DN. For example, the evaluation value ENmay be calculated using other numerical expressions. This embodiment describes a case in which, when an evaluation value ENis larger, a position TMof a viewpoint and a viewing direction UMhave more similarities, although the way of using an evaluation value ENis not limited to this example. A position TMof a viewpoint and a viewing direction UMmay have more similarities when an evaluation value ENis smaller. Similarities between a position TMof a viewpoint and a viewing direction UMmay be determined in advance to be identifiable based on magnitudes of values. Further, an evaluation value ENmay be represented not only by a numerical value but also a word or a symbol.

The image selecting unit56may select some of the image data pieces based on the photograph information and the orbit information of respective image data pieces and the determination result of the photograph determining unit55. The image selecting unit56selects image data pieces in which the feature point ID of the feature point QKdesignated by the bidder is stored as display target. For example, the image data pieces in which the feature point QKdesignated by the bidder is photographed are kept as the display target, and the image data pieces in which the feature point QKis not photographed are excluded from the display target. For example, when the bidder designates the feature point Q0, the feature point Q0is not detected in the image data piece having the image data ID “7” in the example of data storage inFIG. 9(e.g., when the entire dial plate is difficult to see due to reflections), and thus, such image data piece may be excluded from the display target in advance.

The display control unit57displays the image data pieces selected by the image selecting unit56on the display unit35in the order according to the orbit T. The order according to the orbit T is either of an order from the start point T1to the end point T5on the orbit T, and an order from the end point T5to the start point T1on the orbit T. The display control unit57provides the order to the image data pieces selected by the image selecting unit56in the order closer to the start point T1or the end point T5. For example, in the above example ofFIG. 12, the order of the image data IDs “4”, “2”, “1”, “13”, and “12” in the order closer to the viewpoint T1is the order according to the orbit.

For example, the display control unit57continuously displays (animation display) the image data pieces selected by the image selecting unit56in the order according to the orbit T. That is, the display control unit57displays the image data pieces selected by the image selecting unit56such that the image data pieces are switched in the order according to the orbit T. Here, the display control unit57continuously displays the image data pieces such that the image data pieces are switched in the order of the image data IDs “4”, “2”, “1”, “13”, and “12.”

[4. Processing Executed in Display Control System]

FIG. 13is a flow chart showing an example of processing executed in the display control system1. The processing shown inFIG. 13is executed when the control units11,21, and31respectively operate according to the programs stored in the storage units12,22, and32. In this embodiment, when the processing described below is executed, the functional blocks inFIG. 5are implemented. When the processing described below is executed, assume that the seller photographs an item with the camera26as shown inFIG. 2, and image data pieces are stored in a memory of the camera26.

As shown inFIG. 13, the control unit21of the seller terminal20sends the image data pieces stored in the memory of the camera26together with the exhibition related information to the display control server10through the communication unit23and the network2based on the operation received by the operation unit24(S1). In S1, the seller may be able to designate which one is the reference image data piece among the image data pieces.

The control unit11of the display control server10receives image data and exhibition related information and stores them in the storage unit12(S2). In S2, the control unit11provides image data pieces with respective image data IDs, and stores them in the storage unit12. The control unit11may generate thumbnail image data of all or some of the received image data pieces, and store the generated data in the storage unit12.

The control unit11detects feature points QKin respective image data pieces based on the image data pieces (S3). In S3, the control unit11obtains two-dimensional coordinates of feature points QKincluded in respective image data pieces, and stores them in the storage unit12in association with feature point IDs. The method for detecting a feature point QKwas explained earlier.

The control unit11obtains photograph information of an image data piece based on feature points QKof the image data piece (S4). In S4, the control unit11obtains photograph information for each image data piece and registers the obtained photograph information in the photograph information database. The method for obtaining photograph information was explained earlier.

The control unit11obtains three-dimensional coordinates of each feature point QK(S5). In S5, the control unit11registers three-dimensional coordinates of each feature point QKin the feature point database. The method for obtaining three-dimensional coordinates of a feature point QKwas explained earlier.

Preparation of exhibiting an item completes with the processing described above, and the bidder can bid the item. When the bidder uses the operation unit34of the bidder terminal30to perform a predetermined operation, the control unit31sends a request for displaying the item screen40to the display control server10(S6).

When the display control server10receives the request for displaying the item screen40, the control unit11generates display data of the item screen40, and sends the generated data to the bidder terminal30(S7). In S7, the control unit11reads an image data piece, a thumbnail image, and exhibition related information of the item, for example, from the storage unit12, and generates the display data of the item screen40. The display data may be data in a predetermined format, such as, HTML data.

When the bidder terminal30receives the display data, the control unit31displays the item screen40on the display unit35(S8). The control unit31sends the operation received at the item screen40(S9). Here, for simplicity, a case is explained in which a display request operation for requesting continuous display of image data pieces and a bidding operation for bidding an item are received. The display request operation is performed by designating a position in the item image41with a cursor44. As such, information indicating the position designated by the cursor44is also sent to the display control server10. In S9, if an operation is not received in particular, the processing is finished.

When the display control server10receives an operation, the control unit11specifies content of the operation of the bidder (S10). When it is determined that the bidder has performed a display request operation (S10; display request operation), the control unit11specifies the feature point QKdesignated by the bidder based on the position designated by the bidder in the item image41(S11). In S11, the control unit11compares the two-dimensional coordinates designated by the bidder in the item image41with two-dimensional coordinates of respective feature points QK, and specifies a feature point QKthat is closest to the two-dimensional coordinates designated by the bidder among from the all feature points QK.

The control unit11calculates orbit information based on the feature point QKspecified in S11(S12). In S12, the control unit11calculates an orbit T that moves while fixating on the feature point QKdesignated by the bidder. The method for calculating the orbit was explained earlier.

The control unit11selects some image data pieces based on the photograph information of the image data pieces and the orbit information calculated in S12(S13). In S13, the control unit11calculates evaluation values ENof respective image data pieces based on the photograph information and the orbit information of the image data pieces, and selects image data pieces in the order according to the orbit T. The method for selecting the image data pieces was explained earlier.

The control unit11generates continuous display data (moving image data) of the selected image data pieces, and sends the data to the bidder terminal30(S14). In S14, the control unit11generates the continuous display data such that the image data pieces are displayed in the order according to the orbit T. The continuous display data may be data in a predetermined format, such as GIF data.

When the bidder terminal30receives the continuous display data, the control unit31continuously displays the image data pieces on the display unit35(S15). The control unit31determines whether an ending condition is satisfied (S16). The ending condition is a condition for ending this processing, for example, a predetermined ending operation performed by the bidder. If it is determined that the ending condition is satisfied (S16; Y), this processing is finished. If it is determined that the ending condition is not satisfied (S16; N), the processing returns to S9.

On the other hand, in S10, it is determined that the bidder has performed a bidding operation (S10; bidding operation), the control unit11executes predetermined bidding processing and this processing is finished (S17). When the processing in S17is executed, the bidder can bid the item.

According to the display control system1described above, the image data pieces selected based on the photograph information and the orbit information are displayed in the order according to the orbit T, which makes it unnecessary for the seller to photograph the item on various orbits with the camera26. As such, it is possible to reduce labor of photographing an item when an item image41in which the item is viewed from a viewpoint moving along the orbit T is displayed. In addition, when an item exhibited in an Internet auction has fine scratches and soils, the item is displayed such that the item is viewed from various angles by continuously displaying the item images41, and thus it is possible to check the condition of the item more accurately. In a case where a three-dimensional model of the item is generated, the item can be viewed from various directions, although it takes labor to represent scratches and soils on the item in the three-dimensional model in order to accurately display the condition of the item. According to the display control system1, it is possible to provide the bidder with an actual condition of the item without taking such labor.

The orbit T is obtained based on the three-dimensional coordinates designated by the bidder, and thus the bidder can designate the orbit T of the viewpoint at which the bidder wants to view the item. As such, it is possible to display an image in a way that the viewpoint moves on the orbit T according to the bidder's preference. The orbit T is obtained based on the three-dimensional coordinates of the feature point QKdesignated by the bidder, and thus the bidder can designate the orbit T of the viewpoint at which the feature point QKthat the bidder wants to view is photographed. As such, it is possible to display an image in a way that the position that the bidder wants to check can be viewed from various directions. Further, the bidder can check the feature point QKmore easily by obtaining orbit information of the viewpoint that moves in a way that the three-dimensional coordinates of the feature point QKdesignated by the bidder is fixated. In addition, the bidder can check the feature point QKmore easily by selecting the image data piece in which the feature point QKdesignated by the bidder is photographed, since in this way it is possible to display the image data piece in which the feature point QKdesignated by the bidder is clearly photographed.

The image data piece is selected based on the distance DN, and thus it is possible to display the image data piece having the photographing position PNclosest to the orbit T. Further, the image data piece is selected based on the deviation θN, and thus it is possible to display the image data piece having the photographing direction VNsimilar to the viewing direction UM. In addition, in a case where a photographing position PNis deviated, a view of an object varies greatly compared to a case where a photographing direction VNis deviated. As such, the image data piece is selected based on the evaluation value weighing the deviation θNmore than the distance DN, and thus the image data piece can be selected in view of the smallness of the deviation θN.

The present invention is not to be limited to the above described embodiment and can be changed as appropriate without departing from the spirit of the invention.

(1) For example, when there are a plurality of image data pieces at the photographing position PNthat is close to the orbit T and intervals between the photographing positions PNof the image data piece selected by the image selecting unit56are not consistent, the image data pieces are continuously and unnaturally displayed due to inconsistent changes in angles of the camera26to the item. As such, the image data pieces may be continuously and naturally displayed by setting the photographing positions PNof the image data piece selected by the image selecting unit56at regular intervals.

FIG. 14is a diagram illustrating relationship among an orbit T and photographing positions PN. As shown inFIG. 14, the photographing positions P20to P30are close to the orbit T, and evaluation values E20to E30of these photographing positions are also high. However, when all of image data pieces of the photographing positions P20to P30are continuously displayed, the photographing position P21, for example, has narrower intervals between each of adjacent photographing positions P20and P22than other intervals. Similarly, the photographing position P25has narrower intervals between each of adjacent photographing positions P24and P26than other intervals.

In view of this, the image selecting unit56of Variation (1) selects some of the image data pieces based on photographing position information of respective image data pieces, such that distances of the photographing positions PNindicated by the photographing position information of the image data pieces selected by the image selecting unit56are within a predetermined range. Here, a case is explained in which the predetermined distance or longer corresponds to being within the predetermined range, although less than the predetermined distance may correspond to being within the predetermined range. Assume that information indicating the predetermined range is stored in the data storing unit53in advance.

Regarding an image data piece having a reference evaluation value ENor more, the image selecting unit56calculates a distance between a photographing position PN1of such image data piece and a photographing position PN2of another image data piece that is closest to the photographing position PN1. The image selecting unit56selects the image data piece as display target if the distance is within the predetermined range, and does not select the image data piece if the distance is not within the predetermined range. For example, inFIG. 14, the image selecting unit56does not select image data pieces at the photographing positions P22and P25.

According to Variation (1), intervals between photographing positions PNof image data pieces to be displayed are within a predetermined range, and thus the image data pieces can be displayed naturally.

(2) For example, the display control unit57may determine at least either of a display position and a display size of an image data piece selected by the image selecting unit56so that at least either of a deviation of the display position and a deviation of the display size of the item displayed on the display unit35is within a reference range. The display position is a position of the item in the image, and is, for example, two-dimensional coordinates of the feature point QK. The display size is a size occupied by the item in the image, and is, for example, the number of pixels by which the item is displayed.

The display control unit57determines a display position of an image data piece so that a deviation of the display position of the image data piece of the item selected by the image selecting unit56is within a reference range. For example, the display control unit57refers to the two-dimensional coordinates of the feature point QKof the image data piece, and changes the display position of the image data piece so that the deviation of the position of the two-dimensional coordinates of the feature point QKis within the reference range.

The display control unit57determines a size of an image data piece so that a deviation of the display size of the image data piece of the item selected by the image selecting unit56is within a reference range. For example, the display control unit57changes the size of the image data piece so that the deviation of the ratio occupied by the item in the image data piece is within the reference range. For example, the display control unit57changes the size of the image data piece so that the size of the image data piece gets larger as the distance between the photographing position PNof the image data piece and the feature point QKgets larger.

According to Variation (2), at least either of the deviation of the display position and the deviation of the display size of the image data piece of the displayed item is within the reference range, image data pieces can be naturally displayed in succession. The display control unit57may change both of the display position and the display size, or only one of them.

(3) For example, the embodiment explains a case in which the reference image data piece is an image data piece photographed by the seller at the photographing position that is a predetermined distance away from the item in the front direction, although the reference image data piece may be an image data piece designated by the seller among from the image data pieces to be uploaded to the display control server10. In this case, the photographing position and the photographing direction of the image data piece designated by the seller are the photographing position P0, which is the reference photographing position, and the photographing direction V0, which is the reference photographing direction, respectively.

For example, the reference image data piece may be selected from image data pieces by using a predetermined method. The reference image data piece may not necessarily be designated by the seller, for example, but may be an image data piece first photographed by the seller. For example, in a case where the image data piece first photographed by the seller is the reference image data piece and the camera26is moved to photograph an image such that a distance between the photographing position of the image data piece and the center point of the item is consistent, deviations of distances between the camera26and the item among the image data pieces are small. As such, the item images41can be continuously displayed on the item screen40in an easily viewable way. In this case, when the camera26photographs an image, a guide to photograph the image while keeping a predetermined distance from the center of the item may be displayed on the display unit of the camera26.

For example, when the image data pieces are selected as described in the embodiment by referring toFIG. 12, the image data pieces of the photographing positions PNthat are respectively closest to the positions TKare selected. As such, even though a deviation of each position from the orbit T is small, sometimes deviations among the photographing positions PNof the image data pieces are large. In this case, as described in Variation (1), when the image data pieces are continuously displayed, they may be unnaturally displayed. As such, the image data pieces may be selected by using a method described below such that deviations among the photographing positions PNare reduced in order to achieve more natural continuous display.

The image selecting unit56specifies, based on a plurality of lines parallel to the orbit T, photographing positions PNfor the lines, respectively. Each line may be in a predetermined distance from the orbit T, for example, a distance within a predetermined percent of the size of the area occupied by the item in the three-dimensional space in a direction perpendicular to the orbit T. Further, the image selecting unit56may specify a photographing position PNso that a distance to each line is within the predetermined distance, or calculate an evaluation value for each line by using a method similar to the method described in the embodiment. For example, the image selecting unit56may specify lines having the equal or more number of the photographing positions PNspecified as described above than the number of positions TKon the orbit T (i.e., numerical value of K). Subsequently, the image selecting unit56selects a line based on intervals of the photographing positions PNrespectively specified for the lines (i.e., intervals along the lines) and distances between the lines and the orbit T. In selecting the lines, evaluation values (different from the evaluation value ENdescribed in the embodiment) may be calculated. Such evaluation values get higher as the deviations of intervals of the photographing positions PNget smaller. Further, such evaluation values get higher as the distances between lines and the orbit T get smaller. The numerical expression for calculating such evaluation values may be written in the program in advance. For example, the image selecting unit56selects the line having the highest evaluation value. On this line, photographing positions PNare aligned along the orbit T to some extent, and intervals among the photographing positions PNare consistent to some extent. Subsequently, the image selecting unit56selects image data pieces of respective photographing positions PNspecified by the selected line.

For example, the display control unit57may display the image data pieces selected by the image selecting unit56in the order according to the orbit T. As such, other than continuous display, these image data pieces may be put in the order according to the orbit T to be displayed on the item screen40.

For example, in the description above, the image selecting unit56selects the predetermined number of image data pieces each having the evaluation value ENequal to or more than the reference value, although all of the image data pieces each having the evaluation value ENequal to or more than the reference value may be selected. The above describes a case in which the image selecting unit56calculates evaluation values ENand selects image data pieces, although the image selecting unit56may select image data pieces using another method. For example, the image selecting unit56may select an image data piece with at least either of the distance DNand the deviation θNbeing in the predetermined range.

For example, the above describes an example in which a user designates a feature point QKon the item screen40, although the user may designate a viewing direction UM. In this case, the image selecting unit56may select an image data piece in a photographing direction VNthat is closest to the viewing direction UMdesignated by the user. The image selecting unit56may select an image data piece having the smallest deviation from the photographing position PNand the photographing direction VNof the selected image data piece as the image data piece to be displayed next. Subsequently, the image selecting unit56may select image data pieces in ascending order of deviation from the photographing position PNand photographing direction VNuntil the predetermined number of image data pieces are obtained.

For example, the method for obtaining the orbit information is not limited to the above described example. For example, the orbit information may be obtained without the need for the bidder to designate the feature point QK. In this case, the bidder may determine the orbit information by drawing a predetermined orbit on the item screen40using the operation unit34. For example, the display unit35may display an image indicating photographing positions PNand photographing directions VNof an image data piece (e.g., image indicating three-dimensional space as shown inFIG. 8), and the orbit information may be obtained as the orbit drawn by bidder on the image.

For example, the above describes the case in which each function of the display control system1is implemented in the display control server10, although each function may be implemented in the bidder terminal30. In this case, the bidder terminal30corresponds to the display control device according to the present invention. For example, the functions may be shared among the display control server10, the seller terminal20, and the bidder terminal30. For example, the feature point detecting unit51and the information obtaining unit52may be implemented in the seller terminal20, and the seller terminal20may obtain feature points QKand photograph information, and upload the obtained feature points QKand photograph information together with the image data pieces to the display control server10. In this case, the feature point detecting unit51and the information obtaining unit52are implemented mainly by the control unit21. For example, the orbit obtaining unit54and the photograph determining unit55may be implemented in the bidder terminal30, and the bidder terminal30may obtain the orbit information and determine whether a feature point QKis photographed. In this case, the orbit obtaining unit54and the photograph determining unit55are implemented mainly by the control unit31. For example, the image selecting unit56and the display control unit57may be implemented in the bidder terminal30, and the bidder terminal30may select image data pieces and display the selected image data pieces on the item screen40in the order according to the orbit. In this case, the image selecting unit56and the display control unit57are implemented mainly by the control unit31.

For example, the processing of the display control system1has been described using an example in which the item screen40is displayed in an Internet auction, although the display control system1according to the present invention may be applied to various cases other than the Internet auction. For example, the processing similar to that of the display control system1may be applied to a SNS service in which users communicate with one another. The display control system1may be applied to a case where an image data piece in which an object is photographed from a plurality of positions is displayed. As such, an object may be any physical object besides an item. In the above description, “item” can be replaced with “object”, and “seller” and “bidder” can be replaced with “user.”