Source: https://patents.google.com/patent/JP2007316925A/en
Timestamp: 2019-12-05 22:14:25
Document Index: 66453767

Matched Legal Cases: ['art 207', 'art 202', 'art 203', 'art 204', 'art 208', 'art 203', 'art 101', 'art, 102', 'art, 103']

JP2007316925A - Display device, terminal device, image pasting system and methods therefor - Google Patents
Display device, terminal device, image pasting system and methods therefor Download PDF
JP2007316925A
JP2007316925A JP2006145493A JP2006145493A JP2007316925A JP 2007316925 A JP2007316925 A JP 2007316925A JP 2006145493 A JP2006145493 A JP 2006145493A JP 2006145493 A JP2006145493 A JP 2006145493A JP 2007316925 A JP2007316925 A JP 2007316925A
JP2006145493A
JP4805022B2 (en
輝 九鬼
義雄 野澤
2006-05-25 Application filed by Sharp Corp, シャープ株式会社 filed Critical Sharp Corp
2006-05-25 Priority to JP2006145493A priority Critical patent/JP4805022B2/en
2007-12-06 Publication of JP2007316925A publication Critical patent/JP2007316925A/en
2011-11-02 Publication of JP4805022B2 publication Critical patent/JP4805022B2/en
An object of the present invention is to improve the operability of user operations required when displaying an image stored in a mobile terminal device on a large screen display device such as a television or a PC.
It is detected whether or not a terminal device (200) is in contact with an image display unit (101) of a display device (100), and if it is in contact, the terminal device to the display device. A pasted image display method for transmitting a selected pasted image, wherein the display device controls a display layout of the pasted image received based on contact state information indicating a state of contact of the terminal device with the image display unit; To do.
The present invention relates to a display device for pasting an image on a terminal device side to a display device, a terminal device, an image pasting system, a method thereof, and a computer program.
Display screens mounted on televisions and PCs (personal computers), such as LCD (Liquid Crystal Display) and PDP (Plasma Display Panel), etc. High definition is progressing, not only displaying digital images one by one as in the past, but also displaying multiple images at the same time, providing a level of performance that can be viewed by multiple people together ing.
Under such circumstances, a means for displaying an image stored in another device such as a digital camera or a mobile phone terminal with a camera function on a large screen display device such as a television is desired. In particular, there is a demand for a means for displaying a photograph in a layout (position, size, inclination) as intended by the user as easily as sticking a photograph to a cork board and with a high degree of freedom.
Conventionally, as a means for displaying an image stored in a digital camera or a mobile phone terminal on a TV, a memory card storing the image is inserted into the TV and image data is displayed one by one, or a predetermined amount is displayed. Displaying a list with a layout has been put into practical use. However, in order to lay out the displayed image freely (setting / changing the position, size, and tilt), first copy the image data to the PC, then start the digital camera image management software on the PC and edit it. The operation must be performed, which is cumbersome and time-consuming.
As this improvement measure, Patent Document 1 describes the following method. In other words, this is a method for designating an arbitrary display layout by moving the position of a digital camera storing an image or operating an operation button of a digital camera with respect to a display device to be displayed. Specifically, in this method, the user performs the following operation procedure. 1) Select the display image on the terminal, 2) Press the shutter halfway with the terminal facing the display, 3) Move the terminal position to adjust the image display position on the display, 4) Operate the zoom button on the terminal Adjust the image display size on the display, 5) Press the shutter fully. The display is confirmed by this procedure.
JP-A-2005-316403
The prior art described in the above-mentioned Patent Document 1 aims at improving the operability by paying attention only to the layout operation. However, it is inconvenient for the user to perform individual operations such as image transfer from the portable terminal device to the television, image display on the television, and layout designation on the television display screen as a series of operation procedures. .
The present invention has been made in view of the above circumstances, and an object thereof is to freely display images stored in a portable terminal device such as a digital camera or a cellular phone on a large screen display device such as a television or a PC. It is to improve the operability of a series of necessary user operations when displaying with a simple layout so that the user can easily perform them.
In order to solve the above problems, the pasted image display method of the present invention detects whether or not the terminal device is in contact with the image display unit of the display device, and if so, the terminal device to the display device. The selected pasted image is transmitted to the display device, and the display device controls the display layout of the received pasted image based on contact state information representing a state of contact of the terminal device with the image display unit. It is characterized by.
Further, the pasted image display method of the present invention detects the contact of the terminal device to the image display unit of the display device, causes the terminal device to transmit image data to the display device based on the detection, and the image data The image is pasted and displayed at the contact location.
According to this pasted image display method, when the user brings the terminal device into contact with the display device, this is detected, and using this as a trigger, a predetermined pasted image is transmitted from the terminal device side to the display device side. Further, the pasting layout is controlled according to whether or not the user keeps the terminal device in contact with the display device or according to the contact position.
(2) Further, the display device of the present invention includes an image display unit that displays an image, contact state information acquisition means that acquires contact state information indicating a contact state of a contact body with the image display unit, and the contact state An image receiving unit that receives a pasted image according to information, and a display control unit that controls a layout when the received pasted image is displayed on the image display unit according to the contact state information. It is characterized by.
According to this display device, the user brings the contact body into contact with the image display unit, and the contact state information acquisition unit acquires the contact state information indicating the contact state of the contact body with the image display unit. And according to this contact state information, for example, only when there is a contact, the image receiving means receives the pasted image. Further, depending on whether or not the user brings the contact body into contact with the image display unit, and depending on the contact position, that is, according to the contact state information, for example, according to contact presence / absence information or contact position information, the display control means Control the layout. That is, the display method of the pasted image is controlled according to the operation of the contact body by the user.
(3) Further, in the display device according to the present invention, when the display control unit changes the display size of the pasted image as time elapses according to the contact state information, and the contact state information changes. This stops the change in display size.
According to this display device, when the user keeps the contact body in contact with the image display unit, the display layout (display size) is continuously changed, and when the user moves the contact body away from the image display unit (that is, the contact is made). The display layout change is finished, that is, the display layout is finalized.
(4) Further, in the display device according to the aspect of the invention, the display control unit may continuously increase the display size of the pasted image as time elapses when the contact body is in contact with the image display unit. The display size change is stopped when the contact body is not in contact with the image display unit.
(5) Further, in the display device according to the present invention, the contact state information acquisition unit acquires the contact state information in response to an image sticking request from a terminal device, and the image reception unit acquires the acquired When the contact presence / absence information included in the contact state information indicates presence, the paste image is received, and the display control unit receives the paste image received based on the contact position information included in the contact state information. In addition to displaying on the display unit, the contact state information is acquired from the contact state information acquisition unit, and while the contact presence / absence information included in the contact state information indicates presence, the display size of the pasted image is changed, and the contact When the presence / absence information indicates nothing, the change in the display size of the pasted image is stopped.
(6) Further, the terminal device of the present invention provides contact state information acquisition means for acquiring contact state information indicating a contact state with an external display device, and a paste image on the display device according to the contact state information. It is characterized by comprising pasted image transmission control means for controlling to transmit to.
According to this terminal device, the user brings the terminal device into contact with an external display device, the contact state information acquisition unit detects this contact, and the pasted image transmission control unit determines the contact state information (for example, presence or absence of contact). Control to transmit a predetermined pasted image. That is, the transmission of the pasted image is controlled by the operation of the contact body by the user.
(7) Further, according to the present invention, in the above terminal device, the pasted image transmission control unit pastes an image pasted in advance when a pasted image is selected when receiving a contact notification from the contact state information obtaining unit. When the request is transmitted to the display device and the image paste response indicating the paste permission is received from the display device, the paste image is controlled to be transmitted to the display device. .
(8) Moreover, the image sticking system of this invention is an image sticking system which consists of said display apparatus and said terminal device.
(9) The display method of the present invention is a display method in a display device including an image display unit that displays an image, and acquires contact state information indicating a contact state of a contact body with the image display unit, A pasted image is received according to the contact state information, and a layout when the pasted image received according to the contact state information is displayed on the image display unit is controlled.
(10) An image transmission control method according to the present invention is an image transmission control method in a terminal device, which acquires contact state information representing a contact state with an external display device, and pastes it according to the contact state information. Control is performed to transmit an image to the display device.
(11) A computer program according to the present invention is a computer program for controlling a display device including an image display unit that displays an image, and acquires contact state information representing a contact state of a contact body with the image display unit. A process for receiving a pasted image according to the contact state information, a process for controlling a layout when displaying the pasted image received according to the contact state information on the image display unit, Is a computer program that causes a computer to execute.
(12) A computer program according to the present invention is a computer program for controlling a terminal device, according to a process of acquiring contact state information representing a contact state with an external display device, and the contact state information. A computer program that causes a computer to execute a process of controlling to send a pasted image to the display device.
As described above, according to the present invention, a series of image pasting operations such as transfer of image information (pasted image) from the mobile terminal device to the display device, change of the image display layout in the display device, and confirmation of the image display layout are displayed. Control is performed based on contact state information of the mobile terminal device with respect to the device.
According to the image pasting system, the display device, and the mobile terminal device of the present invention, the user transfers the image stored in the mobile terminal to the display device, and changes the display layout when the transferred image is displayed on the display device. In addition, a series of user operations for pasting an image, such as finalizing the display layout of the image when the change work is completed, can be easily performed with a simple one action without using complicated button operations or various complicated user interfaces. It can be done intuitively. As a result, the user interface can be simplified, and an apparatus and system that are easy to use for everyone can be provided.
FIG. 1 is a schematic diagram showing the appearance of the entire image pasting system according to an embodiment of the present invention. As illustrated in FIG. 1, the image pasting system includes a display device 100 and a mobile terminal device 200.
The display device 100 is, for example, a digital tuner built-in television or a PC display. The mobile terminal device 200 is, for example, a digital camera or a mobile phone terminal with a digital camera function. The display device 100 includes an image display unit 101 that displays various images, and a contact position detection unit 103 (contact) that detects the contact and the contact position when an external object contacts the image display unit 101. Status information acquisition means). In addition, the mobile terminal device 200 includes a mobile terminal display unit 201 for displaying characters and images, and a contact detection unit 203 (contact state information acquisition unit) that detects that there is a contact with an external object. And an input unit 208 that receives input from the user.
For the portable terminal display unit 201, for example, an LCD or the like is used. The contact detection unit 203 is realized using, for example, a mechanical switch. Alternatively, the contact detection unit 203 may be realized by incorporating an acceleration sensor in the mobile terminal device 200 and analyzing a time-series change in acceleration measured by the acceleration sensor. The input unit 208 is, for example, a numeric keypad (“0” to “9” and “*” and “#”) in which key switches are arranged in a matrix.
In this system, when the user holds the portable terminal device 200 by hand and brings the tip of the contact detection unit 203 into contact with a location on the image display unit 101, the contact detection unit 203 has made contact with the portable terminal 200 side. In the display device 100 side, the contact position detecting unit 103 detects the contact and the contact position.
Next, an internal functional configuration of the display device 100 will be described.
FIG. 2 is a block diagram illustrating an internal functional configuration of the display device 100. Hereinafter, FIG. 2 will be described.
The image display unit 101 has a function of displaying display screen information. The display screen information (image data) is the content displayed on the image display unit 101 and is passed from the display control unit 105. A device constituting the image display unit 101 is a display device such as an LCD, an organic EL (Electro-Luminescence), a plasma display, a CRT (Cathode Ray Tube), a projector.
The display device storage unit 102 has a function of storing image data, and transfers the image data by a writing / reading operation from the display control unit 105. Devices constituting the display device storage unit 102 are, for example, a flash memory, a RAM (Random Access Memory), an HDD (Hard Disk Drive), and the like.
The contact position detection unit 103 detects whether or not an external object (contact body) such as the mobile terminal device 200 is currently in contact with the image display unit 101, and further detects the contact position in the case of contact. The contact position detection unit 103 displays the position information of these contact objects with respect to the display change unit 106 (specifically, the display change control unit 1061 (FIG. 3) which is one of the elements constituting the display change unit 106). Notice. A device constituting the contact position detection unit 103 is, for example, an optical touch panel, a resistive film type touch panel, or the like.
An optical touch panel is provided with a plurality of cameras at the periphery of the display screen of the display device, and these cameras capture images over a continuous time in a direction substantially parallel to the screen, or intermittently capture them, By reading and analyzing the image, the contact position is detected when the contact body contacts the display screen. For example, when two small cameras are installed sufficiently apart from each other, each camera can detect a two-dimensional position on the display screen when the contact body is captured as an image. An infrared camera is used as the camera, and infrared illumination for irradiating the contact body is provided as necessary. Two or more cameras may be used.
The resistive film type touch panel is configured by attaching a film electrode having two electrical resistances on a display screen. These two electrodes are not in contact with each other by a spacer at normal times (when there is no contact body). When the contact body comes into contact with the display portion, one of the two electrodes (movable electrode) is pushed by the pressure, and only that portion (this point is called a contact point) is the other electrode (fixed electrode). To touch. At this time, the distance from the edge of the screen to the contact point can be calculated by measuring the potential difference from the electrode at the edge of the screen to the contact point in each of the X-axis direction and the Y-axis direction. Then, the X coordinate and the Y coordinate of the contact point are respectively calculated by switching the timing for measuring the distance in the X-axis direction and the timing for measuring the distance in the Y-axis direction using a changeover switch or the like.
The display device wireless communication unit 104 (image receiving unit) performs data communication with the mobile terminal device 200 and also transmits the communication data with the display changing unit 106 and the display control unit 105 inside the display device 100. Has a function to deliver. The display device wireless communication unit 104 exchanges an image pasting request signal and an image pasting response signal with the display as-needed changing unit 106. In addition, the display device wireless communication unit 104 exchanges a pasted image transfer signal with the display control unit 105. The wireless communication method of the display device wireless communication unit 104 is, for example, Bluetooth (registered trademark), wireless LAN (Local Area Network, local area network), or the like.
The display changing unit 106 communicates with the mobile terminal device 200 via the display device wireless communication unit 104 and starts a series of image pasting operations triggered by reception of an image pasting request signal from the mobile terminal device 200. It has a function of controlling the display content on the image display unit 101 in conjunction with the position detection unit 103 and the display control unit 105 (the display change unit 106 and the display control unit 105 constitute a display control unit). Details of the display change unit 106 will be described later.
The display control unit 105 has a function of receiving image data to be pasted from the mobile terminal device 200 via the display device wireless communication unit 104. Further, it has a function of analyzing the format of the received image data, creating resolution information as an analysis result, and notifying the display changing unit 106 as needed. Further, display area information defining the position and size at which the image data is displayed on the image display unit 101 is received from the display changing unit 106, display screen information is created from the display area information and the image data, and image display is performed. A function of displaying on the unit 101.
Next, a detailed configuration of the display changing unit 106 will be described. FIG. 3 is a block diagram showing an internal configuration of the display changer 106 at any time. Hereinafter, it will be described with reference to FIG.
The display change unit 106 includes a display change supervision unit 1061, a paste start unit 1062, and a display area change unit 1063 therein. The interaction between these parts is as follows.
The display change supervision unit 1061 sends an image pasting request to the pasting start unit 1062. In response to the contact state inquiry sent from the sticking start unit 1062, the display change control unit 1061 returns the contact state information to the sticking start unit 1062. Also, the display change supervision unit receives an image pasting response sent from the pasting start unit 1062.
In addition, the display change supervision unit 1061 sends contact state information and resolution information to the display area change unit 1063. From the display area changing unit 1063, an initial display area is sent to the display change managing unit 1061. In addition, the display change supervision unit 1061 sends a display enlargement request to the display area change unit 1063. The display area is sent from the display area changing unit 1063 to the display change managing unit 1061.
(Display Change Supervision Unit) The display change supervision unit 1061 manages input / output to the pasting start unit 1062 and the display area change unit 1063. The input to the display changing unit 106 is received by the display change managing unit 1061 and transferred to the paste starting unit 1062 and the display area changing unit 1063 via the display change managing unit 1061 as necessary. In addition, the display change supervision unit 1061 always serves as an output source for output from the display changing unit 106 to the outside (display device wireless communication unit 104, contact position detection unit 103, display control unit 105).
In addition to the transfer of various types of information, the functions installed in the display change control unit 1061 will be described.
The display change supervision unit 1061 instructs the display area change unit 1063 to increase the display size, and receives the changed display area. In addition, the display layout change start and the determination of the display layout are determined. The outline of the judgment is described. The display layout change operation starts when the display change supervision unit 1061 passes the initial value of the display area of the pasted image to the display control unit 105. During the display layout change, contact information (contact presence / absence information and contact position information) is acquired from the contact position detection unit 103 at a predetermined time interval (for example, every 1 second). When the acquired contact information is examined and it is determined that the contact position cannot be detected, the display layout is determined.
That is, by the cooperative operation of the display change control unit 106 and the display control unit 105, the layout (display size) of the pasted image is changed (enlarged) over time according to the contact state information, and the contact state information is changed. Sometimes stop this layout change. In other words, the display size of the pasted image is changed while the contact presence / absence information included in the contact state information indicates yes, and the change in the display size of the pasted image is stopped when the contact presence / absence information indicates nothing.
The elements of the pasted image layout are the display position of the pasted image on the image display unit 101 of the display device 100, the change in the display position, the display size (resolution, number of pixels, display area, enlargement / reduction ratio, etc.), display Changes in size (enlargement and reduction), display direction / tilt, and display direction / tilt change.
The pasted image is handled and processed as digital data in a computer system or a digital circuit. The pasted image is, for example, a digital still image, a digital animation image, a moving image, or the like. In addition, the pasted image is JPEG (Joint Photographic Experts Group), GIF (Graphic Interchange Format), PNG (Portable Network Graphics) standard format, MPEG (Moving Picture Expert Data), etc. The
(Paste Start Unit) The paste start unit 1062 has a function of determining the start of the image paste operation based on the image paste request signal received from the mobile terminal device 200 and the contact state information received from the contact position detector 103. .
(Display Area Changing Unit) The display area changing unit 1063 has a function of calculating a display area when an image is displayed on the image display unit 101 in a layout manner. The calculated display area information is passed to the display change control unit 1061.
When calculating the initial value of the display area information, contact state information and resolution information are received from the display change control unit 1061 and calculated based on these information.
When a display enlargement request is received from the display change control unit 1061 after the initial value is calculated, a new display region value is calculated based on the previously calculated display region information and is passed to the display change control unit 1061.
That is, while the display position detection unit 103 detects the contact of the external object, the display size is continuously increased, and when the display position detection unit 103 cannot detect the contact of the external object, the display size is not increased. The display layout is finalized.
Next, the internal configuration of the mobile terminal device 200 will be described. FIG. 4 is a block configuration diagram showing an internal functional configuration of the mobile terminal device 200. Hereinafter, a description will be given with reference to FIG.
The mobile terminal device 200 includes a mobile terminal display unit 201, a mobile terminal storage unit 202, a contact detection unit 203, a mobile terminal wireless communication unit 204, an imaging unit 205, a display image selection unit 206, and an image pasting control unit 207 (pasting). Image transmission control means) and an input unit 208.
The portable terminal display unit 201 has a function of displaying display screen information. Display screen information (image data) is passed from the display image selection unit 206. That is, corresponding image data is received from the portable terminal storage unit 202 based on the image ID passed from the display image selection unit 206, and display using this image data is performed. A device constituting the mobile terminal display unit 201 is, for example, a flat panel display such as an LCD or an organic EL.
The portable terminal storage unit 202 has a function of storing image data. First, the image data is delivered from the imaging unit 205, and is stored in association with (associated with) an image ID for uniquely identifying the image data. In addition, the mobile terminal storage unit 202 receives an image ID from the mobile terminal display unit 201 or the image pasting control unit 207 and passes the corresponding image data. Further, the portable terminal storage unit 202 passes a list of image IDs corresponding to the stored image data in response to an image ID request from the display image selection unit 206. The devices constituting the portable terminal storage unit 202 are, for example, flash memory, RAM, HDD, and the like.
The contact detection unit 203 detects that the mobile terminal device 200 is in contact with a contacted object such as the display device 100. The contact detection unit 203 notifies the image pasting control unit 207 of contact detection (contact state information). The device constituting the contact detection unit 203 is, for example, a contact sensor using a piezoelectric element.
The portable terminal wireless communication unit 204 has a function of performing data communication with the display device 100. The wireless communication method of the portable terminal wireless communication unit 204 is, for example, Bluetooth (registered trademark), wireless LAN, or the like.
The imaging unit 205 has a function of taking a photograph and recording it in the portable terminal storage unit 202 as digital image data. A device that constitutes the imaging unit 205 includes, for example, a condensing unit such as a lens, an image sensor such as a CCD (Charge Coupled Devices) or a CMOS (Complementary Metal Oxide Semiconductor, a complementary metal oxide semiconductor), and an image. It is a signal processing LSI (Large Scale Integration, semiconductor integrated circuit).
The input unit 208 has a function of receiving a user input and notifying the display image selection unit 206. The devices constituting the input unit 208 are, for example, various operation buttons and a touch panel.
The image pasting control unit 207 receives a contact notification from the contact detection unit 203. Further, the image pasting control unit 207 receives the image ID of the image selected by the user from the display image selection unit 206. Further, the image pasting control unit 207 passes the image ID to the mobile terminal storage unit 202 and reads out image data corresponding to the ID from the mobile terminal storage unit 202. Also, the image pasting control unit 207 communicates with the display device 100 via the portable terminal wireless communication unit 204, thereby passing an image pasting request, receiving an image pasting response, and passing image data.
And by these, the image sticking control part 207 controls the portable terminal storage part 202, the contact detection part 203, the portable terminal wireless communication part 204, and the input part 208, and the function which transfers an image to the display apparatus 100 of a contact other party. Have
That is, the image pasting control unit 207 controls to send the pasted image to the display device according to the contact state information.
The display image selection unit 206 has a function of selecting and displaying a desired image from a plurality of images stored in the mobile terminal storage unit 202 based on a user input. Furthermore, it has a function of notifying the image pasting control unit 207 of the selected image.
Next, an outline of a method for using the image pasting system according to the present embodiment will be described. FIG. 5 is a schematic view showing how to use the image pasting system.
In (0) of FIG. 5, the user operates the input unit 208 of the mobile terminal device 200 to select an image to be pasted on the display device 100.
Next, in (1), in a state where the desired image selected in (0) is displayed on the mobile terminal display unit 201, the user places the mobile terminal device 200 on the image display unit 101, which is the image paste destination. Make contact.
In (2), the image display unit 101 displays the image selected in (0) at the position touched by the mobile terminal device 200 in (1), and starts the display layout change.
At the start of the display layout change, that is, in the initial state shown in (a), the image display unit 101 displays an image with the minimum display size.
Then, when the user keeps the portable terminal device 200 that has been in contact with the image display unit 101 in (1), the image display unit 101 displays it according to the contact time as shown in (b). The image display size gradually increases.
In (3), the user moves the mobile terminal device 200 away from the screen of the display device 100 (releases the contact state). Then, the display layout is determined, and the image remains displayed on the image display unit 101 with the display size when the mobile terminal device 200 is released.
Next, a data communication sequence performed between the mobile terminal device 200 and the display device 100 will be described. FIG. 6 is a schematic diagram showing a communication sequence between the mobile terminal device 200 and the display device 100 corresponding to the operation shown in FIG. Hereinafter, a description will be given with reference to FIG.
The user operates the mobile terminal device 200 to bring the mobile terminal device 200 into contact with the image display unit 101 in a state where an image to be pasted is selected and displayed in advance.
When the contact detection unit 203 detects a contact, the portable terminal device 200 searches for the display device 100 of the communication partner, so that the image pasting control unit 207 broadcasts (transmits) an image pasting request signal via the portable terminal wireless communication unit 204. (S501).
The format of the image pasting request signal (S501) is as indicated by F521, and the information included in the signal is a broadcast address, a source address, a command type, and a pasting ID. The broadcast address specifies all devices that are received as the signal destination. The transmission source address is an ID (address) that identifies the mobile terminal device that is the transmission source, and is used as a destination when a device that has received this signal transmits a response to the mobile terminal device 200. As the value of the command type, a value for identifying the image pasting request signal is set. The pasting ID is assigned and used to uniquely identify the image pasting request signal.
Upon receiving this image sticking request signal (S501), the display device 100 uses the contact position detection unit 103 to check whether the contact body is in contact with the image display unit 101 and the contact position. If the contact position can be detected, the source address included in the received image pasting request signal (S501) is set as the destination address, and the image pasting response signal is sent to the mobile terminal device 200 that is the source. Is transmitted (S502).
The format of the image pasting response signal (S502) is as indicated by F522, and information included in the signal is a transmission destination address, a transmission source address, a command type, and a pasting ID. As the value of the transmission source address, an ID for identifying the display device of the transmission source is set. The command type sets a value that can identify that the mobile terminal that has received the signal is an image pasting response signal (paste permission). As the pasting ID, the same information as the pasting ID information included in the image pasting request signal received by the display device 100 is set.
When the portable terminal device 200 receives this image paste response signal (S502), the portable terminal device 200 examines the signal and includes it in the paste ID and the paste image response signal (S502) transmitted by itself in the image paste request signal (S501). If the pasted ID is the same, the pasted image transfer signal is transmitted to the display device 100 (S503). The format of the pasted image transfer signal (S503) is as indicated by F523, and information included in the signal is a transmission destination address, a transmission source address, a command type, a pasting ID, and image data. Here, the command type is set to a value that can identify the pasted image transfer signal. The pasting ID is set to the same information as the pasting ID information included in the image pasting request signal transmitted by the mobile terminal device 200 in S501.
When receiving the pasted image transfer signal (S503), the display device 100 displays an image on the image display unit 101 using the image data included in the signal, and enters a layout display changing state. Then, while the portable terminal device 200 and the image display unit 101 are kept in contact with each other, the display of the pasted image is continuously enlarged. When the contact end is detected, the display enlargement is stopped and the image display layout is determined.
FIG. 7 is a schematic diagram showing a format of data handled in the display device.
In FIG. 7, the data format of the contact state information is as shown in F430. This contact state information includes items of a contact presence / absence flag, a coordinate X value, and a coordinate Y value. The contact presence / absence flag is ON (contact is present) when an external contact body is in contact with the image display unit 101 and its position can be detected, and the value is OFF (no contact) otherwise. When the value of the contact presence / absence flag is ON (F431, when contact is detected), the detected coordinate value of the current position of the contact body is stored in the coordinate X value and the coordinate Y value. When the value of the contact presence / absence flag is OFF (F432, when no contact is detected), the coordinate X value and the coordinate Y value of the current position of the contact body are indefinite.
Next, processing procedures inside the mobile terminal device 200 and inside the display device 100 will be described.
FIG. 8 is a flowchart showing a processing procedure on the mobile terminal device 200 side, and the processing content corresponds to the communication sequence shown in FIG. Hereinafter, a description will be given with reference to FIG.
The image data stored in the portable terminal storage unit 202 is captured in advance by the imaging unit 205, and stored in association with image ID information that uniquely identifies the image data.
The display image selection unit 206 acquires an image ID from the mobile terminal storage unit 202 in response to a user input, passes the image ID to the mobile terminal display unit 201, and displays an image. The portable terminal display unit 201 passes the received image ID to the portable terminal storage unit 202 to receive image data, and causes the image display unit 101 to display the image data. The display image selection unit 206 passes the image ID associated with the image data being displayed to the image pasting control unit 207 (step S601).
When the contact detection unit 203 detects that the mobile terminal device 200 has touched something, the contact detection unit 203 notifies the image pasting control unit 207 (step S603).
The image pasting control unit 207 broadcasts an image pasting request signal via the mobile terminal wireless communication unit 204 (step S604). The image pasting request signal includes the image ID information received from the display image selection unit 206 previously.
The image pasting control unit 207 waits for an image pasting response signal as a response to the image pasting request signal via the portable terminal wireless communication unit 204 for a predetermined time. When the image pasting response signal has not been received, the image pasting control unit 207 ends the image pasting operation. If an image pasting response signal has been received, the process proceeds to step S607 (step S605).
When receiving the response signal, the image pasting control unit 207 checks the pasting ID included in the request signal. When the pasting ID is the same as the image pasting request signal transmitted earlier, the image ID information received from the display image selection unit 206 is passed to the portable terminal storage unit 202 and the image data is extracted from the portable terminal storage unit 202. The pasted image transfer signal including the image data is transmitted to the display device 100 that has transmitted the image data request signal (step S607).
FIG. 9 is a flowchart showing a processing procedure on the display device 100 side, and the processing content corresponds to the communication sequence shown in FIG. Hereinafter, a description will be given with reference to FIG.
The image pasting request signal transmitted from the mobile terminal device 200 in S501 (FIG. 6) is received by the display device wireless communication unit 104 and transferred to the display change unit 106 as needed. In the display changing unit 106, the information is transferred from the display change managing unit 1061 to the pasting start unit 1062 (step S701).
The pasting start unit 1062 has a function of determining whether image pasting is possible in response to an image pasting request from the mobile terminal device side.
The pasting start unit 1062 makes a contact state inquiry to check the contact state of the image display unit 101. The contact state inquiry signal is passed from the sticking start unit 1062 to the contact position detection unit 103 via the display change control unit 1061.
The contact position detection unit 103 checks whether or not the contact body is currently in contact with the image display unit 101 and whether the contact position can be specified. As a result, the contact position detection unit 103 passes the contact state information (F430 in FIG. 7) to the display change unit 106 as needed. The contact state information is passed to the pasting start unit 1062 via the display change unit 106 at any time (step S702).
Upon receiving the contact state information, the sticking start unit 1062 checks the contact presence / absence flag included in the information (step S703). If the flag value is OFF, a series of processing relating to FIG. 9 ends here.
When the contact presence / absence flag of the contact state information received by the pasting start unit 1062 is ON, the pasting start unit 1062 passes an image pasting response signal to the display change control unit 1061. This image pasting response signal is wirelessly transmitted via the display device wireless communication unit 104 and received by the mobile terminal device 200 that is the transmission source of the image pasting request signal (step S704).
When the portable terminal wireless communication unit 204 receives the pasted image transfer signal including the image data, the portable terminal wireless communication unit 204 transfers it to the display control unit 105 (step S706).
When receiving the pasted image transfer signal, the display control unit 105 records the image data included in the signal in the display device storage unit 102. The display device storage unit 102 stores image data (step S707).
The display control unit 105 analyzes the format of the received image data, and passes the image resolution information to the display change control unit 1061.
The display change supervision unit 1061 makes a contact state inquiry to the contact position detection unit 103 and acquires contact state information.
The display area changing unit 1063 receives contact state information and resolution information from the display change managing unit 1061. The display area changing unit 1063 calculates the initial value (initial display area) of the display area and passes it to the display change managing unit 1061 (step S708). A method for calculating the display area will be described. The display area information includes position information and size information. The position information included in the contact state information is used as the position information of the display area. The size information of the display area is a set of values in the X direction (horizontal direction) and Y direction (vertical direction) of the rectangular area. The display area changing unit 1063 calculates an aspect ratio from the received resolution information, calculates integer values of X and Y that are closest to a predetermined initial display area value, and sets the size information.
The display area changing unit 1061 passes the initial value of the display area information received from the display area changing unit 1063 to the display control unit 105.
The display control unit 105 creates display screen information, which is the content displayed on the image display unit 101, and passes it to the image display unit 101 for display (step S709).
Upon receiving the initial value of the display area information from the display area changing unit 1063, the display change managing unit 1061 thereafter acquires contact state information from the contact position detecting unit 103 repeatedly every predetermined time (step S710).
When the display change control unit 1061 acquires the contact state information. Check the contact presence / absence flag.
If the value of the flag is OFF, the series of display layout change processing shown in FIG. 9 is terminated (step S711), that is, the display layout is fixed without changing the display size.
When the value of the contact presence / absence flag in step S711 is ON, the display change supervising unit 1061 notifies the display region changing unit 1063 of a display region enlargement request, and the display size is determined from the display region changing unit 1063 by a predetermined size from the previous time. The display area information enlarged at the rate of is received (step S712).
The display change control unit 1061 passes the received display area information to the display control unit 105. The display control unit 105 creates display screen information based on the new display area information and displays it on the image display unit 101 (step S713). Thereafter, the process returns to step S710 to perform processing based on the contact state information after the next predetermined time has elapsed.
The configurations of the display device 100 and the mobile terminal device 200 in the present embodiment are substantially the same as those in the first embodiment. However, in the present embodiment, the mobile terminal device 200 does not have the contact detection unit 203.
In the present embodiment, when the user selects the pasted image and makes the mobile terminal device 200 contact the image display unit 101 of the display device 100, the contact position detection unit 103 on the display device 100 side first detects the contact. . In response to this, an image pasting polling signal is broadcast from the display device 100. When receiving the image sticking polling signal, the portable terminal device 200 that is ready for the sticking image receives the sticking image transfer signal (see FIG. 6) including the image data of the sticking image with the display device 100 as the transmission destination. (Corresponding to S503).
The processing on the display device 100 side after receiving this pasted image transfer signal is the same as in the case of the first embodiment.
In the present embodiment, the presence or absence of contact is detected only on the display device side. At this time, the mobile terminal wireless communication unit 204 that receives the image sticking polling signal corresponds to a contact state information acquisition unit that acquires contact state information representing a contact state with an external display device on the mobile terminal device side.
The configurations of the display device 100 and the mobile terminal device 200 in the present embodiment are substantially the same as those in the first embodiment. However, in the present embodiment, the display device 100 does not have the contact position detection unit 103. And the contact detection part 203 which the portable terminal device 200 has not only detects the presence or absence of a contact, but also detects its own contact position (coordinate X value and coordinate Y value) on the image display part 101 of the display device. be able to. As an example, the contact detection unit 203 receives a signal (a signal using light, infrared rays, radio waves, etc.) emitted from one or a plurality of reference signal transmission units provided at a predetermined position on the display device side. Based on the intensity or signal waveform, contact position information on the image display unit 101 is calculated.
In this embodiment, the display changing unit 106 on the display device 100 side inquires about the contact state by transmitting a contact state inquiry signal to the mobile terminal device side via the display device wireless communication unit 104 when necessary. On the mobile terminal device 200 side, upon receiving this contact state inquiry signal, the contact detection unit 203 detects the presence or absence of contact and the contact position, and includes this contact state information (contact presence flag, coordinate X value, coordinate Y value). The contact state response signal is returned to the display device 100 side. The display changing unit 106 receives contact state information included in the contact state response signal. Processing procedures other than the contact state inquiry are the same as those in the first embodiment.
In the present embodiment, the presence / absence of contact and the contact position are detected only on the mobile terminal device side. At this time, the display device wireless communication unit 104 that receives the contact state response signal including the contact state information described above acquires contact state information representing the contact state of the contact body with the image display unit on the display device side. Corresponds to status information acquisition means.
The entire processing function on the display device side or a part thereof, and the entire processing function on the mobile terminal device side or a part thereof in the first, second, and third embodiments described above are programs for realizing these functions. May be recorded on a computer-readable recording medium, and a program recorded on the recording medium may be read into a computer system and executed. The “computer system” here includes an OS and hardware such as peripheral devices.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
For example, in each of the above-described embodiments, the case where the display size is enlarged is described as a specific example of the layout change of the pasted image. However, the display size may be reduced or the display position may be changed. Is also possible.
According to the embodiment described above, when the user uses the image pasting system, a user can operate a large screen display device such as a TV or a PC to display an image stored in a portable terminal such as a digital camera or a mobile phone. However, a series of necessary user operations can be easily and intuitively performed with one action when displaying in a free layout.
Finally, the user scene assumed by this system is described below. This system is installed in a home and displays a photograph taken by a user on a large screen TV in a desired layout so that it can be viewed with friends and family. In addition, this system can be installed in public places such as stations and department stores and used as a bulletin board for communication between users. Here, the data handled by this system can be expanded not only to image information but also to text information, and it can be expanded to record when and who is pasted. It can be used for.
It is the schematic which shows the external appearance of the whole image sticking system by embodiment of this invention. It is a block diagram which shows the internal function structure of the display apparatus (100) by embodiment of this invention. It is a block diagram which shows the internal structure of the display occasional change part (106) by embodiment of this invention. It is a block diagram which shows the internal function structure of the portable terminal device (200) by embodiment of this invention. It is the schematic which showed the usage of the image sticking system by embodiment of this invention. In the image sticking system by embodiment of this invention, it is the schematic which shows the communication sequence between a portable terminal device (200) and a display apparatus (100). It is the schematic which shows the format of the data handled inside the display apparatus by embodiment of this invention. It is a flowchart which shows the process sequence in the portable terminal device (200) side by embodiment of this invention. It is a flowchart which shows the process sequence by the side of the display apparatus (100) by embodiment of this invention.
DESCRIPTION OF SYMBOLS 100 ... Display apparatus, 101 ... Image display part, 102 ... Display-device storage part, 103 ... Contact position detection part (contact state information acquisition means), 104 ... Display-device radio | wireless communication part ( Image receiving means), 105... Display control section (display control means), 106... Display change section (display control means), 200... Mobile terminal device, 201. ... Mobile terminal storage unit, 203 ... Contact detection unit (contact state information acquisition means), 204 ... Mobile terminal wireless communication unit, 205 ... Imaging unit, 206 ... Display image selection unit, 207 ... Image pasting control unit (pasted image transmission control means), 208 ... Input unit, 1061 ... Display change supervision unit, 1062 ... Paste start unit, 1063 ... Display region change unit
The contact of the terminal device to the image display unit of the display device is detected, the image data is transmitted from the terminal device to the display device based on the detection, and the image of the image data is pasted and displayed at the contact location. A pasted image display method characterized by:
Contact state information acquisition means for acquiring contact state information representing a contact state of the contact body to the image display unit;
Image receiving means for receiving a pasted image according to the contact state information;
A display device comprising: display control means for controlling a layout when displaying the received pasted image on the image display unit according to the contact state information.
The display control means changes the display size of the pasted image with time according to the contact state information, and stops the change in the display size when the contact state information changes. Item 3. The display device according to Item 2.
The display control means changes the display size of the pasted image so that the display size of the pasted image continues to increase with time in a state where the contact body is in contact with the image display unit, and the contact body is moved to the image display unit. The display device according to claim 3, wherein the change in the display size is stopped when contactless.
The contact state information acquisition means acquires the contact state information in response to an image pasting request from a terminal device,
The image receiving means receives the pasted image when the contact presence / absence information included in the acquired contact state information represents presence,
The display control unit displays the pasted image received based on the contact position information included in the contact state information on the image display unit, further acquires contact state information from the contact state information acquisition unit, and The display size of the pasted image is changed while the presence / absence information included in the state information represents yes, and the change in the display size of the pasted image is stopped when the presence / absence information of the contact represents none. The display device according to claim 2.
Contact state information acquisition means for acquiring contact state information representing a contact state to an external display device;
A terminal image transmission control unit configured to control to transmit a pasted image to the display device according to the contact state information;
The affixed image transmission control unit transmits an image affixing request for affixing a previously selected affixed image to the display device when receiving a contact notification from the contact state information acquisition unit, and from the display device The terminal device according to claim 6, wherein the terminal device is controlled to transmit the pasted image to the display device when an image pasting response indicating pasting permission is received.
An image sticking system comprising the display device according to claim 2 and the terminal device according to claim 6.
A display method in a display device including an image display unit for displaying an image,
Contact state information representing a contact state of a contact body with the image display unit is acquired, a pasted image is received according to the contact state information, and the pasted image received according to the contact state information is displayed as the image display unit. A display method characterized by controlling a layout when displaying on a screen.
An image transmission control method in a terminal device,
An image transmission control method comprising: obtaining contact state information representing a contact state with an external display device, and controlling to send a pasted image to the display device according to the contact state information.
A computer program for controlling a display device including an image display unit for displaying an image,
A process of obtaining contact state information representing a contact state of a contact body with the image display unit;
A process of receiving a pasted image according to the contact state information;
A computer program for causing a computer to execute a process for controlling a layout when displaying the pasted image received according to the contact state information on the image display unit.
A computer program for controlling a terminal device,
A process of obtaining contact state information representing a contact state with an external display device;
A computer program that causes a computer to execute a process of controlling to send a pasted image to the display device according to the contact state information.
JP2006145493A 2006-05-25 2006-05-25 Display device, terminal device, image pasting system and methods thereof Expired - Fee Related JP4805022B2 (en)
JP2006145493A JP4805022B2 (en) 2006-05-25 2006-05-25 Display device, terminal device, image pasting system and methods thereof
JP2007316925A true JP2007316925A (en) 2007-12-06
JP4805022B2 JP4805022B2 (en) 2011-11-02
ID=38850734
JP2006145493A Expired - Fee Related JP4805022B2 (en) 2006-05-25 2006-05-25 Display device, terminal device, image pasting system and methods thereof
JP (1) JP4805022B2 (en)
JP2009199050A (en) * 2008-02-25 2009-09-03 Samsung Sdi Co Ltd Plasma display device
JP2010117911A (en) * 2008-11-13 2010-05-27 Canon Inc Image display device, image display system, and image display method
EP2390762A2 (en) 2010-05-28 2011-11-30 Sony Corporation Electronic pen, information processing system, and program
EP2391104A2 (en) 2010-05-28 2011-11-30 Sony Corporation Information processing apparatus, information processing system, and program
EP2391124A1 (en) 2010-05-28 2011-11-30 Sony Corporation Information processing apparatus, information processing system, and program
WO2011148722A1 (en) 2010-05-28 2011-12-01 ソニー株式会社 Information processing device, information processing system, and program
WO2011148723A1 (en) 2010-05-28 2011-12-01 ソニー株式会社 Information processing device, information processing system, and program
JP2012008807A (en) * 2010-06-24 2012-01-12 Canon Inc Content display controller
JP2013054542A (en) * 2011-09-05 2013-03-21 Casio Comput Co Ltd Image display device, image display system, and program
CN103631541A (en) * 2012-08-22 2014-03-12 柯尼卡美能达株式会社 Image forming apparatus, and electronic paper print method
JP2015082168A (en) * 2013-10-22 2015-04-27 シャープ株式会社 Image display device
JP2015132946A (en) * 2014-01-10 2015-07-23 シャープ株式会社 display system
WO2004082212A2 (en) * 2003-03-14 2004-09-23 Nokia Corporation Method for initiating a wireless transfer of data between at least two electronic devices, electronic device and software program therefor
2006-05-25 JP JP2006145493A patent/JP4805022B2/en not_active Expired - Fee Related
JP4549412B2 (en) * 2008-02-25 2010-09-22 三星エスディアイ株式会社 Plasma display device
US8780094B2 (en) 2008-11-13 2014-07-15 Canon Kabushiki Kaisha Image display device, image display system, and image display method
US8873078B2 (en) 2012-08-22 2014-10-28 Konica Minolta, Inc. Image forming apparatus, print method, and recording medium involving a comparison between the number of sheets of e-paper and number of copies specified by user
JP4805022B2 (en) 2011-11-02
US8760555B2 (en) 2014-06-24 Display control apparatus, image pickup apparatus, display control method, and storage medium
CN1488093A (en) 2004-04-07 Image information displaying device