Method and apparatus for presenting multi-dimensional representations of an image dependent upon the shape of a display

A method, apparatus and computer program product are provided to cause different multi-dimensional representations of an image to be presented upon a display and to facilitate changing from one multi-dimensional representation of the image to another multi-dimensional representation of the image, such as in response to a change in the shape of the display. In the context of a method, a first, multi-dimensional representation of an image is caused to be presented upon the display while the display has a first shape. The method also causes a second, multi-dimensional representation of the image, different than the first, multi-dimensional representation of the image, to be presented upon the display while the display has a second shape, different than the first shape. The method also determines the shape of the display such that the corresponding representation of the image is caused to be presented in response thereto.

TECHNOLOGICAL FIELD

An example embodiment of the present invention relates generally to the presentation of an image upon a display and, more particularly, to the presentation of multi-dimensional images upon the display.

BACKGROUND

Computing devices, such as laptop computers, tablet computers, mobile telephones, personal digital assistants (PDAs) or the like, may present a wide variety of images upon a display. The images may include, for example, maps, photographs, textual documents, web pages or the like. Many computing devices have displays that are configured to present a two-dimensional representation of the image, such as a two-dimensional representation of a map that is presented upon a planar display. However, some computing devices include displays that are configured to present three dimensional representations of an image, such as a three-dimensional representation of a photograph, a video or the like.

Both two-dimensional and three-dimensional representations of an image may offer certain advantages and disadvantages. For example, a two-dimensional representation of an image may provide a relatively simple representation of the image that can be readily comprehended by a user. In contrast, a three-dimensional representation of an image may be more complex, but may present a more realistic image and/or may provide additional information that the user may find helpful in reviewing the image. As such, a user may find it desirable to view different representations of the same image at different times and/or for different purposes.

BRIEF SUMMARY

A method, apparatus and computer program product are provided according to an example embodiment in order to cause different multi-dimensional representations of an image to be presented upon a display and to facilitate changing from one multi-dimensional representation of the image to another multi-dimensional representation of the image. In one embodiment, the display may be configured to be transformed so as to have different shapes such that a change in the shape of the display may cause the multi-dimensional representation of the image that is presented upon the display to be correspondingly changed. Thus, by changing the shape of the display, such as by bending the display, a user may intuitively change the multi-dimensional representation of the image that is presented upon the display.

In one embodiment, a method is provided that includes causing a first, multi-dimensional representation of an image to be presented upon a display in an instance in which a display has a first shape. The method of this embodiment also causes a second, multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a second shape, different than the first shape. In this regard, the second, multi-dimensional representation of the image is different than the first, multi-dimensional representation of the image. The method of this embodiment also determines the shape of the display such that the corresponding representation of the image is caused to be presented in response thereto.

In another embodiment, an apparatus is provided that includes at least one processor and at least one memory including computer program code with the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to cause a first, multi-dimensional representation of the image to be presented on the display in an instance in which the display has a first shape. The at least one memory and the computer program code are also configured to, with the at least one processor, cause the apparatus to cause a second, multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a second shape, different than the first shape. In this regard, the second, multi-dimensional representation is different than the first multi-dimensional representation. The at least one memory and the computer program code of this embodiment are also configured to, with the at least one processor, cause the apparatus to determine the shape of the display such that the corresponding representation of the image is caused to be presented in response thereto.

In a further embodiment, a computer program product is provided that includes at least one computer-readable storage medium having computer-executable program code portions stored therein. The computer-executable program code portions include program instructions configured to cause a first, multi-dimensional representation of an image to be presented upon a display in an instance in which the display has a first shape. The computer-executable program code portions also include program instructions configured to cause a second, multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a second shape, different than the first shape. In this regard, the second, multi-dimensional representation is different than the first, multi-dimensional representation. The computer-executable program code portions of this embodiment also include program instructions configured to determine the shape of the display such that a corresponding representation of the image is caused to be presented in response thereto.

In yet another embodiment, an apparatus is provided that includes means for causing a first, multi-dimensional representation of an image to be presented upon a display in an instance in which the display has a first shape. The apparatus of this embodiment also includes means for causing a second, multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a second shape, different than the first shape. In this regard, the second, multi-dimensional representation is different than the first multi-dimensional representation. The apparatus of this embodiment also includes means for determining the shape of the display such that a corresponding representation of the image is caused to be presented in response thereto.

In other embodiments of the method, apparatus and computer program product, the display may define a z-axis extending perpendicular to the display in a planar configuration. Additionally, the determination of the shape of the display may include the determination of the degree to which the display is bent. As such, the second, multi-dimensional representation of the image may be caused to be presented by causing the image to be represented along the z-axis in a manner that corresponds to the degree to which the display is bent. The display of one embodiment may define a concave space in a bent configuration. In this embodiment, a gesture that is performed within the concave space may be received and an action may be caused to be taken in response to the gesture.

In one embodiment, the first, multi-dimensional representation of the image may be a two-dimensional representation of the image that is caused to be presented in an instance in which the display has a planar configuration. Additionally, the second multi-dimensional representation of the image may be a three-dimensional representation of the image that is caused to be presented in an instance in which the display has a bent configuration. In another embodiment, the first and second multi-dimensional representations of the image may both be three-dimensional representations of the image that are caused to be presented in an instance in which the display has first and second bent configurations, respectively. In this embodiment, the first and second three-dimensional representations of the image are different from one another and correspond to the first and second bent configurations, respectively, that are also different from one another. The first and second bent configurations may define, for example, concave and convex configurations.

DETAILED DESCRIPTION

As defined herein a “computer-readable storage medium,” which refers to a non-transitory, physical storage medium (e.g., volatile or non-volatile memory device), can be differentiated from a “computer-readable transmission medium,” which refers to an electromagnetic signal.

A method, apparatus and computer program product are provided according to example embodiments of the present invention in order to cause different multi-dimensional representations of an image to be presented upon a display. In this regard, the method, apparatus and computer program product of an example embodiment may determine the shape of the display and may, in turn, cause a corresponding multi-dimensional representation of the image to be presented upon the display based upon the shape of the display. Thus, a display may cause a first, multi-dimensional representation of an image to be presented upon the display while having a first shape, but may cause a second, multi-dimensional representation of the image to be presented on the display while having a second shape. Thus, a user may alter the multi-dimensional representation of the image by correspondingly changing the shape of the display, such as by bending the display, thereby providing an intuitive mechanism for switching between different multi-dimensional representations of an image.

Referring now toFIG. 1, an apparatus10that may be specifically configured to perform the operations described below in conjunction with an example embodiment of the present invention is illustrated. The apparatus may be embodied by any of a wide variety of computing devices including computing devices having integral displays, such as computers, e.g., laptop computers, tablet computers or the like, and mobile terminals, such as PDAs, pagers, mobile televisions, mobile telephones, gaming devices, cameras, camera phones, video recorders, audio/video players, radios, global positioning system (GPS) devices, navigation devices, or any combination of the aforementioned, and other types of voice and text communications systems. While shown inFIG. 1and described below to have an integral display, the apparatus of one embodiment need not include an integral display, but may, instead, be in communication with a remote display such that the apparatus of this embodiment may be embodied by other types of computing devices, such as servers, personal computers, work stations or the like.

Regardless of the manner in which the apparatus10is embodied, the apparatus may generally be configured as shown, for example, inFIG. 1. In this embodiment, the apparatus may include or otherwise be in communication with a processor12, a memory device14and a user interface18. As described below, the apparatus may also optionally include a communication interface16and/or one or more sensors19, as represented by the dashed lines inFIG. 1. In some embodiments, the processor (and/or co-processors or any other processing circuitry assisting or otherwise associated with the processor) may be in communication with the memory via a bus for passing information among components of the apparatus. The memory may include, for example, one or more non-transitory volatile and/or non-volatile memories. In other words, for example, the memory device may be an electronic storage device (e.g., a computer readable storage medium) comprising gates configured to store data (e.g., bits) that may be retrievable by a machine (e.g., a computing device like the processor). The memory may be configured to store information, data, applications, instructions or the like for enabling the apparatus to carry out various functions in accordance with an example embodiment of the present invention. For example, the memory could be configured to buffer input data for processing by the processor. Additionally or alternatively, the memory could be configured to store instructions for execution by the processor.

The user interface18may be in communication with the processor12to receive an indication of a user input at the user interface and/or to provide information, such as an audible, visual, mechanical or other output, to the user. As such, the user interface may include, for example, a display, e.g., a touch screen, which may be integral with the remainder of the apparatus10or may be remote therefrom and in communication therewith, as noted above. In instances in which the display has a planar configuration, the display may define an x-y plane along the surface of the display as well as a z-axis extending perpendicular to the display. The user interface may also include other input/output mechanisms and, as such, may optionally include, among other devices or elements, any or all of a speaker, a microphone, a keyboard or the like. In this regard, for example, the processor may comprise user interface circuitry configured to control at least some functions of one or more elements of the user interface, such as, for example, the display. The processor and/or user interface circuitry comprising the processor may be configured to control one or more functions of one or more elements of the user interface through computer program instructions (e.g., software and/or firmware) stored by a memory accessible to the processor (e.g., memory14and/or the like).

While the apparatus10need not be configured to communicate with other devices and, as such, need not include a communication interface, the apparatus of some embodiments is configured to communicate with other devices and, as such, may include a communication interface16. In these embodiments, the communications interface may be any means such as a device or circuitry embodied in either hardware, software, or a combination of hardware and software that is configured to receive and/or transmit data from/to the devices that are interacting. In this regard, the communication interface may include, for example, an antenna (or multiple antennas) and supporting hardware and/or software for enabling communications with a wireless communication network. In some environments, the communication interface may alternatively or also support wired communication. As such, for example, the communication interface may include a communication modem and/or other hardware/software for supporting communication via cable, digital subscriber line (DSL), universal serial bus (USB) or other mechanisms.

As also shown inFIG. 1, the apparatus10may optionally include one or more sensors19for determining the configuration of the display or for at least providing information from which the configuration and, in turn, the shape of the display may be determined. In one embodiment, for example, the apparatus may include one or more sensors that are carried by and/or move in concert with the display such that an output of the sensor(s) is indicative of the configuration of the display. Various types of sensors may be employed including, for example, position sensors, displacement sensors, strain gauge or strain gage sensors, piezoelectric bending sensors, conductive ink-based sensors, conductive fabric-based sensors, optical bending sensors, fiber optic sensors, capacitive bending sensors, micro electro mechanical bending sensors, flex sensors (e.g., sandwich-type bidirectional bending sensors) or the like. Depending on the type of sensor, the sensors may provide variety of information. With respect to a strain gauge sensor, the sensor provides information relating to the deformation of an object that is being monitored since the resistance of the strain gauge changes as the object that is monitored is deformed. With respect to a piezoelectric bending sensor, the sensor also provides information regarding the deformation of an object being monitored since the sensor includes polarized material that creates a voltage when deformed. With respect to conductive ink-based sensors, e.g. a plastic film printed with a special carbon ink, the sensor may provide information regarding the bending of an object being monitored since the resistance of the sensor increases when the object is bent, although the direction of the bending may not be determinable with this type of sensor. With respect to a conductive fabric-based sensor, the sensor also provides information regarding the bending of an object being monitored since the resistance of the sensor changes in response to bending. With respect to an optical bending sensor, such as a fiber optic sensor, and a capacitive bending sensor, the sensor may also provide information about deformation or bending of an object that is being monitored as a result of a detectable change in the optical transmission behavior of an optical bending sensor or a change in capacitance of a capacitive bending sensor.

Referring now toFIG. 2, the operations performed, such as by apparatus10, in accordance with an example embodiment of the present invention are illustrated. As shown in block20ofFIG. 2, the apparatus may include means, such as the processor12, sensor(s)19or the like, for determining the shape of the display. The shape of the display may be determined in various manners. By way of example, the sensor(s) may be configured to detect the configuration of the display, such as by detecting whether the display has a planer configuration or a bent configuration. In regards to the detection of a bent configuration of the display, the sensor(s) may be configured to detect the degree to which the display is bent, such as the radius of curvature of the display. Additionally or alternatively, in instances in which the display has a bent configuration, the sensor(s) may be configured to determine the direction in which the display is bent, such as by being bent in a concave configuration or a convex configuration from the viewpoint of the user.

The processor12may therefore be configured to receive signals from the sensor(s)19that provide information regarding the configuration of the display such that the processor may, in turn, determine the shape of the display. For example, the processor may determine that the display has a planer configuration or a bent configuration. Additionally, in instance in which the display has a bent configuration, the processor may determine the shape of the display by also taking into account the degree to which the display is bent and/or the direction in which the display is bent.

As shown in block22ofFIG. 2, the apparatus10may include means, such as the processor12, the user interface18or the like, for causing a first, multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a first shape. Additionally, the apparatus may include means, such as the processor, the user interface or the like, for causing a second multi-dimensional representation of the image to be presented upon the display in an instance in which the display has a second shape, different than the first shape. See block24.

The apparatus10may be configured to cause a variety of different types of images to be presented upon the display, such as a map as illustrated and described here, or other types of images. Even though the same image may be presented while the display has either the first shape or the second shape, the multi-dimensional representation of the image is different depending upon the shape of the display. For example, the dimensionality of the representation of the image may be different depending upon the shape of the display, such as with a two-dimensional representation of the image being presented upon the display in an instance in which the display has the first shape, and a three-dimensional representation of the image when presented upon the display in an instance in which the display has the second shape. Alternatively, the first and second multi-dimensional representations of the image may each have the same dimensionality, such as by each being three-dimensional representations, but the three-dimensional representations of the image may still be different depending upon the shape of the display, as described below.

By way of example, the display of one embodiment may have a first shape in which the display has a planer configuration. In this embodiment as shown inFIG. 3, a two-dimensional representation of the image, such as a map, may be presented upon the display30while the display has the planer configuration. In response to the reconfiguration of the display so as to have a different shape, such as a bent configuration as shown inFIG. 4, a three-dimensional representation of the image may be presented upon the display. As shown inFIG. 4, the three-dimensional representation of the image may still provide an image of the map, but one or more elements of the image, such as one or more of the buildings, may be depicted in three dimensions so as to provide a visual indication of the relative height of the buildings.

As shown inFIG. 5, the operations performed by an apparatus10specifically configured in accordance with another embodiment of the present invention are illustrated. As shown in block40, the apparatus may include means, such the processor12, one or more sensors19or the like, for determining the shape of the display such as described above in conjunction with block20ofFIG. 2. In an instance in which the display is determined to have a first shape, a first multi-dimensional representation of the image may be presented upon the display, such as described above in conjunction with block22ofFIG. 2. See block42. However, in an instance in which the display is determined to have a second shape, such as a bent configuration, the apparatus may include means, such as the processor, one or more sensors or the like, for determining the degree to which the display is bent. See block44. In this regard, the display30may be bent to lesser or greater degrees as shown, for example, inFIGS. 4 and 6, respectively. Based upon the degree to which the display is bent, the resulting multi-dimensional representation of the image may be different. As such, the apparatus may include means such as a processor, the user interface18or the like, for causing a second, multi-dimensional representation of the image to be presented upon the display with the image represented along the z-axis in a manner that corresponds to the degree to which the display is bent. See block46ofFIG. 5.

By way of example, the images presented by the displays30ofFIGS. 4 and 6are each three-dimensional representations of the same image. However, the three-dimensional representation of the buildings extend further along the z-axis in the embodiment ofFIG. 6than in the embodiment ofFIG. 4as a result of the increased bending of the display ofFIG. 6relative to the display ofFIG. 4. Although the extent to which the image is represented along the z-axis is shown to directly correspond to the degree to which the display is bent by comparison of the embodiments ofFIGS. 4 and 6, the image may be caused to extend along the z-axis in a manner that corresponds in other ways to the degree to which the display is bent in other embodiments. By causing the image to be extended along the z-axis in a manner that corresponds to the degree to which the display is bent, however, the method, apparatus and computer program product of one embodiment provide an intuitive mechanism by which to modify the multi-dimensional representation of the image by bending of the display.

The display30in a bent configuration defines a concave space32as shown, for example, inFIGS. 4 and 6. The concave space may provide a well-defined region within which gestures may be made by user and received by the apparatus10so as to cause various actions to be taken by the apparatus. With respect toFIG. 7, for example, the operations performed by an apparatus that is specifically configured in accordance with another embodiment of the present invention are illustrated. As shown in block50, the apparatus may include means, such the processor12, one or more sensors19or the like, for determining the shape of the display such as described above in conjunction with block20ofFIG. 2. In an instance in which the display is determined to have a first shape, a first multi-dimensional representation of the image may be presented upon the display, such as described above in conjunction with block22ofFIG. 2. See block52. However, in an instance in which the display is determined to have a second shape, a second multi-dimensional representation of the image may be presented upon the display, such as described above in conjunction with block24ofFIG. 2. See block54.

In this embodiment, the apparatus10may also include means, such as the processor12, the user interface18or the like, for receiving a gesture within the concave space32defined by the bent configuration of the display30. For example,FIG. 8illustrates two fingers being placed within the concave space with the fingers being spaced slightly apart from one another. The apparatus of this embodiment may also include means, such as the processor or the like, for causing an action to be taken in response to the gesture. Various gestures may be defined and various actions may be performed in response to respective one of the gestures. With respect to the embodiment ofFIG. 8in which the user has placed two fingers within the concave shape with the fingers being spaced slightly apart, the fingers may define a gap, such as between the fingertips, that is aligned with a region of the image in which elements34are to be highlighted. By way of another example and with reference toFIG. 9, the user may make another, related gesture by bringing their fingertips together in a pinching gesture within the concave space. This pinching gesture may cause the apparatus, such as the processor, to select the element34of the image that is aligned with the location at which the fingers are pinched together. By receiving gestures within the concave space, the method, apparatus and computer program product of this embodiment provide for a well-defined region within which gestures may be made so as to facilitate user interaction with the apparatus and, more particularly, with the image presented upon the display.

The method, apparatus and computer program product of one embodiment may be configured to repeatedly determine the shape of the display and to cause the multi-dimensional representation of the image that is presented upon the display to change in correspondence to the shape of the display in response to each change in the shape of the display. However, the method, apparatus and computer program product of another embodiment need not cause the multi-dimensional representation of the image that is presented upon the display to change in response to every change in the shape of the display.

For example, the method, apparatus and computer program product of one embodiment may be configured such that once the display is bent so as to have a bent configuration, the bent configuration may be correlated with and can cause a multi-dimensional representation of the image, e.g., a three-dimensional representation of the image, to be presented upon the display. After establishment of the multi-dimensional representation of the image in response to the bent configuration, the shape of the display may be changed in accordance with one embodiment without correspondingly changing the multi-dimensional representation of the image that is presented upon the display. For example, the display30may be returned to a planer configuration as shown inFIG. 10while continuing to display the multi-dimensional representation of the image such as the three-dimensional representation of the image established by the prior bent configuration of the display.

The method, apparatus computer program product of this embodiment may require a triggering event in order to permit the multi-dimensional representation of the image that is presented in response to the prior bent configuration of the display to be changed such that a different multi-dimensional representation of the image is presented in correspondence to a different shape that has been assumed by the display. Various types of triggering events may be defined, including user actuation of the various hard and/or soft keys. In one embodiment, however, the triggering event may be the bending of the display in the opposite direction from that of the prior bent configuration. For example, in an instance in which the prior bent configuration that established the multi-dimensional representation of the image that is presented upon the display30is a convex shape from the viewpoint of the user as shown inFIG. 4, the apparatus10may include means, such as the processor12, one or more sensors19or the like, for detecting a change in the shape of the display in which the display is bent in the opposite direction so as to assume, for example, a concave shape from the viewpoint of the user, such as shown inFIG. 11.

In this instance, the multi-dimensional representation of the image that is presented upon the display30may be changed in a correspondence with the current bent configuration of the display. In regards to the embodiment ofFIG. 11, for example, the extent to which elements of the image are extended along the z-axis is less in an instance in which the display is bent so as to have a concave configuration as shown inFIG. 11as opposed to an instance in which the display is bent so to have a convex configuration as shown inFIG. 4. The method, apparatus computer program product of this example embodiment may therefore provide an intuitive mechanism by which the user may adjust the extent to which elements within an image are extended along the z-axis of the display with those elements being extended to a greater degree in an instance in which the display is flexed towards the user and to a lesser degree in an instance in which the display is flexed away from the user.

FIGS. 2, 5 and 7are flowcharts of a method and program product according to an example embodiment of the invention. It will be understood that each block of the flowcharts, and combinations of blocks in the flowcharts, may be implemented by various means, such as hardware, firmware, processor, circuitry and/or other device associated with execution of software including one or more computer program instructions. For example, one or more of the procedures described above may be embodied by computer program instructions. In this regard, the computer program instructions which embody the procedures described above may be stored by a memory14of an apparatus10and executed by a processor12of the apparatus. As will be appreciated, any such computer program instructions may be loaded onto a computer or other programmable apparatus (e.g., hardware) to produce a machine, such that the instructions which execute on the computer or other programmable apparatus create means for implementing the functions specified in the flowchart blocks. These computer program instructions may also be stored in a computer-readable memory that may direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture which implements the functions specified in the flowchart blocks. The computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus implement the functions specified in the flowchart blocks.