Source: https://patents.google.com/patent/US8890802B2/en
Timestamp: 2019-10-21 23:43:36
Document Index: 712224196

Matched Legal Cases: ['Application No. 200910149660', 'Application No. 200910149660', 'Application No. 200910149660', 'Application No. 200910149660', 'Application No. 2009', 'Application No. 2009', 'Application No. 2009', 'Application No. 98118222', 'Application No. 98118222']

US8890802B2 - Device with display position input - Google Patents
Device with display position input Download PDF
US8890802B2
US8890802B2 US12/157,441 US15744108A US8890802B2 US 8890802 B2 US8890802 B2 US 8890802B2 US 15744108 A US15744108 A US 15744108A US 8890802 B2 US8890802 B2 US 8890802B2
US12/157,441
US20090303208A1 (en
Charlie W. Case, JR.
2008-06-10 Application filed by Intel Corp filed Critical Intel Corp
2008-06-10 Priority to US12/157,441 priority Critical patent/US8890802B2/en
2009-06-22 Assigned to INTEL CORPORATION reassignment INTEL CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CASE, CHARLIE W., JR., OKULEY, JAMES
2009-12-10 Publication of US20090303208A1 publication Critical patent/US20090303208A1/en
2014-11-18 Publication of US8890802B2 publication Critical patent/US8890802B2/en
In accordance with some embodiments, an electronic device is provided with one or more position sensors, providing it with the ability to detect, and use as part of its user interface, a special orientation of a part of the device.
The present invention relates generally to electronic devices and in particular, to an electronic device with display position feedback for controlling one or more aspects of the device.
FIG. 1A shows a notebook computing device with a first display in accordance with some embodiments.
FIG. 1B shows a notebook computing device with first and second displays in accordance with some embodiments.
FIG. 1C shows an electronic computing device with a first display in accordance with some embodiments.
FIG. 2A is a block diagram of a computing system having position feedback in accordance with some embodiments.
FIG. 2B is a block diagram of a computing system with a system-on-chip implementation having position feedback in accordance with some embodiments.
FIGS. 3A-3F illustrate a computing device using display position feedback to control a view in accordance with some embodiments.
FIGS. 4A-4F illustrate a computing device using display position feedback to control a view in accordance with some additional embodiments.
In accordance with some embodiments, an electronic device is provided with one or more position sensors, providing it with the ability to detect, and use as part of its user interface, a special orientation of one or more parts of the device. As used herein, an electronic device is any device with one or more displays such as a notebook computer or cell phone, as well as tablets, global positioning sensor (GPS) units, and the like. In some embodiments, an electronic device detects the relative rotational position of a display, e.g., relative to another part of the device or to a reference such as a gravity vector in space. The device may use this information as an input for controlling something with the device, e.g., to control what or how content is displayed, for example, the point of view of displayed content.
FIGS. 1A to 1C show different electronic devices having display position information (feedback) as input for controlling an aspect of the device, such as a view on a display, in accordance with some embodiments. FIG. 1A shows a so-called “notebook” or “laptop” type computer. It has first and second pieces 102, 112 rotatably coupled to one another about an axis “A” in a so-called clam shell configuration. It also has a first display 105 in the first piece 102. FIG. 1B shows a notebook 121 that is similar to notebook 101, except it has a second display 115 in its second piece 122. In this embodiment, either or both of its displays are so-called “touch screens” or have touch screen portions to implement user input functionality such as keypads and the like. FIG. 1C is a device, such as a so-called “tablet” computer, formed from a first piece 132 with a display 115 for viewing information and facilitating user input.
The displays may be implemented with any suitable display type, including but not limited to liquid crystal displays (LCD), surface-conduction electron-emitter displays (SED), field emission display (FED), and organic light emitting diode (OLED) displays, etc. Moreover, they may also have, with one or more of the displays, touch control capabilities, e.g., via suitable resistive or capacitive grid sensing.
The electronic devices also have one or more position sensors to measure relative and/or absolute positions of a display on the device. The relative position sensors measure the position of a display against an external reference and/or against another part or parts of the device, while absolute position sensors can determine the geographical position of the device (e.g., such as with global positioning). In some embodiments, relative position sensors include one or more angular or rotational displacement sensors to measure an angle between a display and another part of the device (e.g., the angle “A” between first and second rotatably coupled pieces in devices 101 and 121). Other sensors (e.g., inertial sensors, accelerometers, gyroscopes, compasses, level sensors, etc.) could be used to measure the relative or absolute position of a display against an external reference such as a gravity vector, as is shown with device 131.
The one or more sensors may be implemented with any suitable sensor type for performing these functions. Sensors for determining absolute position and direction of the device include but are not limited to GPS units used to determine device position on the surface of the earth, and magnetic compasses for detecting magnetic north for direction, accelerometers used to determine direction of local gravity vector (e.g., down direction ), tilt sensors and inclinometers, which generate an artificial horizon and measure angular displacement with respect to this horizon, and altitude sensors to mention just a few. In some embodiments, inertial (gyro, compass, or accelerometer systems), may be implemented, e.g., using a combination of accelerometers and angular rate sensors (gyroscopes) to detect altitude, location, and motion. They may also be capable of detecting attitude, position, velocity, temperature, or magnetic field.
Sensors for determining relative movement of the device include but are not limited to inertial sensors such as accelerometers or gyroscopes, and angle sensors (rotary), e.g., to be disposed near hinge area. Suitable angle sensors may include rotary position sensors including potentiometers, resolvers, optical encoders, and a variety of magnetic and capacitive devices, particularly those designed for angular displacement less than one turn.
FIGS. 2A and 2B show exemplary computing systems for implementing at least portions of the electronic devices discussed herein. FIG. 2A shows a portion of a computing system comprising a processor 202, graphics/memory controller (GMC) 204, input/output controller (IOC) 210, memory 208, peripheral devices 211, one or more displays 206, and one or more position sensors 212. The processor 202 may be implemented with any suitable processor having one or more processing cores (not shown) to run one or more applications for generating content to be displayed on the one or more displays. It is worth noting that the processor could be implemented in a separate chip and/or package or could be part of a chip or package that is common to other components such as the GMC and/or IOC.
The GMC 204 implements memory and graphics control functionality. It has a memory controller to control access to/from memory 208 and a graphics processing unit (GPU) 205 to generate graphics content for the one or more displays 206 based on application(s) running in the processor 202. The IOC 210 controllably couples the peripheral devices 211 to the rest of the system. The peripheral devices comprise user interface devices (keypad, stylist interface, touch screen interface, audio components, etc.), network interface devices including wireless interface components, access ports such as universal serial bus (USB) ports and the like. The position sensors could comprise any combination of one or more like and or different position sensors as discussed above. The IOC comprises a position processing unit 214 to receive position feedback information for the relative position of at least a part of the one or more displays 206. it processes the information, determines the relative position and provides it to the graphics processing unit 205. In turn, the GPU 205 generates graphic content based on the relative position. For example, it may have content to display, based on the executing application(s), but will display a given view or perspective of the content based on the relative position. it should be appreciated that content and view processing may be performed in the GPU, the processor, or a combination of the GPU and processor.
FIG. 2B shows an implementation of a computing system, such as the one just described for FIG. 2B, but implemented in a system-on-chip (SOC) configuration. It may have equivalent functional units and devices, as shown, but they may or may not be implemented to the same extent. For example, SOC implementations would typically have less flexibility and performance capability than a full computing system implementation. SOC implementations may be particularly suited for more specialized devices (e.g., phones, organizers, etc.) and for less-expensive implementations.
FIGS. 3A to 3F show an exemplary implementation of position based graphical content where the viewpoint for content is affected by the relative position of the display. Here, the computer is a notebook with a clamshell configuration. It has one or more rotational displacement sensors (e.g., magnetic angular displacement sensor) disposed to sense an angle between the two hinged pieces, e.g., the angle of the display relative to the base piece.
In this example, a simple pyramid is shown. When the display is at an angle “A” of 90 degrees, a perspective view from the front side of the pyramid is displayed. As the display moves down, e.g., as the angle increases, the viewpoint is correspondingly changed until the view becomes from the top, looking down onto the pyramid, when the angle is at 180 degrees. In this way, a user is able to conveniently “rotate’ her perspective view of an object simply by moving the display in accordance with a desired view. This use model could be used for a variety of applications including but not limited to computer aided drawing (CAD) tools and mapping applications. For example, in a device such as a portable web appliance with multiple sensors, in an application such as with Google Earth™, the device display could be used as a virtual viewport to view where you are on the earth map ( GPS ), which direction you are pointing the screen with respect to magnetic north (compass/accelerometer), and control the Google Earth™ point of view to correspond with a user's (device's) location, heading, and elevation. For example, one could hold the display up and point it at a mountain or building. The sensors could provide the input necessary to control the Google Earth display to show the same mountain on the device display. As the device display is rotated around in space, the display image of Google Earth™ could be changed in real time to match where the user is pointing the device. If the device display is pointed at the ground, the Google Earth™ image displayed could be the default map view.
To add to this example, for devices with multiple displays that can move with respect to one another, each could operate independently, according to it's orientation. For example, if one display surface is parallel to the earth surface, it could show a map view, whereas the other display, if oriented orthogonally to the surface of the earth, could show a view directed at the horizon. The orientation of the map view may have “map north” aligned parallel with magnetic north, as sensed by a compass in the device. Movement of the device about the roll, pitch, and yaw axes as depicted in FIG. 1C could be sensed by a combination of sensors, and could be used to adjust the displayed Google Earth (virtual) view as one would expect looking through a camera at the real view.
FIGS. 4A to 4F show an example of another usage model for display position based display control. In this example, a device with first and second displays is used. For the running application, a view A, is displayed on the second display, while a different view for the application is shown on the first display. The view option used for the first display is dictated by the position of the first display. In this example, when the display angle is within a range around 90 degrees, App. View B is shown, when in a range of about 110 to 160 degrees, App. view C is shown, and when in a range from 160 to 180 degrees, App. View D is shown. Thus, the display angle is used as part of the user interface control to select an option in the running application. An example of an application where this may be used is PowerPoint™ or any other application with multiple view options. For example, slides in a presentation could all be shown simultaneously on the second display, with the first display displaying a different view option, e.g., a slide show, a whole selected slide, etc., based on the position of the first display. In this way, a user could easily control the view option by simply moving, e.g., rotating, the first display.
a first portion of the apparatus, the first portion including a first display;
a second portion of the apparatus coupled to the first portion of the apparatus by a hinge;
one or more first sensors configured to measure an angle between the first portion of the apparatus and the second portion of the apparatus rotatably coupled to the first portion of the apparatus by the hinge;
one or more second sensors configured to determine a geographical position of the apparatus; and
a graphics processing unit to determine content to be displayed on the first display at a viewpoint based on the angle and the geographical position of the apparatus, wherein a three-dimensional display perspective of the content to be displayed on the first display is changed in accordance with a change in the angle between the first portion of the apparatus and the second portion of the apparatus such that the content to be displayed on the first display rotates with a rotation of the first portion of the apparatus about the hinge.
2. The apparatus of claim 1, in which the second portion of the apparatus includes a second display.
3. The apparatus of claim 1, in which the graphics processing unit generates graphical content to be displayed on the first display at a viewpoint based on an angle between the first display and a gravity vector normal to the earth.
4. The apparatus of claim 1, in which the graphics processing unit generates content corresponding to an application view option for the first display based on an angle between the first display and the second portion.
5. The apparatus of claim 1, in which the graphics processing unit generates content corresponding to an application view option for the first display based on an angle between the first display and a magnetic field vector.
an accelerometer to measure a relative orientation of the first portion relative to a gravity vector or other inertial frame of reference.
7. The apparatus of claim 2, in which the second display is to display a first view for an application, while the first display is to display one of several different views for the application based on the angle between the first and second portions.
an antenna to couple the apparatus to a wireless network.
measuring, with a first sensor, an angle between a first portion of an electronic device including a first display and a second portion of the electronic device rotatably coupled to the first portion of the electronic device by a hinge;
determining, with a second sensor, a geographical position of the electronic device; and
determining content to be displayed on the first display at a viewpoint based on the angle and the geographical position of the electronic device, wherein a three-dimensional display perspective of the content to be displayed on the first display is changed in accordance with a change in the angle between the first portion of the electronic device and the second portion of the electronic device such that the content to be displayed on the first display rotates with a rotation of the first portion of the electronic device about the hinge.
10. The method of claim 9, in which the second portion includes a second display.
generating graphical content to be displayed on the first display at a viewpoint based on an angle between the first display and a gravity vector normal to the earth.
generating content corresponding to an application view option for the first display based on an angle between the first display and the second portion.
generating content corresponding to an application view option for the first display based on an angle between the first display and a magnetic field vector.
14. The apparatus of claim 1, in which the one or more first sensors include one or more potentiometers, one or more resolvers, one or more optical encoders, one or more magnetic devices, or one or more capacitive devices.
a compass to measure a direction of the apparatus with respect to magnetic north, wherein the graphics processing unit controls the viewpoint to correspond with a heading of the apparatus.
a sensor to sense a movement of the apparatus about at least one of a roll axis, a pitch axis, and a yaw axis, wherein the graphics processing unit adjusts the viewpoint based on the movement.
17. A non-transitory, tangible, computer-readable storage medium, encoded with instructions that, when executed by an electronic device, causes the electronic device to perform a method comprising:
measuring, with a first sensor, an angle between a first portion of the electronic device including a first display and a second portion of the electronic device rotatably coupled to the first portion of the electronic device by a hinge;
18. The medium of claim 17, in which the second portion comprises a second display to display a first view for an application, while the first display displays a different view for the application based on the angle between the first and second portions.
measuring, with a compass, a direction of the electronic device with respect to magnetic north; and
controlling the viewpoint to correspond with a heading of the electronic device.
sensing, with a sensor, a movement of the electronic device about at least one of a roll axis, a pitch axis, and a yaw axis; and
adjusting the viewpoint based on the movement.
US12/157,441 2008-06-10 2008-06-10 Device with display position input Expired - Fee Related US8890802B2 (en)
US12/157,441 US8890802B2 (en) 2008-06-10 2008-06-10 Device with display position input
TW098118222A TWI514366B (en) 2008-06-10 2009-06-02 Device with display position input
JP2009139036A JP2009301034A (en) 2008-06-10 2009-06-10 Apparatus equipped with input of display position
CN 200910149660 CN101615073A (en) 2008-06-10 2009-06-10 Device with display position input
US20090303208A1 US20090303208A1 (en) 2009-12-10
US8890802B2 true US8890802B2 (en) 2014-11-18
ID=41399886
US12/157,441 Expired - Fee Related US8890802B2 (en) 2008-06-10 2008-06-10 Device with display position input
US (1) US8890802B2 (en)
JP (1) JP2009301034A (en)
CN (1) CN101615073A (en)
TW (1) TWI514366B (en)
JP5678543B2 (en) * 2010-09-24 2015-03-04 日本電気株式会社 Mobile terminal and display control method thereof
KR20130091196A (en) * 2012-02-07 2013-08-16 삼성전자주식회사 Folder type apparatus and control method thereof
CN104145234A (en) * 2012-03-07 2014-11-12 索尼公司 Information processing device, information processing method, and program
CN104345874B (en) * 2013-08-07 2018-02-27 联想(北京)有限公司 An information processing method for an electronic device, and
JPH09311625A (en) 1996-05-22 1997-12-02 Sony Corp Display device, map display device, display method, and map display method
JPH1055165A (en) * 1996-08-12 1998-02-24 Fujitsu Ltd Image display device, image display controller and image display system
JP2007047294A (en) 2005-08-08 2007-02-22 Nippon Hoso Kyokai <Nhk> Stereoscopic image display device
CN1968368A (en) 2005-11-18 2007-05-23 南京Lg同创彩色显示系统有限责任公司 System and method for OSD function prompt control of image display
US7327330B2 (en) * 2000-02-15 2008-02-05 Canon Kabushiki Kaisha Electronic device having stereo speakers
JP2006243360A (en) * 2005-03-03 2006-09-14 Matsushita Electric Ind Co Ltd Electronic book and display method for use in electronic book
2008-06-10 US US12/157,441 patent/US8890802B2/en not_active Expired - Fee Related
2009-06-02 TW TW098118222A patent/TWI514366B/en not_active IP Right Cessation
2009-06-10 CN CN 200910149660 patent/CN101615073A/en not_active Application Discontinuation
2009-06-10 JP JP2009139036A patent/JP2009301034A/en active Pending
US6020890A (en) * 1996-08-12 2000-02-01 Fujitsu Limited Two-dimensional image display device for three-dimensional computer graphics model
Office Action Received for Chinese Patent Application No. 200910149660.5 mailed on Dec. 23, 2011, 6 pages of Office Action and 9 pages of English Translation.
Office Action Received for Chinese Patent Application No. 200910149660.5 mailed on Jun. 9, 2011, 6 pages of Office Action and 10 pages of English Translation.
Office Action Received for Chinese Patent Application No. 200910149660.5 mailed on Sep. 15, 2010, 6 pages of Office Action and 11 pages of English Translation.
Office Action Received for Chinese Patent Application No. 200910149660.5, Mailed on Jul. 4, 2012,16 pages of office Action including 9 pages of English Translation.
Office Action Received for Japanese Patent Application No. 2009-139036 mailed on Feb. 7, 2012, 4 pages of Office Action and 5 pages of English Translation.
Office Action received for Japanese Patent Application No. 2009-139036, mailed on Mar. 4, 2014, 6 pages of Office Action and 8 pages of English translation.
Office Action received for Japanese Patent Application No. 2009-139036, mailed on Mar. 5, 2013, 7 pages of Office Action including 4 pages of English Translation.
Office Action received for Taiwan Patent Application No. 98118222, mailed on Mar. 13, 2013, 16 Pages of Office Action including 8 pages of English Translation.
Office Action received for Taiwanese Patent Application No. 98118222, mailed on Jun. 14, 2013, 3 pages of English Translation only.
JP2009301034A (en) 2009-12-24
CN101615073A (en) 2009-12-30
US20090303208A1 (en) 2009-12-10
TWI514366B (en) 2015-12-21
TW201013630A (en) 2010-04-01
EP2889722B1 (en) 2018-04-04 Flexible display device and method of controlling same
EP2648064A2 (en) 2013-10-09 Flexible display apparatus and control method thereof
KR20110049873A (en) 2011-05-12 Navigation in a three dimensional environment on a mobile device
JP2014207014A (en) 2014-10-30 Orientation-sensitive signal output
US20170315594A1 (en) 2017-11-02 Method, Device and Program for Browsing Information on a Display
TWI488076B (en) 2015-06-11 Electronic device with wrapped display
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CASE, CHARLIE W., JR.;OKULEY, JAMES;REEL/FRAME:022854/0210;SIGNING DATES FROM 20080724 TO 20080804
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CASE, CHARLIE W., JR.;OKULEY, JAMES;SIGNING DATES FROM 20080724 TO 20080804;REEL/FRAME:022854/0210