Source: https://patents.google.com/patent/US20170168579A1/en
Timestamp: 2019-07-23 03:28:09
Document Index: 464898748

Matched Legal Cases: ['Application No. 61', 'Application No. 61', 'Application No. 61', 'Application No. 61', 'Application No. 61', 'Application No. 61']

US20170168579A1 - Systems and Methods For Shifting Haptic Feedback Function Between Passive and Active Modes - Google Patents
US20170168579A1
US20170168579A1 US15/443,482 US201715443482A US2017168579A1 US 20170168579 A1 US20170168579 A1 US 20170168579A1 US 201715443482 A US201715443482 A US 201715443482A US 2017168579 A1 US2017168579 A1 US 2017168579A1
US10203756B2 (en
2017-07-10 First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=41119917&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20170168579(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
This patent application claims priority to and is a continuation of U.S. patent application Ser. No. 14/712,358, filed on May 14, 2015, and entitled “Systems and Methods for Shifting Haptic Feedback Function Between Passive and Active Modes,” which claims priority to and is a continuation of, U.S. patent application Ser. No. 13/832,420, filed on Mar. 15, 2013, and entitled “Systems and Methods for Shifting Haptic Feedback Function Between Passive and Active Modes,” which claims priority to and is a continuation of U.S. patent application Ser. No. 12/502,758, filed on Jul. 14, 2009, and entitled “Systems and Methods for Shifting Haptic Feedback Function Between Passive and Active Modes,” which claims priority to: U.S. Provisional Patent Application No. 61/080,978, entitled “Systems and Methods for Physics-Based Tactile Messaging” filed Jul. 15, 2008; U.S. Provisional Patent Application No. 61/080,981, entitled “Systems and Methods for Mapping Message Contents to Virtual Physical Properties for Vibrotactile Messaging” filed Jul. 15, 2008; U.S. Provisional Patent Application No. 61/080,985, entitled “Systems and Methods for Shifting Sensor Haptic Feedback Function Between Passive and Active Modes” filed Jul. 15, 2008; U.S. Provisional Patent Application No. 61/080,987, entitled “Systems and Methods for Gesture Indication of Message Recipients” filed Jul. 15, 2008; U.S. Provisional Patent Application No. 61/148,312, entitled “Systems and Methods for Pseudo-Telepresence in a Shared Space” filed Jan. 29, 2009; and U.S. Provisional Patent Application No. 61/181,280, entitled “Systems and Methods for Transmitting Ha.ptic Messages” filed May 26, 2009, the entirety of each of which is hereby incorporated by reference herein.
FIG. 6 is a final illustration of shifting haptic feedback function between passive and active modes according to one embodiment of the present invention; and.
Embodiments of the present invention provide systems and methods for shifting haptic feedback function between passive and active modes
Next, the processor receives a second signal from the user interface device associated with an interaction with the graphical user interface. For instance, the processor may receive the second signal from a touch-sensitive input device, such as a touch-screen. The interaction may take a number of forms. For example, a user may brush, flick, rub, drag, or otherwise engage the touch-screen display to interact with a virtual object displayed on the graphical user interface. Alternatively, after a mode of interaction has been selected, a user may tilt, shake, rotate, or move the messaging device to interact with the graphical user interface. In an active mode of interaction, brushing or flicking a virtual object in the graphical user interface may cause the virtual object to move within the graphical user interface, while the processor generates a haptic signal simulating the virtual object's weight. In a passive mode of interaction, touching a virtual object, may cause the processor generate a haptic signal simulating the virtual object's surface features, such as its texture The simulation of the surface may take the form of a vibration or other haptic feedback effect.
For example, in a messaging device including an accelerometer and a touch-screen, a default mode of interaction may comprise an active ode of interaction. In such a mode, tilting the messaging device may cause virtual objects displayed on a graphical user interface to appear to roll around. In response to the movement of the virtual objects, the device may generate haptic feedback representing friction and impacts between the virtual objects and other surfaces. Using such a device, a user may also utilize the touch-screen to directly move a virtual object within the user interface. The user may tilt the messaging device to cause the virtual object to move on the graphical user interface. Or the user may directly manipulate the virtual object by touching the graphical user interface. The movement of the virtual object on the graphical user interface causes an actuator to generate one or more haptic effects based on the virtualobject's friction profile.
A virtual object may comprise a token. A token is a type of virtual object that includes predefined parameters. The user may then define additional parameters of a specific instantiationof a token. For example, in one embodiment a token may comprise virtual object in the form of a ball, with predefined friction and texture profiles. The user may then define additional characteristics, such as the ball's size and color.
In another embodiment, the device may be equipped with a switch or button, which may be displayed on a touch screen to switch between modes of interaction. In this embodiment, for example, a user may depress a shift key, indicating an active mode of interaction. While operating in this mode, movements of the device can cause virtual objects in the display to move, roll, and collide with each other. When the user releases the shift key, the passive mode of interaction is enabled. In this mode, the virtual objects may exhibit different variables, such as a vibrating feedback representing each virtual object's texture. While in the passive mode, the virtual objects may continue movementon the screen and the user may interact with the virtual objects; however, the user cannot direct interaction between the virtual objects.
Illustrated Systen for Shifting Haptic Feedback Function Between Passive and Active Modes of Interaction
The processor 110 is also in communication with one or more sensors 114. The sensor 114 may comprise a location sensor, rotational velocity sensor, image sensor, pressure sensor, or other type of sensor. For example, sensor 114 may comprise an accelerometer, a gyroscope, a GPS sensor, or a touch-sensitive input device touch screen, touch-pad). The one or more sensors 114 may be configured to detect changes in, for example, acceleratio lination, inertia, or location. For example, the messaging device 102 may comprise an accelerometer configured to measure the acceleration of the messaging device 102. As another example, the messaging device 102 may comprise a location sensor, rotary velocity sensor, image sensor, pressure sensor, or other type of sensor. The one or more sensors 114 may be configured to send a sensor signal to the processor 110.
After a mode of interaction is selected, the processor receives a second signal associated with an interaction with the graphical user interface 204. The signal associated with an interaction may be generated by a touch-sensitive input device (e.g. touch screen, touch-pad) or some other type of sensor, such as an accelerometer, a gyroscope, a GPS sensor, a microphone, a texture stylus, or an imaging sensor. In one example, a user interacts with the user interface by contacting a virtual object through a touch-screen display 116. The processor 114 receives a signal from the touch-screen display 116 associated with the gesture or contact made by the user. The signal associated with the interaction may include properties of the interaction, such as location, speed, pressure, and/or type. For example, a signal from a touch-screen display 116 may include the location of the contac Tith the touch-screen display 116, the speed and/or pressure of the contact, the duration of the contact, and the type of gesture or motion made on the touch-screen display 116.
In another illustrative embodiment, the graphical user interface displays a virtual messaging environment. In the virtual messaging environment, an electronic message such as an email, text message, instant message, or other type of message is displayed as a. virtual message object. In one embodiment, the virtual message object comprises one of: a ball, a tube, a capsule, a box, a balloon, a heart, or any other shape the graphical user interface is capable of displaying. FIG. 7 shows a messaging device 710, that includes a display 720 showing a virtual message object in the form of a ball with a rough surface 730. The virtual message object further comprises a virtual physical parameter which defines one or more characteristics of the virtual object, such as: size, mass, shape, collision, or texture. A virtual physical parameter may be modified by either the user or the program itself. In this illustrative embodiment, the processor 110 receives a signal associated with an interaction with the virtual message object in the virtual messaging environment. Then the processor 110 receives a signal associated with an interaction with the virtual message object in the virtual messaging environment. Processor 110 may then determine a haptic effect based, at least in part, on the mode of interaction with the virtual message object and the interaction with the virtual messaging object.
Such processors may comprise, or may be in communication with media, such as computer-readable media, that may story:instructions that, when executed by the processor, can cause the processor to perform the steps described herein as carried out, or assisted, by a processor. Embodiments of computer-readable media may comprise, but are not limited to, an electronic, optical, magnetic, or other storage or transmission device capable of providing a processor, such as the processor in a web server, with computer-readable instructions. Other examples of media comprise, but are not limited to, a floppy disk, CD-ROM, magnetic disk, memory chip, ROM, RAM, ASIC, configured processor, all optical media, all magnetic tape or other magnetic media, or any other medium from which a computer processor can read. Also, various other devices may include computer-readable media, such as a router, private or public network, or other transmission device. Both the processor and the processing described may be in and/or dispersed through one or more structures. The processor may comprise code for carrying out one or more of the methods (or parts of methods) described herein.
7. The portable messaging device of claim 1, wherein the processor receives the sensor signal from a sensor configured to detect one or more of an orientation or movement of an electronic device.
8. The portable messaging device of claim 1, wherein the user interaction comprises on or more of: tilting, shaking, rotating, or moving the electronic device.
13. The method of claim 9, wherein th ode signal is received from a sensor configured to detect one or more of an orientation or movement of an electronic device.
US20170168579A1 true US20170168579A1 (en) 2017-06-15
US10203756B2 US10203756B2 (en) 2019-02-12
US10339693B2 (en) 2012-05-11 2019-07-02 Semiconductor Energy Laboratory Co., Ltd. Electronic device, storage medium, program, and displaying method
JP6077521B2 (en) 2017-02-08 Tactile content in text message