Source: https://patents.google.com/patent/US7729791B2/en
Timestamp: 2019-04-19 19:39:23+00:00

Document:
A method of operating a portable electronics device can include integrated operation of media playback processing and non-media-playback processing (such as, for example, a game). The method can include receiving an event corresponding to operation of a user interface item by a user of the portable electronics device. The received event can be provided to the non-media-playback processing. The non-media-playback processing can determine whether to cause an action corresponding to the provided received event with respect to the non-media-playback processing. For an event determined by the non-media-playback processing to not cause an action corresponding to the provided received event with respect to the non-media-playback processing, the provided received event can be provided to the media playback processing. Typically, the operating performed by the media playback processing based on the event can be the processing that would otherwise be performed by the media playback processing if the non-media-playback processing was not even occurring.
Portable electronic devices for media playback are becoming ever more popular. For example, a very popular portable media player is the line of iPod® media players from Apple Computer, Inc. of Cupertino, Calif. In addition to media playback, the iPod® media players also provide non-media-playback capabilities, including game playing capabilities.
The inventors have realized that it is desirable to create an integrated media playback and non-media-playback experience.
Methods of operating a portable electronics device can include integrated operation of media playback processing and non-media-playback processing (such as, for example, game processing). The method can include receiving an event corresponding to operation of a user interface item by a user of the portable electronics device. The received event can be provided to the non-media-playback processing. The non-media-playback processing can determine whether to cause an action corresponding to the provided received event with respect to the non-media-playback processing.
For an event determined by the non-media-playback processing to not cause an action corresponding to the provided received event with respect to the non-media-playback processing, the provided received event can be provided to the media playback processing. Typically, the operating performed by the media playback processing based on the event can be the processing that would otherwise be performed by the media playback processing if the non-media-playback processing was not even occurring.
FIG. 1 is an architecture diagram broadly illustrating an example of processing to handle UI events to a portable electronics device such that the UI events may be operated upon by media playback processing and non-media-playback processing, as appropriate.
FIG. 3 is a flowchart illustrating processing of a media player application.
Methods are described to handle UI events to a portable electronics device such that the UI events may be operated upon by media playback processing and non-media-playback processing, as appropriate. The media playback processing and the non-media-playback processing may occur, at least when considered at a macroscopic level, in parallel. For example, the media playback processing may include playback of songs, such as is a commonly-known function of an iPod® media player. In general, the media playback nominally occurs in a predictive manner and, while user interaction may affect the media playback audio (e.g., by a user activating a “fast forward” or other user interface item), the media playback nominally occurs in a predictive manner.
In one example, an event corresponding to operation of a user interface item by a user of the portable electronics device is received. The received event is provided to the non-media-playback processing. The non-media-playback processing includes processing to determine whether to cause an action corresponding to the provided received event, with respect to the non-media-playback processing. For an event determined by the non-media-playback processing to not cause an action corresponding to the received event with respect to the non-media-playback processing, the received event is provided to the media playback processing.
A game application is an example of non-media-playback processing. That is, the game application substantially operates responsive to game-playing actions of a user of the portable media player. In this respect, the game video is not nominally generated in a predictive manner, as is the case with media playback processing.
FIG. 1 is an architecture diagram broadly illustrating an example of this processing. As shown in FIG. 1, a user interface event 110 is received by the media player application 102 executing on a portable media player device. For example, the user interface event 110 is a result of a user interacting with a user interface (for example, a physical or virtual knob, switch etc.) of the portable media player. At step 106 of processing with the media player application 102, the media player application 102 passes through the UI event 110 to the non-media-playback application 104 (in this example, a game playing application).
At step 112, within the game playing application 104, the game playing application 104 determines whether it is configured to act on the UI event 110 that was passed to the game playing application 104 through the media player application 102. If the determination at step 112 is yes, then the UI event is acted upon at step 114, within the game playing application 104.
Otherwise, at step 116 within the game playing application 104, the UI event is passed back to the media player application 102. Then, at step 108 within the media player application 102, the UI event is acted upon by the media player application.
FIGS. 2 and 3 illustrate a particular implementation of the UI event processing, wherein an input queue and an output queue are employed for handling the UI events. FIG. 2 illustrates processing within the non-media-playback (e.g., game) application. At step 202, a UI event is read from an input queue. At step 204, the game application determines if it is configured to act on the UI event. If yes, the game application acts on the UI event at step 206. If no, the game application operates to write the UI event to an output queue.
Meanwhile, the media player application (FIG. 3) operates on a frame-by-frame basis. Within one frame of processing, step 302 (and, in some instances, discussed below), step 304 and step 306 are performed. At step 302, it is determined if there is a UI event in the output queue. (Remember, a UI event ends up in the output queue as a result of step 208 of the game application processing, where the game application is not configured to act on the UI event.) If, at step 302, there is not a UI event in the output queue, then processing returns to step 302, for a subsequent frame.
Otherwise, if at step 302 there is a UI event in the output queue, then an operation is performed, at step 304, corresponding to the UI event. At step 306, the just-processed UI event is removed from the output queue.
As an example, the UI event may correspond to the “next button up.” For example, if a game or other non-media-playback processing is not configured to handle this event, then the media playback processing will perform a “standard” next command. This may include traversing to the next chapter, if playing a chaptered track such as a podcast or audiobook, or playing the next playable track in the “now playing” list. In other words, the typically, the operating performed by the media playback processing based on the event is the processing that would otherwise be performed by the media playback processing if the non-media-playback processing was not even occurring.
Thus, the non-media-playback processing can determine which events to handle, and other events can be passed back to the playback processing.
performing the selected operation corresponding to the received event by the media playback processing.
passing the received event to the non-media-playback processing includes providing an indication of the event to a data structure associated with the non-media-playback processing.
the automatically passing the received event to the media playback processing includes removing the indication of the event from the data structure associated with the non-media-playback processing and providing the indication of the event to a data structure associated with the media playback processing.
the non-media-playback processing includes processing for a game.
the method further comprises the media playback processing causing an operation to be performed on the provided received event.
the selected operation is performed by the media playback processing in the absence of the non-media playback processing.
computer code for performing the operation corresponding to the received event by the media playback processing.
the computer code for determining includes computer code for providing an indication of the event to a data structure associated with the non-media-playback processing.
computer code for removing the indication of the event from the data structure associated with the non-media-playback processing and providing the indication of the event to a data structure associated with the media playback processing.
the computer program product further comprising computer program instructions which are operable to cause the media playback processing to perform an operation on the provided received event.
the selected operation is performed by the media playback processing in the absence of the non-media-playback processing.
processing circuitry, adapted to perform the media playback processing and the non-media-playback processing, the processing circuitry configured to receive from the user interface a user provided input event for selecting an operation to be performed by the portable electronic device, and cause the portable electronic device to operate in a mode suitable for processing the selected operation without further user interaction by providing the received event directly to the media playback processing, passing the received event directly to the non-media-playback processing by the media playback processing, if the selected operation is to be performed by the non-media-playback processing, then the non-playback-processing performs the operation otherwise, the received event is automatically passed to the media playback processing, and the selected operation is performed by the media playback processing.
the processing circuitry being configured to cause the portable electronic device to provide the received event to the non-media-playback processing includes the processing circuitry being configured to cause the portable electronic device to provide an indication of the event to a data structure associated with the non-media-playback processing.
the processing circuitry being configured to cause the portable electronic device to provide the received event to the media playback processing, the processing circuitry being configured to cause the portable electronic device to remove the indication of the event from the data structure associated with the non-media-playback processing and providing the indication of the event to a data structure associated with the media playback processing.
the processing circuitry is further configured to cause the media playback processing to perform an operation on the provided received event.
the operation caused to be performed on the provided received event, by the media playback processing, is the operation that would otherwise be cause to be performed on the provided received event in the absence of the non-media-playback processing.
"12.1" 925 Candela Mobile PC, downloaded from LCDHardware.com on Dec. 19, 2002, http://www.lcdharware.com/panel/12-1-panel/default.asp.
"12.1" 925 Candela Mobile PC, downloaded from LCDHardware.com on Dec. 19, 2002, http://www.lcdharware.com/panel/12—1—panel/default.asp.
"Apple Introduces iTunes / World's Best and Easiest To Use Jukebox Software," Macworld Expo, San Francisco, Jan. 9, 2001.
"Bluetooth PC Headsets—Enjoy Wireless VoIP Conversations: ‘Connecting’ Your Bluetooth Headset With Your Computer", Bluetooth PC Headsets; downloaded on Apr. 29, 2006 from http://www.bluetoothpcheadsets.com/connect.htm.
"Combination Belt Clip Leaf Spring and Housing Latch", Wandt et al.; Motorola Technical Developments, Motorla Inc. Schaumburg, IL. vol. 18, Mar. 1, 1993.
"Creative MuVo TX 256 MB," T3 Magazine, Aug. 17, 2004, http://www.t3.co.uk/reviews/entertainment/mp3-player/creative-muvo-tx-256mb [downloaded Jun. 6, 2006].
"Creative MuVo TX 256 MB," T3 Magazine, Aug. 17, 2004, http://www.t3.co.uk/reviews/entertainment/mp3—player/creative—muvo—tx—256mb [downloaded Jun. 6, 2006].
"Creative Zen Vision: M 30GB", Dec. 21, 2005; downloaded on Jan. 11, 2008 from http://web.archive.org/web/20051221050140/http://www.everthingusb.com/creative-zen-vision:m-30gb.html>.
"Creative Zen Vision: M 30GB", Dec. 21, 2005; downloaded on Jan. 11, 2008 from http://web.archive.org/web/20051221050140/http://www.everthingusb.com/creative—zen—vision:m—30gb.html>.
"Digital Still Cameras-Downloading Images to a Computer," Mimi Chakarova et al., Multi/Media Reporting and Convergence, 2 pgs.
"Digital Still Cameras—Downloading Images to a Computer," Mimi Chakarova et al., Multi/Media Reporting and Convergence, 2 pgs.
"How to Pair a Bluetooth Headset & Cell Phone", About.com; downloaded on Apr. 29, 2006 from http://mobileoffice.about.com/od/usingyourphone/ht/blueheadset—p.htm.
"Peripherals for Industrial Keyboards & Pointing Devices", Stealth Computer Corporation, downloaded on Dec. 19, 2002, http://www.stealthcomputer.com/peropherals—oem.htm.
"Poly-Optical Fiber Optic Membrane Switch Backlighting", downloaded Dec. 19, 2002, http://www.poly/optical.com/membrane-switches.html.
"Poly-Optical Fiber Optic Membrane Switch Backlighting", downloaded Dec. 19, 2002, http://www.poly/optical.com/membrane—switches.html.
"Rocky Matrix Backlit Keyboard", downloaded Dec. 19, 2002, http://www.amrel.com/asi—matrixkeyboard.html.
"SoundJam MP Plus Manual, version 2.0" / MP3 Player and Encoder for Macintosh by Jeffrey Robbin, Bill Kincaid and Dave Heller, manual by Tom Negrino, published by Casady & Greene, Inc., 2000.
"TAOS, Inc., Announces Industry's First Ambient Light Sensor to Convert Light Intensity to Digital Signals", www.taosinc.com/pressrelease—090902.htm, downloaded Jan. 23, 2003.
"Toughbook 28: Powerful, Rugged and Wireless", Panasonic: Toughbook Models, downloaded Dec. 19, 2002, http:www.panasonic.com/computer/notebook/html/01a—s8.htm.
Andrew Birrell, "Personal Jukebox (PJB)," Oct. 13, 2000, http://birrell.org/andrew/talks/pjb/overview.ppt.
Apple iTunes Smart Playlists, downloaded Apr. 5, 2005 from http://web.archive.org/web/20031002011316/www.apple.com/itunes/smartplaylists.... pp. 1-2.
Bociurkiw, Michael, "Product Guide: Vanessa Matz,", www.forbes.com/asap/2000/1127/vmartz—print.html, Nov. 27, 2000.
iAP Sports Lingo 0×09 Protocol V1.00, May 1, 2006.
International Search Report dated Feb. 18, 2008 in Patent Application No. PCT/US2007/079766.
International Search Report dated Jul. 7, 2008 in PCT Application No. PCT/US2007/076793.
International Search Report dated Jun. 10, 2008 in PCT Application No. PCT/US2007/010630.
International Search Report dated Mar. 20, 2008 from PCT Application No. PCT/US2007/077789.
International Search Report dated Oct. 10, 2008 in PCT Application No. PCT/US2007/077160.
International Search Report Dated Sep. 27, 2007 in Application No. 05824296.7.
Invitation to Pay Additional Fees and Partial Search Report for PCT Application No. PCT/US2007/077160 dated Apr. 1, 2008.
Kadir et al., "Adaptive Fast Playback-Based Video Skimming Using a Compressed-Domain Visual Complexity Measure", 2004 IEEE International Conference on Multimedia and Expo, pp. 2055-2058.
Nonhoff-Arps, et al., "Straβenmusik Portable MP3-Spieler mit USB-Anschluss," CT Magazin Fuer Computer Technik, Verlag Heinz Heise GMBH, Hannover DE, No. 25, Dec. 4, 2000.
Notice of Allowance dated Apr. 21, 2009 in U.S. Appl. No. 11/327,544.
Notice of Allowance dated Dec. 18, 2008 in U.S. Appl. No. 11/212,555.
Notice of Allowance dated Jun. 15, 2009 in U.S. Appl. No. 11/212,313.
Notification of Reason for Rejection from PCT Application No. 2003-539048 dated Nov. 27, 2007.
Office Action dated Apr. 4, 2008 in U.S. Appl. No. 11/212,555.
Office Action dated Apr. 9, 2009 in U.S. Appl. No. 11/583,199.
Office Action dated Dec. 15, 2008 in U.S. Appl. No. 11/212,313.
Office Action dated Feb. 20, 2008 in Japanese Application No. 2007-538196.
Office Action dated Feb. 25, 2008 in U.S. Appl. No. 11/749,599.
Office Action dated Jan. 26, 2009 in U.S. Appl. No. 11/373,468.
Office Action dated Jun. 17, 2008 in U.S. Appl. No. 11/212,313.
Office Action dated Jun. 22, 2009 in U.S. Appl. No. 11/515,270.
Office Action dated Jun. 24, 2009 in U.S. Appl. No. 11/373,468.
Office Action dated Jun. 24, 2009 in U.S. Appl. No. 11/519,352.
Office Action dated Mar. 30, 2009 in U.S. Appl. No. 11/515,270.
Office Action dated Mar. 4, 2008 from U.S. Appl. No. 10/973,657.
Office Action dated May 11, 2009 in U.S. Appl. No. 11/680,580.
Office Action dated May 27, 2009 in U.S. Appl. No. 11/439,613.
Office Action dated May 30, 2008 in Chinese Patent Application No. 02825938.6.
Office Action dated Oct. 16, 2008 in U.S. Appl. No. 11/327,544.
Office Action dated Sep. 1, 2008 in EP Application No. 06 256 215.2.
Office Action in European Patent Application No. 05 855 368.6 dated Nov. 20, 2008.
Office Action in Japanese Patent Application No. 2008-045351 dated Aug. 5, 2008.
Office Action in U.S. Appl. No. 11/212,555 dated Aug. 14, 2008.
Partial International Search Report dated Feb. 1, 2008 in Patent Application No. PCT/US2007/010630.
Search Report dated Mar. 20, 2008 in Patent Application No. PCT/US2007/077789.
Search Report dated May 15, 2008 in PCT Application No. PCT/US2007/019578.
Sinitsyn, Alexander. "A Synchronization Framework for Personal Mobile Servers," Pervasice Computing and Communications Workshops, 2004. Proceedings of the Second IEEE Annual Conference on, Piscataway, NJ, USA, IEEE, Mar. 14, 2004, pp. 208/212.
Spiller, Karen. "Low-decibel earbuds keep noise at a reasonable level", The Telegraph Online, dated Aug. 13, 2006, http://www.nashuatelegraph.com/apps/pbcs.dll/article?Date=20060813&Cate.. Downloaded Aug. 16, 2006.
Steinberg, "Sonicblue Rio Car," Product Review, Dec. 12, 2000, http://electronics.cnet.com/electronics/0/6342420/1304/4098389.html.
U.S. Appl. No. 11/144,541, filed Jun. 3, 2005.
U.S. Appl. No. 11/481,303, filed Jul. 3, 2006.
U.S. Appl. No. 11/530,767, filed Sep. 11, 2006.
U.S. Appl. No. 11/530,768, filed Sep. 11, 2006.
U.S. Appl. No. 11/530,807, filed Sep. 11, 2006.
Written Opinion dated Feb. 18, 2008 in Patent Application No. PCT/US2007/079766.
Written Opinion dated Jan. 6, 2009 in Singapore Application No. 200701865-8.
Written Opinion dated Jul. 7, 2008 in PCT Application No. PCT/US2007/076793.
Written Opinion dated Jun. 10, 2008 in PCT Application No. PCT/US2007/010630.
Written Opinion dated Mar. 20, 2008 from PCT Application No. PCT/US2007/077789.
Written Opinion dated Mar. 20, 2008 in Patent Application No. PCT/US2007/077789.
Written Opinion dated May 15, 2008 in PCT Application No. PCT/US2007/019578.
Written Opinion dated Oct. 10, 2008 in PCT Application No. PCT/US2007/077160.
Yee et al., "Faceted Metadata for Image Search and Browsing." Association For Computing Machinery, Conference Proceedings, Apr. 5, 2003.

References: Application No. 05824296
 Application No. 2003
 Application No. 2007
 Application No. 02825938
 Application No. 06
 Application No. 05
 Application No. 2008
 Application No. 200701865