Patent ID: 9484046
Filing Date: 2016-11-01
CPC Classification: G06F,G06K,G06Q,G06T,G10L,H04M,H04N,H04W

Claim Text:
1. A method comprising the acts: receiving audio data using a microphone of a user's portable device; receiving image data using a camera of said device; recognition-processing both the received audio and image data—without a user being required to operate a user interface control to switch between an audio recognition mode and an image recognition mode, said recognition-processing being performed by a hardware processor configured to perform such act; presenting a graphical user interface on the screen of the portable device, and displaying the image data received from the camera in a viewfinder region of said graphical user interface; also presenting, in said graphical user interface, a stack of tiles, each of which corresponds to an item of recognized content, said stack including a first tile corresponding to a first item of recognized audio content, and a second tile corresponding to a second item of recognized visual content, wherein said user interface similarly represents items of recognized audio and visual content by tiles corresponding thereto; said stack of tiles growing in size on said screen as successive items of content are recognized, until a first dimension is reached, after which older tiles disappear off the screen, wherein said first dimension assures that the viewfinder region is preserved for presentation of the image data from the camera; each of the tiles in the stack having a payoff associated therewith, the user interface requiring user interaction with the first tile to initiate a first payoff corresponding to said item of recognized audio content, but not requiring user interaction with the second tile to initiate a second payoff corresponding to said item of recognized visual content, said second payoff instead being initiated automatically; wherein said user interface, which similarly represents items of recognized audio and visual content by tiles corresponding thereto, differently treats initiations of payoffs for said items.