Patent ID: 8824736

Claim:
A system for real time tracking of a marker-free object from a real scene in a video stream, the system comprising: one or more mobile device including a processor, a memory, a transceiver, a display, and an image sensor; and a server in communication with the mobile device, wherein the server includes a server transceiver and an object-tracking and video-stream enrichment application stored in a server memory, wherein the server executes the application to: receive one or more video streams from the one or more mobile devices; determine a position and orientation of one or more marker-free objects to be tracked in the one or more video streams based on a plurality of image blocks determined beforehand, wherein each image block is associated with a pose of the one or more marker-free objects to be tracked; track one or more marker-free objects in the one or more video streams; integrate a virtual object or a secondary video stream into the one or more video streams to create one or more modified video streams based on the pose of the one or more marker-free objects; and transmit the one or more modified video streams to the one or more mobile devices for presentation on the one or more mobile devices.