Patent Document ID: 9659224
Application ID: 14230471

Base Claim:
1. A non-transitory computer-readable storage medium storing instructions executable by one or more processors of a device to cause a method to be performed for merging recognized text from a plurality of frames of image data, the method comprising: sending, from the device to one or more servers in communication with the device via a network, at least a portion of a first frame of image data including a first portion of a scene having at least a first captured textual item, the first captured textual item within a first bounding box corresponding to a region of the first frame; receiving, from the one or more servers, first recognized text corresponding to the first captured textual item, the one or more servers having generated the first recognized text using optical character recognition; displaying the first recognized text on a display; sending, from the device to the one or more servers, at least a portion of a second frame of image data including a second portion of the scene having at least a second captured textual item, the second captured textual item within a second bounding box corresponding to a region of the second frame; receiving, from the one or more servers, second recognized text corresponding to the second captured textual item; determining an edit distance between the first recognized text and the second recognized text; determining that the edit distance satisfies an edit distance threshold, wherein the edit distance threshold depends on at least one of a type of the first recognized text or of the second recognized text; determining an overlap of the first bounding box relative with the second bounding box; determining that the first captured textual item matches the second captured textual item based at least in part on the edit distance and on the overlap; generating merged text based at least in part on the first recognized text and the second recognized text; and displaying the merged text on the display.

---

Claim 2:
2. The non-transitory computer-readable storage medium of claim 1 , wherein merging the first recognized text and the second recognized text to produce merged text comprises selecting a first portion of the first recognized text based at least in part on a first confidence level and selecting a second portion of the second recognized text based at least in part on a second confidence level.