PATENT CLAIM ANALYSIS

Application Number: 15906529
Application Type: Utility
Filing Date: 2018-02
Publication Date: 2019-06
Patent Classification: ["345", "420000"]

Abstract:
Techniques for identifying and labeling distinct objects within  3 -D images of environments in which vehicles operate, to thereby generate training data used to train models that autonomously control and/or operate vehicles, are disclosed. A  3 -D image may be presented from various perspective views (in some cases, dynamically), and/or may be presented with a corresponding  2 -D environment image in a side-by-side and/or a layered manner, thereby allowing a user to more accurately identify groups/clusters of data points within the  3 -D image that represent distinct objects. Automatic identification/delineation of various types of objects depicted within  3 -D images, automatic labeling of identified/delineated objects, and automatic tracking of objects across various frames of a  3 -D video are disclosed. A user may modify and/or refine any automatically generated information. Further, at least some of the techniques described herein are equally applicable to  2 -D images.

Claim (Index 1):
A computer-implemented method for identifying and labeling objects within images for training machine-learning based models that are used to autonomously operate vehicles, the method comprising:\n displaying, on a user interface of one or more computing devices, a three-dimensional (3-D) image of an environment in which vehicles operate, the 3-D image depicting one or more physical objects located in the environment; providing, on the user interface, a paint user control for use by a user to indicate areas within images displayed on the user interface; receiving, via a user activation of the paint user control, an indication of a location within the 3-D image; based upon the indicated location, (i) automatically determining, without any additional user input aside from the user activation, an area within the 3-D image, the area within the 3-D image being a subset of a total area of the 3-D image, the area including the indicated location and other locations within the 3-D image, the area representing a surface area depicted in the 3-D image of the environment, and the surface area being a particular type of surface area, (ii) automatically determining, from a plurality of visual properties, each of which denotes a different type of surface area, a particular visual property corresponding to the particular type of the surface area, and (iii) automatically modifying, by the one or more computing devices, the particular visual property of the automatically determined area representing the surface area of the particular type; obtaining, by the one or more computing devices, an indication of a particular label for the automatically determined area of the 3-D image; and storing, by the one or more computing devices in one or more tangible, non-transitory memories, an indication of an association between data indicative of the automatically determined area of the 3-D image and the particular label, thereby distinguishing the surface area from other physical objects depicted within the 3-D image.

Metadata:
- Claim Count in Document: 7.0
- Percentile: 88.0
- Lexical Diversity: 1.82955
- Patent Class: 345.0
- Transitional Phrase Type: open
- Component Type: 1
- Foreign Priority: False
- Related Applications: ['15906443', '15906676', '15906141', '15906610', '15692180']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.6919199767943555
- 35 USC 102 Novelty (BERT): 0.5117460553744896
- Combined Prediction Score: 0.673902584652369
- Mean Citation Score: 292.17445
- Max Citation Score: 327.44516
- Similarity Product: 304.2044646850372

Labels:
- Claim Label 101: 1
- Claim Label 102: 1
- Claim Label 103: 0
- Claim Label 112: 1
- Combined Label: 1
- Label 101 Adjusted: 1

Dataset: test