Patent ID: 11900490
Assignee: MORGAN STANLEY SERVICES GROUP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A method comprising:
storing, in a computer database of a back-end computer system, building ordinance data for a government agency and permit data for real properties in the government agency; and
determining, by a mobile device that is in communication with the back-end computer system via an electronic data network, a physical address for a subject property, wherein the mobile device comprises a GPS receiver, one or more inertial sensors, a camera system that comprises one or more cameras, and a display, wherein determining the physical address for the subject property comprises determining the physical address for the subject property based on a location and an orientation of the mobile device, wherein the location and orientation of the mobile device are determined based on, at least in part, inputs from the GPS receiver and inputs from the one or more inertial sensors; and
after determining the physical address for the subject property, in real time as a user of the handheld mobile device moves around the subject property, by the mobile device:
detecting, using computer vision, a first object at the subject property in a field of view of a camera system of the mobile device;
determining, based on visual media captured by the camera system, a compliance status of the first object, wherein the compliance status comprises an assessment of whether the first object is compliant with ordinances and permitting requirements of the government agency, and wherein the assessment comprises, when a permit for the first object is required, a permit compliance assessment that comprises (a) whether a permit for the first object at the subject property exists in the computer database and (b) upon a determination that the permit for the first object at the subject property exists in the computer database, a comparison of (i) dimensions and position of the first object at the subject property, based on an image of the first object captured by the handheld mobile device, to (ii) dimensions and position for the first object according to the permit; and
displaying, on the display of the mobile device, augmented reality, wherein the augmented reality comprises real time visual media captured by the camera system of the handheld mobile device and a first virtual indicator for the first object within the field of view of the camera system, wherein the first virtual indicator is overlaid on the first object in the display, and wherein the first virtual indicator indicates the compliance status of the first object.