Patent ID: 11972536
Assignee: DALUX APS
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for monitoring the progress of the construction of at least one object at a construction site, wherein said object is constructed in multiple stages at said site, said method comprising the steps of:
a. providing a digital representation of a 3D model of at least part of said site, wherein said 3D model comprises a representation of said at least one object including coordinates of said object with respect to said 3D model;
said 3D model optionally comprising metadata;
b. capturing one or more images consisting of pixels at the site with a camera;
c. providing an image location and direction for each of said one or more images allowing locating and orienting said images with respect to said 3D model;
d. for each image location and direction rendering the 3D model into a virtual projection consisting of virtual pixels;
e. using at least one of said images to detect a presence of said at least one object or a part of said at least one object by applying a machine learning model on said image, wherein the machine learning model has been trained to detect said object or a part of said at least one object;
f. for each image where the presence of said object has been detected, identifying the stage of progress of construction of said at least one object applying a machine learning model on said image, wherein the machine learning model has been trained to recognize different stages of said multiple stages;
g. feeding the rendered projection into a digital processor, thereby displaying or comparing a relevant part of the 3D model and the at least one image;
h. presenting the stage of progress of the detected object with reference to the 3D model; and
wherein step b. further comprises capturing at least two images with a camera from different locations of said site; and
the method further comprises steps of localizing the detected objects comprising:
j-i. calculating the distance between the different locations;
j-ii. identifying any common features apparent in said at least two images;
j-iii. determining the coordinates of any identified common features by triangulation using the coordinates of said locations, the calculated distance between said locations, the direction of capture of said images, and the position of the identified common features in said at least two images;
j-iv. for each identified common feature adding a point to a point cloud representation at the coordinates determined by the triangulation;
j-v. aligning the point cloud representation with the 3D model; and
j-vi. using the generated point cloud representation to confirm the presence of any detected objects with reference to the 3D model.