APPARATUS AND METHOD FOR IMPROVING CONSTRUCTION PRECISION BASED ON XR

Disclosed is an apparatus for improving construction precision based on extended reality (XR). At least one piece of XR content related to a construction target positioned in front inside a construction site is displayed on a display unit. When a construction position of a construction object included in the construction target is determined, the XR content including the design information of the construction object at the construction position is displayed on the display unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

A claim for priority under 35 U.S.C. § 119 is made to Korean Patent Application No. 10-2023-0007490 filed on Jan. 18, 2023 in the Korean Intellectual Property Office, the entire contents of which are hereby incorporated by reference.

BACKGROUND

Embodiments of the present disclosure described herein relate to an apparatus for improving construction precision based on extended reality (XR).

Recently, an extended reality (XR) technology has been employed in many fields.

Meanwhile, the XR technology has not yet been applied to fields such as building, construction, and surveying, and previous construction and surveying technologies are used without change, so inefficient construction has continuously been performed due to frequent errors.

Accordingly, it is expected that the error is significantly reduced to improve the construction precision, when the XR technology is applied even to the building, the construction, or the surveying. Accordingly, costs may be reduced and extra work may be significantly reduced. However, currently, such a technology is not open.

SUMMARY

Embodiments of the present disclosure provide an apparatus for providing construction precision based on XR.

Embodiments of the present disclosure provide an apparatus for providing construction precision based on XR, capable of displaying, on a display unit, at least one piece of XR content related to a construction target.

Embodiments of the present disclosure provide an apparatus for providing construction precision based on XR, capable of displaying, on a display unit, XR content, which contains design information of a construction object, at a construction position of the construction object included in a construction target, when the construction position is determined.

Problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present disclosure, an apparatus for improving construction precision based on extended reality (XR) includes a display unit to display at least one piece of XR content related to a construction target positioned in front inside a construction site, a sensor unit to recognize an identification (ID) code for information related to the construction target in the construction site, and a processor to acquire the related information through the ID code recognized through the sensor unit, detect a construction position of the construction target, based on the acquired related information, and control to display the XR content on the display unit, based on the detected construction position.

In addition, the processor may control to display XR content, which includes design information of a specific construction object, which included in the specific construction target, at a construction position of the specific construction object, on the display unit, when the construction position of the specific construction object included in the specific construction target is determined, based on a sensing result obtained through the sensor unit.

In addition, the processor may control to display XR content, which is to instruct a construction object included in the construction target to be marked at a position to be constructed, on the display unit, based on a sensing result obtained through the sensor unit.

In addition, the processor may recognize construction instruction information marked in the construction site, based on the sensing result obtained through the sensor unit, and compare the construction instruction information recognized with design information of a design object to calculate an error rate.

In addition, the processor may display, on the display unit, at least one piece of XR content including correction information for correct an error of the recognized construction instruction information, based on the construction instruction information and the design information of the construction object, when the calculated error rate is out of a preset error range.

In addition, the processor may determine a construction stage of the construction target by identifying at least one of a construction object constructed in a construction site or construction instruction information marked in the construction site, based on the sensing result obtained through the sensor unit, and control to display at least one piece of XR content for next construction of the construction target on the display unit, depending on the determined construction stage.

In addition, the apparatus may sense the construction site without movement, to a time point at which construction of the construction target is finished, from a time point at which the construction of the construction target is started

In addition, the processor may determine the construction position of the construction target in a relational enhancement manner, based on position relationship between a plurality of identification codes sensed through the sensor unit, when the plurality of identification codes are sensed through the sensor unit.

According to an embodiment of the present disclosure, a method executed by an apparatus for improving construction precision based on XR may include recognizing an ID code for information related to a construction target in a construction site, based on a sensing result obtained through a sensor unit, acquiring the related information, based on the recognized ID code, detecting the construction position of the construction target, based on the acquired related information, and displaying at least one piece of XR content related to the construction target positioned in front, in the construction site on a display unit, based on the detected construction position .

Besides, computer program stored in a computer-readable medium to execute a method for implementing the present disclosure may be further provided.

Besides, a computer-readable medium having computer program to execute a method for implementing the present disclosure may be further provided.

DETAILED DESCRIPTION

The same reference numerals will be assigned to the same components throughout the whole specification. In the following description of the present specification, all components are not described, and content well known in the art to which the present disclosure pertains or the duplication between embodiments will be omitted. In the specification, the terms “unit”, “˜module”, “˜member” or “˜block” maybe implemented in software or hardware. According to embodiments, a plurality of units, a plurality of modules, a plurality of members, or a plurality of blocks can be implemented by using one component or one unit, one module, one member, or one block may include a plurality of components.

In the whole specification, when a certain part is “linked to”, “coupled to”, or “connected with” another part, the certain part may be directly linked to, coupled to or connected with the another part, and an indirection link, an indirection coupling, or an indirection connection includes a link, a coupling, or a connection through a wireless communication network.

It will be understood that the terms “comprises,” “comprising,” “includes” and/or “including,” when used herein, specify the presence of stated elements and/or components, but do not preclude the presence or addition of one or more other elements and/or components.

In the present specification, when a member is positioned on another member, this includes not only when the member is in contact with the other member, but also when another member is present between the two members.

In the specification, the term “first and/or second” will be used to distinguish between components, and the components are not limited to the above-described terminology.

The articles “a”, “an”, and “the” are singular in that they have a single referent, but the use of the singular form in the specification should not preclude the presence of more than one referent.

Reference numerals in steps are only for the illustrative purpose, and not used to describe the sequence of the steps. The steps may be replicated in a sequence different from a sequence, which is described, unless otherwise specified.

Hereinafter, the operating principle of the present disclosure and embodiments will be described with reference to accompanying drawings.

Herein, an “XR device100according to the present disclosure” includes various devices to provide a result for a user by performing an arithmetic operation. For example, the “XR device100according to the present disclosure” may be provided in the form of any one of a computer, a server device, and a portable terminal.

In this case, the computer may for example, include a laptop computer, a desktop, a laptop, a tablet PC, or a slate PC equipped with a WEB browser.

The server device, which is a server to process information by making communication with an external device, may include an application server, a computing server, a database server, a file server, a game server, an e-mail server, a proxy server, and a web-server.

The portable terminal, which is, for example, a wireless communication device ensuring portability and mobility, may include, all kinds of handheld-based wireless communication devices, such as a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC), a Personal Handyphone System (PHS), a Personal Digital Assistant (PDA), an International Mobile Telecommunication (IMT)-2000, a Code Division Multiple Access (CDMA)-2000, a W-Code Division Multiple Access (W-CDMA), a Wireless Broadband Internet (Wibro) terminal, or a wearable device such as a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lens, or a head-mounted-device (HMD).

FIG.1is a schematic view illustrating a system (hereinafter, XR content providing system) for providing content based on XR according to an embodiment of the present disclosure.

Referring toFIG.1, the XR content providing system10includes the XR device100, XR content providing device200, and a worker terminal300.

According to an embodiment of the present disclosure, the XR content providing device200receives design data from terminals of various workers. This is because design data for various construction processes (targets) such as Civil, Structure, Architecture, HVAC, UT, EL, IN, FF, or FI are required for the design of construction facilities, and the person in charge of designing the construction facilities may have various characteristics.

According to an embodiment of the present disclosure, the XR content providing system10is the system10having a process for integrating individual construction processes is established, and applied with a coding technology personally developed and applied to the system10.

According to an embodiment of the present disclosure, the XR content providing device200generates XR content for a construction site using design data received from various workers as described above.

In addition, the XR content providing device200provides the generated XR content to the XR device100worn by workers working at the construction site, edits the XR content based on editing information received from the XR device100, and reflects the editing result in the design data.

In this case, the XR content providing device200may edit the XR content based on the received editing information, and update the editing details to the BIM design data and a tool (Revit).

According to an embodiment of the present disclosure, the XR content providing device200collects Revit data, which is uploaded by a BIM manager, for each part, transforms a file format, performs automation processing to a template import, and generates XR content, and provides the generated XR content to the XR device100. Thereafter, the XR content is displayed through the XR device100worn by a worker.

In addition, according to an embodiment of the present disclosure, when editing information, such as additional placement or adjustment of shape information, is received by the XR device100of a site worker, the XR content providing device200transforms the received editing information into a Revit file format.

In addition, the worker at the site may determine information on design information or a construction position related to a target (construction target) to be constructed at the construction site using the XR device100.

Hereinafter, an operation of the XR device100will be described in more detail with reference to other drawings.

FIG.2is a block diagram illustrating the XR device100for improving construction precision based on XR, according to an embodiment of the present disclosure.

Referring toFIG.2, the XR device100for improving construction precision based on XR according to an embodiment of the present disclosure includes a processor110, a communication unit120, a memory130, a sensor unit140, and a display unit150.

However, according to some embodiments, the XR device100may include fewer components or more components in number than the components illustrated inFIG.2.

The processor110may be implemented through an algorithm for controlling the operation of components provided in the XR device100for improving construction precision based on XR, or the memory130for storing data for a program for reproducing the algorithm, and at least one processor110for performing the above operation using the data stored in the memory130. In this case, the memory130and the processor110may be implemented using separate chips. Alternatively, the memory130and the processor110may be implemented into a single chip.

In addition, the processor110may perform a control operation by combining any one component or a plurality of components described above, to implement various embodiments of the present described, which are to be described with reference to following drawings, on the XR device100to improve construction precision based on the XR.

The XR device100may make communication with the XR content providing device200through the communication unit120.

According to an embodiment of the present disclosure, the XR content providing device200is configured to further include a server device and may be implemented in the form of a server.

The communication unit120may include one or more components that enable communication with an external device, and for example, may include at least one of a broadcast receiving module, a wired communication module, a wireless communication module, a short-range communication module, and a position information module.

The wired communication modules may include various wired communication modules, such as local area network (LAN) modules, wide area network (WAN) modules, or value added network (VAN) modules, and various cable communication modules, such as a universal serial bus (USB), a high definition multimedia interface (HDMI), a digital visual interface (DVI), an RS-232 (recommended standard 232), power line communication, or plain old telephone service (POTS).

In addition to a Wi-Fi module and a wireless broadband module, the wireless communication module may include wireless communication modules which support various wireless communication methods such as global system for mobile communication (GSM), code division multiple access (CDMA), wideband code division multiple access (WCDMA), a universal mobile telecommunications system (UMTS), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), 4G, 5G, or 6G.

The wireless communication module may include a wireless communication interface including an antenna to transmit a signal and a transmitter. In addition, the wireless communication module may further include a signal conversion module configured to modulate a digital control signal, which is output from the controller, to an analog wireless signal through the wireless communication interface, under the control of the controller.

The short-range communication module, which is used for short range communication, may support short range communication by using at least one of Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies.

The sensor unit140senses at least one of internal information of the XR device100for improving the construction precision based on XR, surrounding environment information of the XR device100which improves the construction precision based on XR, and user information, and generates a sensing signal corresponding thereto. The controller may drive the XR device100for improving the construction precision based on the XR, or control the operation of the XR device100for improving the construction precision based on the XR, processes data related to an application program installed in the XR device100for improving the construction precision based on the XR, or perform the function or the operation of the XR device100for improving the construction precision based on the XR.

As described above, the sensor unit140may include at least one of a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, an optical sensor (for example, a camera), a microphone, or an environmental sensor (e.g., a barometer, a humidity meter, a radioactivity sensor, a heat sensor, or a gas sensor), or a chemical sensor (for example, a healthcare sensor, or a biometric sensor). Meanwhile, the XR device100for improving the construction precision based on the XR may utilize the combination of multiple pieces of information sensed by at least two sensors among the above sensors.

According to an embodiment of the present disclosure, the sensor unit140may include at least one LiDAR device or at least one camera.

In addition, various sensors may be employed as long as the sensors are to perform a method for improving the printed circuit board of claim based on the XR.

The camera processes an image frame, such as a still image frame, or a moving picture frame, obtained by the image sensor in a photographing mode.. The processed image frame may be displayed on the display unit150or stored in the memory130.

According to an embodiment of the present disclosure, the XR device100may include a transparent display to operate based on augmented reality.

The display unit150displays at least one piece of XR content related to a construction target located in front of the construction site.

The person in charge of the construction site may wear the XR device100, secure a field of view through the transparent display, and determine at least one piece of XR content provided to the transparent display.

The display unit150displays (outputs) information processed by the XR device100for improving the construction precision based on XR. For example, the display unit150may display execution screen information of the application program (e.g., an application) run by the XR device100for improving the construction precision based on XR, or user interface (UI) or graphic user interface (GUI) information based on the execution screen information.

The memory130may store data for supporting various functions of the XR device100for improving the construction precision based on XR, input/output data (for example, a music file, a still image, or a moving picture image), various application programs (or applications) run on the XR device100for improving the construction precision based on the XR, and data and instructions for the operation of the XR device100for improving the construction precision based on the XR. At least some of these applications may be downloaded from an external server through wireless communication.

The memory130may include at least one type storage medium among a memory in the type of a flash memory (e.g., see reference numeral130), a hard disk type, an SSD type, a solid state disk type, a silicon disk drive type, a multimedia card micro type, or a card type (for example, an SD memory or an XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory, , a magnetic memory, a magnetic disk, or an optical disk. In addition, the memory130may be separated from the XR device100for improving the construction precision based on the XR, but may include a database connected to in a wired or wireless manner.

According to an embodiment of the present disclosure, the XR device100may further include an input unit, an output unit, and an interface unit.

According to an embodiment of the present disclosure, the XR device100may be applied with “Hololens2”. Components included in the “Hololens2” may be employed as components of the XR device100.

The input unit is to input image information (or signal), audio information (or signal), data, or information input from a user, and may include at least one of a camera, at least one microphone, or a user input unit. The voice data or image data collected by the input unit may be analyzed and processed through a user control command.

The user input unit is to receive information from a user. When information is input through the user input unit, the controller may control the operation of the XR device100for improving the construction precision based on XR to correspond to the input information. The user input unit may include a hardware-type physical key (for example, a button, a dome switch, a jog wheel, or a jog switch, etc. positioned on at least one of the front, rear, and side surfaces of the XR device100for improving the construction precision based on XR), and a software-type touch key. For example, the touch key may include a virtual key, a soft key, or a visual key displayed on the display unit150in the touch-screen type through software processing, or may include a touch key positioned in a part other than the touch screen. Meanwhile, the virtual key or the visual key may be displayed in various forms on the touch screen, and may be, for example, graphic, a text, an icon, a video, or the combination thereof.

The output unit, which is to generate an output related to visual, auditory, or tactile senses, may include at least one of the display unit150, an audio output unit, a haptic module, or a light output unit. The display unit150may implement a touch screen by forming a layered structure with or integrally forming a touch sensor. Such a touch screen, which functions as a user input unit which provides an input interface between the XR device100for improving the construction precision based on XR and the user, while providing an output interface between the XR device100for improving the construction precision based on the XR and the user.

The sound output unit may output audio data received through the communication unit120or stored in the memory130, or output a sound signal related to functions performed by the XR device100for improving the construction precision based on the XR. The sound output unit may include a receiver, a speaker, or a buzzer.

The interface unit serves as a passage with various types of external devices connected to the XR device100for improving the construction precision based on the XR. Such an interface unit may include at least one of a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port connecting a device equipped with an identification module (SIM), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, or an earphone port. The interface unit may perform a proper control operation related to an external device connected to the interface unit, in the XR device100for improving the construction precision based on the XR.

FIG.3is a flowchart illustrating a method for improving the construction precision based on XR, according to an embodiment of the present disclosure.

The processor110recognizes an identification (ID) code for information related to the construction target positioned inside the construction site, based on the sensed result by the sensor unit140(S100)

The processor110acquires related information based on the ID code recognized in S100. (S200)

FIG.4is a view illustrating sensing forward by installing the XR device100in a construction site.

Referring toFIG.4, when first sensing the construction site, the XR device100may sense the construction site, without movement to a time point at which the construction is finished, from a time point at which construction of the construction target is started.

The XR device100may be mounted on a mounting member190as illustrated inFIG.4, and the mounting member190may include a beacon.

After sensing the construction site at the fixed position, the XR device100may sense the construction site by recognizing the change in position as the XR device100moves.

The sensor unit140may recognize an ID code for the information on the construction target within the construction site.

According to an embodiment of the present disclosure, the processor110may sense the construction site through the camera of the sensor unit140.

The processor110may recognize at least one ID code, a mark displayed for construction of the construction target, and a completed construction target, from an image captured by the camera. The processor110may synchronize the actual object with at least one piece of XR content displayed on the display unit150based on the recognized result.

The processor110determines the construction position of the construction target, based on the related information obtained in S300(S300)

The processor110displays at least one piece of XR content on the display unit150, based on the construction position identified in S300(S400)

The worker at the construction site may display the construction position for the construction target at the construction site by referring to the XR content displayed on the display unit150.

According to an embodiment, the processor110may display the XR content including the construction position for constructing the construction target, on the display unit150.

According to an embodiment, the processor110may display at least one piece of XR content for instructing the construction target included in the construction target to be marked/displayed on a position for constructing, on the display unit150, based on the result sensed through the sensor unit140.

FIG.5is a view illustrating that the construction position of the construction target (pipeline) to be actually constructed next to a pipeline is marked in the construction site.

Referring toFIG.5, reference numeral “A” indicates an object which has already been installed, and reference numeral “B” indicates a mark (information for instructing construction) of a construction object, which is displayed on the display unit150by the processor110, constructed at a construction site by a worker

When the information (construction instruction information) for instructing construction is marked/displayed to construct the construction object as described above, a request is made such that a person in charge of the construction proceeds with the construction.

According to an embodiment of the present disclosure, the construction target may include at least one construction object. When one construction object is provided, the construction target may be the construction object itself.

According to an embodiment, the processor110may recognize the construction instruction information marked at the construction site, based on the result sensed through the sensor unit140, and calculate an error rate by comparing the recognized construction instruction information with the XR content provided when instructing the construction position.

More specifically, the processor110may recognize the construction instruction information marked at the construction site based on the result sensed through the sensor unit140, and calculate an error rate (degree of error) by comparing the recognized construction instruction information with design information or BIM design data of the corresponding construction object.

According to an embodiment, when the calculated error rate (degree of error) is out of a preset error range or exceeds a preset error range, the processor110may display at least one piece of XR content, which includes correction information for correcting the error of the recognized construction instruction information, on the display unit150, based on the construction instruction information and design information (BIM design data) of the corresponding construction object.

A worker in the site may identify the correction information displayed on the display unit150and mark/display construction instruction information again. Accordingly, the error may easily be corrected/modified, as compared to a conventional technology.

According to an embodiment, the correction information may include at least one of information on the construction object having the error, a portion, which requires error-correction, of the construction instruction information, and information on a position for constructing the corresponding construction object. According to some embodiments, when the portion, which requires the error-correction, of the construction instruction information is equal to or greater than a reference value, the processor110may delete the construction instruction information and may derive the correction information for instructing a new mark.

FIG.6is a view illustrating that the XR content including design information of a construction object is displayed on the display unit150.

Referring toFIG.6, when the construction position of the specific construction object included in the construction target is determined based on the result sensed through the sensor unit140, the processor110may control the XR content including design information of the specific construction object at the determined construction position of the specific construction object, to be displayed on the display unit150.

FIG.7is a view illustrating that an installation position of a braille block on a sidewalk block is marked using XR content.

FIG.8is a view illustrating that a braille block is constructed based on the XR content ofFIG.6.

The worker in the construction site may recognize the XR content for construction of the braille block displayed on the display unit150of the XR device100and display/mark construction instruction information at the construction site. In addition, a person in charge of the construction for the braille block may construct the braille block as illustrated inFIG.8, based on the construction instruction information displayed/marked at the construction site.

FIG.9is a view illustrating that the construction position of the construction object is marked at the construction site, based on the XR content for the construction object.

FIG.10is a view illustrating that a construction object is constructed depending on the construction position illustrated inFIG.8.

FIG.11is a view illustrating that a construction object to be constructed next to the construction stage ofFIG.10is displayed using the XR content.

When the construction site is sensed through the sensor unit140while the block (construction object) is constructed as illustrated inFIG.10, the processor110may determine a construction stage of the construction target, based on the result sensed through the sensor unit140.

The processor110may recognize the construction object constructed at the construction site based on the design information including the construction position for at least one construction object included in the construction target, determine the construction stage based on the recognized construction object, and detect the construction object to be constructed next.

In addition, the processor110may control to display at least one piece of XR content for the construction of the construction object to be constructed next, on the display unit150.

According to an embodiment, the processor110may determine the construction stage of a construction target by identifying at least one of a construction object constructed at the construction site or construction instruction information marked/displayed at the construction site, based on the result sensed through the sensor unit140.

According to an embodiment, the processor110may display at least one piece of XR content for the next construction (next construction object) of the construction target, on the display unit150, depending on the determined construction stage.

According to an embodiment of the present disclosure, a QR code may be applied to the ID code, and various units are applicable as long as the various units perform an identifying operation.

According to an embodiment, each ID code may be used as a trigger unit which stores the coordinates of the construction site, and position information of the XR content (specifically position information of an object (object) in the XR content) or loads the position information.

According to an embodiment, when a plurality of ID codes sensed through the sensor unit140are provided, the processor110may determine the construction position of the construction target in a relational enhancement manner, based on the position relationship between the plurality of identification codes sensed through the sensor unit140.

The XR device100should determine the construction position of the construction target using only one ID code or determine using at least one of an object around the ID code, construction instruction information, and a construction object. When the plurality of ID codes are sensed as described above, the construction position of the construction target is detected based on the position relationship between ID codes through the relational enhancement manner. Accordingly, in more detail, the construction target, and the construction position of the construction object may be determined.

According to an embodiment of the present disclosure, the XR device100may store at least partial XR content of at least one piece of XR content for a construction target in the memory130, and may receive the XR content from the XR content providing device200through the communication unit120.

According to an embodiment, the processor110of the XR device100may generate editing information, which is contained in the XR content, for the XR content, depending on an editing input to the XR device100and provide the editing information to the XR content providing device200.

According to an embodiment, when a user gesture is recognized in a captured image of the sensor unit140and the recognized gesture is determined as corresponding to editing information for a specific object in the XR content, the processor110may provide the editing information to the XR content providing device200to reflect the change corresponding to the editing information in the XR content. In addition, the processor110may provide the XR content, in which the editing information is reflected, back to the extended reality device according to an embodiment.

Hereinafter, the XR content providing device200to produce the XR content used in the above-described embodiment will be described.

FIG.12is a block diagram of the XR content providing device200according to an embodiment of the present disclosure.

Referring toFIG.12, according to an embodiment of the present disclosure, the XR content providing device200includes a processor210, a communication unit220, a memory230, and a rendering unit260.

FIG.13is a view illustrating the operation of the XR content providing device200according to an embodiment of the present disclosure.

Since the processor210, the communication unit220, and the memory230have the basic functions the same as the above-described basic functions, the duplication thereof will be omitted to avoid redundancy. The following description will be made while focusing a method for providing the extend reality content.

The processor210controls components in the XR content providing device200, and provides XR content providing service by executing various commands, and algorithms stored in the memory230.

According to some embodiments, the processor210may provide XR content providing service using an artificial intelligence (AI) model which is trained previously.

In addition, the processor210may control the combination of any one or more of the components discussed above to implement, on the device, various embodiments, which are to be described below with reference to accompanying drawings, of the present disclosure.

The communication unit220receives BIM design data from worker terminals300of a plurality of different workers, and communicates with the XR device100of the site worker.

The memory230may store shape information and attribute information generated based on the BIM design data received from the worker terminal300of the plurality of different workers, and may include a plurality of different storage spaces. According to some embodiments, the memory230may further include a cloud storage space.

The memory230stores a plurality of templates, which are preset, to generate XR content.

According to an embodiment of the present disclosure, the pre-set templates are pre-made such that the XR content is generated when the processor210reflects the shape information and attribute information of the object, and may have basic matters for XR content which are preset.

According to some embodiments, the memory230may store the BIM design data received from the worker terminals300of the plurality of different workers.

The rendering unit260may perform a rendering operation for a3D image by using the BIM design data, and the shape information and the attribute information of the object.

In addition, when the processor210receives an operating signal or editing information for an object, which is contained in the XR content, from the XR device100, the processor210controls the rendering unit260to perform the rendering operation for the object in real time depending on the received operation signal or editing information, and provides the rendered image to the XR device100, such that site workers may feel the same realism as actually manipulating and editing objects.

The processor210stores the BIM design data, which are received from the worker terminals300of the plurality of different workers, in the memory230.

The processor210generates the shape information and the attribute information for generating at least one piece of XR content, based on the received BIM design data.

The processor210generates at least one piece of XR content, based on the shape information and the attribute information generated in S200.

The processor210transmits at least one piece of XR content to the XR device100and controls the at least one XR content to be displayed on the XR device100.

When editing information on the XR content is received from the XR device100, the processor210reflects the change corresponding to the editing information in the XR content and provides the changed content to the XR device100.

The XR content providing device200according to an embodiment of the present disclosure may generate the at least one piece of XR content based on the templates which are preset.

In this case, the XR content providing device200generates XR content by automatically applying different data to Templates according to the construction process to generate content.

In this time, the data to be applied/input to the templates is information on the construction process, and the shape information and attribute information may correspond to the information on the construction process.

In other words, the processor210generates the shape information and attribute information for generating XR content, based on the BIM design data, which refers to generating information to be applied/input to the templates preset, to generate the XR content for the relevant construction process.

Hereinafter, performing the operation of the processor210will be described in more detail.

According to an embodiment of the present disclosure, XR content may be applied to any one technology of a virtual reality technology, or augmented reality technology. For example, the XR content may include AR content, VR content, and MR content.

As described above, the communication unit220of the XR content providing device200may receive design data from worker terminals300of various workers, such as Civil, Structure, Architecture, HVAC, UT, EL, IN, FF, and FI.

In addition, the processor210may store the design data, which is received from the worker terminal300of the worker, in the memory230.

The BIM design data received from the worker terminal300of the worker is BIM design data for the field of the worker in charge among various BIM design data, and is to be transformed to XR content.

According to an embodiment of the present disclosure, the XR content providing device200may generate at least one of shape information and attribute information, based on the BIM design data.

More specifically, the memory230stores an algorithm for collecting information and an algorithm for transforming information.

The processor210may collect BIM design data received from the worker terminals300of a plurality of different workers through the algorithm for collecting the information. The processor210may transform the collected data to shape information and attribute information for generating the XR content.

Next, the processor210may generate at least one object in the XR content based on the shape information and the attribute information.

In other words, according to an embodiment of the present disclosure, the XR content providing device200may generate the XR content by generating an object including the shape information and the attribute information necessary for design using design data for the construction site.

According to an embodiment of the present disclosure, the memory230may store a Revit program, and the processor210may generate Revit object data including shape information and attribute information by collecting and converting BIM design data using the Revit program.

According to an embodiment of the present disclosure, the shape information of the object may include information which may be displayed in a shape through XR content.

The processor210may determine a visual attribute or a non-visual attribute by analyzing the BIM design data, determine at least one object to be displayed in the XR content based on the determination result, and generate the shape information and the attribute information for each object.

According to an embodiment, the processor210may analyze the data collected on the BIM design data to extract an object included in the design data, and generate the shape information and attribute information for each object, based on the BIM design data related to each object.

For example, the processor210may extract objects, such as pipes, fire-fighting facilities, pillars, or communication facilities, which are included in BIM design data, and generate shape information and attribute information of each of the extracted objects.

The processor210extracts an object, which is included in the BIM design data, and generates shape information and attribute information of each object through the above process. Accordingly, the processor210may generate the XR content using the shape information and the attribute information.

The processor210may perform a test on the generated XR content to detect an object or error which is incorrectly generated in the content. In addition, the processor210may convert the tested XR content into an available state and provide the XR content, in response to the request of the worker in the site through the XR device100.

The processor210may control the rendering unit260to render each selected object in the XR content based on the shape information of each selected object.

The processor210may determine whether to display or hide each object, which is contended in the XR content, under the basic viewing condition of the XR device100.

In this case, the basic viewing condition is a condition in which a function, such as zoom-in, zoom-out, or transmission, is not executed. When the condition for viewing XR content in the XR device100is changed, an object to be displayed as XR content may be changed.

According to an embodiment, the processor210may hide an object out of range through the Sphere Mask setting, and may provide a cross-sectional view function through the setting of ‘section’.

The processor210may provide at least one piece of XR content to the XR device100connected to the XR content providing device200.

In more detail, when a request signal for XR content is received from the XR device100, the processor210may transmit and provide at least one piece of XR content corresponding to the request signal to the XR device100.

In this case, the request signal for XR content may be performed by recognizing a reference mark (e.g., a code), and in detail, may be implemented by recognizing a QR marker.

Accordingly, when a site worker at a specific construction site recognizes the QR Marker at the site while carrying or wearing the XR device100, XR content is requested, and the XR content providing device200transmits XR content, which corresponds to the information about the QR Marker, to the XR device100.

In this case, when the position information of the QR marker matches the position information of the XR device100, the processor210may transmit the XR content.

Although the QR marker is described as the request signal according to the above-described embodiment, it is not necessarily required to proceed through the method for recognizing the code.

The processor210may determine the level of detail (LOD) of each object based on the shape information of each object included in the XR content, and control the rendering unit260based on the determined LOD of each object to render each object in at least one piece of XR content.

According to an embodiment, the processor210may calculate an importance based on the role of each object in at least one piece of XR content, and calculate the LOD based on the calculated importance.

According to an embodiment, the importance of each object is set for each category, and the processor210may determine the role of each object depending on the purpose of the XR content.

The processor210may calculate the relative importance and visibility of each object contained in the XR content displayed on the XR device100, based on the position information of each object included in the at least one piece of XR content, the real-time position of the XR device100, and shape information and attribute information of each object.

The processor210may determine whether to display or hide each object on or from the XR content, based on the calculated relative importance and visibility.

According to an embodiment, the processor210may determine whether to display or hide each object on or from XR content based on the importance with at least one object adjacent to each object.

For example, all objects are displayed with respect to XR content in a first Raw state in which any control signal is not input. When a site worker wears the XR device100, state information of each object is generated based on the information and position of the site worker and the relative relationship between the site worker and each object, and reflected in the XR content such that each object is rendered.

According to an embodiment, the processor210may highlight an object, which has specific importance or more, among the objects and display the highlighted object on the XR content.

The processor210may reload the position information of the XR device100at every preset time to recalculate the relative importance and visibility, and reflect the relative importance and the visibility in the XR content, thereby performing a rendering operation such that the change for each object included in the XR content displayed with respect to the XR device100is reflected.

The XR content providing device200may highlight or display a specific object having the higher importance in a relevant site through the above configuration, or hide a specific object having the less importance in the site or having a longer distance from a present position of a worker without being displayed, to provide a sense of realism to a site worker carrying and wearing the XR device100.

According to an embodiment of the present disclosure, the XR content providing device200may provide various operating options according to the specifications of the XR device100.

In more detail, the processor210may determine an operating option of the XR device100based on the capacity of the XR content to be provided to the XR device100and the specifications of the XR device100.

In this case, the operating option may include a first operating option for providing XR content through a wireless communication manner and a second operating option of a stand-alone manner.

FIG.14is a view illustrating that XR content of a site is displayed through the XR device100worn by the site worker.

FIGS.15to17are views illustrating that an object in the XR content is edited and reflected and displayed in the XR content in response to a signal input to the XR device100.

FIG.18is a view illustrating that the attribute information of an object selected by the site worker is displayed in the XR content.

Hereinafter, the site worker editing an object in the XR content through the XR device100will be described with reference toFIGS.14to18.

The processor210may display XR content including an object around the site worker through the XR device100worn by the site worker, thereby providing a sense of realism as if the site worker is actually looking at the site.

According to some embodiments, the XR device100may further include an input unit (e.g., a microphone).

In addition, according to an embodiment of the present disclosure, the XR device100may be equipped with a transparent display to operate based on augmented reality.

When the gesture of a worker sensed from real-time sensing data sensed through the sensor unit140of the XR device100, the processor110may recognize the gesture and generate an input signal based on the recognized gesture.

FIG.14illustrates that XR content610including an object existing in the site is displayed on a display of the XR device100worn by the site worker.

When a worker inputs a selection signal using a gesture for a specific object contained in the XR content, the processor210may perform a rendering operation for indicating that an object710is selected by highlighting the object710as illustrated inFIG.15and provide the XR content.

Referring toFIG.15, two objects in the XR content are selected according to the control of the XR device100of the user, and a widget UI730is displayed in front of the user.

When a UI call signal is received from the XR device100, the processor210may provide a UI to the display of the XR device100by performing a rendering operation the UI called to the XR content.

According to an embodiment, the processor210may select a UI to be rendered and provided based on at least one object selected by the user.

According to an embodiment, the processor210may compare a plurality of objects selected by the user with each other in terms of shape information and attribute information, and select a UI to be provided by rendering, based on the comparison result.

According to an embodiment, the processor210may select a specific object in the XR content, edit the selected specific object, delete the selected specific object, or generate a specific object in response to a signal input to and received from the XR device100.

FIGS.16and17illustrate that the user edits an object810(a pipeline) for two objects710, which are selected as illustrated inFIG.15, through the XR device100.

Referring toFIG.18, when a signal for selecting a specific object in the XR content is input and received from the XR device100, and a signal for searching for attribute information on the selected specific object is received, the processor210may render attribute information1000of the relevant object with respect to XR content, in response to the signal for searching for the attribute information.

When searching for an object is requested based on the specific attribute information by the XR device100, the processor210may select or display an object having the relevant attribute information in the XR content through a filtering function. The processor210provides a function of simultaneously editing a plurality of objects by providing multiple editing functions for a plurality of objects searched and selected as described above.

The processor210provides a function of editing attribute information (e.g., material, etc.) on the plurality of objects searched and selected by providing the multiple editing functions for the plurality of objects searched and selected as described above.

When the displaying or the hiding of the plurality of objects selected through object searching is selected, the processor210may render the XR content based on the selection.

When at least one object is selected from the XR device100and editing information (addition, deletion, or correction) on the attribute information of the selected object is received, the processor210may edit the attribute information of the corresponding object based on the received editing information.

As described above, the processor210generates at least one piece of XR content by inputting/applying the shape information and the attribute information based on preset templates. When editing information is received from the XR device100, the input/applied information is automatically edited, such that the editing history of the site worker may be reflected.

In addition, when the editing information is related to a specific object, the processor210may edit at least one of the shape information and attribute information of the corresponding object.

In addition, when an input for a note, or voice for an object which is selected is received from the XR device100, the processor210may store the input in the memory230.

The processor210edits information on an object in the XR content based on the editing information received from the XR device100, and renders the image to be reflected in an object displayed with respect to the XR content based on the edited details.

In addition, the processor210stores the editing information in the memory230such that the editing information is reflected even in the BIM design data.

As described above, the method according to an embodiment of the present disclosure may be implemented in the form of a program (or application) to be stored in a medium, so as to be executed in combination with a computer which is hardware.

The above-described program may include codes made in a computer language, such as “C”, “C++”, “JAVA”, or machine language, which is readable through a device interface of the computer by a central processing unit (CPU), to execute, by the computer, the method implemented in program, by reading out the program. The code may include a functional code related to a function for determining functions necessary for executing the methods, and may include a control code related to execution procedures necessary for execute the functions in specific sequence through the processor of the computer. In addition, such a code may include additional information necessary to execute the functions through the processor of the computer, or a code related to memory reference regarding a position (an address) of an internal memory or an external memory of the computer, to which media are referred. In addition, the code may further include a code related to a computer or a server for communication with the processor of the computer, which is positioned at a remote place and related to a communication manner with the computer or the server, when the processor of the computer requires the communication with the computer or the server at the remote plate to execute the functions. In addition, the code may further include a communication code indicating information for communication and media to be transmitted or received.

The stored medium refers to a medium for permanently storing data and readable by machine, as well as a medium, such as a register, a cache, or a memory, within a short period time. In detail, although the stored medium includes a read-only medium (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy-disc, or an optical data storage device, the present disclosure is not limited thereto. In other words, the program may be stored in various recording media on various servers to be accessed by the computer, or various recording media on the computer of the user. In addition, the medium may store codes distributed into computer systems connected over a network and readable by a computer through a distribution manner.

The method or the algorithm steps described regarding the embodiment of the present disclosure may be implemented in hardware, and implemented with a software module executed by the hardware, or the combination of the software and the hardware. A soft module may reside in a random access memory (RAM), a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, a CD-ROM, or a computer readable recording medium well known in the art to which the present disclosure pertains.

As described above, according to an embodiment, the apparatus for providing construction precision based on XR may be provided.

According to an embodiment of the present disclosure, the at least one piece of XR content related to the construction target may be displayed on the display unit.

According to an embodiment of the present disclosure, the XR content including design information of the construction object at the construction position of the construction object, which is included in a construction target, may be displayed on the display unit, when the construction position is determined.

The effects of the present disclosure are not limited to the above-described effects, and other effects are able to be apparently understood by those skilled in the art through the detailed description of the present disclosure.

Although the embodiment of the present disclosure have been described with reference to accompanying drawings, those skilled in the art should understand that various modifications are possible without departing from the technical scope of the present disclosure or without changing the technical sprite or the subject matter of the present disclosure. Therefore, those skilled in the art should understand that the technical embodiments are provided for the illustrative purpose in all aspects and the present disclosure is not limited thereto.