Patent Description:
In the related art, there is known a technique for making crane work efficient by confirming a load and a state around a load based on guide information displayed on a monitor. Such a technique is disclosed, for example, in Patent Literature (hereinafter, referred to as "PTL") <NUM> described below.

PTL <NUM> discloses a technique relating to a height information notification system that notifies a height of an object around a suspended load (load). The height information notification system that notifies height information on an object around a suspended load described in PTL <NUM> is configured such that a distance between a distal end of a boom and a periphery of a suspended load is measured by a distance measurement section such as a laser distance sensor, a microwave distance sensor, and a stereo camera, and then the position of the object around the suspended load is detected by using distance measurement results, the height thereof is calculated, a processing image (guide information) obtained by associating the position and height of the object around the suspended load with a taken image (camera image) taken (captured) by a camera is created (generated), and the processing image is displayed on a monitor.

However, the related art described in PTL <NUM> is configured to measure a distance between a distal end of a boom and a periphery of a suspended load and to calculate the height of an object around the suspended load by using the distance. That is, in the related art, the height of a feature is calculated by using the height of a point, at which measurement is locally performed around a suspended load, as the height of a ground surface. For this reason, in a case where there is a place where a ground surface is inclined from and higher than a point at which measurement is performed around a suspended load, the height of the place may be displayed as the height from the measurement point around the suspended load, and an operator may erroneously recognize that there is a feature having that height.

<CIT> describes a technology in which an unmanned aircraft obtains by a LiDAR system 3D point cloud data indicating terrain, divides data into grids, performs statistical processing on each cell of the grids to specify a set of cells having low variation in altitude as a landing candidate area.

<NPL> describes a technology in which working site 3D modeling for determining a crane working position and a load path is performed using point cloud data obtained by a laser scanner or the like.

<CIT> describes segmenting laser scan data for a land of a city based on a shape or the like of buildings.

An object of the present invention is to provide a crane capable of recognizing a ground surface as a continuous ground surface even when the height of the ground surface varies due to inclination and/or unevenness.

The problem to be solved by the present invention is as described above. Next, a solution to the problem will be described.

According to a first aspect, the present invention provides a crane in accordance with independent claim <NUM>. Further aspects are set forth in the dependent claims.

The present invention achieves effects as indicated below.

According to the present invention, a region in which a difference in altitude value is within a threshold is recognized as a continuous region so that even a region where the altitude value changes continuously, such as an inclined surface, and even a region having unevenness with a height within the threshold are recognized as continuous regions. Thus, a ground surface is recognized as a continuous ground surface even when the height of the ground surface varies due to inclination and/or unevenness.

According to the present invention, even in a case where a ground surface has unevenness and laser is radiated on a side surface of the unevenness of the ground surface, an altitude value is calculated by using point cloud data estimated to have been acquired by radiating laser on an upper surface of the unevenness of the ground surface. Thus, even when a ground surface has unevenness, an upper surface of the unevenness of the ground surface can be recognized as the ground surface.

According to the present invention, a continuous region for which variations in measurement results are taken into more consideration is recognized by changing the threshold to that in consideration of measurement errors in point cloud data. Thus, a ground surface is recognized as a continuous ground surface even when the height of the ground surface varies due to inclination and/or unevenness.

According to the present invention, even in a case where a region of a ground surface becomes smaller, the smaller region of the ground surface is recognized by reducing a grid width. Thus, a ground surface is recognized as a continuous ground surface even when the height of the ground surface varies due to inclination and/or unevenness.

According to the present invention, point cloud data in a work region of a crane is acquired in accordance with operations of a swivel base and/or a boom, and a region in which a difference in altitude value is within the threshold is recognized as a continuous region so that even when there are a wide-range region where the altitude value changes continuously and a wide-range region having unevenness with a height within the threshold, the regions are recognized as continuous regions. Thus, a ground surface is recognized as a continuous ground surface even when the height of the ground surface varies due to inclination and/or unevenness in a work region of a crane.

Hereinafter, crane <NUM> including measurement region display system <NUM> according to Embodiment <NUM> of the present invention will be described. Note that, in the present embodiment, a mobile crane (rough terrain crane) will be described as crane <NUM>, but may also be a truck crane or the like.

As illustrated in <FIG>, crane <NUM> is a mobile crane capable of moving to an unspecified location. Crane <NUM> includes vehicle <NUM> and crane apparatus <NUM>.

Vehicle <NUM> is a traveling vehicle that transports crane apparatus <NUM>. Vehicle <NUM> includes a plurality of wheels <NUM>, and travels using engine <NUM> as a power source. Vehicle <NUM> is provided with outrigger <NUM>. Outrigger <NUM> is formed of an overhang beam that can be extended onto both sides of vehicle <NUM> in a width direction by hydraulic pressure, and a hydraulic jack cylinder that can be extended in a direction perpendicular to the ground.

Crane apparatus <NUM> is a work apparatus that suspends load W by a wire rope. Crane apparatus <NUM> includes swivel base <NUM>, boom <NUM>, jib 9a, main hook block <NUM>, sub-hook block <NUM>, luffing hydraulic cylinder <NUM>, main winch <NUM>, main wire rope <NUM>, sub-winch <NUM>, sub-wire rope <NUM>, cabin <NUM>, control apparatus <NUM> (see <FIG>), and the like.

Swivel base <NUM> is a driving apparatus that configures crane apparatus <NUM> to be swivelable. Swivel base <NUM> is provided on a frame of vehicle <NUM> via an annular bearing. Swivel base <NUM> is configured to be rotatable around a center of the annular bearing as a rotation center. Swivel base <NUM> is provided with hydraulic swivel motor <NUM> which is an actuator and which is of hydraulic type.

Hydraulic swivel motor <NUM> is an actuator that is rotationally operated by swivel valve <NUM> (see <FIG>) that is an electromagnetic proportional switching valve. Swivel valve <NUM> can control the flow rate of hydraulic oil, which is supplied to hydraulic swivel motor <NUM>, to any flow rate. That is, swivel base <NUM> is configured to be controllable to have an arbitrary swivel speed via hydraulic swivel motor <NUM> that is rotationally operated by swivel valve <NUM>. Swivel base <NUM> is provided with swivel sensor <NUM> (see <FIG>) that detects the swivel position (angle) and swivel speed of swivel base <NUM>.

Boom <NUM> is a movable support that supports a wire rope in a state in which the wire rope can suspend load W. Boom <NUM> is formed of a plurality of boom members. Boom <NUM> is configured to be extendable and retractable in an axial direction by moving each boom member by using an extension/retraction hydraulic cylinder (not illustrated) that is an actuator. A base end of a base boom member of boom <NUM> is swingably provided at substantially a center of swivel base <NUM>.

The extension/retraction hydraulic cylinder (not illustrated) is an actuator that is operated to extend and retract by extension/retraction valve <NUM> (see <FIG>) that is an electromagnetic proportional switching valve. Extension/retraction valve <NUM> can control the flow rate of hydraulic oil, which is supplied to the extension/retraction hydraulic cylinder, to any flow rate. That is, boom <NUM> is configured to be controllable to have an arbitrary boom length by extension/retraction valve <NUM>. Boom <NUM> is provided with extension/retraction sensor <NUM> (see <FIG>) which is an extension/retraction length detection section that detects the length of boom <NUM>.

Main hook block <NUM> and sub-hook block <NUM> are suspending tools that suspend load W. Main hook block <NUM> is provided with a plurality of hook sheaves around which main wire rope <NUM> is wound, and main hook 10a that suspends load W. Sub-hook block <NUM> is provided with sub-hook 11a that suspends load W.

Luffing hydraulic cylinder <NUM> is operated to extend and retract by luffing valve <NUM> (see <FIG>) that is an electromagnetic proportional switching valve. Luffing valve <NUM> can control the flow rate of hydraulic oil, which is supplied to luffing hydraulic cylinder <NUM>, to any flow rate. That is, boom <NUM> is configured to be controllable to have an arbitrary luffing speed by luffing valve <NUM>. Boom <NUM> is provided with luffing sensor <NUM> (see <FIG>) that is a swivel angle detection section that detects the luff-up angle of boom <NUM>, a weight sensor that detects the weight of load W, and the like.

Main winch <NUM> and sub-winch <NUM> are winding apparatuses that feed in (wind up) and feed out (wind out) main wire rope <NUM> and sub-wire rope <NUM>. Main winch <NUM> is configured such that a main drum, around which main wire rope <NUM> is wound, is rotated by a main hydraulic motor (not illustrated) that is an actuator. Sub-winch <NUM> is configured such that a sub drum, around which sub-wire rope <NUM> is wound, is rotated by a sub-hydraulic motor (not illustrated) that is an actuator.

The main hydraulic motor is operated to be rotated by main valve <NUM> (see <FIG>) that is an electromagnetic proportional switching valve. Main valve <NUM> can control a flow rate of hydraulic oil, which is supplied to the main hydraulic motor, to any flow rate. That is, main winch <NUM> is configured to be controllable to have any feed-in speed and any feed-out speed by main valve <NUM>. Similarly, sub-winch <NUM> is configured to be controllable to have any feed-in speed and any feed-out speed by sub-valve <NUM> (see <FIG>) that is an electromagnetic proportional switching valve. Main winch <NUM> and sub-winch <NUM> are provided with winding sensor <NUM> (see <FIG>) that detects feed-out amounts of main wire rope <NUM> and sub-wire rope <NUM>, respectively.

Cabin <NUM> covers a driver's seat. The driver's seat is provided with an operation tool for operating travelling of vehicle <NUM>, swiveling operation tool <NUM> for operating crane apparatus <NUM>, extension/retraction operation tool <NUM>, luffing operation tool <NUM>, main-drum operation tool <NUM>, sub-drum operation tool <NUM>, and the like (see <FIG>). Swiveling operation tool <NUM> makes it possible to operate hydraulic swivel motor <NUM>. Extension/retraction operation tool <NUM> makes it possible to operate the extension/retraction hydraulic cylinder. Luffing operation tool <NUM> makes it possible to operate luffing hydraulic cylinder <NUM>. Main-drum operation tool <NUM> makes it possible to operate the main hydraulic motor. Sub-drum operation tool <NUM> makes it possible to operate the sub-hydraulic motor.

Crane <NUM> configured as described above can move crane apparatus <NUM> to any position by causing vehicle <NUM> to travel. Further, crane <NUM> can increase the lifting height and work radius of crane apparatus <NUM>, by raising boom <NUM> to have any luff-up angle with luffing hydraulic cylinder <NUM> by means of operation of luffing operation tool <NUM>, and by extending boom <NUM> to have any boom length by means of operation of extension/retraction operation tool <NUM>. Further, crane <NUM> can transport load W by suspending load W with main-drum operation tool <NUM> or the like and by swiveling swivel base <NUM> by means of operation of swiveling operation tool <NUM>.

As illustrated in <FIG>, control apparatus <NUM> controls the actuators of crane apparatus <NUM> via each valve. Control apparatus <NUM> is provided inside cabin <NUM>. Substantively, control apparatus <NUM> may be configured such that a CPU, a ROM, a RAM, an HDD, and/or the like are connected to each another by a bus, or may be formed of a one-chip LSI or the like. Control apparatus <NUM> stores various programs and data for controlling operations of each actuator, sensor, or the like.

Control apparatus <NUM> is connected to swiveling operation tool <NUM>, extension/retraction operation tool <NUM>, luffing operation tool <NUM>, main-drum operation tool <NUM>, and sub-drum operation tool <NUM>, and can acquire each operation amount of swiveling operation tool <NUM>, extension/retraction operation tool <NUM>, luffing operation tool <NUM>, main-drum operation tool <NUM>, and sub-drum operation tool <NUM>.

Control apparatus <NUM> is connected to swivel valve <NUM>, extension/retraction valve <NUM>, luffing valve <NUM>, main valve <NUM>, and sub-valve <NUM>, and can transmit a control signal to swivel valve <NUM>, extension/retraction valve <NUM>, luffing valve <NUM>, main valve <NUM>, and sub-valve <NUM>.

Control apparatus <NUM> is connected to swivel sensor <NUM>, extension/retraction sensor <NUM>, luffing sensor <NUM>, the weight sensor, and winding sensor <NUM>, and can acquire the swivel position of swivel base <NUM>, the boom length, the luff-up angle, the weight of load W, and the feed-out amounts of main wire rope <NUM> and sub-wire rope <NUM>.

Control apparatus <NUM> can transmit information on crane <NUM>, such as the swivel position of swivel base <NUM>, the boom length, the luff-up angle, the weight of load W, and the feed-out amounts of main wire rope <NUM> and sub-wire rope <NUM>, to measurement region display system <NUM>.

Note that, in the present description, an XYZ coordinate system as illustrated in <FIG> is defined relative to an axial direction of a luff-up support of boom <NUM> (the same applies in the following description).

The X-axis direction (also referred to as "depth direction") is a direction perpendicular and horizontal to the axial direction of the luff-up support of boom <NUM>. In addition, the Y-axis direction (also referred to as "horizontal direction") is a direction parallel and horizontal to the axial direction of the luff-up support of boom <NUM>. Further, the Z-axis direction is a vertically downward direction. That is, the XYZ coordinate system is defined as a local coordinate system relative to boom <NUM> (see <FIG>).

Next, measurement region display system <NUM> according to the embodiment of the present invention will be described.

Crane <NUM> includes measurement region display system <NUM> as illustrated in <FIG>.

Measurement region display system <NUM> is a system that displays information (hereinafter, referred to as "guide information") on a region to be measured by measurement region display system <NUM> (hereinafter, the region will be referred to as "measurement region KA" (see <FIG>)) as an image and presents the image to an operator in order to enable work by crane <NUM> as illustrated in <FIG> to be performed efficiently and safely, which is an example of measurement region display system <NUM> according to the present invention.

As illustrated in <FIG>, measurement region display system <NUM> is formed of data acquisition section <NUM>, data processing section <NUM>, data display section <NUM>, and data input section <NUM>.

Data acquisition section <NUM> is a part that acquires data necessary to generate the guide information on measurement region KA, and includes camera <NUM>, laser scanner <NUM>, inertial measurement unit (IMU) <NUM>, first GNSS receiver 64a, and second GNSS receiver 64b. Camera <NUM>, laser scanner <NUM>, inertial measurement unit (IMU) <NUM>, and first GNSS receiver 64a are fixed to a frame body and integrally configure sensor unit <NUM>.

Sensor unit <NUM> is attached to a distal end portion of boom <NUM> of crane <NUM>, and is disposed in a state of being capable of capturing a situation directly below from the distal end portion of boom <NUM> located directly above load W (see <FIG>). Note that, the concept "directly above" load W herein encompasses a position vertically above load W and a position of a certain range relative to the position vertically above load W (the certain range is, for example, a range of a top surface of load W).

Sensor unit <NUM> is attached to the distal end portion of boom <NUM> via gimbal <NUM> (see <FIG>), and is configured such that an attitude of sensor unit <NUM> (an attitude toward the Z-axis direction) can be maintained substantially constant when a swiveling operation of swivel base <NUM>, a luffing operation of boom <NUM> and/or an extension/retraction operation of boom <NUM> are performed. Thus, camera <NUM> and laser scanner <NUM> can be caused to face load W constantly. Accordingly, sensor unit <NUM> can constantly acquire data from load W and ground surface F below load W by camera <NUM> and laser scanner <NUM>. Further, in a case where feature E is present on ground surface F below load W, sensor unit <NUM> can acquire data of feature E by camera <NUM> and laser scanner <NUM>.

Camera <NUM> is a digital video camera for taking an image of a region below sensor unit <NUM> (hereinafter, the region will be referred to as "individual measurement region ka" (see <FIG>)), and has a function of outputting a taken camera image to the outside in real time. Further, camera <NUM> has a number of pixels, an angle of view, a frame rate, and an image transmission rate in view of an amount of data necessary to generate appropriate guide information.

Laser scanner <NUM> is an apparatus that radiates laser on a measurement target object and receives reflected light of the laser from the measurement target object to thereby acquire information on a reflection point thereof and to acquire point cloud data of the measurement target object. Laser scanner <NUM> is attached to the distal end portion of boom <NUM> via sensor unit <NUM>. Measurement target objects of laser scanner <NUM> are load W, feature E, and ground surface F. Further, third GNSS receiver 64c for acquiring a measurement time is connected to laser scanner <NUM>.

Further, laser scanner <NUM> is disposed such that trajectories of laser radiated toward individual measurement region ka become parallel to the Y-axis direction (see <FIG>). Further, laser scanner <NUM> is configured such that a reference axis for changing the radiation angle of laser is parallel to the X-axis direction.

Measurement region display system <NUM> acquires planar three-dimensional point cloud data in real time by laser scanner <NUM>.

Inertial measurement unit (hereinafter, referred to as "IMU") <NUM> is an apparatus for acquiring attitude data of camera <NUM> and laser scanner <NUM> at the time of data acquisition. IMU <NUM> is capable of measuring an attitude angle in real time, and has a measurement accuracy available for correcting point cloud data acquired by laser scanner <NUM>. Further, fourth GNSS receiver 64d for acquiring a measurement time is connected to IMU <NUM>.

First GNSS receiver 64a is an apparatus for receiving a distance measuring radio wave from a satellite and calculating the latitude, the longitude, and the altitude value that are the coordinates. In data processing section <NUM>, a separation distance between first GNSS receiver 64a and laser scanner <NUM> is set, and data processing section <NUM> is capable of calculating the coordinates of laser scanner <NUM> in real time based on the set distance.

Second GNSS receiver 64b is an apparatus for receiving a distance measuring radio wave from a satellite and calculating the latitude, the longitude, and the altitude value that are the coordinates. Second GNSS receiver 64b is disposed at a position of a swivel center of swivel base <NUM>. Second GNSS receiver 64b is capable of calculating the coordinates of the swivel center of swivel base <NUM> in real time.

In the present embodiment, a RTK-GPS (Real Time Kinematic GPS) positioning system with high measurement accuracy is adopted for first GNSS receiver 64a and second GNSS receiver 64b. By adopting the RTK-GPS positioning system, it is possible to enhance the measurement accuracy of the position of laser scanner <NUM> and the position of the swivel center of swivel base <NUM>. Note that, the RTK-GPS positioning system is not necessarily adopted, but any other positioning method may be adopted.

First GNSS receiver 64a is disposed such that a straight line connecting first GNSS receiver 64a and second GNSS receiver 64b, a measurement axis of laser scanner <NUM>, and a measurement axis of IMU <NUM> are on the same straight line. Further, the orientation (azimuth) of laser scanner <NUM> can be calculated by forming a GNSS compass, in which boom <NUM> serves as a base line, with the coordinates of laser scanner <NUM> calculated by first GNSS receiver 64a and the coordinates of the swivel center of swivel base <NUM> calculated by second GNSS receiver 64b. First GNSS receiver 64a and second GNSS receiver 64b have a measurement accuracy available for correcting point cloud data acquired by laser scanner <NUM>.

As illustrated in <FIG>, laser scanner <NUM> is an apparatus which includes a total of <NUM> laser transmission/reception sensors, and which is capable of acquiring point cloud data of a measurement target object by radiating <NUM> laser beams on the measurement target object at the same time. As illustrated in <FIG>, the <NUM> laser transmission/reception sensors of laser scanner <NUM> are arranged with radiation angles shifted by two degrees in the X-axis direction, and are configured such that laser can be radiated on a measurement target object with a spread angle of <NUM> degrees in total. Further, each laser transmission/reception sensor of laser scanner <NUM> is configured to be capable of rotating <NUM> degrees (entire azimuth) around the X-axis. As illustrated in <FIG>, trajectories drawn by laser radiated toward individual measurement region ka are parallel to the Y-axis direction, and the trajectories drawn using laser scanner <NUM> are <NUM> trajectories that are drawn at the same time.

Note that, as laser scanner <NUM>, a device capable of measuring the three-dimensional shape of a measurement target object from a maximum reachable height of boom <NUM> (for example, approximately <NUM> meters) is selected in view of the maximum reachable height of boom <NUM>. Further, as laser scanner <NUM>, a device having predetermined performances with respect to each specification regarding a measurement speed, the number of measurement points, a measurement accuracy and the like is selected in view of an amount of data and data accuracy necessary to generate appropriate guide information.

Note that, in the present embodiment, a case where laser scanner <NUM> including a total of <NUM> laser transmission/reception sensors is used is described as an example, but measurement region display system <NUM> according to the present invention is not limited by the number of laser transmission/reception sensors forming laser scanner <NUM>. That is, in measurement region display system <NUM> according to the present invention, laser scanner <NUM> having optimal specifications is selected as appropriate in accordance with the maximum reachable height of boom <NUM> (jib 9a) of crane <NUM>, or the like.

Data acquired from individual measurement region ka by sensor unit <NUM> includes image data, taken by camera <NUM>, of load W, ground surface F below load W, and feature E present on ground surface F below load W. Further, the data acquired from individual measurement region ka by sensor unit <NUM> includes point cloud data acquired by scanning load W, ground surface F, and feature E by laser scanner <NUM>. Note that, ground surface F herein widely encompasses surfaces serving as a transport source and a transport destination of load W, and encompasses not only a surface on the ground, but also a floor surface on a rooftop terrace of a building, a rooftop surface and the like.

Data processing section <NUM>, which is a data processing section, is a part that performs arithmetic processing on data acquired by data acquisition section <NUM> to generate the guide information that is presented to an operator. In the present embodiment, data processing section <NUM> is formed of a general-purpose personal computer in which a predetermined data processing program is installed.

Further, data processing section <NUM> is electrically connected to control apparatus <NUM> of crane <NUM>, and information on crane <NUM> output from control apparatus <NUM>, such as the swivel position of swivel base <NUM>, the boom length, the luff-up angle, the weight of load W, and the feed-out amounts of main wire rope <NUM> and sub-wire rope <NUM>, is input to data processing section <NUM>.

Data display section <NUM> is a part for displaying the guide information that is presented to an operator, and is formed of a display apparatus connected to data processing section <NUM>.

Data display section <NUM> displays a three-dimensional map of measurement region KA and a camera image of individual measurement region ka in real time.

Here, measurement region KA and the guide information will be described.

Measurement region KA is a region for which the guide information is generated.

As illustrated in <FIG>, measurement region display system <NUM> measures load W, ground surface F, and feature E that are present on individual measurement region ka below sensor unit <NUM>. Sensor unit <NUM> moves in accordance with a swiveling operation of swivel base <NUM>, a luffing operation, and/or an extension/retraction operation of boom <NUM>. Accordingly, individual measurement region ka also moves in accordance with the movement of sensor unit <NUM>. Measurement region KA is a region including individual measurement region ka measured from different positions. In a case where measurement region display system <NUM> measures a measurable region in its entirety, measurement region KA becomes a region including work region SA that is a region in which the distal end portion of boom <NUM> is operable.

The guide information herein is information that assists an operator in determining whether a length of boom <NUM>, a swivel position, a luff-up angle, feed-out amounts of main wire rope <NUM> and sub-wire rope <NUM>, and/or the like are good or not when the operator transports load W by crane <NUM>. The guide information includes a three-dimensional map of measurement region KA, camera image information, information on shapes of load W and feature E, height information on load W, height information on feature E, information on a traffic line of load W, and the like.

As illustrated in <FIG>, data input section <NUM> is a part for inputting a setting value or the like to data processing section <NUM>, and is formed of input apparatuses such as a touch screen, a mouse, and a keyboard apparatus.

As illustrated in <FIG>, data display section <NUM> and data input section <NUM> are disposed inside cabin <NUM>, at positions in front of a driver's seat which are easily visible to an operator. Data processing section <NUM> is preferably disposed near sensor unit <NUM>. Note that, in a case where data processing section <NUM>, data display section <NUM>, and data input section <NUM> are integrally configured by a tablet PC, measurement region display system <NUM> may also be configured such that data processing section <NUM> is disposed inside cabin <NUM>.

A wired LAN is preferably used for data transmission between data acquisition section <NUM> and data processing section <NUM>. Note that, a wireless LAN or power line communication may be used for data transmission between data acquisition section <NUM> and data processing section <NUM>.

Hereinafter, a state of acquisition of data by data acquisition section <NUM> will be described.

Data acquisition section <NUM> continuously takes images of individual measurement region ka by camera <NUM> to acquires camera images of individual measurement region ka.

As illustrated in <FIG>, data acquisition section <NUM> continuously scans individual measurement region ka by laser scanner <NUM> to acquire point cloud data of a measurement target object on individual measurement region ka. Hereinafter, the point cloud data acquired by laser scanner <NUM> will be referred to as point cloud data P. Point cloud data P is a set of point data p, and point data p indicates each point located on ground surface F, load W, and feature E that are present on individual measurement region ka.

Data acquisition section <NUM> acquires point cloud data P by laser scanner <NUM> and receives time information from a plurality of positioning satellites by third GNSS receiver 64c at the same time. Further, data processing section <NUM> gives information on acquisition time tp of point data p to point data p.

Further, data acquisition section <NUM> acquires point cloud data P by laser scanner <NUM>, acquires attitude data Q of laser scanner <NUM> at predetermined intervals by IMU <NUM>, and acquires position data R and azimuth data D of laser scanner <NUM> by first GNSS receiver 64a and second GNSS receiver 64b at the same time. Note that, data processing section <NUM> may calculate the position and orientation of laser scanner <NUM> based on the position of the swivel center of swivel base <NUM>, which is acquired by second GNSS receiver 64b, and a swivel position of swivel base <NUM>, a boom length, and a luff-up angle, which are output from control apparatus <NUM>.

Attitude data Q includes information on an angle and acceleration of laser scanner <NUM> with respect to each axis direction of X-, Y-, Z-axes. Note that, an acquisition cycle of attitude data Q by IMU <NUM> is set to be shorter than an acquisition cycle of point cloud data P by laser scanner <NUM>. Attitude data Q is a set of individual attitude data q that is measured in each measurement cycle.

Data acquisition section <NUM> acquires attitude data Q by IMU <NUM> and receives time information from a plurality of positioning satellites by fourth GNSS receiver 64d at the same time. Data processing section <NUM> gives acquisition time tq as information on an acquisition time of individual attitude data q, to individual attitude data q.

Position data R includes information on the position of laser scanner <NUM> in the XYZ coordinate system. Note that, an acquisition cycle of position data R by first GNSS receiver 64a and second GNSS receiver 64b is set to be shorter than an acquisition cycle of point cloud data P by laser scanner <NUM>. Position data R is a set of individual position data r that is measured in each measurement cycle. Data processing section <NUM> calculates individual azimuth data d based on individual position data r. Azimuth data D is a set of individual azimuth data d that is measured in each measurement cycle.

First GNSS receiver 64a and second GNSS receiver 64b acquire position data R and azimuth data D and receive time information from a plurality of positioning satellites at the same time. Data processing section <NUM> gives acquisition time tr as information on acquisition time of position data R and azimuth data D, to position data R and azimuth data D.

Next, a state of processing of data by data processing section <NUM> will be described.

The ground surface estimation method according to the embodiment of the present invention includes a point cloud data acquisition process, a grid generation processing process, a continuous region recognition process, and a ground surface estimation process.

Data processing section <NUM> acquires measurement data. Specifically, data processing section <NUM> cuts out point cloud data P for one frame from stream data of point cloud data P and outputs point cloud data P for one frame described above. Point cloud data P for one frame is a set of point data p acquired while the radiation direction of laser by laser scanner <NUM> makes one round around the X-axis. Further, data processing section <NUM> acquires a camera image of camera <NUM>, attitude data Q of IMU <NUM>, and position data R and azimuth data D acquired by first GNSS receiver 64a and second GNSS receiver 64b as measurement data.

Data processing section <NUM> associates point data p included in point cloud data P for one frame with attitude data Q acquired by IMU <NUM>, and position data R and azimuth data D acquired by first GNSS receiver 64a and second GNSS receiver 64b according to the time (see time association processing (STEP-<NUM>) in <FIG>).

Specifically, with respect to attitude data Q, data processing section <NUM> retrieves acquisition time tq of individual attitude data q closest to acquisition time tp of each point data p, and associates individual attitude data q at acquisition time tq with each point data p. Further, with respect to position data R and azimuth data D, data processing section <NUM> retrieves acquisition time tr of position data R and azimuth data D closest to acquisition time tp of each point data p, and associates individual position data r and individual azimuth data d at acquisition time tr with each point data p.

In this way, data processing section <NUM> outputs point data p associated with individual attitude data q, individual position data r, and individual azimuth data d according to the time.

Data processing section <NUM> performs rigid transformation processing to a combination of point data p, individual attitude data q, individual position data r, and individual azimuth data d that are associated with each other according to the time (see rigid transformation processing (STEP-<NUM>) in <FIG>). Specifically, data processing section <NUM> performs an affine transformation of point cloud data P based on individual attitude data q, individual position data r, and individual azimuth data d to transform point cloud data P into that in a surface rectangular coordinate system. Thus, point cloud data P whose inclination, position, orientation have been corrected is output. An altitude value of point data p becomes a value of point data p, whose inclination, position, and orientation have been corrected, in the Z coordinate. That is, an altitude value of a radiation point of laser scanner <NUM> is calculated as a value of point data p in the Z coordinate. However, since the Z-axis is the axis in the vertically downward direction, the position of the altitude becomes lower as the value of the Z coordinate becomes larger.

As illustrated in <FIG>, data processing section <NUM> divides point cloud data P, which has been corrected, in its entirety by grids g having a certain size, and sets representative points pr of grids g (grid generation processing A (STEP-<NUM>) in <FIG>). Specifically, data processing section <NUM> first superimposes point cloud data P that has been corrected. As illustrated in <FIG>, data processing section <NUM> then divides point cloud data P, which has been superimposed, in its entirety by grids g having a certain size.

Point cloud data P that has been superimposed may include not only point data p acquired by radiating laser on an upper surface of feature E or ground surface F, but also point data p acquired by radiating laser on a side surface of feature E or ground surface F. In order to generate the guide information with an upper surface of feature E or ground surface F as a target, data processing section <NUM> first slices each grid g in the horizontal direction at arbitrary intervals. Data processing section <NUM> then calculates, for each grid g, average altitude value H that is an average value of altitude values of point data p (point cloud data P) of layer L1, in which point data p is present and which is located at the highest altitude, among layers L1, L2, L3. formed by slicing. Further, data processing section <NUM> calculates a center-of-gravity position of each grid g. As illustrated in <FIG>, data processing section <NUM> finally sets the center-of-gravity position of each grid g at average altitude value H, which has been calculated, as a position of representative point pr of each grid g. Thus, even in a case where ground surface F has unevenness and laser is radiated on a side surface of the unevenness of ground surface F, data processing section <NUM> can set representative point pr of point cloud data P which is estimated to have been acquired by radiating laser on an upper surface of the unevenness of ground surface F.

Note that, a layer for which average altitude value H is calculated is not limited to layer L1, but may be a layer selected based on the number of point data p, the positions of point data p, and the density of point data p in each layer. For example, a layer having the largest number of point data p among layers may be selected. Alternatively, the highest layer among layers in which an arbitrary number or more of point data p is present may be selected. Alternatively, a layer in which point data p is uniformly present along a Z direction may be selected since it is highly likely that point data p of the layer in which point data p is uniformly present along the Z direction is acquired by radiating laser on an upper surface of feature E.

As illustrated in <FIG>, data processing section <NUM> updates a three-dimensional map in its entirety generated prior to a current time by using representative point pr set for each grid g (three-dimensional map updating processing B (STEP-<NUM>) in <FIG>). The left diagram of <FIG> illustrates only representative point pr1 in each grid g, where representative point pr1 is representative point pr set for each grid g. The right diagram of <FIG> illustrates only representative point pr2 in each grid g, where representative point pr2 is representative point pr for each grid g on the three-dimensional map generated prior to the current time. Specifically, data processing section <NUM> first acquires representative point pr1 and representative point pr2 for each grid g. As illustrated in <FIG>, in a case where a plurality of representative points pr is present in one grid g, data processing section <NUM> deletes representative point pr2. Data processing section <NUM> generates a surface having the size of grid g for each of every representative point pr after deletion, and outputs a three-dimensional map of measurement region KA between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods. As illustrated in <FIG>, in a case where three-dimensional map M is displayed on data display section <NUM>, the color of surface S is displayed more densely as the altitude value of representative point pr of grid g becomes higher.

As illustrated in <FIG>, data processing section <NUM> gives a label to each continuous region by using a three-dimensional map (see labeling processing C (STEP-<NUM>) in <FIG>). The continuous region is a region in which a difference in altitude value between representative points of grids g adjacent to each other is equal to or less than a threshold. The threshold is set based on measurement errors of laser scanner <NUM> in the Z-axis direction, and is set to <NUM>, for example. Labels are sequentially given with numbers from No. <NUM> on. Hereinafter, for the sake of description, the altitude value of representative point pr present at a position with the lowest altitude is set as a reference, and the height from representative point pr set as a reference is the altitude value of representative point pr of grid g.

As illustrated in <FIG>, specifically, data processing section <NUM> first selects interest grid ga from grids g of a three-dimensional map. An altitude value of representative point pr of interest grid ga is compared with altitude values of representative points pr of grids g present in four neighborhoods at the upper-left, upper, upper-right, and left thereof (hereinafter, simply referred to as "four neighborhoods"). The order of selection of interest grid ga is from the left end to the right starting from the upper left of the three-dimensional map, and, when the right end is reached, from the left end of one grid below to the right.

In a case where any of differences between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof is equal to or less than the threshold, data processing section <NUM> gives the same label as that of grid g having a difference in altitude value being equal to or less than the threshold, to interest grid ga. In a case where every difference between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof is larger than the threshold, data processing section <NUM> gives a new label to interest grid ga. The new label is a label whose number is obtained by increasing the largest number among those of labels given up to this point in time by one. In a case where there are a plurality of label types of grids g having a difference between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof being equal to or less than the threshold, however, data processing section <NUM> gives a label having the smallest number among labels of grids g having a difference in altitude value being equal to or less than the threshold, to interest grid ga. By performing these pieces of processing to every grid g, it is possible to compare interest grid ga with grids g present in eight neighborhoods at the upper-left, upper, upper-right, left, right, lower-left, lower, and lower-right thereof.

For example, in a case where interest grid ga indicated in <FIG> is selected, data processing section <NUM> calculates every difference between the altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof as <NUM>. Since every difference between the altitude value of representative point pr of interest grid ga and the altitude value of representative point pr of each grid g present in the four neighborhoods thereof is larger than the threshold of <NUM>, data processing section <NUM> gives label No. <NUM> obtained by increasing the number of label No. <NUM> by one to interest grid ga.

As illustrated in <FIG>, data processing section <NUM> selects interest grid ga again from grids g after labels are given to every grid g. The order of selection of interest grid ga is from the left end to the right starting from the upper left of a three-dimensional map, and, when the right end is reached, from the left end of one grid below to the right in the same manner as in giving labels.

Data processing section <NUM> compares an altitude value of representative point pr of interest grid ga with an altitude value of representative point pr of each grid g present in the four neighborhoods thereof. In a case where grid g in the four neighborhoods of interest grid ga has a difference in altitude value being equal to or less than the threshold and is given a label different from the label of interest grid ga, data processing section <NUM> overwrites the label of grid g, which has a difference in altitude value being equal to or less than the threshold and which is given the label different from the label of interest grid ga, with the label of interest grid ga.

For example, in a case where interest grid ga indicated in <FIG> is selected, data processing section <NUM> calculates each difference between the altitude value of representative point pr of interest grid ga and the altitude value of representative point pr of each grid g present at the left and upper-right thereof as <NUM>, and calculates each difference between the altitude value of representative point pr of interest grid ga and the altitude value of representative point pr of each grid g present at the upper-left and upper thereof as <NUM>. Further, grid g present at the left of interest grid ga is given label No. <NUM> which is different from label No. <NUM> given to interest grid ga. Accordingly, grid g at the left of interest grid ga has a difference in altitude value being equal to or less than the threshold of <NUM>, and is given a label different from the label of interest grid ga. For this reason, as illustrated in <FIG>, data processing section <NUM> overwrites the label of grid g at the left of interest grid ga with label No. <NUM>.

Finally, data processing section <NUM> outputs a three-dimensional map in which labels are given to grids g. Thus, data processing section <NUM> compares altitude values of representative points pr between grids g adjacent to each other, and recognizes grids g, to which the same label is given, as a continuous region regardless of the presence or absence of inclination.

Data processing section <NUM> estimates labels indicating regions of ground surface F and load W, and regions other than those of ground surface F and load W from a three-dimensional map in which labels are given (same-region estimation processing (STEP-<NUM>) in <FIG>). Specifically, since a region of ground surface F is considered to be the widest, data processing section <NUM> sets the same label having the largest number of grids g as a label given to grids g of ground surface F. That is, data processing section <NUM> estimates a continuous region having the largest number of grids g among continuous regions as ground surface F. Data processing section <NUM> is capable of automatically performing such estimation of ground surface F in real time. For example, as illustrated in <FIG>, the number of grids g of label No. <NUM> is the largest so that data processing section <NUM> estimates a continuous region of label No. <NUM> as ground surface F (see the white portion). In a case where three-dimensional map M is displayed on data display section <NUM>, data processing section <NUM> displays a region of ground surface F by distinguishing the region from other regions in terms of the color and shading (see <FIG>).

Since measurement region display system <NUM> that performs such a ground surface estimation method recognizes a region, in which a difference in altitude value between grids g adjacent to each other is within the threshold, as a continuous region, even a region in which the altitude value continuously changes, such as an inclined surface, and even a region having unevenness with a height within the threshold are recognized as continuous regions. Thus, even ground surface F in which the height varies due to inclination and/or unevenness can be recognized as ground surface F that is continuous.

In the present embodiment, a configuration has been described in which measurement region display system <NUM> is independent from crane <NUM>. However, it may also be configured such that crane <NUM> includes: a variety of sensors <NUM> to 64d, which have been described as being included in data acquisition section <NUM>; the display apparatus, which has been described as being included in data display section <NUM>; and the input apparatus, which has been described as being included in data input section <NUM>, and that control apparatus <NUM> performs data processing, which has been described as being performed by data processing section <NUM>.

In crane <NUM> as such, point cloud data P in work region SA of crane <NUM> is acquired in accordance with operations of swivel base <NUM> and/or boom <NUM>, and a region in which a difference in altitude value is within the threshold is recognized as a continuous region so that even when there are a wide region in which the altitude value continuously changes and a wide region having unevenness with a height within the threshold, the regions are recognized as continuous regions. Thus, even ground surface F in which the height varies due to inclination and/or unevenness in work region SA of crane <NUM> can be recognized as ground surface F that is continuous. Note that, measurement region display system <NUM> can also be used for work vehicles other than crane <NUM>. For example, measurement region display system <NUM> can also be used for an aerial work platform or the like.

Data processing section <NUM> acquires a label of grid g of representative point pr having the lowest altitude value among representative points pr of grids g present in a manually input range of load W (see <FIG>), and sets the label as a label given to grids g of load W. This is because, in a case where grids g include grid g of load W and grid g of a hook or wire, an altitude value of representative point pr in grid g of load W is lower than an altitude value of representative point pr in grid g of the hook or wire rope. Note that, a height of load W (length in the Z-axis direction) is actually measured and is input to data processing section <NUM> since it is impossible to measure a side surface and a lower portion of load W from the distal end portion of boom <NUM>.

As illustrated in <FIG>, data processing section <NUM> estimates a region for each feature E by using labels given to grids g (feature region estimation processing of <FIG> (STEP-<NUM>)). Specifically, data processing section <NUM> performs this processing for each continuous region other than those of ground surface F and load W estimated in the same-region estimation processing. First, data processing section <NUM> calculates an average value of altitude values of representative points pr in a continuous region and a region of ground surface F present in the nearest neighborhood thereof. The "region of ground surface F present in the nearest neighborhood" herein is a region formed of grids g adjacent to a continuous region in a case where the continuous region and a region of ground surface F are adjacent to each other, and is a region formed of grids g adjacent to another continuous region between a continuous region and a region of ground surface F in a case where the continuous region and the region of ground surface F are not adjacent to each other. When a "region of ground surface F present in the nearest neighborhood" is formed including grids g not adjacent to a continuous region or grids g not adjacent to another continuous region between a continuous region and a region of ground surface F, an influence of a change in altitude value due to an inclination increases so that the "region of ground surface F present in the nearest neighborhood" is defined as the regions described above. However, the "region of ground surface F present in the nearest neighborhood" is not limited to the regions described above, but can be set as a region with an arbitrary range. Further, in a case where a difference in an average value of altitude values is equal to or less than the threshold, data processing section <NUM> estimates a continuous region as ground surface F. In a case where a difference in an average value of altitude values is larger than the threshold, data processing section <NUM> estimates a continuous region as feature E.

As illustrated in <FIG>, for example, it is assumed that in the same-region estimation processing, the continuous region of label No. <NUM> is estimated as ground surface F and the continuous regions of labels No. <NUM> and No. <NUM> are not estimated as ground surface F or load W. The continuous region of label No. <NUM> is separated from the region estimated as ground surface F (the continuous region of label No. <NUM>) by the continuous region of label No. <NUM>. The region of ground surface F present in the nearest neighborhood of labels No. <NUM> and No. <NUM> is indicated as an oblique line portion in <FIG>. Data processing section <NUM> calculates an average value of altitude values of representative points pr in the continuous region of label No. <NUM> as <NUM>. Data processing section <NUM> calculates an average value of altitude values of representative points pr in the continuous region of label No. <NUM> as <NUM>. Data processing section <NUM> calculates an average value of altitude values of representative points pr in the region of ground surface F present in the nearest neighborhood of the continuous region of label No. <NUM> and the continuous region of label No. <NUM> as <NUM>. As illustrated in <FIG>, since the difference in the average value of the altitude values between the continuous region of label No. <NUM> and the region of ground surface F present in the nearest neighborhood thereof is larger than the threshold of <NUM>, data processing section <NUM> estimates the continuous region of label No. <NUM> as feature E. Since the difference in the average value of the altitude values between the continuous region of label No. <NUM> and the region of ground surface F present in the nearest neighborhood thereof is equal to or less than the threshold of <NUM>, data processing section <NUM> estimates the continuous region of label No. <NUM> as ground surface F.

Finally, data processing section <NUM> outputs a set of representative points pr of grids g for each of load W, ground surface F, and feature E based on labels given to grids g. Thus, data processing section <NUM> is capable of recognizing a region separated from ground surface F surrounding the region by feature E, as ground surface F.

Data processing section <NUM> uses a set of representative points pr of grids g to visualize, for each of load W and feature E, the size and height thereof on a camera image (region visualization processing (STEP-<NUM>) in <FIG>). Specifically, data processing section <NUM> first calculates the position and orientation (azimuth) of laser scanner <NUM> at a current time from measurement data of first GNSS receiver 64a and second GNSS receiver 64b. Next, data processing section <NUM> determines the coordinate axes based on the calculated position and orientation of laser scanner <NUM>, and displays the size and height of load W, feature E or the like on a camera image by aligning positions of representative points pr of load W, feature E or the like on the camera image.

As illustrated in <FIG>, data processing section <NUM> calculates an outer line including load W, feature E or the like on camera image I by using positions of representative points pr of load W, feature E or the like on camera image I, and displays an outline figure formed by the outer line as guide information GD1 on camera image I. Finally, data processing section <NUM> displays difference values between altitude values of load W or feature E and altitude values of ground surface F as guide information GD2 (height information) on guide information GD1. Note that, the drawing color of guide information GD1 is displayed in a predetermined color whose shading is changed in accordance with the height of load W or feature E. Further, with respect to significant figures of heights of load W and feature E, values are rounded to the first decimal place.

As illustrated in <FIG>, data processing section <NUM> uses a three-dimensional map of measurement region KA in which labels are given for each of load W, ground surface F, and feature E to visualize the positional relationship and size of each of load W, ground surface F, and feature E in a three-dimensional space (three-dimensional map visualization processing of <FIG> (STEP-<NUM>)). Specifically, data processing section <NUM> first generates surfaces S having representative point pr as the center of gravity based on the positions and altitude values of representative points pr for each of load W, ground surface F, and feature E. At this time, the width of surface S is set to be the width of grid g used when generating representative point pr. Then, data processing section <NUM> colors surfaces S for each of load W, ground surface F, and feature E, and visualizes three-dimensional map M therewith in the three-dimensional space on data display section <NUM>.

Note that, the width of grid g is changed in accordance with the states of crane <NUM> and/or measurement region KA to adjust the visibility of three-dimensional map M. For example, when the width of grid g is reduced as the height of the distal end portion of boom <NUM> becomes higher, data processing section <NUM> can visualize a wide range of measurement region KA measured from a high position by using three-dimensional map M with surface S being smaller. In a case where a plurality of features E having a height difference being within the threshold is close to each other on measurement region KA, data processing section <NUM> can visualize the plurality of features E as one feature E on three-dimensional map M by increasing the width of grid g.

Hereinafter, a control aspect of measurement region display system <NUM> will be specifically described.

As illustrated in <FIG>, measurement data is input to data processing section <NUM>, and data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs time association processing, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs rigid transformation processing, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> starts grid generation processing A, and proceeds to STEP-<NUM> (see <FIG>). Then, when grid generation processing A is terminated, data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> starts three-dimensional map updating processing B, and proceeds to STEP-<NUM> (see <FIG>). Then, when three-dimensional map updating processing B is terminated, data processing section <NUM> proceeds to STEP-<NUM>. Note that, in a case where a three-dimensional map is not generated prior to a current time, data processing section <NUM> newly generates a three-dimensional map.

In STEP-<NUM>, data processing section <NUM> starts labeling processing C, and proceeds to STEP-<NUM> (see <FIG>). Then, when labeling processing C is terminated, data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs same-region estimation processing, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs feature region estimation processing, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs region visualization processing, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> performs three-dimensional map visualization processing, and outputs visualization results. The visualization results are three-dimensional map M, camera image information, and the like.

As illustrated in <FIG>, in STEP-<NUM>, data processing section <NUM> starts grid generation processing A, superimposes point cloud data P that has been corrected, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> divides point cloud data P, which has been superimposed, by grids g having a certain size, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> slices grids g, in which point cloud data P is present, in the horizontal direction at arbitrary intervals to form a plurality of layers L1, L2, L3. , and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> calculates average altitude value H of point data p of layer L1, in which point data p is present and which is located at the highest altitude, among the layers, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> calculates a center-of-gravity position of each grid g, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> sets the center-of-gravity position of each grid g at average altitude value H, which has been calculated, as a position of representative point pr of each grid g, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> determines whether the setting of representative point pr is completed for every grid g in which point cloud data P is present.

As a result, in a case where the setting of representative point pr is completed for every grid g in which point cloud data P is present, data processing section <NUM> terminates grid generation processing A, and proceeds to STEP-<NUM>.

In a case where the setting of representative point pr is not completed for every grid g in which point cloud data P is present, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>, and performs STEP-<NUM> to grid g in which the setting of representative point pr is not performed.

As illustrated in <FIG>, in STEP-<NUM>, data processing section <NUM> starts three-dimensional map updating processing B, and acquires representative point pr set in each grid g and representative point pr for each grid g on a three-dimensional map generated prior to a current time.

In STEP-<NUM>, data processing section <NUM> determines whether a plurality of representative points pr is present in one grid g.

As a result, in a case where a plurality of representative points pr is present in one grid g, data processing section <NUM> proceeds to STEP-<NUM>.

In a case where a plurality of representative points pr is not present in one grid g, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> deletes representative point pr for each grid on the three-dimensional map generated prior to the current time, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> determines whether STEP-<NUM> and STEP-<NUM> are completed for every grid g.

As a result, in a case where STEP-<NUM> and STEP-<NUM> are completed for every grid g, data processing section <NUM> proceeds to STEP-<NUM>.

In a case where STEP-<NUM> and STEP-<NUM> are not completed for every grid g, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>, and performs STEP-<NUM> to grid g in which STEP-<NUM> and STEP-<NUM> are not performed.

In STEP-<NUM>, data processing section <NUM> generates surfaces having the same size as grid g, outputs a three-dimensional map of measurement region KA, terminates three-dimensional map updating processing B, and proceeds to STEP-<NUM>.

As illustrated in <FIG>, in STEP-<NUM>, data processing section <NUM> starts labeling processing C, calculates each difference between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> determines whether any of the calculated differences in altitude value is equal to or less than the threshold. Note that, in a case where no grid g in the four neighborhoods is present (interest grid ga is at the upper-left of a three-dimensional map), data processing section <NUM> proceeds to STEP-<NUM>, and gives label No. <NUM> to interest grid ga.

As a result, in a case where any of the calculated differences in altitude value is equal to or less than the threshold, data processing section <NUM> proceeds to STEP-<NUM>.

In a case where every calculated difference in altitude value is larger than the threshold, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> gives a label having the smallest number among labels of grids g having a difference in altitude value being equal to or less than the threshold, to interest grid ga, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> gives a new label to interest grid ga, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> determines whether label giving to every grid g is completed.

As a result, in a case where the label giving to every grid g is completed, data processing section <NUM> proceeds to STEP-<NUM>.

In a case where the label giving to every grid g is not completed, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>, and performs STEP-<NUM> with grid g on the right side of or in the next row of interest grid ga as the next interest grid ga.

In STEP-<NUM>, data processing section <NUM> calculates each difference between an altitude value of representative point pr of interest grid ga and an altitude value of representative point pr of each grid g present in the four neighborhoods thereof, and proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> determines whether grid g in the four has a difference in altitude value being equal to or less than the threshold and is given a label different from the label of interest grid ga.

As a result, in a case where grid g in the four neighborhoods of interest grid ga has a difference in altitude value being equal to or less than the threshold and is given a label different from the label of interest grid ga, data processing section <NUM> proceeds to STEP-<NUM>.

In a case where grid g in the four neighborhoods of interest grid ga has a difference in altitude value being equal to or less than the threshold and is not given a label different from the label of interest grid ga, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>.

In STEP-<NUM>, data processing section <NUM> overwrites the label of grid g, which has a difference in altitude value being equal to or lower than the threshold and which is given the label different from the label of interest grid ga, with the label of interest grid ga, and proceeds to STEP-<NUM>.

In a case where STEP-<NUM> and STEP-<NUM> are not completed for every grid g, on the other hand, data processing section <NUM> proceeds to STEP-<NUM>, and performs STEP-<NUM> with grid g on the right side of or in the next row of interest grid ga as the next interest grid ga.

In STEP-<NUM>, data processing section <NUM> outputs a three-dimensional map in which label are given to grids g, terminates labeling processing C, and proceeds to STEP-<NUM>.

Hereinafter, a ground surface estimation method in which the threshold is changed in accordance with distance La between laser scanner <NUM> and each representative point pr will be described.

Data processing section <NUM> changes the threshold based on distance La between laser scanner <NUM> and each representative point pr and measurement performance of laser scanner <NUM>. Distance La is calculated based on the coordinates of point cloud data P. As illustrated in <FIG>, for example, in a case where distance La increases and exceeds predetermined distance Lb, data processing section <NUM> increases the threshold from <NUM> to <NUM>. Predetermined distance Lb is a distance that serves as a condition for changing the threshold. Thus, even when measurement errors of laser scanner <NUM> (variations in measurement results) increase by an increase in distance La, data processing section <NUM> can recognize grids g, in which measurement errors increase, as a continuous region within a range of an increased threshold.

Alternatively, as illustrated in the left diagram of <FIG>, data processing section <NUM> calculates height H1 of laser scanner <NUM> disposed in sensor unit <NUM> from the boom length, the luff-up angle, and the position where laser scanner <NUM> is disposed. Data processing section <NUM> sets virtual ground surface Fa, which is a horizontal surface, based on height H1, which has been calculated, of laser scanner <NUM>. Specifically, data processing section <NUM> sets virtual ground surface Fa such that the height of laser scanner <NUM> from virtual ground surface Fa is equal to height H1, which has been calculated, of laser scanner <NUM>. Then, data processing section <NUM> calculates a position on virtual ground surface Fa such that the distance between the position and laser scanner <NUM> becomes predetermined distance Lb, based on height H1 of laser scanner <NUM> and predetermined distance Lb.

As illustrated in the right diagram of <FIG>, in a case where a plurality of predetermined distances Lb is present, data processing section <NUM> sets concentric regions N along the Z-axis direction such that calculated positions on virtual ground surface Fa are positions of edge Na of the same circle. In concentric regions N to be set, the center of the concentric circle is at the position of laser scanner <NUM> disposed in sensor unit <NUM> in the vertically downward direction. Data processing section <NUM> sets a threshold for each region of virtual ground surface Fa segmented by concentric circles. For example, data processing section <NUM> sets thresholds of <NUM>, <NUM>, <NUM>, <NUM>, <NUM> for each region of virtual ground surface Fa segmented by concentric circles.

In a case where there is one predetermined distance Lb, data processing section <NUM> sets a circular region along the Z-axis direction such that a calculated position on virtual ground surface Fa is a position of an edge of a circle. In the circular region to be set, the center of the circle is at the position of laser scanner <NUM> disposed on sensor unit <NUM> in the vertically downward direction. Data processing section <NUM> sets a threshold for each region of the virtual ground surface segmented by circles.

Alternatively, data processing section <NUM> uniformly changes the threshold of every representative point pr based on height H2 of the distal end portion of boom <NUM>. As illustrated in <FIG>, for example, in a case where the height of the distal end portion of boom <NUM> becomes high and exceeds predetermined height H3, data processing section <NUM> uniformly increases the threshold of every representative point pr from <NUM> to <NUM>. Predetermined height H3 is a height that serves as a condition for changing the threshold. Alternatively, the threshold may also be changed in accordance with the weight of load W or the boom length since the swing of boom <NUM> becomes large and measurement errors increase due to the weight of load W or the boom length as well.

As illustrated in <FIG>, in STEP-<NUM>, data processing section <NUM> calculates distance La between laser scanner <NUM> and representative point pr, changes the threshold based on distance La between laser scanner <NUM> and representative point pr and the measurement performance of laser scanner <NUM>, and proceeds to STEP-<NUM>.

In such a ground surface estimation method, a continuous region for which variations in measurement results are taken into more consideration is recognized by changing the threshold to that in consideration of measurement errors in point cloud data P. Thus, ground surface F is recognized as ground surface F that is continuous even when the height of ground surface F varies due to inclination and/or unevenness.

Hereinafter, a ground surface estimation method in which the width of grid g is changed in accordance with the number of continuous regions within a predetermined range of measurement region KA will be described.

As illustrated in <FIG>, in a case where there are a predetermined number or more of continuous regions within a predetermined range, a region of ground surface F may become narrow and a smaller region of ground surface F may not be recognized. The predetermined range and the predetermined number are arbitrarily set. Data processing section <NUM> determines, while moving predetermined range Ja on grids g of a three-dimensional map in their entirety, whether there are a predetermined number or more of continuous regions within predetermined range Ja.

For example, a case is assumed in which when predetermined range Ja is moved on grids g, there are continuous regions of labels No. <NUM> to No. <NUM> in predetermined range Ja. Further, it is assumed that the predetermined number is set to four. At this time, since there are the predetermined number or more of continuous regions within predetermined range Ja where the predetermined number is four, data processing section <NUM> reduces the width of grid g to a half, and performs labeling processing C again. As illustrated in <FIG>, data processing section <NUM> recognizes a smaller region of ground surface F (label No. <NUM>) between the continuous regions of labels No. <NUM> and No. <NUM> by reducing the width of grid g. Note that, it is configured that the rate of change of the width of grid g can be arbitrarily set. Further, in a case where the shape of a continuous region is not changed even when the width of grid g is reduced, data processing section <NUM> may return the width of grid g to the width of grid g before reduction.

As illustrated in <FIG>, in STEP-<NUM>, data processing section <NUM> changes the width of grid g in accordance with the number of continuous regions within a predetermined range, and proceeds to STEP-<NUM>.

In such a ground surface estimation method, even in a case where a region of ground surface F becomes small, a smaller region of ground surface F is recognized by reducing the width of grid g. Thus, ground surface F is recognized as ground surface F that is continuous even when the height of ground surface F varies due to inclination and/or unevenness.

Claim 1:
A crane (<NUM>) comprising:
a swivel base (<NUM>);
a boom (<NUM>) provided on the swivel base (<NUM>);
a laser scanner (<NUM>) attached to the boom (<NUM>) and acquiring point cloud data;
a control apparatus (<NUM>, <NUM>) adapted to perform arithmetic processing on the acquired point cloud data; and
a display apparatus (<NUM>), wherein:
the point cloud data for each position of the laser scanner (<NUM>) is acquired by laser radiation while the laser scanner (<NUM>) is caused to move in accordance with a swiveling operation of the swivel base (<NUM>), an extending and retracting operation of the boom (<NUM>), and/or a luffing operation of the boom (<NUM>), and
the control apparatus (<NUM>, <NUM>) is adapted to:
acquire the point cloud data for each position of the laser scanner (<NUM>) when radiating the laser, superimpose the point cloud data for each position of the laser scanner (<NUM>) when radiating the laser based on each position and attitude of the laser scanner (<NUM>) when radiating the laser, and calculate an altitude value of a radiation point;
divide a measurement region into a plurality of grids, calculate a center-of-gravity position of each of the grids and an average altitude value of the point cloud data in each of the grids, and set the center-of-gravity position at the average altitude value as a position of a representative point for each of the grids;
recognize one grid and another adjacent grid of the plurality of grids as a continuous region when a difference in altitude value between the representative point of the one grid and the representative point of the other adjacent grid is equal to or less than a threshold, the continuous region being a region where the one grid and the other adjacent grid are continuous;
estimate the continuous region having a largest number of the grids among one or more continuous regions recognized in the measurement region, as a ground surface; and
display the continuous region estimated as the ground surface on the display apparatus (<NUM>), the continuous region estimated as the ground surface being distinguished from a continuous region other than the continuous region estimated as the ground surface.