Patent Description:
<CIT> discloses that when a marker is recognized, position information of the marker stored in a robot vehicle is read to grasp a current position of the robot vehicle.

<CIT> discloses a robot, the features thereof corresponding to those in the preambles of the independent claims. <CIT> discloses a control system for a machine, the features thereof corresponding to those found in the preambles of the independent claims.

However, in the technique described in PTL <NUM>, it is necessary to prepare a plurality of different markers that can be distinguished from each other, and there is a problem that the procurement cost of the markers increases.

The present invention has been made in view of the above problem, and an object of the present invention is to provide a technique for controlling a work machine using markers that do not need to be individually distinguished.

To solve the problem described above and achieve the object, an autonomous work machine according to the present invention is an autonomous work machine that works in a work area and is characterized by including a detection means that detects a plurality of markers arranged to define the work area, a specifying means that specifies marker information based on a detection result of the detection means, a setting means that sets a virtual line connecting the plurality of markers based on the marker information specified by the specifying means, and a control means that controls the autonomous work machine such that the autonomous work machine does not deviate to a region beyond the virtual line set by the setting means. Furthermore, the control means is configured to calculate a time required for the autonomous work machine to reach the virtual line, and to control the autonomous work machine based on the calculated time.

According to the present invention, it is possible to control a work machine using markers that do not need to be individually distinguished. The avoidance operation can be performed before the time required to reach the virtual line is reached. In addition, deviation can be prevented without using an IMU or a GPS sensor for recognizing the self-position.

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain principles of the invention.

The invention is set forth in the independent claims <NUM> and <NUM> and in the dependent claims <NUM> to <NUM> and <NUM>.

Note that the same components are denoted by the same reference numerals throughout the drawings.

<FIG> is an external view of an autonomous work machine capable of autonomously traveling according to an embodiment of the present invention. Hereinafter, a moving direction (vehicle length direction), a lateral direction (vehicle width direction) orthogonal to the moving direction, and a vertical direction orthogonal to the moving direction and the lateral direction in a side view of the autonomous work machine are respectively defined as a front-and-rear direction, a left-and-right direction, and an up-and-down direction, and the configuration of each part will be described in accordance with the above definition.

In <FIG>, reference numeral <NUM> denotes an autonomous work machine (hereinafter referred to as a "work vehicle"). Specifically, the work vehicle <NUM> functions as a lawn mower that autonomously travels. However, the lawn mower is merely an example, and the present invention is also applicable to other types of work machines. The work vehicle <NUM> includes a camera unit <NUM> including a plurality of cameras (a first camera 11a and a second camera 11b), and calculates and acquires distance information between an object existing forward and the work vehicle <NUM> using images captured by the first camera 11a and the second camera 11b having parallax. Then, the operation of the work vehicle <NUM> is controlled based on the captured image and the object recognition model held in advance.

<FIG> is a diagram illustrating the work vehicle <NUM> observed in the lateral direction (vehicle width direction). As illustrated in <FIG>, the work vehicle <NUM> includes the camera unit <NUM>, a vehicle body <NUM>, a stay <NUM>, front wheels <NUM>, rear wheels <NUM>, a blade <NUM>, a work motor <NUM>, a motor holding member <NUM>, a blade-height adjustment motor <NUM>, and a translation mechanism <NUM>. The work vehicle <NUM> further includes a travel motor <NUM>, a group of various sensors S, an electronic control unit (ECU) <NUM>, a charging unit <NUM>, a battery <NUM>, a charging terminal <NUM>, and a communication unit <NUM>.

The vehicle body <NUM> of the work vehicle <NUM> includes a chassis 12a, and a frame 12b attached to the chassis 12a. The front wheels <NUM> include one left wheel and one right wheel each having a smaller diameter and fixed to the front of the chassis 12a through the stay <NUM> in the front-and-rear direction. The rear wheels <NUM> include one left wheel and one right wheel each having a larger diameter and attached to the rear of the chassis 12a.

The blade <NUM> is a rotary blade for a lawn mowing work, and is attached near the central position of the chassis 12a. The work motor <NUM> is an electric motor disposed above the blade <NUM>. The blade <NUM> is connected with the work motor <NUM>, and is rotatably driven by the work motor <NUM>. The motor holding member <NUM> holds the work motor <NUM>. The motor holding member <NUM> is restricted in rotation with respect to the chassis 12a, and is allowed to move in the up-and-down direction by, for example, the combination of a guide rail and a slider movable up and down while being guided by the guide rail.

The blade-height adjustment motor <NUM> is a motor for adjusting the height in the up-and-down direction of the blade <NUM> to the ground surface GR. The translation mechanism <NUM> is connected to the blade-height adjustment motor <NUM>, and is a mechanism for converting rotation of the blade-height adjustment motor <NUM> into translation in the up-and-down direction. The translation mechanism <NUM> is also connected with the motor holding member <NUM> that holds the work motor <NUM>.

The rotation of the blade-height adjustment motor <NUM> is converted into the translation (movement in the up-and-down direction) by the translation mechanism <NUM>, and the translation is transmitted to the motor holding member <NUM>. Due to the translation (movement in the up-and-down direction) of the motor holding member <NUM>, the work motor <NUM> held by the motor holding member <NUM> also is translated (moves in the up-and-down direction). Due to the movement in the up-and-down direction of the work motor <NUM>, the height of the blade <NUM> with respect to the ground surface GR is adjustable.

The travel motor <NUM> is two electric motors (prime movers) attached to the chassis 12a of the work vehicle <NUM>. The two electric motors are connected one-to-one to the left and right rear wheels <NUM>. By independently rotating the left and right wheels forward (rotating in the forward direction) or backward (rotating in the backward direction) with the front wheels <NUM> as driven wheels and the rear wheels <NUM> as driving wheels, the work vehicle <NUM> can be moved in various directions.

The charging terminal <NUM> is a charging terminal provided at a front end position in the front-and-rear direction of the frame 12b, and is connected with a corresponding terminal of a charging station (for example, a charging station <NUM> that will be described later with reference to <FIG>) to receive electric power supplied from the charging station. The charging terminal <NUM> is connected with the charging unit <NUM> through wiring, and the charging unit <NUM> is connected with the battery <NUM>. In addition, the work motor <NUM>, the travel motor <NUM>, and the blade-height adjustment motor <NUM> are connected to the battery <NUM>, and are supplied with power from the battery <NUM>.

An ECU <NUM> is an electronic control unit including a microcomputer formed on a circuit board and controls the operation of the work vehicle <NUM>. The details of the ECU <NUM> will be described later. The communication unit <NUM> can transmit and receive information to and from an external device (for example, a charging station that will be described later, a communication terminal possessed by a user, a remote controller for operating the work vehicle <NUM>, or the like) connected with the work vehicle <NUM> in a wired or wireless manner.

<FIG> is a diagram illustrating a configuration example of a control system according to an embodiment of the present invention. A control system <NUM> includes the work vehicle <NUM> and the charging station <NUM>. Note that a remote controller for operating a communication terminal possessed by a user that will be described later or the work vehicle <NUM> may be further included.

As illustrated in <FIG>, the ECU <NUM> included in the work vehicle <NUM> includes a CPU 44a, an I/O 44b, and a memory 44c. The I/O 44b inputs and outputs various types of information. The memory 44c is a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a random access memory (RAM), or the like. The memory 44c stores a captured image, a work schedule of the work vehicle <NUM>, map information on a work area, various programs for controlling the operation of the work vehicle <NUM>, and the like. In order to operate each processing unit for achieving the present invention, the ECU <NUM> reads and executes a program stored in the memory 44c.

The ECU <NUM> is connected with the group of various sensors S. The sensor group S includes an orientation sensor <NUM>, a GPS sensor <NUM>, a wheel speed sensor <NUM>, an angular speed sensor <NUM>, an acceleration sensor <NUM>, a current sensor <NUM>, and a blade height sensor <NUM>.

The orientation sensor <NUM> and the GPS sensor <NUM> are sensors for acquiring information on the orientation and position of the work vehicle <NUM>. The orientation sensor <NUM> detects the orientation in accordance with terrestrial magnetism. The GPS sensor <NUM> receives a radio wave from a GPS satellite and detects information indicating a current position (latitude and longitude) of the work vehicle <NUM>. To be noted, in addition to or instead of the GPS sensor <NUM> and the orientation sensor <NUM>, odometry and an inertial measurement unit (IMU) may be provided.

The wheel speed sensor <NUM>, the angular speed sensor <NUM>, and the acceleration sensor <NUM> are sensors for acquiring information regarding a moving state of the work vehicle <NUM>. The wheel speed sensor <NUM> detects the wheel speeds of the left and right rear wheels <NUM>. The angular speed sensor <NUM> detects an angular speed around an axis in the up-and-down direction (z axis in the vertical direction) of the gravity center position of the work vehicle <NUM>. The acceleration sensor <NUM> detects accelerations in the <NUM> orthogonally triaxial directions of x, y, and z axes acting on the autonomous work vehicle <NUM>.

The current sensor <NUM> detects the current consumption (amount of power consumption) of the battery <NUM>. The detection result of the current consumption (amount of power consumption) is stored in the memory 44c of the ECU <NUM>. In a case where a predetermined amount of power is consumed and the amount of power stored in the battery <NUM> becomes not more than a threshold, the ECU <NUM> performs returning control for causing the autonomous work vehicle <NUM> to return to the charging station <NUM> for charging. Note that a daily work schedule may be stored in the memory 44c, and the returning control may be performed in response to completion of work to be performed on that day.

The blade height sensor <NUM> detects a height of the blade <NUM> with respect to a ground surface GR. The detection result of the blade height sensor <NUM> is output to the ECU <NUM>. On the basis of the control of the ECU <NUM>, the blade-height adjustment motor <NUM> is driven and the blade <NUM> moves up and down in the up-and-down direction to adjust the height from the ground surface GR.

Outputs from the group of various sensors S are input into the ECU <NUM> through the I/O 44b. On the basis of the outputs of the group of various sensors S, the ECU <NUM> supplies power from the battery <NUM> to the travel motor <NUM>, the work motor <NUM>, and the height adjustment motor <NUM>. The ECU <NUM> controls the traveling of the work vehicle <NUM> by outputting a control value via the I/O 44b and controlling the travel motor <NUM>. In addition, the height of the blade <NUM> is adjusted by outputting a control value through the I/O 44b and controlling the height adjustment motor <NUM>. Further, the rotation of the blade <NUM> is controlled by outputting a control value through the I/O 44b to control the work motor <NUM>. Here, the I/O 44b can function as a communication interface and can be connected to another device in a wired or wireless manner via a network <NUM>.

The charging station <NUM> functions as a charging device for charging a battery (battery <NUM>) of the work vehicle <NUM>. The work vehicle <NUM> is installed in the work area, and can return to the charging station <NUM> and perform charging by connecting the charging terminal <NUM> to the charging station <NUM>.

A virtual line setting method according to the present embodiment will be described with reference to <FIG>. A virtual line is an imaginary line connecting markers arranged to define the work area. In <FIG>, reference numeral <NUM> denotes a region (for example, the entire site owned by a user) including the work area (for example, a garden) where the work vehicle <NUM> performs work. Reference numerals 401a to 401n denote markers according to the present embodiment. An area surrounded by these markers 401a to 401n is a work area. The work vehicle <NUM> performs work so as not to deviate from this work area by performing control so as not to deviate to a region beyond the virtual line. Note that the work area may be defined by partitioning the entire site using an existing area wire of a type that is embedded in the ground, and disposing markers in a part of the site to provide a non-entry area. That is, the present invention can also be applied to a case where a work area is defined by combining an existing area wire and a marker.

Reference numeral <NUM> denotes a traveling direction of the work vehicle <NUM>, and reference numeral <NUM> denotes a range (for example, an angle of view range) that the work vehicle <NUM> can recognize by the camera unit <NUM>. In the illustrated example, four markers 401a to 401d are included in the recognizable range. When recognizing the marker, the work vehicle <NUM> sets a virtual line (virtual wire) between two adjacent markers. In the illustrated example, a virtual line <NUM> is set between the marker 401a and the marker 401b, a virtual line <NUM> is set between the marker 401b and the marker 401c, and a virtual line <NUM> is set between the marker 401c and the marker 401d. To be noted, for example, since the marker 401b and the marker 401d are not adjacent markers, a virtual line is not set.

Here, the virtual line is not limited to a straight line. For example, a smooth curve may be set like a virtual line <NUM> set between the marker 401i and the marker 401j.

Whether two markers are adjacent markers can be determined based on the distance between the markers in the case where it is assumed that the markers are arranged at predetermined distance intervals. When the distance between the markers is within a predetermined distance range (for example, <NUM> to <NUM>), it may be determined that the markers are adjacent markers, and when the distance is out of the predetermined distance range, it may be determined that the markers are not adjacent markers. In <FIG>, since the length (for example, <NUM>) of a line <NUM> is out of the predetermined distance range, the line is not set as a virtual line. As a result, it is possible to prevent the work from not being performed in the region of a triangle obtained by connecting the marker 401b, the marker 401c, and the marker 401d.

As described above, according to the determination method <NUM>, among the plurality of markers, two markers whose distance between the markers is within the predetermined distance range are specified as adjacent markers. The predetermined distance range do not have to have an upper limit value or a lower limit value, for example, like <NUM> or more, <NUM> or more, <NUM> or less, or <NUM> or less.

To be noted, the method for determining whether two markers are adjacent markers is not limited to a method using the distance between the markers. For example, by using a marker, such as the marker <NUM> in <FIG>, including an indicator (For example, <NUM> and <NUM>) for indicating a direction in which an adjacent marker is present, each indicator may be detected, and a nearby marker present in the direction indicated by the indicator <NUM> or <NUM> may be determined to be an adjacent marker. In the illustrated example, a virtual line <NUM> is set between the marker <NUM> and the marker <NUM> existing in the direction indicated by the indicator <NUM>, and a virtual line <NUM> is set between the marker 401n and the marker 401n. In this case, each marker may be configured to include indicators indicating at least two directions similarly to <NUM>.

As described above, according to the determination method <NUM>, each marker includes an indicator indicating the direction in which an adjacent marker exists, and a second marker existing in the direction indicated by the indicator of a first marker can be specified as an adjacent marker. When there are a plurality of markers in the direction indicated by the indicator of the first marker, the marker existing closest to the first marker may be specified as the adjacent marker. In addition, in combination with the determination method <NUM>, a marker in a direction indicated by the indicator and within a predetermined distance range (for example, <NUM> to <NUM>) may be specified as an adjacent marker. In addition, the direction indicated by the indicator may be freely changed by the user. For example, the direction of the indicator may be adjustable using a rotation mechanism or the like.

In the case of the determination method <NUM>, in the case where three markers are arranged in an equilateral triangle shape at intervals of a predetermined distance (for example, <NUM>), or in the case where four markers are arranged in a square shape at intervals of a predetermined distance (for example, <NUM>), there is a possibility that it is not possible to enter a region inside the equilateral triangle or the square, and work cannot be performed in these regions.

Here, <FIG> is an explanatory diagram of a method of determining an adjacent marker in a work area in which an equilateral triangular or square region is formed. Reference numeral <NUM> denotes a region (for example, the entire site owned by a user) including the work area (for example, a garden) where the work vehicle <NUM> performs work. Reference numerals 451a to 451p denote markers according to the present embodiment. An area surrounded by these markers 451a to 451p is a work area. The work vehicle <NUM> performs work so as not to deviate from the work area.

The markers 451a to 451p are arranged at predetermined distance (for example, <NUM>) intervals. In this work area, an equilateral triangular region is formed by three markers of the marker 451b, the marker 451c, and the marker 451d. Similarly, a square region is formed by four markers of the marker <NUM>, the marker <NUM>, the marker 451n, and the marker <NUM>. If there are such regions, when the determination method <NUM> is used, the work vehicle <NUM> cannot move to a region behind the virtual line connecting the marker 451b and the marker 451c and the virtual line connecting the marker <NUM> and the marker 451c, so that the work cannot be performed in these regions.

Therefore, when another marker is detected behind the two markers, it may be determined that the two markers are not adjacent markers. In the illustrated example, two markers of the marker 451b and the marker 451d are detected, and the other marker 451c is further detected behind the two markers. Therefore, it is determined that the two markers 451b and 451d are not adjacent markers. Similarly, two markers of the marker <NUM> and the marker <NUM> are detected, and the other markers <NUM> and 451n are further detected behind the two markers. Therefore, it is determined that the two markers <NUM> and <NUM> are not adjacent markers.

As a result, no virtual line is set between the marker 451b and the marker 451c and between the marker <NUM> and the marker 451c, so that the work vehicle <NUM> can enter an equilateral triangular area and a square area to perform work.

As described above, according to the determination method <NUM>, when another marker is present in a region behind a line connecting two markers, it is specified that the two markers are not adjacent markers. However, when the determination method <NUM> is applied, in the case where another marker at a position far away from the two markers is detected, there is a possibility of erroneous entry to the back region. Therefore, a configuration in which movement to the back region is only possible when the distance to the other marker is calculated and the calculated distance is equal to or less than a predetermined distance (for example, <NUM>), or when it is determined that the other marker is a marker adjacent to either one of the two markers on the front side. As a result, it is possible to suppress entry into a region that should not be originally entered.

<FIG> is an explanatory diagram of an example of a method of determining adjacent markers. Reference numeral <NUM> denotes a region (for example, the entire site owned by a user) including the work area (for example, a garden) where the work vehicle <NUM> performs work. Reference numerals 461a to <NUM> denote markers according to the present embodiment. An area surrounded by these markers 461a to <NUM> is a work area. The work vehicle <NUM> performs work so as not to deviate from the work area.

Before starting work by the work vehicle <NUM>, a user <NUM> directly controls the work vehicle <NUM> by operating a remote controller <NUM>, and moves the work vehicle <NUM> one lap along each marker. An operation signal from the remote controller <NUM> is received via the communication unit <NUM> of the work vehicle <NUM>.

In addition, the work vehicle <NUM> includes a GPS sensor <NUM>, and stores a trajectory obtained by sequentially tracing each marker according to the operation signal of the remote controller <NUM> as trajectory information of the work area. As a result, since the trajectory information of the work area can be grasped before the start of the work, it is possible to determine whether or not the two markers are adjacent markers, by determining that markers not following the trajectory are not adjacent markers after the start of the work.

As described above, according to the determination method <NUM>, the trajectory information of the work vehicle <NUM> is acquired by causing the work vehicle <NUM> to travel along each of the arranged markers. As a result, two markers matching the trajectory information among the plurality of markers can be specified as adjacent markers.

<FIG> is a diagram illustrating an example of drawing something on a map related to a work area displayed on a communication terminal held by a user. Reference numeral <NUM> denotes a communication terminal of the user, which is, for example, a tablet or a smartphone. Reference numeral <NUM> denotes a hand of the user. Reference numeral <NUM> represents map information on the work area displayed on a display screen of the communication terminal <NUM>. In the illustrated example, a map of a site including a home and a garden of the user as viewed from above is displayed. Reference numeral <NUM> denotes a roof of the user's home, and reference numeral <NUM> denotes a tree space in a site of the user's home. Here, <FIG> is an external view of a part of the site including the user's home corresponding to the map information of <FIG>.

In <FIG>, reference numeral <NUM> denotes a boundary traced on the map by the user using a finger of the hand <NUM>. Similarly, reference numeral <NUM> indicates a boundary traced around the tree space by the user using the finger of hand <NUM>. A tree spaces <NUM> is an island excluded from the work area. Note that the boundary may be designated by connecting positions pointed by a finger instead of tracing using the finger.

In this manner, the boundary of the work area is designated on a map displayed on the communication terminal <NUM>, and the designated boundary information (information indicating the position of a boundary line) is transmitted to the work vehicle <NUM>. As a result, since the work vehicle <NUM> can acquire the boundary information designated by the user operation, the work vehicle <NUM> can recognize its self-position and orientation using the GPS sensor <NUM> and the orientation sensor <NUM>, and determine whether or not two detected markers are adjacent markers using the self-position and orientation and the boundary information. In the example of <FIG>, the work vehicle <NUM> can determine that a marker <NUM> and a marker <NUM> are not adjacent markers from the acquired boundary information. To be noted, the self-position and orientation may be recognized by using, in addition to or instead of the GPS sensor <NUM> and the orientation sensor <NUM>, an odometry and an inertial measurement unit (IMU).

To be noted, the method of tracing the boundary is not limited to the method in which the user traces the boundary using the finger of the hand <NUM>. As indicated by black circles <NUM> in <FIG>, the user may sequentially point out a plurality of positions of markers on the map along the boundary using the finger of the hand <NUM> to acquire marker arrangement information as the boundary information. The boundary information may be transmitted from the communication terminal <NUM> to the work vehicle <NUM>.

Even in a case where the position of each marker is pointed out, it is possible to determine whether or not two detected markers are adjacent markers by using the self-position and orientation and the boundary information (marker arrangement information). For example, in the example of <FIG>, the work vehicle <NUM> can determine that the marker <NUM> and the marker <NUM> are not adjacent markers from the boundary information (marker arrangement information).

As described above, according to the determination method <NUM>, the boundary information (for example, arrangement information of a plurality of markers arranged at the boundary of the work area (position information designated by pointing) or information of a boundary line (line traced with a finger) indicating the boundary of the work area) of the work area designated on the map including the work area is acquired. As a result, two markers matching the boundary information among the plurality of markers can be specified as adjacent markers.

<FIG> illustrates an example of a method using two types of markers. Different types (For example, different colors, different shapes, and the like) of markers are respectively used for each marker arranged on the boundary of the work area and each marker arranged around the tree space <NUM> which is an island excluded from the work area. As a result, the work vehicle <NUM> can discriminate different types of markers from the features of the markers extracted from the captured image, and the work vehicle <NUM> can determine that a marker <NUM> and a marker <NUM> are not adjacent markers from the captured image.

Note that the marker is not limited to two types of markers, and in a case where there are a plurality of islands, different types of markers may be used for respective islands. Therefore, the present invention is also applicable to a case where three or more types of markers are used.

In this manner, a plurality of first type markers defining the outer edge of the work area and a plurality of second type markers defining the internal region (island) enclosed by the outer edge and excluded from the work area are used. This allows the first type markers and the second type markers to be identified as not being adjacent markers.

<FIG> is a diagram illustrating an example in which markers are arranged at short intervals in a region having a complicated shape. Reference numerals 491a to 491e each denote a marker for a first distance (for example, <NUM>) interval. Reference numerals 492a to 492f each denote a marker for a second distance (for example, <NUM>) interval. The first type markers for the first distance interval and the second type markers for the second distance interval are different types of markers having, for example, different colors, shapes, sizes, or the like.

In the illustrated example, the marker 491b, the marker 491c, and the marker 491d form an equilateral triangle shape, and the marker 491c, the marker 491d, and the marker 491e also form an equilateral triangle shape. A case where only the markers 491a to 491e are arranged in such a complicated shape will be considered. If it is determined that two markers are not adjacent markers when another marker is detected behind the two markers as in the determination method <NUM>, for example, in the case where the work vehicle is traveling toward a position between the marker 491c and the marker 491d, the marker 491e is detected at the back, so that the work vehicle can travel in a direction approaching the marker 491e at the back beyond the boundary of the work area connecting the marker 491c and the marker 491d.

Therefore, the markers 492a to 492f are further arranged at places having complicated shapes. Accordingly, since the work vehicle <NUM> further detects the marker 492c and the marker 492d on the line connecting the marker 491c and the marker 491d, it is possible to determine that the two markers (the marker 491c and the marker 491d) are adjacent markers. Therefore, it is possible to prevent the work vehicle <NUM> from deviating to the back region beyond the boundary of the work area connecting the marker 491c and the marker 491d. To be noted, although a case where the two markers 492c and 492d are detected is has been described for the illustrated example, it may be determined that the two markers (the marker 491c and the marker 491d) are adjacent markers when either the marker 492c or the marker 492d is detected on the line connecting the marker 491c and the marker 491d.

As described above, according to the determination method <NUM>, the plurality of first type markers arranged at the first distance intervals and the plurality of second type markers arranged at the second distance intervals shorter than the first distance intervals are used. Accordingly, when one or more second type markers are present between two first type markers among a plurality of first type markers, the two first type markers can be identified as adjacent markers.

Next, a procedure of processing performed by the work vehicle <NUM> according to the present embodiment will be described with reference to flowcharts of <FIG> and <FIG>. The work vehicle <NUM> according to the present embodiment sets a virtual line between markers and performs control so that the work vehicle <NUM> does not deviate to a region beyond the virtual line.

In step S501, the CPU 44a acquires a stereo image captured by the camera unit <NUM>.

In step S502, the CPU 44a acquires a distance image based on the stereo image.

In step S503, the CPU 44a trims an image of one of the first camera 11a and the second camera 11b constituting the camera unit <NUM>. In the present embodiment, an image of the second camera 11b is used.

In step S504, the CPU 44a executes object recognition processing using the trimmed image. Features of objects including persons and markers are learned in advance by machine learning, and an object is recognized by comparison with the learning result.

In step S505, the CPU 44a determines whether or not a marker has been recognized as a result of the object recognition processing in step S504. In the case where it is determined that a marker has been recognized, the process proceeds to step S506. In the case where it is determined that a marker has not been recognized, the process proceeds to step S517.

In step S506, the CPU 44a acquires the gravity center position of the marker in the image. For example, a specific position of the marker is specified as the gravity center position based on information of the gravity center position of the marker held in advance. Note that the gravity center position is merely an example, and is not limited to the gravity center position. The position may be a top position of the marker, or may be a ground contact position where the marker and the ground are in contact with each other.

In step S507, the CPU 44a acquires information of the distance from the work vehicle <NUM> to the gravity center position of the marker as marker information using the distance image acquired in step S502.

In step S508, the CPU 44a determines whether or not a plurality of markers have been recognized in step S505. In the case where it is determined that a plurality of markers have been recognized, the process proceeds to step S509. In the case where only a single marker has been recognized, the process proceeds to step S515.

In step S509, the CPU 44a determines whether or not two markers included in the plurality of markers are adjacent markers. In the present embodiment, whether or not the distance between the two markers is within a predetermined distance range is determined, and when the distance is within the predetermined distance range, it is determined that the markers are adjacent markers. In the present embodiment, it is assumed that the markers are installed at intervals of <NUM>, but the markers are not necessarily arranged at equal intervals of <NUM>, and there is a possibility that some deviation occurs. Therefore, it is determined that the markers are adjacent markers if the markers are within the predetermined distance range, for example, in a range of <NUM> to <NUM>. In the case where it is determined that the markers are adjacent markers, the process proceeds to step S510. In contrast, in the case where it is determined that the markers are not adjacent markers, the process proceeds to step S511. As a method of determining whether or not the markers are adjacent markers, other determination methods described with reference to <FIG> may be used.

In step S510, the CPU 44a sets a virtual line between the two markers determined to be adjacent markers.

In step S511, the CPU 44a determines whether or not the determination has been completed for all combinations of two markers among the plurality of markers. When the determination is completed for all the combinations, the process proceeds to step S512. In contrast, in the case where there remains a combination for which the determination has not been performed yet, the process returns to step S509, and the determination is performed on a new combination of two markers.

In step S512, the CPU 44a calculates the distance from the work vehicle <NUM> to a virtual line located ahead of the work vehicle <NUM> in the traveling direction based on the traveling direction of the work vehicle <NUM> and the virtual line located ahead in the traveling direction. In the example of <FIG>, the distance to an intersection with the virtual line <NUM> located ahead in the traveling direction <NUM> is calculated.

Here, an example of a method of calculating the distance to the intersection with the virtual line <NUM> located ahead in the traveling direction <NUM> will be described with reference to <FIG>. In <FIG>, a point O is a current position of the work vehicle <NUM>. A point A corresponds to the marker 401a in <FIG>, and a point B corresponds to the marker 401b in <FIG>. When the distance to be obtained is X, X is the length of a line OC. Here, the length of a line OA and the length of a line OB can be obtained from the distance image. Furthermore, an angle α and an angle β can also be obtained from the imaging direction (normally, the same direction as the traveling direction <NUM>) and the viewing angle of the camera unit <NUM>, and the directions of the point A and the point B. Then, a perpendicular line is drawn down from the point A to the line OC, and an intersection thereof is defined as D. Similarly, a perpendicular line is drawn down from the point B to an extension line of the line OC, and an intersection thereof is defined as E. At this time, since a triangle ACD and a triangle BCE are similar, AD:BE = CD:CE holds. Then, as illustrated in <FIG> illustrating an example of the captured image, the ratio between AD and BE can be obtained from the ratio of the distance from a center line <NUM> of the image of one camera captured by the camera unit <NUM> (that is, the ratio of the length between AG and BH).

In <FIG>, AD = OAsinα, BE = OBsinβ, CD = OC - OAcosα, and CE = OBcosβ - OC hold, and therefore a distance X to the point C can be obtained by <MAT> <MAT> <MAT>.

In step S513, the CPU 44a determines whether or not the distance from the work vehicle <NUM> to the virtual line located ahead of the work vehicle <NUM> in the traveling direction is equal to or less than a threshold value (for example, <NUM>). When it is determined that the distance is equal to or less than the threshold, the process proceeds to S514. In contrast, in the case where the distance is larger than the threshold value, the process proceeds to step S517.

In step S514, the CPU 44a executes an avoidance operation based on the virtual line. Specifically, when the work vehicle <NUM> approaches a threshold (for example, <NUM>) from the virtual line, the work vehicle <NUM> stops, moves backward, or turns. Accordingly, it is possible to prevent the work vehicle <NUM> from deviating to a region beyond the virtual line. For example, the work vehicle <NUM> stops, moves backward, or turns the work vehicle <NUM> when the distance from the work vehicle <NUM> to the virtual line <NUM> becomes equal to or less than the threshold so as not to deviate to the back region beyond the intersection position of the line <NUM> extending in the traveling direction <NUM> and the virtual line <NUM> existing in the traveling direction <NUM> illustrated in <FIG>. As a result, the work vehicle <NUM> can perform work without deviating from the work area. Here, the turning is to change the traveling direction of the work vehicle <NUM>, and includes moving along a parabolic trajectory when the site is viewed from above, rotating on the spot after stopping at a certain point to change the traveling direction, and going around so as not to enter the region defined by the virtual line.

When the distance to the virtual line becomes equal to or less than another threshold value (for example, <NUM>), control for lowering the traveling speed of the work vehicle <NUM> heading for the virtual line <NUM> may be further performed. By decelerating in advance before performing an avoidance operation such as stop, backward movement, or turning, it is possible to suppress sudden operation such as sudden stop, sudden backward movement after sudden stop, or sudden turning.

In step S515, the CPU 44a determines whether or not the distance from the work vehicle <NUM> to the marker is equal to or less than a threshold. The threshold here is, for example, <NUM>, but is not limited to this value. When it is determined that the distance is equal to or less than the threshold, the process proceeds to S516. In contrast, in the case where the distance is larger than the threshold value, the process proceeds to step S517.

In step S516, the CPU 44a executes the avoidance operation. Specifically, when the work vehicle <NUM> stops, moves backward, or turns when reaching a threshold distance (for example, <NUM>) from a marker. Since only one marker is detected, the avoidance operation is performed independently of the virtual line. Thereafter, the process proceeds to step S517.

In step S517, the CPU 44a determines whether to end the series of processing. For example, there are a case where the remaining battery charge becomes equal to or lower than a threshold and it is necessary to return to the charging station <NUM>, a case where a predetermined time has elapsed from the start of work, and a case where work in the work area has been completed (for example, the lawn in the work area has been mowed). This also applies to a case where the user operates the power source of the work vehicle <NUM> to be turned off. In the case where it is determined not to end the series of processing, the process returns to step S501. In contrast, in the case where it is determined to end the series of processing, the processing of <FIG> and <FIG> is ended.

As described above, in the present embodiment, two markers are detected, and a virtual line is set between the markers. Then, the avoidance operation is executed so that the work vehicle does not deviate to the back region beyond the virtual line. As a result, it is possible to control the work machine using the same type of marker, and it is not necessary to prepare a plurality of markers having different features so that each of the markers can be distinguished. Therefore, it is also possible to reduce the introduction cost of the marker. In addition, in order to set the virtual line (virtual wire), it is not necessary to provide an area wire (for example, a wire embedded in the ground) for defining the work area, so that the cost can be reduced. To be noted, as described above, an existing area wire and a marker may be combined to define the work area, and in this case, the area wire does not have to be provided for some regions, so that the cost can be reduced. Further, since the markers can be freely arranged, the shape of the work area can be flexibly changed. For example, in the case where the user himself/herself works in a part of a garden, there is a case where the work vehicle is not desired to enter the area. In this case, by defining the region so as to be surrounded by markers, it is possible to easily create an area where the work vehicle does not temporarily enter.

To be noted, when it is necessary to return to the charging station <NUM> or when it is necessary to move to a predetermined position, the CPU 44a sets a travel route for the work vehicle <NUM> to travel according to the set travel route. At that time, the travel route is set such that the virtual line does not exist on the travel route. Accordingly, it is possible to prevent traveling beyond the virtual line and deviating.

In addition, although an example in which the processing is performed in consideration of combinations of two markers for all the detected markers has been described in step S511, markers on the left and right of the line along the traveling direction may be set as processing targets based on the traveling direction of the work vehicle <NUM>. For example, in the example of <FIG>, it is possible to set only markers on the left and right of the line <NUM> along the traveling direction <NUM> instead of processing all the combinations (<NUM> combinations) of the four markers 401a to 401d. In this case, three combinations of the marker 401a and the marker 401b, the marker 401a and the marker 401c, and the marker 401a and the marker 401d may be set as processing targets, and three combinations of the marker 401b and the marker 401c, the marker 401b and the marker 401d, and the marker 401c and the marker 401d may be excluded from the processing targets. This makes it possible to speed up the processing.

In addition, in the present embodiment, an example has been described in which, when the distance from the work vehicle <NUM> to the virtual line is larger than the threshold in step S513, the process returns to step S501 through step S517, and the stereo image is acquired again. However, in the case re-capturing images all the time, as the work vehicle <NUM> travels and approaches the virtual line, a plurality of markers may come to not be detected. Therefore, instead of necessarily returning to step S501 and re-capturing images, control may be performed such that the timing at which the distance from the work vehicle <NUM> to the virtual line becomes equal to or less than the threshold is estimated on the basis of the traveling speed of the work vehicle <NUM>, and the avoidance operation is executed when that timing arrives. Alternatively, a distance from a certain point to the virtual line is calculated, and thereafter, a moving distance from the point is constantly measured by odometry, an inertial measurement unit (IMU), or the like. Then, the operation of the work vehicle <NUM> may be controlled based on the calculated distance and the moving distance being measured. For example, the avoidance operation may be executed in response to the moving distance being measured reaching the "distance from the point to the virtual line".

In addition, in steps S512 and S513, an example in which the avoidance operation is controlled on the basis of the distance between the work vehicle <NUM> and the virtual line has been described, but it is not limited to the distance. For example, a time required for the work vehicle <NUM> to reach the virtual line <NUM> may be calculated, and whether or not the work vehicle <NUM> has reached the virtual line may be determined on the basis of the calculated time. For example, the time may be calculated based on the traveling speed of the work vehicle <NUM> and the distance from the work vehicle <NUM> to the virtual line <NUM>. Then, the avoidance operation may be controlled to be executed when the difference between the time and the elapsed time is equal to or less than a threshold. Similarly, in step S515, an example in which the avoidance operation is controlled on the basis of the distance between the work vehicle <NUM> and a marker has been described, but it is not limited to the distance. For example, a time required for the work vehicle <NUM> to reach the marker may be calculated, and whether or not the work vehicle <NUM> has reached the marker may be determined on the basis of the calculated time.

In addition, control may be performed in parallel with repeating the processing by returning to step S501, such that the avoidance operation is separately executed when the timing at which the distance from the work vehicle <NUM> to the virtual line becomes equal to or less than the threshold arrives.

In the first embodiment, an example has been described in which information of the distance to a detected marker is acquired as marker information, and the avoidance operation is performed by calculating the distance from the work vehicle to the virtual line and the time until the work vehicle reaches the virtual line are calculated using the distance information. In contrast, in a second embodiment, an example will be described in which marker position information indicating position coordinates of a marker is acquired as marker information, and the avoidance operation is performed by calculating a distance from the work vehicle to the virtual line and a time until the work vehicle reaches the virtual line by using the marker position information and self-position information and orientation information of the work vehicle.

Since the system configuration and the configuration of the autonomous work machine are similar to those described in the first embodiment, the description thereof will be omitted.

Next, a procedure of processing performed by the work vehicle <NUM> according to the present embodiment will be described with reference to flowcharts of <FIG> and <FIG>. The work vehicle <NUM> according to the present embodiment sets a virtual line between markers and performs control so that the work vehicle <NUM> does not deviate to a region beyond the virtual line. Steps of performing the same processes as those in the flowcharts of <FIG> and <FIG> are denoted by the same reference numerals. Hereinafter, differences from <FIG> and <FIG> will be mainly described.

In step S801, the CPU 44a acquires information on the self-position and orientation using the GPS sensor <NUM> and the orientation sensor <NUM>.

In step S802, the CPU 44a acquires marker position information (position coordinates) of the detected marker as marker information. For example, as described with reference to <FIG> in the first embodiment, the marker position information is stored in advance in the memory 44c as map information so that the marker position information can be referred to. The work vehicle <NUM> recognizes its self-position and orientation using the GPS sensor <NUM> and the orientation sensor <NUM>, specifies which marker included in the map information is the marker detected from the image captured by the camera unit <NUM>, and acquires marker position information of the detected marker.

Alternatively, the marker position information can be specified from the landscape information of the image captured by the camera unit <NUM>. For example, landscape information and a marker included in an image are stored in advance in association with information of the distance to the marker obtained by measurement distance in the landscape. Then, while the work vehicle <NUM> is caused to travel in the work area, the association is performed at various places and stored as learning information. Then, by referring to this learning information, position coordinates of the marker detected from the image captured by the camera unit <NUM> can be acquired as marker position information using the self-position and orientation recognized using the GPS sensor <NUM> and the orientation sensor <NUM>.

Alternatively, the work vehicle <NUM> recognizes its self-position and orientation using the GPS sensor <NUM> and the orientation sensor <NUM>, and acquires, on the basis of an image having parallax (S501 and S502), information on the distance (distance image) to a marker detected from an image captured by the camera unit <NUM>. Furthermore, an angle (for example, the angle α or the angle β in <FIG>) at which the marker exists with respect to the photographing direction of the camera unit <NUM> is obtained from the position of the marker with respect to the image center of the captured image. Then, a direction in which the marker is present may be specified from the orientation of the work vehicle <NUM> and the acquired angle, and position coordinates that is ahead along the direction by a distance indicated by the acquired distance information may be acquired as the marker position information.

In step S803, the CPU 44a determines whether or not two markers included in the plurality of markers are adjacent markers. Also in the present embodiment, the determination method is the same as that in the first embodiment, and thus detailed description thereof is omitted.

In step S804, the CPU 44a calculates the distance from the work vehicle <NUM> to a virtual line located ahead of the work vehicle <NUM> in the traveling direction based on the traveling direction of the work vehicle <NUM> and the virtual line located ahead in the traveling direction. In the example of <FIG>, the distance to an intersection with the virtual line <NUM> located ahead in the traveling direction <NUM> is calculated.

Here, an example of a method of calculating the distance to the intersection with the virtual line <NUM> located ahead in the traveling direction <NUM> of <FIG> will be described again with reference to <FIG>. In <FIG>, a point O is a current position of the work vehicle <NUM>. A point A corresponds to the marker 401a in <FIG>, and a point B corresponds to the marker 401b in <FIG>. When the distance to be obtained is X, X is the length of a line OC. Here, since the position coordinates of the point A, the position coordinates of the point B, and the position coordinates (self-position) of the point O are known, the length of the line OA and the length of the line OB can be obtained from these. Thereafter, the distance from the work vehicle <NUM> to the virtual line <NUM> located ahead in the traveling direction of the work vehicle <NUM> is calculated by a procedure similar to the procedure described in the first embodiment.

Other steps are similar to the processing described with reference to <FIG> and <FIG>.

As described above, in the second embodiment, marker position information indicating position coordinates of a marker is acquired as marker information, and the avoidance operation is performed by calculating a distance from the work vehicle to the virtual line and a time until the work vehicle reaches the virtual line by using the marker position information and self-position information and orientation information of the work vehicle.

As a result, the operation of the work vehicle can be controlled using the marker position information indicating the position coordinates of the marker and the self-position and orientation of the work vehicle.

In a third embodiment, an example will be described in which map information including position information of markers arranged to define a work area is generated and presented to a user.

The work vehicle <NUM> acquires information on the distance to the detected marker from an image captured by the camera unit <NUM>, while acquiring information on its self-position and orientation using the GPS sensor <NUM> and the orientation sensor <NUM>. As described in the first embodiment, the distance to the marker can be acquired on the basis of an image having parallax. Furthermore, an angle (for example, the angle α or the angle β in <FIG>) at which the marker exists with respect to the photographing direction of the camera unit <NUM> is obtained from the position of the marker with respect to the image center of the captured image as illustrated in <FIG>. Then, a direction in which the marker is present may be specified from the orientation of the work vehicle <NUM> and the acquired angle, and position coordinates that is ahead along the direction by a distance indicated by the acquired distance information is acquired as the marker position information. Each time the work vehicle <NUM> detects a marker while performing work, the work vehicle calculates position information (position coordinates) of the marker by using information on the self-position and orientation, information on the distance to the marker, and a direction in which the marker exists. Then, the calculated position information of the marker is plotted on the map. As a result, map information including position information of markers arranged to define a work area can be generated.

<FIG> is an example of a map on which position information of markers is plotted. Reference numeral <NUM> denoted a map, and the map is defined as a grid area divided in a grid pattern. Reference numerals 901a to 901w are each position information of a plotted marker. The work vehicle <NUM> generates such map information and stores the map information as a map database while performing work or traveling before starting work. In addition, the generated map information may be presented to the user. As a method of presentation to the user, when a display unit is provided in the work vehicle <NUM>, the presentation may be performed by displaying on the display unit. Alternatively, the work vehicle <NUM> may transmit map information to a communication terminal (for example, a tablet, a smartphone, or the like) possessed by the user and present the map information on a display screen of the communication terminal.

As described above, in the present embodiment, an example map information including marker positions arranged to define a work area is generated and presented to the user. As a result, the user can acquire the map information on manually arranged markers. Therefore, it is also possible to manually adjust the arrangement positions of the markers later to redefine a more appropriate work area.

Note that the processing of the present embodiment may be performed in parallel with the first embodiment and the second embodiment, or may be performed independently of these. In the case of performing the processing in parallel, at least one of the information of the virtual line acquired by the processing of the first embodiment or the second embodiment and the position information of the marker acquired by the processing of the third embodiment may be reflected in the map information and presented to the user.

In the embodiments described above, the lawn mower has been described as an example of the autonomous work machine, but the autonomous work machine is not limited to the lawn mower. For example, the present invention can also be applied to other types of autonomous work machines such as an autonomous snow removing machines, golf ball collectors, outboard motors, and the like.

An autonomous work machine (for example, <NUM>) of the embodiments described above is an autonomous work machine that works in a work area. The autonomous work machine includes a detection means (for example, <NUM> and 44a) that detects a plurality of markers (for example, 401a to 401n) arranged to define the work area, a specifying means (for example, 44a) that specifies marker information based on a detection result of the detection means, a setting means (for example, 44a) that sets a virtual line (for example, <NUM>, <NUM>, and <NUM>) connecting the plurality of markers based on the marker information specified by the specifying means, and a control means (for example, 44a) that controls the autonomous work machine such that the autonomous work machine does not deviate to a region beyond the virtual line set by the setting means.

According to this embodiment, it is possible to control a work machine using markers that do not need to be individually distinguished. For example, the work machine can be controlled using the same type of marker.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means calculates the time based on a speed of the autonomous work machine and a distance from the autonomous work machine to the virtual line.

According to this embodiment, the avoidance operation can be performed before the time required to reach the virtual line is reached. In addition, deviation can be prevented without using an IMU or a GPS sensor for recognizing the self-position.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, a measuring means (for example, IMU or odometry) that measures a moving distance of the autonomous work machine is further provided. The control means calculates a distance from the autonomous work machine to the virtual line based on the marker information, and controls the autonomous work machine based on the calculated distance and the moving distance from a position of the autonomous work machine where the distance has been calculated.

According to this embodiment, even when a marker is no longer detected on during the operation, the autonomous work machine can be controlled.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the marker information includes distance information indicating a distance from the autonomous work machine to a marker, and the setting means sets the virtual line based on the distance information.

According to this embodiment, since a virtual line is set using distance information indicating the distance to a marker, the virtual line can be set even if the position information of the marker is not known.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the marker information includes marker position information indicating a position coordinate of a marker, and the setting means sets the virtual line based on the marker position information.

According to this embodiment, since a virtual line is set using marker position information, the virtual line can be set without additionally acquiring information on the distance to a marker.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, a storage means (for example, 44c) that stores feature information of a marker is further provided, and the specifying means specifies the marker information based on the feature information of a marker stored in the storage means and a feature of a marker detected by the detection means.

According to this embodiment, it is possible to recognize a marker and acquire marker information for the marker.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means stops, moves backward, or turns the autonomous work machine in a case where a distance from the autonomous work machine to the virtual line becomes equal to or less than a first threshold.

According to this embodiment, it is possible to prevent the autonomous work machine from deviating to the region beyond the virtual line.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means decelerates the autonomous work machine heading for the virtual line in a case where the distance from the autonomous work machine to the virtual line becomes equal to or less than a second threshold larger than the first threshold.

According to this embodiment, by decelerating in advance before performing an operation of stop, backward movement, or turning, it is possible to suppress sudden operation such as sudden stop, sudden backward movement after sudden stop, or sudden turning.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, an adjacent marker specifying means (for example, 44a) that specifies two markers as adjacent markers among the plurality of markers detected by the detection means is further provided, and the control means sets a virtual line between the two markers specified as the adjacent markers by the adjacent marker specifying means.

According to this embodiment, since a virtual line is not set between markers that are not originally adjacent to each other, it is possible to prevent the occurrence of a region where no work is performed.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the adjacent marker specifying means specifies, as the adjacent markers, two markers having a distance therebetween within a predetermined distance range among the plurality of markers.

According to this embodiment, it is possible to prevent markers having a long distance from each other from being determined as adjacent markers.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, in a case where another marker (for example, 451c) detected by the detection means is present in a region beyond a line connecting the two markers (for example, 451b and 451d), the adjacent marker specifying means specifies that the two markers are not the adjacent markers.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, each marker includes an indicator (for example, <NUM> and <NUM>) indicating a direction in which an adjacent marker is present. The adjacent marker specifying means specifies, as the adjacent marker, a second marker (for example, <NUM> or <NUM>) present in a direction indicated by the indicator of a first marker (for example, <NUM>).

According to this embodiment, it is possible to prevent a virtual line from being set between markers that are not originally adjacent to each other.

In the autonomous work machine (for example, <NUM>) of the embodiments described above,
an acquisition means that acquires trajectory information (for example, a trajectory along an arrow in <FIG>) of the autonomous work machine by causing the autonomous work machine to travel along markers that are arranged is further provided. The adjacent marker specifying means specifies, as the adjacent markers, two markers matching the trajectory information among the plurality of markers.

According to this embodiment, it is possible to prevent a virtual line from being set between markers that do not match the trajectory information and are not originally adjacent to each other.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, an acquisition means that acquires boundary information (for example, <NUM> and <NUM>) of the work area designated on a map including the work area is further provided. The adjacent marker specifying means specifies, as the adjacent markers, two markers matching the boundary information among the plurality of markers.

According to this embodiment, it is possible to prevent a virtual line from being set between markers that do not match the boundary information and are not originally adjacent to each other.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the boundary information is arrangement information (for example, <NUM>) of a plurality of markers arranged at a boundary of the work area, or information (for example, <NUM>) of a boundary line indicating a boundary of the work area.

According to this embodiment, it is possible to acquire arrangement information of markers designated on a map and information of boundary lines.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the plurality of markers include a plurality of first type of markers (for example, <NUM>) defining an outer edge of the work area, and a plurality of second type of markers (for example, <NUM>) defining an inner region that is included in an inside of the outer edge and excluded from the work area. The adjacent marker specifying means specifies the first type of markers and the second type of markers as not being the adjacent markers.

According to this embodiment, it is possible to prevent a virtual line from being set between a marker defining the outer edge and a marker defining the inner region (island).

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the plurality of markers include a plurality of first type of markers (for example, 491a to 491e) arranged at first distance intervals, and a plurality of second type of markers (for example, 492a to 492f) arranged at second distance intervals smaller than the first distance intervals. In a case where the second type of marker is present between two of the first type of markers among the plurality of first type of markers, the adjacent marker specifying means specifies the two of the first type of markers as the adjacent markers.

According to this embodiment, it is possible to prevent the autonomous work machine from deviating to the outside of the work area even in a region having a complicated shape.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, a route setting means that sets a travel route of the autonomous work machine is further provided. The route setting means sets the travel route such that the virtual line is not present on the travel route.

According to this embodiment, it is possible to prevent the autonomous work machine from deviating to the outside of the work area in the case where it is necessary to travel to some predetermined position.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the travel route is a travel route for returning to a station.

According to this embodiment, it is possible to prevent the autonomous work machine from deviating to the outside of the work area when the autonomous work machine returns to the station.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, a position specifying means (for example, <NUM>) that specifies a current position of the autonomous work machine is further provided. The control means controls the autonomous work machine based on information on the virtual line and the current position of the autonomous work machine specified by the position specifying means.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means reflects at least one of the marker position information (for example, 901a to 901w) and the information on the virtual line on the map information (for example, <NUM>) of the work area.

According to this embodiment, it is possible to generate map information reflecting marker position information and information on a virtual line.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means presents, to a user, the map information on which at least one of the marker position information and the information on the virtual line is reflected.

According to this embodiment, the user can recognize the generated map information.

In the autonomous work machine (for example, <NUM>) of the embodiments described above, the control means transmits, to a communication terminal (for example, <NUM>) of a user, the map information on which at least one of the marker position information and the information on the virtual line is reflected.

According to this embodiment, it is possible to easily check the generated map information via the communication terminal held by the user.

A control method for the autonomous work machine (for example, <NUM>) of the embodiments described above is a control method for an autonomous work machine that works in a work area. The control method for an autonomous work machine includes a detection step for detecting a plurality of markers arranged to define the work area, a specifying step for specifying marker information based on a detection result of the detection step, a setting step for setting a virtual line connecting the plurality of markers based on the marker information specified in the specifying step, and a control step for controlling the autonomous work machine such that the autonomous work machine does not deviate to a region beyond the virtual line set in the setting step.

A program according to the embodiment described above is a program for causing a computer to function as the autonomous work machine according to the embodiments described above.

Claim 1:
An autonomous work machine for working in a work area, the autonomous work machine comprising:
a detection means (<NUM>, 44a) configured to detect a plurality of markers (401a to 401n, 451a to 451p, 461a to <NUM>) arranged to define the work area;
a specifying means (44a) configured to specify marker information based on a detection result of the detection means (<NUM>, 44a);
a setting means (44a) configured to set a virtual line (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) connecting the plurality of markers (401a to 401n, 451a to 451p, 461a to <NUM>) based on the marker information specified by the specifying means (44a); and
a control means (44a) configured to control the autonomous work machine such that the autonomous work machine does not deviate to a region beyond the virtual line (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>) set by the setting means (44a), characterized in that
the control means (44a) is configured to calculate a time required for the autonomous work machine to reach the virtual line (<NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>), and to control the autonomous work machine based on the calculated time.