Patent ID: 12223102

DETAILED DESCRIPTION OF EMBODIMENT(S)

First Embodiment

(1) Overall Configuration

As illustrated inFIG.2, a remote work support system1according to a first embodiment includes a wearable device10, a mobile terminal20, a server30, a support operator terminal40, and a database50. The wearable device10and the mobile terminal20are held by each of site workers “AAA_aaa”, “BBB_bbb”, and “CCC_ccc”. The site workers are a plurality of workers dispatched to a plurality of separate sites. InFIG.2, three workers are dispatched to three sites. However, the number of sites and the number of workers are not limited to those. The support operator terminal40is arranged so as to be used by a support operator located remotely from the site workers.

The wearable device10, the mobile terminal20, the server30, the support operator terminal40, and the database50arm connected to a common network and are capable of communicating with each other.

In this specification, site workers are sometimes referred to as workers, and both are the same in meaning.

In this specification, the term “work” refers to any of repair and maintenance of a device, site investigation for installation of a device, and installation and mounting of a device.

(2) Detailed Configuration

(2-1) Wearable Device10

As illustrated inFIG.1, the wearable device10is a neck-mounted device. The wearable device10is shaped into a loop, a portion of which is open. The wearable device10is worn on the neck of a worker using the open portion such that the open portion is located at the front of the body of the worker.

The wearable device10is a neck-mounted device, which allows the worker to work with both hands free even while wearing the wearable device10. In addition, unlike the eyeglass type, the field of vision is not affected.

The wearable device10includes a main body19, an image capturing unit11, a voice input unit12, a voice output unit13, a gesture sensor14, a control unit15, a communication unit16, and a power switch (not illustrated).

The main body19has both ends at which the image capturing unit11and the gesture sensor14are arranged.

The image capturing unit11is a camera. The camera continuously captures images of an area in front of the worker while the worker works. The captured images are moving images. The images may be still images. The captured images are sent to the server30from the communication unit16via the network. The images sent to the server30are saved in a storage unit32of the server30. The images sent to the server30are simultaneously displayed on a display unit43of the support operator terminal40.

The gesture sensor14has a function of a switch. The wearer (worker) shows a sign in front of the gesture sensor, thereby being able to operate the wearable device. The operation may be, for example, to turn on or off capturing an image with the image capturing unit11. The gesture sensor14may be used by the worker to call a support operator who uses the support operator terminal40. The wearable device10may include a mechanical or electronic switch instead of the gesture sensor14or together with the gesture sensor14.

The voice input unit12is a microphone. The microphone has directivity and preferentially collects voice generated by the wearer. The voice input unit12may be used by the worker, instead of the gesture sensor14or together with the gesture sensor14, to call the support operator who use the support operator terminal40. For example, the worker speaks the utterance “Help, please”. Then, the utterance reaches the server30and is subjected to voice recognition and converted into text by the server30. The server30identifies that the worker requests support from text-converted voice data, and blinks the name of the worker, “AAA aaa”, in worker identification information112in the support operator terminal40. Accordingly, the support operator is informed that the worker “AAA aaa” requests support.

The voice output unit13is a speaker. The voice output unit13is arranged in a portion of the wearable device10behind the body of the wearer (worker).

The wearable device10according to this embodiment includes the voice input unit12, the voice output unit13, and the communication unit16that transmits and receives voice. This enables the worker wearing the wearable device10to have a telephone conversation with the support operator by using the device as a telephone.

The communication unit16is connected to the network via a first line T1. Voice input through the voice input unit12and an image captured with the image capturing unit11can be transmitted to the network as electronic data. Further, the communication unit16receives voice as electronic data from the network.

The control unit15is a computer. The control unit15includes a processor and a storage unit. The control unit15controls the image capturing unit11, the voice input unit12, the voice output unit13, the gesture sensor14, and the communication unit16. The control unit15receives a control command input to the gesture sensor14and executes the control command. The control unit15executes a command from the server30and a command input by the support operator operating the support operator terminal40.

(2-2) Mobile Terminal20

The mobile terminal20is carried or held by the worker. The mobile terminal20may be a smartphone, a tablet, a PC, or the like. The mobile terminal20includes a display unit21, a communication unit22, and a control unit23. The mobile terminal20is connected to the network via a second line T2.

The communication unit22receives an image from the network. The image may be a moving image or a still image.

The display unit21is a display. The display unit21displays an image received from the network. An image processed by the support operator using the support operator terminal40is transmitted to the mobile terminal20via the network and is displayed on the display unit21. The image may be a moving image or a still image.

The control unit23is a computer. The control unit23includes a processor and a storage unit. The control unit23controls the display unit21and the communication unit22.

Unlike the wearable device10, the mobile terminal20does not need to be always connected to the support operator terminal40(or the server30) while the worker works. The mobile terminal20may connect to the support operator terminal40only when an image (including text information) is sent from the support operator terminal40to the mobile terminal20.

(2-3) Server30

The server30is a computer. The server30includes a processor31and a storage unit32. The storage unit32saves applications and data. In this embodiment, an application for the remote work support system1, which is stored in the storage unit32, is read and executed by the processor31. The application for the remote work support system1is a web application. The support operator terminal40and the mobile terminal20each activate a browser and access the application for the remote work support system1through the browser.

When the worker activates the wearable device10, the wearable device10connects to the server30and transmits an image captured with the image capturing unit11of the wearable device10to the server30. The captured image is accumulated in the storage unit32of the server30. The captured image is simultaneously viewable on the display unit43of the support operator terminal40in response to activation of the browser of the support operator terminal40.

Further, the application for the remote work support system1enables a two-way telephone conversation to be established between the worker and the support operator in response to a connection request from the wearable device10or a connection request from the support operator terminal40while the worker works.

The server30converts voice acquired from the wearable device10and voice acquired from the support operator terminal40into text information by voice recognition. The text information is stored in the storage unit32for each item of work. Further, the text information is transmitted to the support operator terminal40and displayed on the display unit43of the support operator terminal40. The text information is also transmitted to the mobile terminal20and displayed on the display unit21of the mobile terminal20, as necessary.

The server30collects voice data of all the wearable devices10that are in communication and saves the voice data in the storage unit32as text information. If the voice of the worker “BBB bbb”, who is currently connected to the support operator terminal40but is not supported, includes wording that requests support, the server30blinks the name of the worker, “BBB bbb”, in the worker identification information112in the support operator terminal40.

The server30may also have an automatic translation function. The voice data subjected to voice recognition is translated into another language. For example, when the site worker speaks in English and the support operator in the remote location speaks in Japanese, the words spoken by the site worker in English may be communicated to the support operator by voice in Japanese. Alternatively, the words may be displayed in Japanese in an utterance record116on the display unit43of the support operator terminal40. English text and Japanese text may be displayed together.

An image and text-converted voice information, which are generated during work support, and an image processed by the support operator are saved in the storage unit32of the server30. These pieces of information may be stored in any other location. For example, these pieces of information may be saved in the database50. These pieces of information may be saved in a storage unit of the support operator terminal40.

(2-4) Database50

The database50includes a storage unit that saves electronic data. The database50is connected to the network. In this embodiment, the database50stores site work support information used for repair or maintenance of devices. The storage of the site work support information is not limited to the database50. The site work support information may be stored in the storage unit32of the server30. The site work support information may be stored in the storage unit of the support operator terminal40.

(2-5) Support Operator Terminal40

The support operator terminal40is used by the support operator who remotely supports the site worker. The support operator terminal40may be a PC. The support operator terminal40includes a voice input unit41, a voice output unit42, a display unit43, a communication unit44, and a control unit45.

The voice input unit41is a microphone. The voice output unit42is a speaker. The support operator terminal40according to this embodiment includes the voice input unit41, the voice output unit42, and the communication unit44that transmits and receives voice. This enables the support operator to have a telephone conversation with the site worker by using the support operator terminal40as a telephone.

The communication unit44is connected to the network. The communication unit44receives voice as electronic data from the network. The communication unit44further receives text information, which is obtained by the server30subjecting the voice to voice recognition and converting the voice into text. The communication unit44receives an image captured with the image capturing unit11of the wearable device10. On the other hand, the communication unit44is capable of transmitting voice input through the voice input unit41and an image processed by the support operator using the support operator terminal40to the network as electronic data.

The display unit43is a display.

The control unit45is a computer. The control unit45includes a processor and a storage unit. The control unit45controls the voice input unit41, the voice output unit42, the display unit43, and the communication unit44. The storage unit of the control unit45stores a browser (program). The control unit45reads and executes a browser program. If the application for the remote work support system1has been executed by the server30, the control unit45of the support operator terminal40is capable of using the browser to support work using the support operator terminal40.

Communication among the wearable device10, the mobile terminal20, the server30, the support operator terminal40, and so on according to this embodiment may be performed by selectively using a plurality of communication protocols.

In this embodiment, for example, WebRTC is used as a communication protocol for moving images and voice. WebRTC is a standard protocol and has a feature of being secure but not flexible in design (capable of changing only parameters such as resolution). HTTPS, MQTT, or WebSocket may be used as a communication protocol for still images. These communication protocols have features of being designed flexibly and compatible with anything such as moving images, text, and still images and increasing the design level on the server side.

(2-5-1) Display Screen on Display Unit43of Support Operator Terminal40

FIG.3illustrates an example of a display screen on the browser of the display unit43of the support operator terminal40when the application for the remote work support system1is being executed.

The screen on the display unit43displays a work progress111, worker identification information112, a live image113of the site, a support-operator-processed image114, a reference document list115, and an utterance record116.

The work progress111represents the number of work sites (or the number of workers) in which the support operator using the support operator terminal is engaged “today”. The example indicates that two items of work have been completed “today”.

The work progress111may display the state of progress of the work (which may be expressed as %) or the predicted end time of the work. To this end, through automatic extraction from the image captured with the image capturing unit11of the wearable device10and/or the utterances of the workers and the support operator, the server30may automatically estimate the state of progress of the work or the end time of the work.

The worker identification information112describes “currently online novice”. This means a worker who is currently using the wearable device10connected to the support operator terminal40. Here, an icon (photograph) of the worker and the name of the worker, “AAA aaa”, are displayed. Then, the sign “LIVE” is displayed along with the icon of the worker “AAA aaa”. The display of the sign “LIVE” indicates that the connection between the support operator terminal40and the wearable device10is active. The term “being active” refers to a state in which the live image113of the worker “AAA aaa” is being displayed on the screen and a voice connection has been established between the support operator and the worker “AAA aaa” so that a telephone conversation can be established therebetween.

While the worker identification information112inFIG.3shows five workers, some of the workers who are not active may be hidden and may be displayable by scrolling. Alternatively, the worker who is active may be displayed in large size, and some or all of the names of the other workers may be hidden.

The worker identification information112is not limited to the icon or the name of the worker, and may include the ID number of the worker, the address of the site, the model number or ID number of a device (here, an air conditioner) on which the worker is working, the ID of the work, and so on. The worker identification information112is information by which the support operator can identify the worker or the work.

In addition, the method for displaying a worker who is active is not limited to the display of the sign “LIVE”. It is sufficient that the support operator using the support operator terminal40identify a worker who is active. The worker identification information under connection may be displayed in large size, in blinking mode, with color changes, or in pop-up window.

The live image113indicates live video regarding the worker who is active, which is being captured with the image capturing unit11of the wearable device10of the worker, namely, the worker “AAA aaa”.FIG.3illustrates an image of an outdoor unit of the air conditioner. In the active state, a voice connection has been established with the worker “AAA aaa”, and thus the support operator can provide instructions by voice to instruct the worker to consequently move the position of the image capturing unit11of the wearable device10to switch to a different image.

The support-operator-processed image114is obtained by extracting and processing an image from the live image113. In the support-operator-processed image114inFIG.3, a center portion of a diagram showing a fan is marked with a circle, as well as the “Open the fan from here” instruction given by handwriting. The instruction is given by the support operator inputting characters or symbols on the support operator terminal40using a touch pen. The support-operator-processed image114is transmitted to the mobile terminal20of the worker and displayed on the display unit21, thereby being able to efficiently support the worker.

The reference document list115is a list of reference documents (site work support information) that are referred to by the support operator to provide support. The site work support information may include site investigation check items, a construction work procedure manual, or maintenance information. The support operator can extract a document necessary for construction from within the site work support information saved in the database50, further extract a necessary portion from within the document, mark the extracted portion, as necessary, and then transmit the portion to the mobile terminal20of the worker.

The utterance record116displays the text of an utterance of the worker “AAA aaa”, who is active, and the text of an utterance of the support operator in a distinguishable manner.

(3) Description of Support for Site Worker Using Remote Work Support System1

Next, a method for supporting a worker using the remote work support system1according to this embodiment will be described.

The worker arrives at the site and starts work for repair or maintenance of a device. The device is assumed here to be an air conditioner. At the start of the work, the site worker wears the wearable device10on their body and turns on the power switch.

First, the worker shows a sign in front of the gesture sensor14to activate the image capturing unit11. The image capturing unit11starts capturing an image. Further, the wearable device10is connected to the application for the remote work support system1in the server30. The captured image is sent from the communication unit16to the server30via the network and accumulated in the storage unit32of the server30.

To start support, the support operator activates the browser on the support operator terminal40and connects the support operator terminal40to the application for the remote work support system1in the server30.

The power-on of the wearable device10and the connection of the support operator terminal40to the application for the remote work support system1in the server30does not need to be performed simultaneously. Either of them may be performed first. In response to the image capturing unit11of the wearable device10being activated and the support operator terminal40being connected to the application for the remote work support system1in the server30through the browser, both are connected.

The support operator who uses the support operator terminal40appropriately selects a worker and starts support.

To request the support operator for support, the worker shows a gesture in front of the gesture sensor14to indicate that the worker desires to be supported. The request for support may be made by another method such as voice. The support request from the worker is made by blinking the name of the worker, “AAA aaa”, in the worker identification information112on the screen of the display unit43of the support operator terminal40. To approve the support request from the worker, the support operator clicks on the name “AAA aaa” to make the connection with the worker “AAA aaa” active. In other words, the worker “AAA aaa” in the worker identification information112is marked with the sign “Live”, an image captured by the wearable device10is displayed live in the live image113, and a telephone conversation can be established between the worker “AAA aaa” and the support operator.

The support operator checks the moving image transmitted from the wearable device10of the worker “AAA aaa” and examines the content of the work support while having a telephone conversation with the worker “AAA aaa”.

To access the worker from the support operator side, the support operator clicks on the worker name “AAA aaa” in the worker identification information112to make the connection with the worker “AAA aaa” active to display an image captured by the wearable device10live in the live image113, and a telephone conversation between worker “AAA aaa” and the support operator can be established.

As the simplest support method, the support operator provides advice to the worker while having a telephone conversation with the worker “AAA aaa”. The content of the utterances of the worker and the support operator is subjected to voice recognition and converted into text by the server30, and is stored in the storage unit32of the server30. The content of the utterances is simultaneously displayed in the utterance record116on the display unit43of the support operator terminal40. The support operator reviews the content of the support and provides advice while checking the content of the utterances in the utterance record116. Alternatively, the content of the utterance of the support operator or the content of the telephone conversation may be converted into text, which is transmitted to the mobile terminal20of the worker “AAA aaa” and displayed on the display unit21, to perform support.

In addition, the support operator appropriately selects (cuts) an image from the live image113as a still image (snapshot), and displays the still image in the support-operator-processed image114. The support operator further processes the displayed image. Specifically, the support operator cuts out a necessary portion, marks the portion, or writes characters on the portion. The image on which characters are written by the support operator is transmitted to the mobile terminal20of the worker “AAA aaa”. The worker “AAA aaa” checks the display unit21of the mobile terminal20to check the image transmitted by the support operator. In this way, the worker proceeds with the work while being supported by the support operator.

While a case has been described above where the support-operator-processed image created by the support operator is a still image, the support-operator-processed image may be a moving image.

Support information provided by the support operator may be not only an image captured at the wearable device10and processed as described above, but also an image or characters (snapshot) extracted from a reference document (site work support information) or processed. The site work support information may be displayed in the reference document list115on the screen or may be obtained by search from a window in the reference document list115. What is obtained by searching the reference document list115is stored in the database50. For example, when the support operator determines that the instruction manual needs to be checked for support, the support operator clicks the instruction manual in the reference document list115. Then, a new window pops up, and a page of the instruction manual is displayed. The support operator selects a predetermined page of the instruction manual, cuts out a necessary portion, and displays the cut out image (snapshot) in the support-operator-processed image114. Here, the support operator processes an image (snapshot) of the predetermined page of the instruction manual to by marking the image (snapshot), writing characters on the image (snapshot), or performing other operation. The processed image is transmitted to the mobile terminal20of the worker as a support-operator-processed image in a way similar to that for an image captured by the wearable device10and selected and processed. The worker can proceed with the work with reference to the support-operator-processed image.

In the foregoing, a description has been given of a case where the site work support information is stored in the database50. The site work support information may be saved in the storage unit32of the server30. Alternatively, the site work support information may be saved in the storage unit of the support operator terminal40. The site work support information may be obtained from any other source. For example, the site work support information may be information on a web site.

As described above, the support operator proceeds with support work for the worker “AAA aaa”. When a support request is made by the worker “BBB bbb” after the support for the worker “AAA aaa” is completed or while the support for the worker “AAA aaa” is being performed, the name of the worker, “BBB bbb”, in the worker identification information112on the display screen on the browser of the support operator terminal40blinks. The support operator viewing the blinking name clicks on the name of the worker, “BBB bbb”, if the support operator is ready to start supporting the worker “BBB bbb”. Then, the connection with the worker “BBB bbb” is made active. In other words, the worker “BBB bbb” in the worker identification information112is marked with the sign “Live”, an image captured by the wearable device10is displayed live in the live image113, and a telephone conversation between the worker “BBB bbb” and the support operator can be established.

In the way described above, work support for a plurality of workers is performed. Through work performed using the remote work support system1according to this embodiment, images captured by the wearable devices10, voice including telephone conversations between the workers and the support operator, support-operator-processed images created by the support operator, and so on are accumulated in the storage unit32of the server30. These are stored for each item of work. The server30may automatically create a report on the basis of the stored information.

(4) Features

(4-1)

A remote work support system1according to this embodiment includes a wearable device10, a mobile terminal20, and a support operator terminal40. The wearable device10is used by being worn by a site worker. The wearable device10includes an image capturing unit11and is capable of transmitting a captured image of the surroundings of the worker to the support operator terminal40. Further, the wearable device10and the support operator terminal40can be used as telephones to establish a telephone conversation therebetween.

The wearable device10includes no display unit. When a wearable device includes a display unit, for example, like an eyeglass-type device, the worker may have a limited field of view, which may present a danger to the worker. The absence of a display unit provides an advantage in that such a concern is less likely to occur.

Furthermore, since the worker is carrying the mobile terminal20, information on support from the support operator can be displayed on the display unit21of the mobile terminal20, as necessary.

(4-2)

The wearable device10according to this embodiment is a neck-mounted device. This enables the worker to work with both hands free.

(4-3)

The image captured with the image capturing unit11of the wearable device10is a moving image or a still image.

Capturing a moving image makes it possible to continuously display the live image113on the display unit43of the support operator terminal40.

The support operator can more easily create a support-operator-processed image by using a still image.

(4-4)

The image captured with the image capturing unit11of the wearable device10is selected, processed, or additionally provided with information using the support operator terminal40. The resulting image is transmitted to the mobile terminal20and displayed on the display unit21of the mobile terminal20.

Use of both the wearable device10and the mobile terminal20eliminates the need for the worker to view the support information of the support operator more than necessary, and enables the worker to view the support information on the mobile terminal20when necessary.

(4-5)

The utterances of the worker and the support operator are subjected to voice recognition and are displayed in the utterance record116on the display unit43of the support operator terminal40as text information.

Since the utterance record is displayed on the support operator terminal40as text information, the support operator easily checks the content of the telephone conversation and can support the worker by using it. Further, recording of the content of the utterances as text information can also be utilized to create a report.

(4-6)

The text information described above may also be displayed on the display unit21of the mobile terminal20. It is useful also for the worker to be able to check, on the display unit21, the conversation with the support operator in text. Alternatively, the text of the content of an important utterance may be extracted by the support operator and displayed on the mobile terminal20of the worker.

(4-7)

The remote work support system1includes a first line T1connecting the support operator terminal40and the wearable device10, and a second line T2connecting the support operator terminal40and the mobile terminal20. The first line T1is continuously used while the worker works, and the second line T2is connected, as necessary, while the worker works.

This enables the worker to work without constantly viewing the screen.

(4-8)

The server30of the remote work support system1stores an image captured with the image capturing unit11of the wearable device10in the storage unit32of the server30. Further, the utterances of the worker and the support operator are subjected to voice recognition and converted into text, which is stored in the storage unit32of the server30. The server30may estimate the state of progress of the work and the end time of the work from the image, the text characters, and so on and display the state of progress and the end time on the display unit43of the support operator terminal40. The state of progress of the work may be estimated and displayed in form such as xx % completion. In this way, the support operator can be informed of the progress of the work.

(4-9)

The support operator terminal40displays the reference document list115on the display unit43. Reference documents are site work support information. The site work support information is saved in a database50on a network. The support operator can access the content of the site work support information from the reference document list115. The support operator extracts and processes the content of the site work support information and transmits the site work support information to the mobile terminal20.

The support operator processes the site work support information and transmits the processed site work support information to the worker in the way described above, which eliminates the need for the worker to view a large amount of enormous materials and increases the efficiency of the worker.

(4-10)

The work support performed using the remote work support system1according to this embodiment includes support performed by various means. In other words, the work support includes any one or a combination of support by voice, support with a processed image, support by characters input from a support operator terminal, and support by characters obtained by converting an utterance of the support operator into text.

The support by voice is the same as support by telephone.

The support with a processed image includes support using an image captured by the wearable device10and support using processed site work support information.

The support by characters input from the support operator terminal40is support implemented as follows: The support operator inputs characters through the support operator terminal40, and the characters are transmitted to the mobile terminal20and displayed on the display unit21.

The support by characters obtained by converting an utterance of the support operator into text is support in which an utterance of the support operator is converted into text and text-converted information is sent to the mobile terminal20of the worker. The worker may fail to hear the utterance of the support operator or forget the utterance of the support operator. Accordingly, an important utterance is converted into text, and the text is transmitted, which may lead to effective support.

(5) Modifications

(5-1) Modification 1A

In the first embodiment, as illustrated inFIG.3, only the live image113of the worker “AAA aaa”, who is active, is displayed on the display unit43. In Modification 1A, live images of all the connected workers “AAA aaa”, “BBB bbb”, “CCC ccc”, “DDD ddd”, and “EEE eee” are displayed in the live image113. In other words, live video of a worker who is not active is also displayed simultaneously in the live image113. Note that the video of the worker “AAA aaa”, who is active, is displayed in large size in an upper portion, whereas the video of the workers “BBB bbb”, “CCC ccc”, “DDD ddd”, and “EEE eee”, who are not active, is displayed in small size in a lower portion. In this way, the display unit43according to Modification 1A allows the support operator to know the approximate behavior of a worker who is not active, or a worker who is not being supported. Using this, for example, the support operator can alert a worker who attempts to perform an undesirable behavior.

(5-2) Modification 1B

In the first embodiment, voice is subjected to voice recognition and converted into text by the server30. In Modification 1B, voice recognition and conversion into text are performed by the wearable device10or the support operator terminal40. Accordingly, the wearable device10or the support operator terminal40transmits both voice audio data and voice text data to the network. Further, the wearable device10or the support operator terminal40may have a translation function in addition to the voice recognition function.

(5-3) Modification 1C

In the first embodiment, the wearable device10is a neck-mounted device. The wearable device10may be of any other type. The wearable device10is preferably a device that is worn on the body while leaving both hands free. The wearable device10according to Modification 1C is worn on the head. Specifically, the wearable device10is of a helmet type, a hat type, or a hairband type.

(5-4) Modification 1D

In the remote work support system1according to the first embodiment, the site worker holds and uses the wearable device10and the mobile terminal20. The remote work support system1may further use another device. The other device may be connected to the support operator terminal40via the network. The other device may be connected to the server30.

In Modification 1D, the other device is a network camera different from the image capturing unit11of the wearable device10, which is used by the site worker. The network camera transmits a captured image of a location different from that of the image capturing unit11of the wearable device10or an image of the same location, which is captured from a different angle, to the support operator terminal via the network.

(5-5) Modification 1E

In the first embodiment, the wearable device10and the mobile terminal20are each independently connected to the network via the first line (T1) or the second line (T2). In Modification 1E, the wearable device10and the mobile terminal20are connected to each other via P2P.

In Modification 1E, the wearable device10may be connected to the network (or the support operator terminal40) via the first line, or the wearable device10and the mobile terminal20may communicate with each other via P2P and then the mobile terminal20may be connected to the network via the second line.

(5-6) Modification 1F

Another communication device is connectable to the wearable device10via short-range wireless communication technology. The short-range wireless communication technology may be Bluetooth (registered trademark), infrared communication, or Wi-Fi.

(5-7) Modification 1G

In the first embodiment, voice generated by the support operator is transmitted to the wearable device10, and an image that is transmitted from the support operator terminal40is transmitted to the mobile terminal20.

In Modification 1G, the site worker can use the wearable device10, the mobile terminal20, which is a smartphone, and a PC as a different device.

When sending an image from the support operator terminal40, the support operator may select the mobile terminal20or a PC and transmit the image.

Alternatively, a configuration may be provided in which the server30controls the transmission of an image from the support operator terminal40to the worker, the support operator terminal40issues a command for designating a device of the worker to which the image is to be transmitted, and the server30accepts the command.

(5-8) Modification 1H

The worker support system according to this embodiment can be used for other purposes, for example, for training purposes.

The content of the training relates to site work such as repair or maintenance of a device. A trainee participates as a worker. The number of trainees (workers) is preferably one or two. The training is preferably performed by a minimum number of people required to perform skilled work.

The trainer of the training is a support operator. Preferably, a plurality of trainers teach each trainee from different ways of views. Thus, the trainers check different points or check an identical point from different angles. For example, a trainer who is familiar with the work itself desires to check the work done with the trainee's hands. A person who is specialized in equipment desires to generally check the state of the entire equipment, including the trainee, or to also check a measuring device such as a meter included in the equipment.

The trainer (support operator) prompts the trainee (worker) to switch to the wearable device10or the mobile terminal20such as a smartphone capable of capturing an image of a location desired to be checked or an image of the field of view, or to add such a device. Accordingly, the trainee (worker) can be supported and trained by the trainers for the work to be performed by the trainee (worker) from different viewpoints or angles.

Second Embodiment

(6) Remote Work support system according to Second Embodiment

FIG.4is a diagram schematically describing a remote work support system according to a second embodiment.

The remote work support system according to the second embodiment includes substantially the same configuration as that of the remote work support system1according to the first embodiment. In other words, the remote work support system according to the second embodiment includes a wearable device10, a mobile terminal20, a server30, a support operator terminal40, and a database50. As in the first embodiment, the remote work support system performs work support, and, as a result, accumulates an image captured by the wearable device10, text obtained by performing voice recognition of an utterance of a worker and an utterance of a support operator and converting the utterances into text, a support image created by the support operator, a work report, and so on. For work such as repair of a failure that has newly occurred, the server30according to the second embodiment compares data such as an image captured by the wearable device10with previously accumulated data and automatically determines that an abnormality or failure has occurred in a similar device. In this way, the remote work support system1according to this embodiment is capable of diagnosing an abnormality or failure of a device.

If the server30has successfully diagnosed an abnormality or failure of a device, the server30proposes an appropriate support method similar to the previous support method to the support operator. Alternatively, an appropriate support method similar to the previous support method is proposed directly to the worker.

In addition, the remote work support system according to this embodiment predicts a future failure of a device.

(7) Modifications

(7-1) Modification 2A

A configuration of Modification 2A is substantially the same as that of the second embodiment. In Modification 2A, the server30accumulates work support data, which may result in automatic identification of inappropriate points in a device operation manual or a repair and maintenance manual. In this case, the server30proposes correction and optimization of the operation manual or the repair and maintenance manual.

Third Embodiment

(8) Remote Work Support System According to Third Embodiment

The configuration of a remote work support system1according to a third embodiment is the same as the configuration of the remote work support system1according to the first embodiment, as illustrated inFIG.2. The remote work support system1includes a plurality of devices. The plurality of devices include a wearable device10, a mobile terminal20, and a support operator terminal40. The plurality of devices may further include another device. The other device may be a device that is used by a worker in addition to the wearable device10and the mobile terminal20and that supports inputting or outputting voice or an image. Specific examples of the other device may include a camera, a smartphone, a smart watch, smart glasses, a headset, and a wearable device. The other device may be a web camera similar to that in Modification 1D or a communication device similar to that in Modification 1F.

Also in this embodiment, the server30is connected to the plurality of devices, and information collected by the plurality of devices is collected by the server and accumulated in the storage unit32. The information is, for example, an image captured by the wearable device10and voice collected by the wearable device10or the support operator terminal40.

In this embodiment, the server30designates at least one or more devices among the plurality of devices under a predetermined condition and calls a connection target device in accordance with the designation. The server30may use AI technology to perform determination of the predetermined condition.

In this embodiment, the server30acquires environment information of the work site of the site worker and accumulates the environment information in the storage unit32. The environment information is information such as the illumination of the work site, the level of noise in the work site, the temperature and the humidity of the work site, and whether the work is work in a high place. The server30may prompt the worker to use or select a device in accordance with the environment information and may call the selected device.

For example, the server30acquires information indicating that the worker is in a noisy environment, such as a factory, by using voice information transmitted from the wearable device10. In this case, the server30prompts the worker to use a device including a directional microphone, other than the wearable device10. In response to the worker turning on the power to the device including a directional microphone, the server30calls the device including a directional microphone.

In another example, the server30acquires information indicating that the worker is in a dark place by using image information transmitted from the wearable device10. In this case, the server30prompts the worker to use a light-equipped camera (such as the mobile terminal20or another digital camera) other than the wearable device10. The worker prepares a light-equipped camera, and the server30calls the light-equipped camera.

(9) Modifications

(9-1) Modification 3A

In Modification 3A, the server30manages the progress of work performed by a site worker and stores the progress of the work in the storage unit32. The server30calls at least one or more devices among the plurality of devices described above in accordance with the progress of the work.

For example, when the worker is performing work using smart glasses, upon determining that the next work is work in a high place from the progress of the work, the server30prompts the worker to remove the smart glasses because the worker with the smart glasses has a narrow field of view.

In another example, upon determining that the work requires checks from two or more viewpoints from the progress of the work, the server30prompts the worker to use two cameras, namely, a camera that captures the entire area and a camera that moves the area around the hands. When the worker is ready to the two cameras, the server30calls the two cameras.

(9-2) Modification 3B

In Modification 3B, the server30performs voice recognition of utterances of the site worker and the support operator. The server30calls at least one or more devices among the plurality of devices on the basis of a keyword acquired by the voice recognition.

For example, when a conversation between the worker and the support operator includes words “climb” or “by stepladder”, the server30prompts the worker to use a headset. When the worker wears the headset, the server30calls the headset.

When the conversation between the worker and the support operator includes words “cannot hear” or “low voice”, the server30prompts the worker to use a device equipped with a directional microphone. When the worker is ready to use the device equipped with a directional microphone, the server30calls the device equipped with a directional microphone.

When the conversation between the worker and the support operator includes words “not clear” or “enlarge”, the server30prompts the worker to use a smartphone or smart glasses. When the worker is ready to use the smartphone or smart glasses, the server30calls the smartphone or smart glasses.

(9-3) Modification 3C

In Modification 3C, as in Modification 1H, the remote work support system1is used for training purposes. In this embodiment, in addition to Modification 1H, further, the server30accepts, from the support operator terminal40, designation of at least one or more devices among a plurality of devices used by the site worker.

While embodiments of the present disclosure have been described, it will be understood that forms and details can be changed in various ways without departing from the spirit and scope of the present disclosure as recited in the claims.