Patent Description:
At an assembly work site in a manufacturing industry, it is important to reduce an occurrence of a failure and establish traceability for investigating a cause of the occurrence of a failure in an early stage. A matter for visualizing who performed what kind of work and when the work was performed can be used for the purpose of facilitating training of workers and improving work efficiency at the entire site. At a maintenance site or the like, a matter for associating a tool with a worker is effective in managing articles and recognizing a worker or a work state. When whether work has been performed correctly can be immediately fed back to a worker, quality can be improved and worker safety can be improved.

Under such a background, with the development of the Internet of Things (IoT) technique in recent years, a method for visualizing work information of a worker in many ways has been proposed, or the technique has been commercialized. In PTL <NUM>, for example, a wrist band is worn on an arm of a worker who works in an inventory, and a sensor provided on a shelf where articles are stored is used to detect a movement of a hand of the worker.

PTL <NUM> describes a work determination system, a work determination method, and a work determination method for determining a work state of a worker who is performing a part assembly work for fitting parts together in a production line in a factory.

PTL <NUM> describes production control technology, and in particular, to an intelligent production line monitoring system and method.

PTL <NUM> describes a system and program for supporting a worker's work.

PTL <NUM> describes a golf training glove with sensors for triggering a perceptible signal.

At a work site or a production site, touching information between a body and the outside may be used in a workable factory in addition to the situation described above. For an article such as fruits that may be damaged by strong gripping, when pressing down a button of a machine or a sensing mechanism for holding the article without impairing the article is confirmed, or when a tool or the like is held in hand, a work state or a worker can be managed if it is possible to know how much strength should be used to hold what kind of tool or confirm that the article is held when the article has a characteristic shape.

It is difficult to acquire information on touching strength when touching the article with the body in such a manner or information of a surface concave-convex state by using the method disclosed in PTL <NUM> or from an image of a camera or the like. On the other hand, the information can be collected by, for example, wearing on the body a pressure sensor or a wearable object such as a piece of clothing to which the pressure sensor is attached. However, an article such as a tool generally has a unique shape or surface state, and it is difficult to determine what a touched object is like only from a sensor worn on the body.

An object of the invention is to provide a technique capable of performing work information management by associating a worker with a work content by the worker touching a sensing object via a wearable sensor.

The work information management system according to the invention preferably includes a wearable sensor including a sensor that is worn by a worker and receives sensor data from a sensing object and a transmitter that transmits the sensor data received by the sensor to a terminal, and a computer that determines a work content of the worker based on the sensor data received from the wearable sensor and outputs a determination result to a display unit.

The invention is also known as a work information management method performed by the work information management system described above.

According to an aspect of the invention, work information can be managed by associating a worker with a work content by the worker touching a sensing object via a wearable sensor.

Hereinafter, embodiments will be described in detail with reference to the drawings. However, the invention should not be construed as being limited to the description of the embodiments described below. Those skilled in the art could easily understand that specific configurations can be changed without departing from the spirit or scope of the invention.

In configurations according to the invention described below, the same or similar functions are denoted by the same reference numerals in different drawings, and repetitive descriptions may be omitted.

In the present specification, expressions such as "first", "second", and "third" are used to identify components, and do not necessarily limit a number or an order. Numbers for identifying components may be used on a context basis, and a number used in one context may not necessarily indicate the same configuration in another context. A component identified by a certain number is not prevented from having a function of a component identified by another number.

In order to facilitate understanding of the invention, positions, sizes, shapes, ranges, or the like of each configuration shown in the drawings may not represent actual positions, sizes, shapes, ranges, and the like. Therefore, the invention is not necessarily limited to the positions, the sizes, the shapes, the ranges, and the like shown in the drawings.

Components described in a singular form in the present specification include components in a plural form unless specifically stated otherwise.

Although an application example of work in a manufacturing industry or at a maintenance site will be described in the following embodiments, the application of the invention is not necessarily limited thereto. Although an example of work performed by hands will be mainly described in the following embodiments, a wearable sensor included in the invention is not limited thereto. The wearable sensor may be worn on a part of a foot such as a sole of a foot and a knee, or a part of an arm such as a shoulder or an elbow. In the following embodiments, an example of a mechanism for a worker to acquire data by touching with a part of a body includes a pressure sensor that is mounted to a wearable sensor. The pressure sensor may have a plastic shape, or a cloth shape.

The first embodiment will be described with reference to <FIG>. A work information management system <NUM> according to the first embodiment includes a terminal device <NUM> and a sensor device <NUM>. The terminal device <NUM> includes a general computer as hardware, receives sensor data from the sensor device <NUM>, and analyzes the sensor data. As shown in <FIG>, the terminal device <NUM> includes a receiver <NUM>, a signal analyzing unit <NUM>, a display unit <NUM>, and a data storage unit <NUM>. The sensor device <NUM> includes, as hardware, an object (for example, a glove or a shoe provided with a pressure sensor) such as an appliance, a machine, a tool, or a device that is provided with a wearable sensor <NUM> and a transmitter <NUM>. The sensor device <NUM> acquires sensor data from the wearable sensor <NUM>, and the transmitter <NUM> transmits the sensor data to the terminal device <NUM>. As shown in <FIG>, the sensor device <NUM> includes the wearable sensor <NUM> and the transmitter <NUM>.

The receiver <NUM> in the terminal device <NUM> includes a general communication device (for example, a network interface card (NIC)) as hardware, and receives the sensor data from the sensor device <NUM>. The signal analyzing unit <NUM> includes a general arithmetic device (for example, a central processing unit (CPU)) as hardware. The signal analyzing unit <NUM> analyzes the sensor data, displays the sensor data and an analysis result of the sensor data on the display unit <NUM>, and stores the sensor data and the analysis result of the sensor data in the data storage unit <NUM>. The data storage unit <NUM> includes a general storage device (for example, a hard disk drive (HDD) or a solid state drive (SSD)) as hardware, and stores the analysis result of the sensor data from the signal analyzing unit <NUM>. The display unit <NUM> includes a general display (for example, a liquid crystal display (LCD)) as hardware, and displays the analysis result of the sensor data from the signal analyzing unit <NUM>.

The wearable sensor <NUM> has a glove shape or the like, and is a device that is internally provided with a sensing device. Alternatively, the wearable sensor <NUM> may have a cap shape worn on a fingertip, or a shape covering parts of a palm or a back of a hand. A worker <NUM> grips a sensing object <NUM> or touches a surface of the sensing object <NUM> with a tip of a hand, or presses the sensing object <NUM> with a part of the hand, so that the wearable sensor <NUM> provided in the sensor device <NUM> obtains sensor data. The sensing object <NUM> may be a tool, an electric machine, or the like used by the worker <NUM> during working. Alternatively, the sensing object <NUM> may be a conveying object such as a trolley or food such as fruits. In addition to a sensor that senses an object by touching the object, the wearable sensor <NUM> may include a sensor such as a sound sensor, a vibration sensor, and a magnetic sensor at the same time. The transmitter <NUM> may be integrally formed in the wearable sensor <NUM>. The transmitter <NUM> may be provided in the wearable sensor <NUM> through a wire for transferring power or an electrical signal.

The receiver <NUM> receives an electrical signal including sensor data that is wirelessly transmitted from the transmitter <NUM>. The signal analyzing unit <NUM> reads, from the received electrical signal, the sensor data of the sensing object <NUM> taken by the worker <NUM> in hand or touched by the worker <NUM> with hand, and determines a work content of the worker such as how the worker <NUM> touches the sensing object <NUM>.

<FIG> shows a configuration example of the sensor device and the sensing object when the signal analyzing unit <NUM> analyzes the sensor data. <FIG> shows an example of the sensor data analyzed by the signal analyzing unit <NUM>.

As shown in <FIG>, the wearable sensor <NUM> in the sensor device <NUM> is a glove-shaped wearable sensor <NUM> that can be worn on a hand of the worker <NUM>, and includes one or plural sensors provided at one or plural parts where the worker <NUM> touches the sensing object <NUM>. The glove-shaped wearable sensor <NUM> includes an index finger base pressure sensor <NUM> (ch <NUM>), an index finger central pressure sensor <NUM> (ch <NUM>), an index finger tip pressure sensor <NUM> (ch <NUM>), a middle finger base pressure sensor <NUM> (ch <NUM>), a middle finger central pressure sensor <NUM> (ch <NUM>), a middle finger tip pressure sensor <NUM> (ch <NUM>), a ring finger base pressure sensor <NUM> (ch <NUM>), a ring finger central pressure sensor <NUM> (ch <NUM>), and a ring finger tip pressure sensor <NUM> (ch <NUM>). The sensing object <NUM> is an electric tool or the like held by the worker <NUM> when cutting a work material.

In such a configuration, the sensor device <NUM> reads a pressure signal detected by a pressure sensor in each part of the wearable sensor <NUM>, and transmits information serving as sensor data to the terminal device <NUM> via the transmitter <NUM>. The sensor data includes a pressure value, identification information for identifying the wearable sensor <NUM> and a pressure sensor, and a time point when the pressure value is detected.

<FIG> shows an example of the sensor data. As shown in <FIG>, information in the sensor data indicates a temporal transition of pressure values included in detection signals detected by the wearable sensor. The information is transmitted to each wearable sensor. <FIG> shows that the index finger base pressure sensor <NUM> (ch <NUM>), the middle finger central pressure sensor <NUM> (ch <NUM>), the ring finger tip pressure sensor <NUM> (ch <NUM>), and the like detected pressure exceeding a predetermined threshold <NUM> used in pressure evaluation at a time point <NUM> indicating a moment when the worker <NUM> holds a tool. Although pressure values of the other pressure sensors increase at the time point <NUM> indicating a moment when the worker <NUM> holds a tool, the pressure values do not exceed the threshold <NUM>. Therefore, the signal analyzing unit <NUM> determines that the sensing object <NUM> is gripped by an index finger base, a middle finger center, and a ring finger tip as a work content of the worker <NUM>, and outputs the determination result as an analysis result. For example, the signal analyzing unit <NUM> outputs to the display unit <NUM> a message indicating that the sensing object <NUM> is gripped by the index finger base, the middle finger center, and the ring finger tip, pressure values when the sensing object <NUM> is gripped, and a time point. At this time, the signal analyzing unit <NUM> may compare the above-described sensor data used when determining the work content with reference sensor data that defines a criterion to be satisfied in the work, determine whether the sensor data satisfies the reference sensor data, and output a determination result and an analysis result to the display unit <NUM>. The reference sensor data may be pre-stored in the data storage unit <NUM> on a work basis. With such a configuration, an administrator can easily determine what kind of work state the worker is in, what kind of work content is performed, and whether the work content satisfies a criterion.

The sensor data obtained by touching may not be a pressure value and may be, for example, a level indicating a strength at which the sensing object <NUM> is touched by the wearable sensor <NUM>. Alternatively, the sensor data may be a change rate of a touching strength indicating how the touching strength changes within a certain period of time.

The display unit <NUM> may be provided in the sensor device <NUM> and may be implemented to be directly visible to the worker <NUM>. Alternatively, the display unit <NUM> may include a monitor that is checked by another person such as an administrator at a position away from the worker <NUM> or checked by both the administrator and the worker <NUM>. The signal analyzing unit <NUM> may transmit an analysis result to the monitor via wireless communication to display the analysis result. A content displayed as the analysis result may relate to sensor data in real time when the worker <NUM> works. Alternatively, the content displayed as the analysis result may be a result obtained by comparing the sensor data in real time when the worker <NUM> works with sensor data of previous work, or a result obtained by analyzing the previous work. In this case, a change in a degree of proficiency of the worker or the like can be known by comparing sensor data during current work of the worker <NUM> with sensor data during previous work of the worker <NUM>.

The display unit <NUM> may only display visual information, or may display a combination of tactile information such as sound and vibration and visual information. In addition, the display unit <NUM> may only display tactile information instead of visual information, or may display information obtained by the worker or a person other than the worker. The same may be applied to the second and subsequent embodiments.

When there are a plurality of workers, the data storage unit <NUM> stores sensor data of the sensing object <NUM> touched by each worker <NUM> for each part of the wearable sensor <NUM>. The data storage unit <NUM> stores work data of a working object serving as the sensing object <NUM> corresponding to the sensor data. The work data includes time spent on the work, a date and time when the work is performed, a worker ID for identifying the worker <NUM>, and the like. The IC chip provided in the wearable sensor <NUM> of the sensor device <NUM> transmits the time spent on the work, the date and time when the work is performed, and the worker ID to the terminal device <NUM> as the work data. For example, the IC chip counts a period of time from a time point when the wearable sensor <NUM> detects pressure up to a time point when the wearable sensor <NUM> detects no pressure. The period of time may serve as the time spent on the work. The IC chip reads a current time point counted by a timer (not shown). The current time point may serve as the date and time when the work is performed. The worker ID may be a worker ID obtained by the IC chip reading a worker ID pre-stored in a memory (not shown) of the worker <NUM> who uses the sensor device <NUM>.

Data stored in the data storage unit <NUM> may be the sensor data received by the receiver <NUM> of the terminal device <NUM>, or an analysis result of the signal analyzing unit <NUM>, or both the analysis result and the sensor data. The data storage unit <NUM> may temporarily store real-time sensor data received from the sensor device <NUM> by the receiver <NUM> at any time, or may continue storing previous sensor data. The data storage unit <NUM> may store data in an electronic medium, or may print data on a printing medium.

As described above, the work information management system according to the present embodiment includes the sensor device <NUM> and the terminal device <NUM>. The sensor device <NUM> includes a sensor that is worn by a worker and receives sensor data from the sensing object <NUM>, and the wearable sensor <NUM> that includes the transmitter <NUM> that transmits the sensor data received from the sensor to the terminal device <NUM>. The terminal device <NUM> determines a work content of the worker based on the sensor data received from the wearable sensor <NUM> and outputs the determination result to the display unit <NUM>. Accordingly, the work content of the worker can be easily known using the sensor device <NUM>.

In such a work information management system, work information of the worker can be associated with a working object by using the sensor data and the work data, and a work history and a work content, for example, when and where the worker performs what kind of work, can be managed. That is, work on a working object can be detected or estimated by a worker touching the working object, and work information can be managed by associating the worker with a work content according to the detection or estimation.

For example, a supervisor of the worker <NUM> may use the sensor device <NUM> to touch the sensing object <NUM>, and sensor data indicating a correct touching manner of the sensing object <NUM> may be stored in the data storage unit <NUM> in advance as a model. Then, the signal analyzing unit <NUM> compares sensor data obtained when the worker <NUM> works with the model to determine a deviation degree between the sensor data and the model, and displays an analysis result on the display unit <NUM>, so that a correct using manner of the sensing object <NUM> can be taught to the worker <NUM>. For example, when a value of the index finger base pressure sensor <NUM> (ch <NUM>) included in the sensor data received from the sensor device <NUM> is smaller than a correct value of the index finger base pressure sensor included in the sensor data indicating the correct touching manner by a predetermined value, the signal analyzing unit <NUM> displays, on the display unit <NUM>, an advice message such as "a holding manner of the index finger is weak, please hold a litter stronger".

The second embodiment will be described with reference to <FIG>. A work information management system <NUM> according to the second embodiment has a more specific device configuration than the work information management system <NUM> according to the first embodiment. The work management system <NUM> includes the sensor device <NUM> the same as the sensor device in the first embodiment, an IoT gateway <NUM>, and a server <NUM>. Compared with the sensing object <NUM> according to the first embodiment, a sensing object <NUM> is implemented by an object (for example, a tool that can store information and count time) that can obtain work data such as sensing object identification information (ID), ID indicating an installation place of the sensing object, a user of the sensing object, and time when the sensing object is operated. Work data according to the present embodiment may include the work data according to the first embodiment.

The IoT gateway <NUM> includes a general communication computer (for example, a gateway server) as hardware, and performs data shaping to transmit a wireless signal including sensor data transmitted from the transmitter <NUM> to a network <NUM>.

The server <NUM> includes a general computer as hardware, receives the sensor data and the work data transmitted from the IoT gateway <NUM> via the network <NUM>, and performs machine learning. As shown in <FIG>, the server <NUM> includes a control unit <NUM>, a pattern library <NUM>, a database <NUM>, a machine learning unit <NUM>, a determination unit <NUM>, and a display unit <NUM>.

The control unit <NUM>, the machine learning unit <NUM>, and the determination unit <NUM> include a CPU or the like as hardware, and control operation of each unit of the server <NUM> such as storing, in the database <NUM>, the sensor data and the work data received from the sensor device <NUM> via the network <NUM>. The pattern library <NUM> includes, as hardware, a database stored in a storage device such as an HDD and an SSD, and uses the sensor data and the work data to store a work content or a determination criterion for determining the sensing object <NUM> as a library.

Processing performed by the control unit <NUM>, the machine learning unit <NUM>, and the determination unit <NUM> is implemented by reading a program stored in a read only memory (ROM) (not shown) and loading the program into a random access memory (RAM) (not shown) to execute the program. The program may be downloaded from a network, loaded into a memory, and then executed. Alternatively, the program may be directly loaded into a memory from a portable computer-readable storage medium such as a compact disk (CD) and a digital versatile disk (DVD) via a reading and writing device that reads information from and writes information into the storage medium, and then the program is executed. The program may be provided or distributed by being recorded in the storage medium in a file format that can be installed or executed on a computer. The program may be provided or distributed by being stored in a computer connected to a communication network and downloaded via a network. The same may be applied to other embodiments.

The database <NUM> is stored in a storage device such as an HDD or an SSD as hardware, and stores the sensor data and the work data transmitted from the IoT gateway <NUM>. Since a data content stored in the database <NUM> is the same as a data content stored in the data storage unit <NUM> according to the first embodiment, a description of the data content will be omitted.

The machine learning unit <NUM> performs machine learning by collating previous data stored in the database <NUM> with latest sensor data and work data received from the sensor device <NUM> at any time, and stores a learning result in the pattern library <NUM> as the latest sensor data and work data.

<FIG> shows an example of the pattern library <NUM>. In <FIG>, a type serving as identification information of the wearable sensor <NUM> provided in the sensor device <NUM>, a tool ID serving as identification information of a tool touched by the wearable sensor <NUM> of this type, a work ID serving as identification information of work using the tool, and a value of each part of the wearable sensor <NUM> are stored in association on a work order basis. In <FIG>, for example, it can be seen that identification information "type <NUM>" of the glove-shaped wearable sensor <NUM> serving as the wearable sensor <NUM>, a work ID "<NUM>" of work using the sensor, and tool IDs "<NUM>", "<NUM>" and "<NUM>" of tools that serve as the sensing object <NUM> used in the work are associated with a value of each part of the wearable sensor <NUM> when the tools are used. In this example, three tools (tool IDs "<NUM>", "<NUM>", and "<NUM>") are required when the work having the work ID "<NUM>" is performed. When the work is performed using the tool having the tool ID "<NUM>", three sensors, that is, the index finger tip pressure sensor <NUM> (ch <NUM>), the middle finger tip pressure sensor <NUM> (ch <NUM>), and the ring finger tip pressure sensor <NUM> (ch <NUM>), must have detected a pressure equal to or larger than the threshold <NUM>. When the work is performed using the tool having the tool ID "<NUM>", three sensors, that is, the index finger base pressure sensor <NUM> (ch <NUM>), the middle finger base pressure sensor <NUM> (ch <NUM>), and the ring finger base pressure sensor <NUM> (ch <NUM>), must have detected a pressure equal to or larger than the threshold <NUM>. When the work is performed using the tool having the tool ID "<NUM>", six sensors, that is, the index finger base pressure sensor <NUM> (ch1), the index finger central pressure sensor <NUM> (ch2), the middle finger base pressure sensor <NUM> (ch4), the middle finger central pressure sensor <NUM> (ch5), the ring finger base pressure sensor <NUM> (ch7), and the ring finger central pressure sensor <NUM> (ch8), must have detected a pressure equal to or larger than the threshold <NUM>.

In this manner, the pattern library <NUM> stores, for each wearable sensor and each work serving as a detection target, a pattern indicating a value of each sensor when a piece of work is performed using a wearable sensor. The determination unit <NUM> compares the sensor data and the work data received from the sensor device <NUM> with data in the pattern library <NUM> and determines whether a value of each sensor included in the sensor data and the work data matches a value stored in the pattern library <NUM>. Then, the determination unit <NUM> reads identification information (for example, "type <NUM>") of a wearable sensor whose value is determined to be matched with the value stored in the pattern library <NUM>, a work name (for example, a work name "component mounting" corresponding to the ID "<NUM>") of work using the sensor, and tool names (for example, "electric jigsaw", "electric drill", and "electric screwdriver" corresponding to IDs "<NUM>", "<NUM>", and "<NUM>") of tools serving as sensing objects used in the work, and determines, as a work content, that component mounting work is performed using these tools. The determination unit <NUM> displays the determination result on the display unit <NUM>. Although a case is described above in which the determination unit <NUM> determines that a value of each sensor included in the sensor data and the work data matches a value stored in the pattern library <NUM>, the invention is not limited thereto. The determination unit <NUM> may select data having a closest value.

The sensor data and the work data obtained from the sensing object <NUM> include the tool identification information (ID), the ID indicating an installation place of the tool, the user of the tool, the time when the tool is operated, and the like. Information such as the tool ID, the ID indicating an installation place of the tool, and the user of the tool is pre-stored in a memory of the tool, and the time when the tool is operated is counted by a timer inside the tool. The information may be transmitted from the tool via wireless communication and received by the sensor device <NUM>, or the sensor device <NUM> may directly read the information.

An NTP server <NUM> is provided in the work information management system <NUM>, and is connected to the server <NUM> via the network <NUM>. The control unit <NUM> matches work time included in the sensor data and the work data with time information obtained from the NTP server <NUM>, and stores the work time in the database <NUM>. The determination unit <NUM> determines whether work is normally performed when the work data collated in the pattern library <NUM> is transmitted. In a case in which the work is determined to be normal or not normal, for example, when a deviation degree between a value of each sensor included in the sensor data and the work data at the time of performing actual work and the data stored in the pattern library is equal to or larger than a certain value (for example, when a sensor value in a first step at the time of performing certain work matches the data stored in the pattern library while a sensor value in a subsequent step cannot be obtained), the determination unit <NUM> determines that an error occurs in the work performed in the subsequent step and outputs to the display unit <NUM> a fact that the work in the subsequent step is abnormal as a determination result. Similar to the first embodiment, the determination unit <NUM> may display an advice message on the display unit <NUM>.

In the second and subsequent embodiments, the IoT gateway <NUM> may be directly connected with the server <NUM> instead of being connected via the network <NUM>.

As described above, the wearable sensor <NUM> acquires, from the sensing object <NUM>, work data including identification information of the sensing object <NUM>, a place of the sensing object, a user of the sensing object, and time when the sensing object is operated, and transmits the acquired work data and sensor data to the server <NUM> in the present embodiment. The server <NUM> determines a work content of the worker based on the sensor data and the work data received from the wearable sensor <NUM> and the pattern library <NUM> indicating a pattern of sensor values stored for each wearable sensor <NUM> and each work. With such a work information management system, a worker and work can be managed by obtaining identification information of a tool, a person, a place, time or the like from the sensor data and the work data, for example, from the sensing object <NUM>, and associating the identification information with each other.

The server <NUM> performs machine learning based on previous sensor data and work data received from the wearable sensor <NUM> and latest sensor data and work data, and sets a result of the machine learning as a new pattern library <NUM>. Accordingly, accuracy of data held by the pattern library <NUM> can be improved.

As shown in <FIG>, a work information management system <NUM> according to the third embodiment is different from the work information management system <NUM> according to the second embodiment in that the work information management system <NUM> further includes a camera <NUM> which is a network camera connected via the network <NUM>. The camera <NUM> may be a stationary camera installed in a workshop, or may be worn on the body of the worker <NUM>. Alternatively, the camera <NUM> may be integrally formed with the wearable sensor <NUM>. The camera <NUM> captures an image of the worker <NUM> who works in a workshop, and transmits to the server <NUM> image data in which the captured image is associated with identification information (ID) of a workshop which is a capturing place and where the camera <NUM> is installed and identification information (ID) of the camera. A workshop ID and an ID indicating an installation place of a tool are associated with each other in advance to determine which tool is installed in which workshop.

When the control unit <NUM> of the server <NUM> receives the image data from the camera <NUM>, the control unit <NUM> stores the image data in the database <NUM>. For example, the control unit <NUM> searches the database <NUM> for an ID indicating an installation place of a tool that has the same ID as a workshop ID included in the image data, and associates the searched sensor data and work data with the image data received from the camera <NUM>.

As described above, the work information management system <NUM> according to the present embodiment includes the network camera <NUM> that captures an image of the worker. The camera <NUM> transmits to the server <NUM> image data in which the captured image of the worker, identification information indicating a capturing place, and identification information of the camera <NUM> are associated with each other. The server <NUM> associates work data with the image data based on identification information indicating a place included in the image data received from the camera <NUM> and a place of the sensing object <NUM> included in the work data.

With such a configuration, visual information in addition to the sensor data and the work data obtained by the wearable sensor <NUM> can be collected from the camera <NUM>. A worker and work can be managed more accurately by using data obtained from the wearable sensor <NUM> and data obtained from the camera <NUM> as complementary information.

As shown in <FIG>, a work information management system <NUM> according to the fourth embodiment includes, in the sensor device <NUM>, a determination unit <NUM> and a display unit <NUM> having the same functions as the determination unit <NUM> and the display unit <NUM> shown in <FIG> according to the second or third embodiment. Similar to the first embodiment, the display unit <NUM> may be integrally formed with the wearable sensor, or may be separated from the wearable sensor and connected to the wearable sensor by a wire.

The transmitter <NUM> of the sensor device <NUM> transmits sensor data and work data to the server <NUM> via the IoT gateway <NUM>, and outputs the sensor data and the work data to the determination unit <NUM>. When the determination unit <NUM> receives the sensor data and the work data from the transmitter <NUM>, similar to the determination unit <NUM>, the determination unit <NUM> compares the sensor data and the work data with a library that is similar to the pattern library <NUM> that is stored in a memory in the sensor device <NUM> in advance, and determines whether the sensor data and the work data match the library. When the sensor data and work data is determined to be matched with the library, the determination unit <NUM> reads identification information (for example, "type <NUM>") of the wearable sensor, a work name (for example, a work name "component mounting" corresponding to the ID "<NUM>") of work using the sensor, and tool names (for example, "electric jigsaw", "electric drill", and "electric screwdriver" corresponding to the IDs "<NUM>", "<NUM>", and "<NUM>") of tools serving as sensing objects used in the work, and determines whether component mounting work is performed using these tools. The determination unit <NUM> displays the determination result on the display unit <NUM>. Similar to the first embodiment, the determination unit <NUM> may display an advice message on the display unit <NUM>.

The determination unit <NUM> and the display unit <NUM> may be provided at a place other than the worker <NUM>. For example, the determination unit <NUM> and the display unit <NUM> may be configured such that an administrator other than the worker <NUM> can visually recognize a work content. The determination unit <NUM> may have a function different from a function of the determination unit <NUM> in order to transmit different information to the administrator and the worker. As a system configuration, a determination result of the determination unit <NUM> may be directly transmitted to and displayed on the display unit <NUM>. Accordingly, the worker <NUM> can check their own work state information in real time.

The fifth embodiment will be described with reference to <FIG>. Different from the second to fourth embodiments, a work information management system <NUM> according to the fifth embodiment does not include the server <NUM> or the IoT gateway <NUM>. Instead, data is transmitted from the transmitter <NUM> to a control unit <NUM> of a personal computer (PC) <NUM> via a receiver <NUM>. The receiver <NUM> includes a general communication device as hardware, and may be a modem, a NIC integrally formed with the PC <NUM>, or the like. The control unit <NUM> has the same configuration as the configuration of the control unit <NUM> of the server <NUM> shown in <FIG>.

Similar to the server <NUM>, the PC <NUM> stores sensor data and work data in the database <NUM>. On the other hand, similar to the fourth embodiment, the determination unit <NUM> provided in the sensor device <NUM> compares the sensor data and the work data received from the transmitter <NUM> of the sensor device <NUM> with a library that is similar to the pattern library <NUM> that is stored in a memory in the sensor device <NUM> in advance, determines whether the sensor data and the work data match the library, and outputs the determination result. With such a configuration, a worker and work can be managed using a small-scale electronic device or a small investment.

The sixth embodiment will be described with reference to <FIG>. Similar to the fifth embodiment, a work information management system <NUM> according to the sixth embodiment performs processing on the PC <NUM>. On the other hand, similar to the case shown in <FIG>, the determination unit <NUM> and the display unit <NUM> are provided in the PC <NUM>. With such a configuration, the configuration of the sensor device <NUM> can be made compact. When processing capability of the sensor device <NUM> is low or in a small appliance in which no space is provided for display, a worker and work can be managed in the same manner as in the embodiments described above. Although the determination unit <NUM> and the display unit <NUM> are provided in the PC <NUM> in <FIG>, the determination unit <NUM> and the display unit <NUM> may be provided in both the PC <NUM> and the sensor device <NUM> as shown in <FIG>.

The seventh embodiment will be described with reference to <FIG>. In a work information management system <NUM> according to the seventh embodiment, the control unit <NUM>, the determination unit <NUM>, and the display unit <NUM> that perform the same processing as the PC <NUM> are directly and wirelessly connected to the wearable sensor <NUM>. The worker <NUM> wears the sensor device <NUM> having such a configuration to work. Accordingly, a worker can manage their own work using an electronic device smaller than electronic devices according to the fifth and sixth embodiments.

The eighth embodiment will be described with reference to <FIG>. The eighth embodiment relates to an assistance in acquiring data by the wearable sensor <NUM> of the sensor device <NUM> that is used in the work information management systems according to the first to seventh embodiments. A case in which the sensing object <NUM> is a tool is described as an example. When there are a plurality of tools having the same shape at a work site, it is difficult or impossible to use the method according to the seventh embodiment described above to determine which one of the plurality of tools the worker <NUM> has taken. A sensing assistance <NUM> is attached to a tool <NUM> serving as the sensing object <NUM> in the eighth embodiment so that it is possible to perform the determination. A position where the sensing assistance <NUM> is attached is at, for example, a handle position <NUM> of the tool <NUM> that imitates a electric screwdriver.

The sensing assistance <NUM> is formed of a rubber material, a plastic material, a metal material, or the like. Alternatively, the sensing assistance <NUM> is formed of a material that has a seal-shaped back surface and can be pasted to the tool <NUM>. The sensing assistance <NUM> may be implemented by a member that can be detached from the wearable sensor <NUM> by a detachment member such as a stopper or Velcro (registered trademark).

The sensing assistance <NUM> is provided with concave-convex shaped protrusions <NUM> within a range of a predetermined position <NUM>. When the worker <NUM> takes the tool <NUM> to which the sensing assistance <NUM> is attached (indicated by an arrow A in <FIG>), parts of the wearable sensor <NUM> provided at positions corresponding to the protrusions <NUM> in the predetermined position <NUM> are pressed against the protrusions <NUM> to detect a position where the worker holds the tool <NUM>, so that it is easy to determine which tool the worker <NUM> has taken.

For example, when the worker holds the sensor device <NUM> in hand, a sensor at each part of the wearable sensor <NUM> touches the sensing assistance <NUM> attached to the sensing object <NUM>. Then, pressures of sensors (for example, three sensors including the index finger tip pressure sensor <NUM> (ch3), the middle finger tip pressure sensor <NUM> (ch6), and the ring finger tip pressure sensor <NUM> (ch9)) at parts corresponding to the protrusions <NUM> in the predetermined position <NUM> of the sensing assistance <NUM> are detected, and the IC chip of the wearable sensor <NUM> transmits information of these sensors to the terminal device <NUM>. Sensor data at this time includes a sensor position corresponding to the protrusion <NUM> and a pressure value of the sensor in addition to the information shown in <FIG>. For example, at a moment when the worker <NUM> holds a tool, a pressure of a pressure sensor provided in the glove-shaped wearable sensor increases in each channel. On the other hand, pressures of sensors (for example, the above-described three sensors) positioned corresponding to the protrusions <NUM> change particularly greatly. Therefore, similar to the first embodiment, the signal analyzing unit <NUM> of the terminal device <NUM> compares pressure values of sensors at these parts with a threshold. When a difference between the pressure values and the threshold is equal to or larger than a certain value, the signal analyzing unit <NUM> may display, for example, a value of the index finger base pressure sensor <NUM> (ch <NUM>) included in the sensor data received from the sensor device <NUM> and a position of the index finger base pressure sensor <NUM> (ch <NUM>) on the display unit <NUM>, and present an advice message indicating a holding manner to the worker <NUM>.

The sensing object <NUM> to which the sensing assistance <NUM> is attached is not limited to a tool. For example, the sensing assistance <NUM> may be pasted to a desk used in work or a wall at a work site in order to specify the work site. The sensing assistance <NUM> may be attached to the floor of a work site to specify the work site by a wearable sensor on a shoe sole. The number of the sensing assistance <NUM> is not limited to one, and a plurality of sensing assistances <NUM> may be pasted to one object to be pasted. The concave-convex shaped predetermined position <NUM> may entirely have a concave shape or a convex shape, and include the protrusions <NUM> in the range of the predetermined position <NUM>. The predetermined position <NUM> is only a design index when the sensing assistance <NUM> is created. Instead of actually providing the sensing assistance <NUM>, the predetermined position <NUM> may be directly designed on the sensing object <NUM> and have the same configuration with the sensing assistance <NUM>. The protrusions <NUM> may have a round shape as shown in <FIG>, or may have various shapes such as a square shape, a triangle shape, and a star shape.

As described above, the wearable sensor <NUM> receives, from the sensing object <NUM>, sensor data obtained by touching the sensing assistance <NUM> attached to the sensing object <NUM> in the present embodiment. Accordingly, sensor data can be obtained from various sensing assistances <NUM> that can be attached to the sensing object <NUM>.

The wearable sensor <NUM> receives, from the sensing object <NUM>, sensor data obtained by touching the concave-convex shape provided in each sensing assistance <NUM>. The server <NUM> identifies the sensing object <NUM> based on a sensor value obtained from the concave-convex shape included in the sensor data. For example, the sensing assistance <NUM> is attached to the sensing object <NUM>, and a shape of the sensing assistance <NUM> is determined in advance corresponding to a place where the sensing object is placed, a type of the sensing object, and a user of the sensing object. The wearable sensor <NUM> touches the shape of the sensing assistance <NUM> so as to output sensor data of a touched part. A computer such as the server <NUM> and the PC <NUM> reads the sensor data, so that the place where the touched sensing object is placed, the type of the sensing object, and the user of the sensing object can be specified.

Since the wearable sensor <NUM> receives the sensor data from the sensing object <NUM> by pressing the concave-convex shape of the sensing assistance <NUM>, the sensor data can be obtained by, for example, simply holding a tool by the worker.

The ninth embodiment will be described with reference to <FIG>. Similar to the eighth embodiment, the ninth embodiment relates to a sensing assistance. In a sensing assistance 801a according to the ninth embodiment, a concave-convex shaped predetermined range 802a that is read by the wearable sensor <NUM> has a long and narrow shape, and is provided with concave-convex shaped protrusions <NUM> and <NUM>. Since the predetermined range 802a has a long and narrow shape, it is not possible to touch both the protrusion <NUM> and the protrusion <NUM> even when, for example, the wearable sensor <NUM> is pasted to a handle position 804a of the tool <NUM> and is held by the worker <NUM> in hand. According to the ninth embodiment, the worker <NUM> sequentially traces the long and narrow sensing assistance 801a attached to the tool <NUM> (as indicated by an arrow B in <FIG>) with, for example, a finger wearing the wearable sensor <NUM>, and an IC chip of the wearable sensor <NUM> reads the concave-convex shape. Specifically, similar to the eighth embodiment, when the IC chip of the wearable sensor <NUM> traces that the sensor device <NUM> is held by the worker in hand, sensors at each part of the wearable sensor <NUM> trace the sensing assistance 801a attached to the sensing object <NUM>. Sensors (for example, the index finger tip pressure sensor <NUM> (ch <NUM>), the middle finger tip pressure sensor <NUM> (ch <NUM>), and the ring finger tip pressure sensor <NUM> (ch <NUM>)) at parts positioned corresponding to the protrusions <NUM> in the predetermined range 802a of the sensing assistance 801a detect pressures in order of the index finger tip pressure sensor <NUM> (ch <NUM>), the middle finger tip pressure sensor <NUM> (ch <NUM>), and the ring finger tip pressure sensor <NUM> (ch <NUM>).

The IC chip of the wearable sensor <NUM> transmits information to the terminal device <NUM>. In addition to the information shown in <FIG>, sensor data at this time includes a sensor position corresponding to the protrusion <NUM>, a pressure value of a sensor, and a time point when a sensor at each part detects a pressure value. For example, when the worker <NUM> traces a tool, pressures of pressure sensors provided in the glove-shaped wearable sensor increase in each channel in a tracing order. On the other hand, pressures of sensors (for example, the above-described three sensors) positioned corresponding to the protrusions <NUM> change particularly greatly in the tracing order. Therefore, similar to the first embodiment, the signal analyzing unit <NUM> of the terminal device <NUM> compares the pressure values of sensors at these parts with a threshold. When a difference between the pressure values and the threshold is equal to or larger than a certain value, the signal analyzing unit <NUM> may display, for example, a value of the index finger base pressure sensor <NUM> (ch <NUM>) included in the sensor data received from the sensor device <NUM> and a position of the index finger base pressure sensor <NUM> (ch <NUM>) on the display unit <NUM>, and present an advice message indicating a holding manner to the worker <NUM>. The signal analyzing unit <NUM> reads a time point when these parts are traced and a correct order in which each predetermined part is traced, and determines whether each part is traced in the correct order. When the signal analyzing unit <NUM> determines that each part is not traced in the correct order, the signal analyzing unit <NUM> may present an advice message indicating a holding manner to the worker <NUM>.

As described above, since the wearable sensor <NUM> receives the sensor data from the sensing object <NUM> by tracing the concave-convex shape of the sensing assistance 801a in the present embodiment, the sensor data can be obtained by simply tracing, with a finger even for a tool having a shape that cannot be held or the like.

Shapes of the protrusions <NUM> and <NUM> may include two types of a round shape and a square shape, and the shapes are not limited. The wearable sensor <NUM> may identify the sensing object <NUM> to which the sensing assistance 801a is pasted based on shapes of the protrusions, or an interval (an interval between positions or time) between a plurality of concave-convex shapes when the sensing object <NUM> is traced by a finger. For example, data in which the sensing object <NUM>, the sensing assistance 801a, and an arrangement of the protrusions provided in the sensing assistance 801a are associated with each other may be stored in a memory of the terminal device <NUM>. The signal analyzing unit <NUM> may compare sensor data obtained from the wearable sensor <NUM> with the data to determine which sensing object <NUM> is traced.

In addition to a finger, a body that touches the sensing object <NUM> when the sensing object <NUM> is traced may be a palm, the back of a hand, an arm, a sole of a foot via a shoe sole, or the like. A length of the sensing assistance 801a can be set to any length and the number of protrusion shapes can be set to any number. More information is easily read by the wearable sensor by using the sensing assistance 801a having such a shape as compared with the eighth embodiment.

The tenth embodiment will be described with reference to <FIG>. Similar to the eighth and ninth embodiments, the tenth embodiment relates to a sensing assistance. <FIG> is a side cross-sectional view of a sensing assistance 801b according to the tenth embodiment. The sensing assistance 801b is provided with one or plural recesses P and a protrusion <NUM> is provided at a bottom of each recess P. The sensing assistance 801b is formed of, for example, an elastic material such as rubber that contracts when the material is strongly pressed. For example, the sensing assistance 801b is pasted (as indicated by an arrow C in <FIG>) to a handle 804b of the tool <NUM>. When the worker <NUM> holds the tool <NUM> in hand and a holding force is weak, the hand wearing a wearable sensor does not touch the protrusion <NUM>. A force of a certain level or above is applied to the hand to compress the sensing assistance 801b and touch the protrusion shape <NUM>. With the sensing assistance 801b, a strength of holding a working object by a worker or a strength of a pressing force when a part of a body presses against the working object can be acquired with good sensitivity by the wearable sensor.

The eleventh embodiment will be described with reference to <FIG>. Similar to the tenth embodiment, the eleventh embodiment relates to an object that acquires a pressing strength of a part of a body such as a hand. The eleventh embodiment is different from the tenth embodiment in that heights of protrusions 8000a, 8000b, 8000c, and 8000d in a sensing assistance 801c are different. A shape difference of the sensing assistance 801c may be a height difference of the protrusions, a depth difference of the recesses P, or a sharpness difference of tip corners of the protrusions. Alternatively, the shape difference of the sensing assistance 801c may be a width difference of the protrusions in a horizontal direction. The sensing assistance 801c is pasted (as indicated by an arrow D in <FIG>) to a specified position 804c such as a handle of the tool <NUM>, so that a wearable sensor can accurately determine a holding position of the tool when the worker <NUM> holds the tool.

The twelfth embodiment will be described with reference to <FIG>. The twelfth embodiment relates to a method for using the sensing assistance <NUM> according to the eighth to eleventh embodiments to identify the worker <NUM>. According to the twelfth embodiment, the sensing assistance <NUM> according to the eighth to eleventh embodiments is attached (as indicated by an arrow E in <FIG>) to an identification medium such as a personal identification ID card <NUM> worn by the worker <NUM>. When the worker <NUM> wears the sensor device <NUM> provided with the wearable sensor <NUM> at the time of starting work, at a first hour of starting work of a day, or the like, a part of a body touches the wearable sensor <NUM> of the sensor device <NUM> worn by the worker <NUM> at the sensing assistance <NUM> provided on the card <NUM>. Accordingly, worker information can be directly registered in the work information management system according to the first to seventh embodiments.

For example, the wearable sensor <NUM> of the sensor device <NUM> worn by the worker touches the sensing assistance <NUM> attached to the ID card <NUM>. The sensing assistance <NUM> includes the concave-convex shaped protrusions <NUM> within a range of the predetermined position <NUM>. The protrusions <NUM> are provided at different positions for each worker. Therefore, an IC chip of the wearable sensor <NUM> reads a pattern indicating positions when the protrusions <NUM> are traced by the wearable sensor <NUM> and a time point when each protrusion is traced, and transmits such information to the terminal device <NUM> as sensor data. The signal analyzing unit <NUM> of the terminal device <NUM> compares a protrusion arrangement pattern stored in an identification table that is used for identifying a worker and is stored in the data storage unit <NUM> in advance with the pattern included in the sensor data.

Claim 1:
A work information management system comprising:
- a terminal device (<NUM>), and
- a sensor device (<NUM>),
wherein the terminal device <NUM> includes a receiver (<NUM>), a signal analyzing unit (<NUM>), a display unit (<NUM>), and a data storage unit (<NUM>),
wherein the sensor device (<NUM>) includes an object (<NUM>) provided with a wearable sensor (<NUM>) that is worn by a worker (<NUM>) and a transmitter (<NUM>),
wherein the sensor device (<NUM>) acquires sensor data from the wearable sensor (<NUM>), and the transmitter (<NUM>) transmits the sensor data to the terminal device (<NUM>);
the wearable sensor (<NUM>) acquires, from the object (<NUM>), work data including identification information of the object (<NUM>), a place of the object (<NUM>), a user of the object (<NUM>), and time when the object (<NUM>) is operated, and transmits the acquired work data and the sensor data to the terminal device (<NUM>),
the terminal device (<NUM>) determines a work content associated with certain motions or positions of the worker (<NUM>) based on the sensor data and the work data received from the wearable sensor (<NUM>) and a pattern library indicating a pattern of sensor values stored for each wearable sensor (<NUM>) and each work content, and outputs a determination result on the display unit (<NUM>),
and
the wearable sensor (<NUM>) senses, from the object (<NUM>), the sensor data obtained by touching a sensing assistance (<NUM>) with concave-convex shaped protrusions (<NUM>) within a range of a predetermined position (<NUM>) attached to the object (<NUM>).