CLOUD HMI SYSTEM

A cloud human-machine interface (HMI) system includes an interactive panel for executing user interface tasks along with one or more cloud HMI servers for executing communication interface tasks and background tasks. The interactive panel and the cloud HMI server are connected via a network.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 2shows a block diagram illustrative of a cloud human-machine interface (HMI) system2according to one embodiment of the present invention. In the embodiment, the cloud HMI system2includes an interactive panel21and at least one cloud HMI server22. Although one interactive panel21is depicted in the drawing, it is appreciated that more than one interactive panel21may be used in the cloud HMI system2. The interactive panel21primarily executes user interface (particularly graphical user interface or GUI) tasks, and the cloud HMI server22primarily executes communication interface tasks and background tasks.

The cloud HMI server22and the interactive panel21may be connected via a network23such as Wi-Fi (IEEE 802.11) or Ethernet. The network23in general may be a wired computer network or a wireless computer network. As shown inFIG. 2, each cloud HMI server22may be connected to an associated machine controller24, such as a programmable logic controller (PLC), which further controls an associated machine (not shown).

FIG. 3shows a detailed block diagram of the interactive panel21ofFIG. 2. As shown inFIG. 3, the interactive panel21of the embodiment includes a display (e.g., a liquid crystal display or LCD)211, an input device (e.g., a touch panel)212and a processing board (e.g., a central processing unit (CPU) board)213. The processing board213couples with the display211and the input device212. Specifically, the LCD211and the touch panel212combine to form a touchscreen, via which an operator is facilitated or enabled to observe the status of machine operation and/or send commands to control the machine(s).

FIG. 4shows a detailed block diagram, from a hardware perspective, of the cloud HMI server22ofFIG. 2. Specifically, the cloud HMI server22may include a processor such as a central processing unit (CPU)220utilized to execute the aforementioned background tasks. The cloud HMI server22may also include communication interfaces, such as universal serial bus (USB), RS-232/485, dual Ethernet, control area network (CAN) bus (not shown), high-definition multimedia interface (HDMI) and secure digital (SD) slot, for executing the aforementioned communication interface tasks.

Each communication interface mentioned above has its specific use. Specifically speaking, USB and SD slots may be configured to receive, for example, a thumb drive/disk as extended storage. RS-232/485 and CAN buses may be configured to communicate with, for example, the machine controller24to exchange data and send commands. In the embodiment, the Ethernet of each cloud HMI server22includes two Ethernet interfaces: one to communicate with the interactive panel21and the other to connect with the machine controller24. Either or both of the HDMI interfaces may act as a direct video output interface of the cloud HMI server22to transmit audio and video signals.

FIG. 5shows a detailed block diagram, from a software perspective, of the cloud HMI server22ofFIG. 2. Specifically, the cloud HMI server22includes a communication (COM) module221configured to communicate with the machine controller24and provide service to the interactive panel21. Accordingly, the interactive panel21may read from or write to the machine controller24via the COM module24. Therefore, the use of the COM module24may simplify protocols/processes to control and communicate with the machine controller24.

The cloud HMI server22also includes a data server (D-server) module222configured to be responsible for alarm logging, data logging, macro function and providing an interface for a cloud HMI software application (App) located in the interactive panel21to read log data from the cloud HMI server22. The cloud HMI server22may further include a web server223that is used to provide a web interface, via which an engineer can configure system settings. The web server223may also process upload/download commands to/from the interactive panel21.

The cloud HMI App mentioned above, in the embodiment, constructs a graphical user interface (GUI)210on the interactive panel21to handle foreground components of a project, and then display data of the machine controller24and log data from the cloud HMI server22in visual format. The cloud HMI App also controls the machine controller24via the COM module221. As used herein, the process of transferring a custom design visual interface from the cloud HMI server22to the interactive panel21is called an upload and the custom design visual interface is called a project.

In the embodiment, according to that shown inFIG. 5, the interaction between the interactive panel21and the cloud HMI server22may be conducted by the following two protocols: a device control protocol and/or a log data access protocol.

The device control protocol is in charge of conducting protocol conversion between the machine controller24and the GUI (or the interactive panel)210. The device control protocol accepts commands from the GUI210or D-server222, and converts the commands, which are then sent to the machine controller24. The commands may, for example, be categorized into two classes: setting and reading registers/coil. After the machine controller24replies, the device control protocol converts data and then sends them (e.g., the converted data) to the GUI210or the D-server222.

The log data access protocol defines how the GUI210accesses alarm and data (including accessible objects, length, etc.) maintained by the cloud HMI server22. The log data access protocol also defines how a response is generated and the content of the response for data update event(s).

According to the cloud HMI system2(FIG. 2) disclosed herein and discussed above, an operator is capable of remotely monitoring and controlling some or all machines (via associated machine controllers24) through a single interactive panel21. Alternatively, one or more machines may be monitored and controlled through multiple interactive panels21.

As user projects (i.e., custom design visual interfaces) are stored in the cloud HMI servers22, and then transferred (i.e., uploaded) to requesting interactive panels21, the (normally difficult) synchronization among the custom design visual interfaces on the interactive panels21may thus be eliminated according to an aspect of the embodiment. Different characteristics of the machine controllers24may thus be transparent to the interactive panel21.

FIG. 6shows an exemplary search interface of the GUI210ofFIG. 5. When the interactive panel21is activated, an operator may initiate an upload command by clicking “GO” button61in the search interface. After an associated project is uploaded, the visual format is set as configured by the project, and the interactive panel21may communicate with the cloud HMI server22to obtain data, which are then displayed on the screen of the interactive panel21.

As mentioned above, one single interactive panel21can monitor and control multiple cloud HMI servers22, one of which may be selected by clicking one “slot”62as shown inFIG. 6, thereby changing the visual interface to a corresponding cloud HMI server22.

FIG. 7shows a flow diagram illustrative of operation sequence of the cloud HMI system2ofFIG. 2. In step71, projects are designed and then stored in the cloud HMI servers22. In step72, a cloud HMI App is installed in the interactive panel21. Subsequently, in step73, the interactive panel21and the cloud HMI servers22are connected to the network23. In step74, the cloud HMI App is opened on the interactive panel21, a cloud HMI server is searched, and a project is uploaded from the cloud HMI server22to the interactive panel21by clicking an associated “GO” button. Afterwards, in step75, the user project with real time data are displayed on the interactive panel21. If another cloud HMI server22need be connected (step76), a different “slot” is clicked and the flow goes back to step74.

According to the embodiment discussed above, as one interactive panel21may be connected to multiple cloud HMI servers22to manipulate several machines, LCDs and touch panels may therefore be saved, compared with a conventional. system (e.g.,FIG. 1) that requires an LCD and touch panel set for each HMI server. Moreover, an operator need not go to each machine and operate dedicated HMI installed near or in each machine. Instead, the operator in the embodiment is able to remotely monitor and control the cloud HMI servers22and associated machines. Alternatively, the embodiment allows several operators to be connected with one cloud HMI server22and an associated machine.

As HMI servers are commonly installed to endure relatively extreme environments, such as those less than optimal for LCDs and touch panels, the system2as disclosed in the embodiment can offer a more suitable solution, e.g., for harsh environments. By operation of the invention the LCDs211and touch panels212are no longer disposed in the cloud HMI servers22that come near the machines subjected to harsh environments. To the contrary, in a conventional system (FIG. 1), the LCDs and touch panels are disposed in the HMI that is subjected to harsh environments.

Furthermore, in the embodiment, the interactive panel21is connected with the cloud HMI server22by the uploading of project (i.e., custom design visual interface(s)), and the cloud HMI server22is selected by switching among slots. To the contrary, in a conventional system, a dedicated project is downloaded into HMI1(FIG. 1) to perform communication and switching.