….turning innovation into flexible automation….

The Intuitive ROS UI: FlexGui 4.0
introduction and industrial applications
Laszlo Nagy
PPM AS
08 October, 2016

08 October, 2016

….turning innovation into flexible automation….

PPM AS• International high-tech robot-system
integrator and software house• Making robotization user friendly,
highly flexible and cost efficient• Developing cutting edge industrial
robot installations and software forindustrial robots• Full member of ROS Industrial Europe

08 October, 2016

….turning innovation into flexible automation….

PPM AS – R&D network
South Korea

Japan
NorwayNarvikHungary

Trondheim

GermanyErlangen
Györ

Budapest

Banja Luka

Bosnia08 October, 2016

….turning innovation into flexible automation….

PPM AS – Industrial experience

08 October, 2016

….turning innovation into flexible automation….

Users know your software through the UIBest software ever made?

Windows Mobile 2003

iOS 1.0

I must preorder twomonth before anyone
has seen it!

Touch screen
phones are totally
hopeless!
I rather take aBlackberry with full
QWERTY keyboard…
08 October, 2016

Best software ever madeCustomers
Let’s wait in a line
overnight!

….turning innovation into flexible automation….

R&D + Industry →FlexGui

08 October, 2016

….turning innovation into flexible automation….

FlexGui Applications
Graphical Program Editor

08 October, 2016

Welding Monitor

Graphical Palletizing

….turning innovation into flexible automation….

Industry 4.0 → FlexGui 4.0• Transparent access to all devices on a production line
• “Mobile phone” like interface• Drag’n drop GUI to any application• Open source (the source is on the ROS GitHub)• Platform independent• Based on ROS

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 Components

08 October, 2016

….turning innovation into flexible automation….

Components by Connections
FlexGui
TabletPC
Phone

FlexGui
Expert PC

AlarmsFidgetMessenger
FidgetVideo / Audio /Text Messaging

Factory
Designer

Advanced
Robot NodeSupport

OptimizedCore

RemoteView

FlexGui
Web Server

Messenger
FidgetDrag & Drop

Factory
Designer

OnlineExpert Site

Linux PC
Raspberry Pi

Lamp Fidget

 UI layer Service layer
 ROS layer
 Hardware layer

CameraFidgetAlarms
service

CameraFidgetROScoreROSbridge

MODBUS
driverROSbag+FlexGui Node

Hyundai
Link

Robot

08 October, 2016

FD Link

Robot

Alarm
Management

NetworkCamera

Expert Site
Link

NetworkCamera

CameraHUB

NetworkCamera

FD RT
5ms

Robot

PLC

PLC

…

….turning innovation into flexible automation….

Connecting a robot to a lamp
FlexGui
TabletPC
Phone

FlexGui
Expert PC

AlarmsFidgetMessenger
FidgetVideo / Audio /Text Messaging

Factory
Designer

Advanced
Robot NodeSupport

OptimizedCore

RemoteView

FlexGui
Web Server

Messenger
FidgetDrag & Drop

Factory
Designer

OnlineExpert Site

Linux PC
Raspberry Pi

Lamp Fidget

 UI layer Service layer
 ROS layer
 Hardware layer

CameraFidgetAlarmsservice

CameraFidgetROScoreROSbridge

MODBUS
driverROSbag+FlexGui NodeHyundai
Link

Robot

08 October, 2016

FD Link

Robot

Alarm
Management

NetworkCamera

Expert Site
Link

Network
CameraCameraHUB

NetworkCamera

FD RT
5ms

Robot

PLC

PLC

…

….turning innovation into flexible automation….

Demo 1: Binding lamps to a robot

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Switch to edit mode

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Select the robot’s node

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Pick the variables from the list

08 October, 2016

….turning innovation into flexible automation….

Demo 1: See the topics created

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Give them a short „friendly name”

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Place a lamp from the right belt

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Edit the lamp: text and value

08 October, 2016

….turning innovation into flexible automation….

Demo 1: Copy and paste to have teach mode

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Building a Factory Screen
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Place robots or other devices
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Set up the screen links
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Place obstacles
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Draw the fences
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 2 – Adding cameras
Factory Designer- Simplified Overview- Devices, Cameras- Fences, Obstacles, etc.
- Shortcuts to screens- Customizable- Adding a new device
takes a second

08 October, 2016

….turning innovation into flexible automation….

Demo 3 – Scriptable Alarm Definition

Custom Scripts- Full JavaScript logic- Kept simple- Combine parameters

08 October, 2016

….turning innovation into flexible automation….

Demo 3 – FG ExpertSite Multiple Factory Management

Widget System- Factories- Alarms- Multimedia Messages

08 October, 2016

….turning innovation into flexible automation….

Demo 3 – Diverse Alarm PossibilitiesSMS messages
Push Messages

08 October, 2016

….turning innovation into flexible automation….

Demo 3 – Inspect the problem

08 October, 2016

Remote Access- Over VPN- All device variables- Camera images- History Mode
- Real Time Synchronization

….turning innovation into flexible automation….

Remote Access- Over VPN- All device variables- Camera images- History Mode
- Real Time Synchronization

Demo 3 – Prepare a solution

Recovery Screen

Please press the buttons from left to right08 October, 2016

….turning innovation into flexible automation….

Demo 3 – Wait for the call

08 October, 2016

Remote Access- Over VPN- All device variables- Camera images- History Mode
- Real Time Synchronization

….turning innovation into flexible automation….

Demo 3 – Amaze the customer with 5s response time
Emergency Line
- Not even an expert is required

Recovery Screen

Please press the buttons from left to right08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level 0: Multi-factory monitoring and control(example; View status of factories, remote control,contact the local operator (audio, video, text))
Only 1 button press!

I need assistance

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level i: Factory monitoring and control(example; View status of the factory and get access to any device by double click on the icon)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level ii: Device monitoring and control(example; View status and manufacturing data of one of the robots in the production)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level ii: Device monitoring and control(example; View the current status of the robot program being executed)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level ii: Device monitoring and control(example; View / playback error messages and synchronous video from the production)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level iii: Device operation – std interface(example; Safe remote monitoring / operation of the robot to assist the local operatorduction)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 – case setup• level iii: Device operation – FlexGui interface(example; Programming and operating the robot by FlexGui)

08 October, 2016

….turning innovation into flexible automation….

FlexGui 4.0 licenses

08 October, 2016

….turning innovation into flexible automation….

How to get FlexGui 4.0 ?
• Homepage: www.ppm.no/flexgui4-Home• Product description, documentation, on-line trial• ROS: github.com/ros-industrial/flexgui_industrial• Open source download

08 October, 2016

….turning innovation into flexible automation….

Contact information
Laszlo Nagy
Head of Software Development

PPM AS
Leirfossveien 27
NO-7038 Trondheim
NorwayPhone: +47 73 96 50 50
Email: laszlo.nagy@ppmas.nowww.ppm.no08 October, 2016

….turning innovation into flexible automation….

Contact Information
Trygve Thomessen
Managing director / ProfessorPPM AS
Leirfossveien 27
NO-7038 Trondheim
NorwayPhone: +47 73 96 50 50
Email: tth@ppm.nowww.ppm.no08 October, 201645