Introducing Intel® RealSense™
Robotics Innovation Program – ROS Integration

Amit Moran, Gila Kamhi,
Artyom Popov, Raphaël Groscot
Perceptual Computing - AdvancedTechnologies Israel

Agenda• Intel RealSense – intro• Intel RealSense Robotics Innovation program• What is it, what is our goal and how we are planning toachieve it• Summary• Questions

2

Intel® RealSense™ Technology
Add “Senses” to the “Brain” :Eyes, Ears, Voice, Touch, Emotion and Context

for an immersive, intuitive and exciting life-like experience3

Short Range/Long Range
Intel® RealSense™ Short Range 3D Camera (F200)
Color

Depth (IR)Active Pixels

1920x1080

640x480

Aspect ratio

16:9

4:3

Frame rate

30/60/120 FPS

30/60/120 FPS

Field of view
(D x V x H)

77x43x70(Cone)

90x59x73(Cone)

Effective Range-

0.2m – 1.2m

Color

Depth (IR)Active Pixels

1920x1080

640x480

Aspect ratio

16:9

4:3

Frame rate

30 FPS

30/60/90 FPS

Field of view
(D x V x H)

77x47x70(Cone)

70x46x59(Cone)

Effective Range-

0.6m – 3.5m*

Intel® RealSense™ Long Range 3D Camera (R200)*For outdoors use cases, depth is reported at a greater range (up to about 10 m) with lower accuracy.

4Intel® RealSense™ SDKIntel® RealSense SDK
Front Facing

Rear Facing

Gesture-Enabledcontentconsumption

Immersive
Telepresence

Edutainment
Games/Kits for kids

3D Obj view
3D Print & Share

Virtual Instructor for
Education

3D Body Scanner(see, share, print)

3D Obj & Face
Scanner; 3D Print

Interactive Books

Content Creation
Virtual Green Room

3D Room Scanner
for Decoration

3D-based Photo
Post-Processing

Collaborative Games

Speech Command & Control

RealSense™ SDK Run Time API
SW & MW Framework
GestureRecognition

Background
RemovalF2003D Face
Tracking &Recognition

3D Scene
Understanding

Hands/Fingerstracking

3D ObjTracking &Recognition

R200Expression

SpeechEngines

R1005

Intel® RealSense™ Technology

6

“This is just the beginning”

7Intel® RealSense™ Technology

User Facing RealSense
2014 3D (F200) Camera

World Facing RealSense
2015 3D (R200) Camera

AIOs, Laptops, 2in 1s

Tablets

Multi-User Interaction
based on RealSense
AIOs, Laptops, 2in1s,Tablets

Dynamic Social
Interaction

Autonomous Machines,
Wearables

From Human – Computer Interaction to Human – World Interaction
Robots and Wearables are ultimate hardware platforms for PerceptualComputing Technologies driving this revolution
Intel8

Intel® RealSense™
Robotics Innovation Program• A strategic program, aiming to develop technology to support
rapid cycles of innovation in the robotic world of research,focused on Intel® RealSense™ Technology• Our Goal:

Supportin your quest to innovate andcreate the next big thing in robotics

Intel® RealSense™ Technology - ROS Integration

Intel® RealSense™
Robotics Innovation Program• RealSense-ROS pilots has been kicked off in April’15 withselect universities• Gathered feedback and requirements• A lot of traction…
• Our offering available to all ROS community announcement made by our CEO @IDF15

http://wiki.ros.org/RealSense

Intel® RealSense™ Technology - ROSIntegration• Camera access• RGB, Depth, IR, PointCloud• CV basic modules• Plane analysis, Depth enhancements, Blob detection…
• Advanced modules• Person detection and tracking, skeleton tracking, gestures,
object recognition, localization and mapping, scanning…

12Videos
Depth Enhancement :13

Videos
Scan

14

Videos
Autonomous Navigation15

Videos
Person tracking

16Videos
Outside17

Short Range Camera (MASCOR Institute, FH Aachen)

VideosPartners work

Long Range Camera (TUM)

18

Summary
There is huge pull to Intel RealSense technology in robotics
community

RealSense has competitive advantage in comparison with otherperipheral depth sensors• Significantly small form factor• Low weight• Low cost
• Multi-range support; short (F200) and long (R200)• Larger range support of lighting conditions• Very rich technology engines that support mobile set-up

19

“This is just the beginning”

20Questions?
Gila Kamhi, Amit Moran
Perceptual Computing – Advanced Technologies

21

22