Introduction on Advanced Robot and Automotive Collaboration

Shibaura Institute of Technology
Active Learning
Advanced Driver Assistance Systems Lab

Introduction on Advanced Robot and Automotive Collaboration
Toshio Ito,Depart. Of Machinery and Control of Systems

Yutaka Hirakawa,

Depart. Of Computer Science and Eng.

Kojiro Iizuka, Depart. Of Machinery and Control of Systems
Dai Watanabe, Depart. Of Machinery and Control of Systems
Toshiya Hirose,

Depart. of Eng. Science and Mechanics

Nobuto Matsuhira,Depart. of Eng. Science and Mechanics

http://www.web.se.shibaura-it.ac.jp/tosi-ito/
Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Background – To achieve Sympathy Community- ICT and SIT : Sympathy Community Support by Mobility and Robotics tech Mobility and Robot techCommunity Support

Sympathy Personalization
Bay Area Verification
Test

Sensing Analyzation Information- Real-time update of environmental physical information- Collection of wheelchairs and children positions- Information from the environment, people, and robots- Scalable distributed Database through Middleware

Tourist guide
The Olympics
Advanced Robot

Shopping district support

Artificial intelligence Machine learning
Characteristics
Sensitivity
Feeling
Taste

Learning about humanSupport by machine learning
Creating maps for support、Mobility support
Mobility Scooter

with Automated Driving Set BOX

Mobility and community support by sensitivity‐‐

Cooperation among theenvironment, human and robots
Internet

Creating personalized hospitality and mobility
Creating motivation to live and community participation

Seamless connection between daily life and local communities

Tourists and the elderly support

Pedestrian recognition(Deep learning)
Safety, security and comfort
Automated driving Collaboration Support for elderly people's(SLAM)
participation in society
Health check system

Cloud

Guidance&PatrolKinematic analysis
Interaction technology
Multiple robot connection

Watch robot

Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Automated driving Set BOX
Automated Driving Set BOX

Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

SLAM – Sensor view

4
Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

SLAM – Point cloud map

Travel route pattern
Inside Building

3D map example (Omiya campus)

Inside building and environment 3D map(For Toyosu verification test)
5
Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Traffic light recognition
Histogramequalization

HSVRGB

Normalized
RGBSSD

・Red traffic light・Green traffic light・Location

6
6
Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Verification test in Toyosu

7
Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Other technologies
Overview of other technologies

Trial manufactureof step-overbetween sidewalk
and roadway

・Prototype of the principle model of the step-overmechanism and check the operation
・Study completed on detection method of danger
information outside vehicle by ultrasoniccommunication

Step down mechanism

Step up mechanism

・Start of joint study of SLAM map data with map
manufacturers

Ultrasoniccommunication

・Exploring how to use 3D maps and traditional map
information
・Completion of data collection at the Toyosu publicroad test site・ Development of common information map forrobots and automobiles
・Study and implement methods to reflect
environmental information in environmental maps

3D mapping
around Toyosu
Campus8Advanced Driver Assistance Systems Laboratory

Introduction on Advanced Robot and Automotive Collaboration

Future works
 Technologies
 Health monitoring using heart beat detection by radarRadar Pedestrian detection from omni-directional camera Mouth movement recognition from the camera
 Sensor fusion with LiDAR and omni-directional camera Integration by low-cost devices

 Collaboration
 Closer cooperation with robots
 Finding collaborate partner universities and companies Demonstration on 2nd March 2021
9Advanced Driver Assistance Systems Laboratory