Architecture design and implementation of image based autonomous car: THUNDER
Abstract
Autonomous driving with high velocity is a research hotspot which challenges the scientists and engineers all over the world. This paper proposes a scheme of indoor autonomous car based on ROS which combines the method of Deep Learning using Convolutional Neural Network (CNN) with statistical approach using liDAR images and achieves a robust obstacle avoidance rate in cruise mode. In addition, the design and implementation of autonomous car are also presented in detail which involves the design of Software Framework, Hector Simultaneously Localization and Mapping (Hector SLAM) by Teleoperation, Autonomous Exploration, Path Plan, Pose Estimation, Command Processing, and Data Recording (Co- collection). what’s more, the schemes of outdoor autonomous car, communication, and security are also discussed. Finally, all functional modules are integrated in nVidia Jetson TX1.
Similar content being viewed by others
References
Aldibaja M, Suganuma N, Yoneda K (2017) Robust Intensity Based Localization Method for Autonomous Driving on Snow-wet Road Surface. IEEE Trans Ind Info 1
Alheeti KMA, Gruebler A, Mcdonald-Maier KD (2015) An intrusion detection system against malicious attacks on the communication network of driverless cars. Consumer Comm Network Conf 916–921
Bag S (2017) Deep Learning Localization for Self-driving Cars
Carlone L, Ng MK, Du J, Bona B, Indri M (2011) Simultaneous Localization and Mapping Using Rao-Blackwellized Particle Filters in Multi Robot Systems. J Int Robot Syst 63:283–307
Chu K, Kim J, Jo K, Sunwoo M (2015) Real-time path planning of autonomous vehicles for unstructured road navigation. Int J Automot Technol 16:653–668
Dolgov D, Thrun S, Montemerlo M, Diebel J (2009) Path Planning for Autonomous Driving in Unknown Environments, Experimental Robotics, The Eleventh International Symposium, ISER 2008 13–16, 2008, Athens, Greece, 55–64
Endres F, Hess J, Sturm J, Cremers D, Burgard W (2017) 3-D Mapping With an RGB-D Camera. IEEE Trans Robot 30:177–187
Fernandes LC, Souza JR, Pessin G, Shinzato PY, Sales D, Mendes C, Prado M, Klaser R, Magalhães AC, Hata A (2014) CaRINA Intelligent Robotic Car: Architectural design and applications. J Syst Archit 60:372–392
Garip MT, Gursoy ME, Reiher P, Gerla M (2015) Congestion Attacks to Autonomous Cars Using Vehicular Botnets, The Workshop on Security of Emerging NETWORKING Technologies
Grisetti G, Stachniss C, Burgard W (2007) Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters. IEEE Trans Robot 23:34–46
International S (2014) Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems
Jalalmaab M, Fidan B, Jeon S and Falcone P (2015) Model predictive path planning with time-varying safety constraints for highway autonomous driving, International Conference on Advanced Robotics 213–217
Kang MC, Chae SH, Sun JY, Lee SH, Ko SJ (2017) An enhanced obstacle avoidance method for the visually impaired using deformable grid. IEEE Trans Consum Electron 63:169–177
Kohlbrecher S, Meyer J, Graber T, Petersen K, Klingauf U, Stryk OV (2013) Hector Open Source Modules for Autonomous Mapping and Navigation with Rescue Robots. Springer, Berlin
Kohlbrecher S, Stryk OV, Meyer J and Klingauf U (2011) A flexible and scalable SLAM system with full 3D motion estimation. IEEE Int Sympos Saf Sec Rescue Robot 155–160
Lee SH, Chung CC (2017) Robust Multirate On-Road Vehicle Localization for Autonomous Highway Driving Vehicles. IEEE Trans Control Syst Technol 25:577–589
Mur-Artal R and Tardos JD (2015) Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM, Robotics: Science and Systems
Oliveira M, Santos V, Sappa AD, Dias P, Moreira AP (2016) Incremental texture mapping for autonomous driving. Robotics & Autonomous Systems 84:113–128
Pink O, Becker J, Kammel S (2015) Automated driving on public roads: Experiences in real traffic, it. Info Technol 57:223–230
Rosolia U, Bruyne SD and Alleyne AG (2016) Autonomous Vehicle Control: A Nonconvex Approach for Obstacle Avoidance. IEEE Trans Control Syst Technol 1–16
Sallab AAA, Abdou M, Perot E and Yogamani S (2016) Deep Reinforcement Learning framework for Autonomous Driving, NIPS 2016 Workshop - MLITS
Schellekens M (2016) Car hacking: Navigating the regulatory landscape. Comput Law Sec Rev Int J Technol Law Pract 32:307–315
Taş ÖŞ, F. KUHNT, J. M. ZöLLNER and C. STILLER (2016) Functional system architectures towards fully automated driving, Intelligent Vehicles Symposium
Tijmons S, Croon GCHED, Remes BDW, Wagter CD, Mulder M (2017) Obstacle Avoidance Strategy using Onboard Stereo Vision on a Flapping Wing MAV. IEEE Trans Robot 33:858–874
Ulbrich S, Reschka A, Rieken J, Ernst S, Bagschik G, Dierkes F, Nolte M and Maurer M (2017) Towards a Functional System Architecture for Automated Vehicles
Wolcott RW, Eustice RM (2017) Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving. Int J Robot Res 36:027836491769656
Acknowledgements
The research of autonomous car are funded by Sci-Tech Support Plan of Sichuan Province, China [Grant Numbers: 2016GZ0343].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, C., Li, F. & Cao, W. Architecture design and implementation of image based autonomous car: THUNDER-1. Multimed Tools Appl 78, 28557–28573 (2019). https://doi.org/10.1007/s11042-018-5816-9
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1007/s11042-018-5816-9