The collaboration of unmanned aerial vehicles (UAVs), also known as aerial swarm, has become a popular research topic for its practicality and flexibility in plenty of scenarios. However, one of the most fundamental components for autonomous aerial swarm systems in GPS-denied areas, the robust decentralized relative state estimation, remains to be an extremely challenging research topic. In order to address this research niche, the Omni-swarm, an aerial swarm system with decentralized Omni-directional visual-inertial-UWB state estimation , which features robustness, accuracy, and global consistency, is proposed in this paper. We introduce a map-based localization method using deep learning tools to perform relative localization and re-localization within the aerial swarm while achieving the fast initializationand maintaining the global consistencyof state estimation. Furthermore, to overcome the sensors' visibility issues with the limited field of view (FoV), which severely affect the performance of the state estimation, Omni-directional sensors, including fisheye cameras and ultra-wideband (UWB) sensors, are adopted. The state estimation module, together with the planning and the control modules, is integrated on the aerial system with Omni-directional sensors to attain the Omni-swarm, and extensive experiments are performed to verify the validity and examine the performance of the proposed framework  . According to the experiment result, the proposed framework can achieve centimeter-level relative state estimation accuracy while ensuring global consistency  .
The decentralized state estimation is one of the most fundamental components for autonomous aerial swarm systems in GPS-denied areas, which still remains a highly challenging research topic. To address this research niche, the Omni-swarm, a decentralized omnidirectional visual-inertial-UWB state estimation system for the aerial swarm is proposed in this paper. In order to solve the issues of observability, complicated initialization, insufficient accuracy and lack of global consistency, we introduce an omnidirectional perception system as the front-end of the Omni-swarm, consisting of omnidirectional sensors, which includes stereo fisheye cameras and ultra-wideband (UWB) sensors, and algorithms, which includes fisheye visual inertial odometry (VIO), multi-drone map-based localization and visual object detector. A graph-based optimization and forward propagation working as the back-end of theOmni-swarm to fuse the measurements from the front-end . According to the experiment result, the proposed decentralized state estimation method on the swarm system achieves centimeter-level relative state estimation accuracy while ensuring global consistency . Moreover, supported by the Omni-swarm, inter-drone collision avoidance can be accomplished in a whole decentralized scheme without any external device, demonstrating the potential of Omni-swarm to be the foundation of autonomous aerial swarm flights in different scenarios .
R
collaboration of unmanned aerial vehicles (UAVs), also known as aerial swarm, has become a popular research topic for its practicality and flexibility in plenty of scenarios. However,
decentralized state estimation is
R
the robust decentralized relative state estimation, remains to be an extremely
which still remains a highly
R
In order to
To
R
an aerial swarm system with decentralized Omni-directional
a decentralized omnidirectional
R
, which features robustness, accuracy, and global consistency,
system for the aerial swarm
R
We introduce a map-based localization method using deep learning tools to perform relative localization and re-localization within the aerial swarm while achieving the fast initializationand maintaining the global consistencyof state estimation. Furthermore, to overcome the sensors' visibility issues with the limited field of view (FoV), which severely affect the performance of the state estimation, Omni-directional sensors, including
In order to solve the issues of observability, complicated initialization, insufficient accuracy and lack of global consistency, we introduce an omnidirectional perception system as the front-end of the Omni-swarm, consisting of omnidirectional sensors, which includes stereo
D
are adopted. The state estimation module, together with the planning and the control modules, is integrated on the aerial system with Omni-directional sensors to attain the Omni-swarm,
R
extensive experiments are performed to verify the validity and examine the performance of the proposed framework
algorithms, which includes fisheye visual inertial odometry (VIO), multi-drone map-based localization and visual object detector. A graph-based optimization and forward propagation working as the back-end of the
A
Omni-swarm
A
to fuse the measurements from the front-end
R
framework can achieve
decentralized state estimation method on the swarm system achieves
A
. Moreover, supported by the Omni-swarm, inter-drone collision avoidance can be accomplished in a whole decentralized scheme without any external device, demonstrating the potential of Omni-swarm to be the foundation of autonomous aerial swarm flights in different scenarios