Single Image 3D Vehicle Pose Estimation for Augmented Reality The intent of this paper is to introduce a novel method for 3D vehicle pose estimation, a critical component of augmented reality. The proposed method is able to recover the location of a specific object from a single image by combining pretrained reliable semantic segmentation and improved single image depth estimation. Our method exploits a novel pose estimation technique by generating new 2D images created from the projections of rotated point clouds. The rotation of the specific object is able to be predicted. Augmented objects can be shifted, rotated and scaled correctly based on the recovered orientation and localization. Through accurate vehicle pose estimation, virtual vehicles are able to be augmented accurately in place of real vehicles. The effectiveness of our method is verified by comparison with other recent pose estimation methods on the challenging KITTI 3D benchmark. Further experiments on the Cityscapes dataset also demonstrates good robustness in the method. Without requiring ground truth 3D vehicle pose labels for training, our model is able to produce competitive and robust performance in 3D vehicle pose estimation.

A Geometric Convolutional Neural Network for 3D Object Detection We propose a method for accurate 3D vehicle detection based on geometric deep neural networks. From only a single RGB image, the framework is able to recover the 3D positions and predict 3D bounding boxes. In particular, the algorithm leverages single image depth estimation and semantic segmentation to produce 3D point cloud for specific objects. By geometrically constraining the object dimensions, an accurate and stable 3D bounding box which tightly fits into the real object can be estimated. We verify the effectiveness and robustness of our method by comparing with other recent stateofart methods on the challenging KITTI 3D benchmark dataset as well as synthetic Virtual KITTI dataset. Without requiring ground truth 3D labels, our method is able to produce competitive and robust performance in 3D scene understanding and detection.