Package: asrl-pyboreas
pyboreasThis devkit provides tools for working with the Boreas Dataset, an all-weather autonomous driving dataset which includes a 128-beam Velodyne Alpha-Prime lidar, a 5MP Blackfly camera, a 360 degree Navtech radar, and post-processed Applanix POS LV GNSS data. Our dataset currently suports benchmarking odometry, localization, and 3D object detection.Our leaderboard is now live! Baseline implementations for each leaderboard are coming soon.If you find our dataset useful in your research, please cite our dataset paper:Boreas: A Multi-Season Autonomous Driving Dataset@article{burnett_ijrr23,
author = {Keenan Burnett and David J Yoon and Yuchen Wu and Andrew Z Li and Haowei Zhang and Shichen Lu and Jingxing Qian and Wei-Kang Tseng and Andrew Lambert and Keith YK Leung and Angela P Schoellig and Timothy D Barfoot},
title ={Boreas: A multi-season autonomous driving dataset},
journal = {The International Journal of Robotics Research},
volume = {42},
number = {1-2},
pages = {33-42},
year = {2023},
doi = {10.1177/02783649231160195},
}InstallationUsing pippip install asrl-pyboreasFrom sourcegit clone https://github.com/utiasASRL/pyboreas.git
pip install -e pyboreasDownload InstructionsCreate an AWS account (OPTIONAL)Install the AWS CLICreate arootfolder to store the dataset, example:/path/to/data/boreas/Each sequence will then be a folder underroot.Use the AWS CLI to download either the entire dataset or only the desired sequences and sensors.Don't have an AWS Account?Add--no-sign-requestafter each AWS CLI command.The following command will download the entire Boreas dataset:root=/path/to/data/boreas/
aws s3 sync s3://boreas $rootThe following command will list all the top-level prefixes (sequences):root=/path/to/data/boreas/
aws s3 ls s3://boreasAlternatively,boreas.utias.utoronto.ca (Work In Progress)can be used to browse through sequences so as to pick and choose what data to download. The website will then generate a list of AWS CLI commands that can be run as a bash script. These commands will look something like:root=/path/to/data/boreas/
cd $root
aws s3 sync s3://boreas/boreas-2020-11-26-13-58 boreas-2020-11-26-13-58 --exclude "*" \
    --include "lidar/*" --include "radar/*" \
    --include "applanix/*" --include "calib/*"Example UsageimportnumpyasnpfrompyboreasimportBoreasDatasetroot='/path/to/data/boreas/'bd=BoreasDataset(root)# Note: The Boreas dataset differs from others (KITTI) in that camera,# lidar, and radar measurements are not synchronous. However, each# sensor message has an accurate timestamp and pose instead.# See our tutorials for how to work with multiple sensors.# Loop through each frame in order (odometry)forseqinbd.sequences:# Iterator examples:forcamera_frameinseq.camera:img=camera_frame.img# np.ndarray# do somethingcamera_frame.unload_data()# Memory reqs will keep increasing without thisforlidar_frameinseq.lidar:pts=lidar_frame.points# np.ndarray (x,y,z,i,r,t)# do somethinglidar_frame.unload_data()# Memory reqs will keep increasing without this# Retrieve frames based on their index:N=len(seq.radar_frames)foriinrange(N):radar_frame=seq.get_radar(i)# do somethingradar_frame.unload_data()# Memory reqs will keep increasing without this# Iterator example:cam_iter=bd.sequences[0].get_camera_iter()cam0=next(cam_iter)# First camera framecam1=next(cam_iter)# Second camera frame# Randomly access frames (deep learning, localization):N=len(bd.lidar_frames)indices=np.random.permutation(N)foridxinindices:lidar_frame=bd.get_lidar(idx)# do somethinglidar_frame.unload_data()# Memory reqs will keep increasing without this# Each sequence contains a calibration object:calib=bd.sequences[0].calibpoint_lidar=np.array([1,0,0,1]).reshape(4,1)point_camera=np.matmul(calib.T_camera_lidar,point_lidar)# Each sensor frame has a timestamp, groundtruth pose# (4x4 homogeneous transform) wrt a global coordinate frame (ENU),# and groundtruth velocity information. Unless it's a part of the test set,# in that case, ground truth poses will be missing. However we still provide IMU# data (in the applanix frame) through the imu.csv files.lidar_frame=bd.get_lidar(0)t=lidar_frame.timestamp# timestamp in secondsT_enu_lidar=lidar_frame.pose# 4x4 homogenous transform [R t; 0 0 0 1]vbar=lidar_frame.velocity# 6x1 vel in ENU frame [v_se_in_e; w_se_in_e]varpi=lidar_frame.body_rate# 6x1 vel in sensor frame [v_se_in_s; w_se_in_s]TutorialsNote that we provide a few simple tutorials for getting started with the Boreas dataset. Also note that we provide instructions for using this dataset using an AWS SageMaker instance, instructions at: pyboreas/tutorials/aws/README.md.NOTE:ground truth poses have dtype=np.float64, but PyTorch defaults to float32. Avoid using implicit type conversion as this will result in significant quantization error. Implicit conversion is only safe when the translation values are small, such as a pose with respect to a sensor frame or with respect to a starting position, but NOT with respect to ENU (very large).TODO:Pointcloud voxelization