Before revision:  Other generic video object segmentation tasks have dealt with instance-wise motion segmentation but on much simpler setting and have not dealt with the multi-task learning problem for both semantic and class agnostic instance segmentation. In this paper, we propose a motion-based instance segmentation task and provide a new annotated dataset based on KITTIMoSeg , which will be released publicly. Our datasetprovide extra class annotations which is crucial for studying class agnostic  segmentation.
After revision:  As the main issue is the lack of large public datasets, we create a new InstanceMotSeg dataset comprising of 12.9K samples improving upon our KITTIMoSeg dataset. In addition to providing instance level annotations, we have added 4 additional classes which is crucial for studying class agnostic segmentation.