CaT: CAVS Traversability Dataset for Off-Road Autonomous Driving

In the context of autonomous driving, the existing semantic segmentation concept strongly supports on-road driving where hard inter-class boundaries are enforced and objects can be categorized based on their visible structures with high confidence. Due to the well-structured nature of typical on-road scenes, current road extraction processes are largely successful and most types of vehicles are able to traverse through the area that is detected as road. However, the off-road driving domain has many additional uncertainties such as uneven terrain structure, positive and negative obstacles, ditches, quagmires, hidden objects, etc. making it very unstructured. Traversing through such unstructured area is constrained by a vehicle's type and its capability. Therefore, an alternative approach to segmentation of the off-road driving trail is required that supports consideration of the vehicle type in a way that is not considered in state-of-the-art on-road segmentation approaches. To overcome this limitation and facilitate the path extraction in the off-road driving domain, we propose traversability concept and corresponding dataset which is based on the notion that the driving trails should be finely resolved into different sub-trails and areas corresponding to the capability of different vehicle classes in order to achieve safe traversal. Based on this, we consider three different classes of vehicles (sedan, pickup, and off-road) and label the images corresponding to the traversing capability of those vehicles. So the proposed dataset facilitates the segmentation of off-road driving trail into three regions based on the nature of the driving area and vehicle capability. We call this dataset as CaT (CAVS Traversability, where CAVS stands for Center for Advanced Vehicular Systems) dataset and is publicly available at https://www.cavs.msstate.edu/resources/downloads/CaT/CaT.tar.gz.