Waymo unveiled its latest self-driving car dataset, inviting driverless car researchers to participate in a series of challenges based on the vast amount of data collected by their fleets of driverless cars. Waymo, separated from Google, added 800 new segments to its multisensor data set.
The data set itself is a pile of high-resolution sensor data that Waymo’s vehicles have collected as they roam the roads in different locations. It includes a variety of geographic locations and conditions, as well as information from a large number of sensors. Everything from cameras mounted on the front and sides of cars to mid- to short-range lidar, and simultaneous data between the two.
Waymo also marked some of the data, such as data on vehicles, pedestrians, cyclists and road signs. The data set does not reflect the full functionality of the Waymo sensor system, which is only a small fraction of the data trained by Waymo’s self-driving system, but parent company Alphabet says large and diverse, high-quality data sets are valuable for research purposes.
Researchers can participate in five different challenges. The first is around 3D detection: when given one or more LIDAR range images and related camera images, you must generate a set of 3D vertical boxes for different objects in the scene. The second 2D challenge features much the same functionality, but only for 2D boxes in a set of camera images.
The third and fourth challenges are resolved with tracking. Each of them contains data for a time series (lidar and camera, or just a camera image), from which participants are required to produce a set of 3D or 2D vertical boxes, and the correspondence between these boxes across frames. Finally, the fifth set of challenges adapts around the domain, adding additional segments from the new location (only some of them labeled) to the 3D detection challenge.
A team can have up to ten members, and each team can submit up to three assessments in 30 days. The deadline for registration is today until 31 May 2020. Waymo will use automatic verification to rank participants on the leaderboard, and manually check top entries, with each of the five challenges winning three prizes, the first with $15,000, the second with $5,000 and the third $2,000. While Alphabet employees may appear on the leaderboard, they won’t compete for cash rewards.