Waymo’s story starts in the San Francisco Bay Area. Since early 2009, when we completed our first 1,000 autonomous miles across California, we’ve driven the length and breadth of the region, becoming intimately familiar with the many unique challenges of driving in San Francisco and the surrounding area.

On October 8th, Waymo opened its fully autonomous ride-hailing service to the general public in Phoenix. Right now members of the public are hailing vehicles with no human driver controlling the car – either in the vehicle or remotely – to help them get to where they’re going as part of their everyday lives.

For any emerging technology to be trusted, it helps to first be understood. In the past, people could see how their cars worked, looking under the hood and tinkering with them with the help of a user manual. In 2020, vehicles have so much technology that they’ve become difficult for the general public to comprehend. We want to change that. With this blog series, we’ll unpack the different parts of our technology stack to explain the fundamentals of self-driving technology. How does the Waymo Driver perceive the world? How does it learn to understand its surroundings? How can it predict the intentions of other drivers and pedestrians? And how does it keep our riders safe? We’re starting with one of the foundational questions: how does a self-driving car know where it is? 

Imagine a tiny city where you control everything that happens on the streets. You manage how many cars zip down the roads and how fast they are going. You dictate how many cyclists are on a roundabout or whether they follow the road rules. The “weather” around the vehicle can change multiple times a day from blue skies and sunshine one minute to heavy rain showers the next, but only if you want it that way. One may say such a city doesn’t exist, but if you drive out to the middle of Merced County in California, you’ll find it at Castle, a former Air Force Base our team uses to help build the World’s Most Experienced Driver™. 

Last year around this time, I found myself on a racetrack in Hockenheim, Germany, at Formula Student Germany as a student on the MIT/Delft team. Formula Student is an international design competition, where students with various backgrounds, ranging from mechanical and software engineering to finance and marketing, join forces to design, build, and race a prototype self-driving racecar. This project was one of the most challenging and rewarding experiences of my life; seeing an idea transform from a concept pitch and a system architecture diagram to a car driving itself on a racetrack in Germany was extremely rewarding, but by no means easy.

In March 2020, we launched the Waymo Open Dataset Challenges, inviting researchers to build and test their machine learning models using Waymo’s diverse self-driving dataset. We received over 100 submissions from around the world and invited the winners to present their work at our virtual Workshop on Scalability in Autonomous Driving at CVPR 2020. Today, we are excited to introduce some of the winners and their learnings.

One of the key qualities of a good driver is being able to anticipate and predict what others on the road might do. For example, what is the probability of another car merging into our lane or the cyclist in front of us making a left turn? The ability to accurately predict the intentions of other road users allows the Waymo Driver to make the safest possible decisions.

COVID-19 has had a significant impact on the world, affecting people’s lives and forcing many businesses to suspend their operations. At Waymo, we're actively monitoring the situation, taking steps to support our local communities, and contributing to COVID-19 response efforts. While Waymo has temporarily suspended its on-the-road operations as we put the health and safety of our riders, partners, and employees first, we are still driving our technology forward with our work in simulation.

In early 2009, when Waymo was first founded as the “Google Self-Driving Car Project,” Google founders Sergey Brin and Larry Page challenged our first engineers to drive autonomously without human intervention or disengagements along ten challenging 100-mile routes in our home state of California. By December 2009, the team had completed their first route, and nine months later in mid 2010, we had wrapped up the last.

To help safely navigate the complexities of the road, our self-driving technology needs to see and identify what’s around it. To perceive its surroundings, the Waymo Driver relies on our powerful custom sensor suite of lidar, cameras, and radars, while neural nets empower the “brain” of our self-driving system to understand the sensor data and respond to a wide range of scenarios.

Last August, we invited the research community to join us in accelerating self-driving technology with the release of one of the largest multi-sensor self-driving datasets available today. Even as COVID-19 continues to develop, we are committed to fostering an environment of innovation and learning - one that can continue to grow and thrive in our temporarily virtual world. That is why today, we are launching the next phase of our program: expanding the Waymo Open Dataset by an additional 800 segments and inviting researchers to participate in Waymo’s Open Dataset Challenges.

At Waymo, we’re building the World's Most Experienced Driver - our combination of hardware, software, and compute that powers vehicles to safely get people and things where they’re going.

At Waymo, we use machine learning to detect and classify different types of objects and road features. The powerful neural nets that make up our perception system learn to recognize objects and their corresponding behaviors from labeled examples of everything our Waymo Driver encounters, from joggers and cyclists, to traffic light colors and temporary road signs, or even trees and shrubs. Over the past decade we have built up an enormous collection of objects captured by our powerful custom-designed hardware.

Halloween is a fun and exciting night. People dress up as robots, fairies, or their favorite superhero. Parents and children travel from house to house, creating a great sense of community. However, behind all of this fun is a scary reality: Halloween is one of the deadliest days of the year for pedestrians in the US. 

My father-in-law was responsible for teaching all of his kids to drive. During the winter, he would ask, “How do we drive on the ice?” And everyone responded in unison, “We don’t!”

Data is a critical ingredient for machine learning. Our vehicles have collected over 10 million autonomous miles in 25 cities; this rich and diverse set of real world experiences has helped our engineers and researchers develop Waymo’s self-driving technology and innovative models and algorithms.

Today, we are inviting the research community to join us with the release of the Waymo Open Dataset, a high-quality multimodal sensor dataset for autonomous driving.

Waymo’s self-driving vehicles employ neural networks to perform many driving tasks, from detecting objects and predicting how others will behave, to planning a car’s next moves. Training an individual neural net has traditionally required weeks of fine-tuning and experimentation, as well as enormous amounts of computational power. Now, Waymo, in a research collaboration with DeepMind, has taken inspiration from Darwin’s insights into evolution to make this training more effective and efficient.

We were founded a decade ago on a mission to make our roads safer. Since then, we’ve been focused on building the world’s most experienced driver. Safely sharing the road is an important part of driving, and the Waymo driver tirelessly scans for objects around the vehicle — including pedestrians, cyclists, vehicles, road workers, animals, and obstructions — and then predicts their future movements based on information such as speed, trajectory, and road context.

This week our CTO Dmitri Dolgov sat down with MIT Technology Review’s Editor-in-Chief Gideon Lichfield at EmTech Digital. This year’s forum brought together experts from around the world to discuss advancements in AI in a variety of fields, from healthcare and public safety, to transportation and urban design.