# How do self-driving cars deal with stoplights?

**URL:** <https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031>\
**Category:** Factual Questions\
**Created:** [April 3, 2016, 5:08am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031 "2016-04-03T05:08:05Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![chacoguy](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@chacoguy](https://boards.straightdope.com/u/chacoguy)\
**Post date:** [April 3, 2016, 5:08am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/1 "2016-04-03T05:08:05Z")

</div>

How do they know that particular object is actually a stoplight?

How do they, then, react to Red, Yellow, Green?

---

<div class="post-metadata">

**Author:** ![engineer\_comp\_geek](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/engineer_comp_geek/32/504_2.png) [@engineer\_comp\_geek](https://boards.straightdope.com/u/engineer_comp_geek)\
**Post date:** [April 3, 2016, 7:05am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/2 "2016-04-03T07:05:14Z")

</div>

The google cars use very high precision maps. They know where the stop lights are, and they even know how high the stop lights are. So they know fairly precisely where to aim their cameras to look for the lights.

The current generation of cars apparently doesn’t handle arbitrarily placed stop lights, so if someone temporarily places a light in a location where the car isn’t expecting it, the car will ignore it.

Needless to say, that’s not a good thing.

---

<div class="post-metadata">

**Author:** ![chappachula](https://avatars.discourse-cdn.com/v4/letter/c/d2c977/32.png) [@chappachula](https://boards.straightdope.com/u/chappachula)\
**Post date:** [April 3, 2016, 7:26am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/3 "2016-04-03T07:26:28Z")

</div>

> [@engineer\_comp\_geek](#):
>
> The google cars use very high precision maps. They know where the stop lights are, and they even know how high the stop lights are. So they know fairly precisely where to aim their cameras to look for the lights.
> 
> The current generation of cars apparently doesn’t handle arbitrarily placed stop lights, so if someone temporarily places a light in a location where the car isn’t expecting it, the car will ignore it.

This boggles my mind!  
Every cheap camera today uses facial recognition. Surely stop lights are easier to identify than human faces…After all, a stop light is a specific geometrical shape with rigid mathematical dimensions. It seems like it should be easy to program a computer to do the math. Why can’t it be done?

---

<div class="post-metadata">

**Author:** ![Musicat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/musicat/32/20189_2.png) [@Musicat](https://boards.straightdope.com/u/Musicat)\
**Post date:** [April 3, 2016, 7:31am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/4 "2016-04-03T07:31:31Z")

</div>

> [@engineer\_comp\_geek](#):
>
> The current generation of cars apparently doesn’t handle arbitrarily placed stop lights, so if someone temporarily places a light in a location where the car isn’t expecting it, the car will ignore it.

Cite?

---

<div class="post-metadata">

**Author:** ![boytyperanma](https://avatars.discourse-cdn.com/v4/letter/b/4491bb/32.png) [@boytyperanma](https://boards.straightdope.com/u/boytyperanma)\
**Post date:** [April 3, 2016, 8:07am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/5 "2016-04-03T08:07:05Z")

</div>

> [@Musicat](#):
>
> Cite?

I think they are a little bit beyond that problem now but they still haven’t got it completely tackled. It was initially an issue.  
This [article](https://www.technologyreview.com/s/530276/hidden-obstacles-for-googles-self-driving-cars/) explains capabilities a bit. That was a few years ago, not sure if they’ve advanced much.

---

<div class="post-metadata">

**Author:** ![engineer\_comp\_geek](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/engineer_comp_geek/32/504_2.png) [@engineer\_comp\_geek](https://boards.straightdope.com/u/engineer_comp_geek)\
**Post date:** [April 3, 2016, 8:19am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/6 "2016-04-03T08:19:27Z")

</div>

> [@Musicat](#):
>
> Cite?

This is from wikipedia (bolding mine)

> [@](#):
>
> As of August 28, 2014 the latest prototype has not been tested in heavy rain or snow due to safety concerns.[51] **Because the cars rely primarily on pre-programmed route data, they do not obey temporary traffic lights** and, in some situations, revert to a slower “extra cautious” mode in complex unmapped intersections. The vehicle has difficulty identifying when objects, such as trash and light debris, are harmless, causing the vehicle to veer unnecessarily. Additionally, the lidar technology cannot spot some potholes or discern when humans, such as a police officer, are signaling the car to stop.[52] Google projects having these issues fixed by 2020.[53]

> **[Waymo](https://en.wikipedia.org/wiki/Google_self-driving_car)**
>
> Waymo LLC, formerly known as the Google Self-Driving Car Project, is an American autonomous driving technology company headquartered in Mountain View, California. It is a subsidiary of Alphabet Inc., Google's parent company. Waymo operates commercial robotaxi services available to the public in Phoenix (Arizona), San Francisco (California), Los Angeles (California), Atlanta (Georgia), and Austin (Texas). Waymo services are available to select passengers on a waitlist in Silicon Valley (Cali Th...

Another cite:

> [@](#):
>
> Many people have heard that Google’s autonomous cars can “drive anywhere a car can legally drive,” but it can’t drive in snow, heavy rains, see “unmapped” traffic lights or stop signs. In other words, Google’s self-driving cars can handle the “matrix” but it can’t navigate on 99% of the roads in the U.S.

> **[Did you know Google’s self-driving cars can’t handle 99% of roads in the US?](https://www.computerworld.com/article/1373792/did-you-know-googles-self-driving-cars-cant-handle-99-of-roads-in-the-us.html)**
>
> While there is a lot to be excited about when it comes to driverless cars, Google's self-driving cars can't handle heavy rain, snow, unmapped traffic lights or stop signs. In other words, it is incapable of driving in nearly 99% of the U.S.

Google’s own documentation:

> [@](#):
>
> Cars must deal with traffic lights. The two main tasks are  
> detecting the traffic lights and understanding their control  
> semantics. Our approach to solving these two tasks has been  
> to automatically construct maps of the traffic light positions  
> and orientations, and then to manually add control semantics  
> to each light. We then use this map to allow an onboard  
> perception system to anticipate when it should see and react  
> to a traffic light, to improve the performance of the traffic  
> light detector by predicting the precise location of the traffic  
> light in the camera image, and to then determine whether  
> a particular route through an intersection is allowed. Our  
> system has been deployed on multiple cars, and has provided  
> reliable and timely information about the state of the traffic  
> lights during thousands of drives through intersections

> **[37259.pdf](https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/37259.pdf)**
>
> 1442.06 KB

(warning - pdf)

ETA: This article has a lot of technical information in it, by the way.

---

<div class="post-metadata">

**Author:** ![Mijin](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mijin/32/9369_2.png) [@Mijin](https://boards.straightdope.com/u/Mijin)\
**Post date:** [April 3, 2016, 8:26am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/7 "2016-04-03T08:26:43Z")

</div>

In any case, the cars have to be able to deal with a four way crossing where there are no lights, or the lights are not working.  
To do this, it has an “edging out” behaviour where it makes its intention to cross obvious to other drivers before finally crossing when it has been given way.

I assume it would resort to this behaviour if it reached a crossing but did not see any lights for whatever reason. It would go through but slowly and cautiously.

This is assuming the AI hasn’t been updated to just recognizing temporary traffic lights.

---

<div class="post-metadata">

**Author:** ![core](https://avatars.discourse-cdn.com/v4/letter/c/d26b3c/32.png) [@core](https://boards.straightdope.com/u/core)\
**Post date:** [April 3, 2016, 8:29am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/8 "2016-04-03T08:29:28Z")

</div>

They say the cars can detect unmapped stop signs now. I’m wondering what would happen if I placed a red sign in my front yard that was able to fool the cars but didn’t look exactly like a stop sign to humans (including humans wearing badges). That will be good for an afternoon of laughs. There will be lots of mischief once these things become mainstream.

---

<div class="post-metadata">

**Author:** ![jz78817](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jz78817/32/1028_2.png) [@jz78817](https://boards.straightdope.com/u/jz78817)\
**Post date:** [April 3, 2016, 10:56am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/9 "2016-04-03T10:56:33Z")

</div>

> [@core](#):
>
> They say the cars can detect unmapped stop signs now. I’m wondering what would happen if I placed a red sign in my front yard that was able to fool the cars but didn’t look exactly like a stop sign to humans (including humans wearing badges). That will be good for an afternoon of laughs. There will be lots of mischief once these things become mainstream.

Yeah, but a stop sign is an easily recognizable form. A red light is just a glowing red light.

---

<div class="post-metadata">

**Author:** ![Mijin](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mijin/32/9369_2.png) [@Mijin](https://boards.straightdope.com/u/Mijin)\
**Post date:** [April 3, 2016, 11:07am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/10 "2016-04-03T11:07:49Z")

</div>

Also of course if someone wanted to screw around with traffic and potentially cause accidents there are plenty of ways you could do it with human drivers.  
Fortunately the pointlessness and risk of getting caught is enough deterrent it seems.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [April 3, 2016, 12:02pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/11 "2016-04-03T12:02:57Z")

</div>

Another point: Just because something is a problem that Google’s engineers are attempting to solve does _not_ mean that it’s something that human drivers have already solved. For instance, those cites say that self-driving cars have a hard time distinguishing between harmless trash which can be safely hit, and solid objects that must be veered around. This may be true, but human drivers have a hard time with that, too. The difference is, since the car can make use of radar and sonar data in addition to vision (and lidar), there’s a chance that the self-driving cars _will_ be able to solve that problem, and so, since they can solve the problem, they’re doing so.

On the topic at hand, I’d be interested to know how often human drivers fail to notice a new temporary traffic signal on a previously-familiar route.

---

<div class="post-metadata">

**Author:** ![Schnitte](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/schnitte/32/9033_2.png) [@Schnitte](https://boards.straightdope.com/u/Schnitte)\
**Post date:** [April 3, 2016, 12:15pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/12 "2016-04-03T12:15:12Z")

</div>

> [@Chronos](#):
>
> Another point: Just because something is a problem that Google’s engineers are attempting to solve does _not_ mean that it’s something that human drivers have already solved. For instance, those cites say that self-driving cars have a hard time distinguishing between harmless trash which can be safely hit, and solid objects that must be veered around. This may be true, but human drivers have a hard time with that, too. The difference is, since the car can make use of radar and sonar data in addition to vision (and lidar), there’s a chance that the self-driving cars _will_ be able to solve that problem, and so, since they can solve the problem, they’re doing so.
> 
> On the topic at hand, I’d be interested to know how often human drivers fail to notice a new temporary traffic signal on a previously-familiar route.

This is IMHO, but I second your point completely. When I follow the ongoing discussion about autonomous cars, I find it remarkable how much the strictness with which we assess the capabilities of autonomous cars differ from those with which we assess the capabilities of human drivers. In my experience, most human drivers vastly overestimate their own driving skills; they may have decades of accident-free driving, but that can just as much be due to lack as opposed to superior skills. As soon as an autonomous car causes an accident that kills a human (and that will happen sooner or later), there will be a huge outcry, but apparently we’re very much fine with the thousands of people killed by human drivers every year.

---

<div class="post-metadata">

**Author:** ![Dewey\_Finn](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dewey_finn/32/4222_2.png) [@Dewey\_Finn](https://boards.straightdope.com/u/Dewey_Finn)\
**Post date:** [April 3, 2016, 2:15pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/13 "2016-04-03T14:15:05Z")

</div>

Another issue aside from unmapped streetlights is the [lack of lane markings on many US streets](http://www.nytimes.com/reuters/2016/03/31/business/31reuters-autos-autonomous-infrastructure-insight.html).

---

<div class="post-metadata">

**Author:** ![Musicat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/musicat/32/20189_2.png) [@Musicat](https://boards.straightdope.com/u/Musicat)\
**Post date:** [April 3, 2016, 3:21pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/14 "2016-04-03T15:21:59Z")

</div>

> [@Dewey\_Finn](#):
>
> Another issue aside from unmapped streetlights is the [lack of lane markings on many US streets](http://www.nytimes.com/reuters/2016/03/31/business/31reuters-autos-autonomous-infrastructure-insight.html).

If a car can’t handle roads without lane markings, that eliminates 90% of the roads near me. Rural roads don’t have center lines or edge markers, and they can be narrow.

Conversely, one road near me that _does_ have a center marker would be a bad place for a self-driving car, as any self-respecting self-driving car would try to stay in a lane, and to do so on this very winding road would require slowing way down or squealing around the many corners. Since there is very little traffic, human drivers just cut across the lane markers, and if vision lines are good, drive in the middle of the road, straddling the line.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [April 3, 2016, 7:36pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/15 "2016-04-03T19:36:38Z")

</div>

Also, you know how you know the timing for most of the lights on your daily routine? Like, you know that if you make it through one light halfway through its green cycle, you’ll just barely catch the next one red, or there are three in a row on this street that all change at the same time? Well, Google knows that about very nearly every traffic light in the civilized world, thanks to their army of over a billion route-testers.

---

<div class="post-metadata">

**Author:** ![chappachula](https://avatars.discourse-cdn.com/v4/letter/c/d2c977/32.png) [@chappachula](https://boards.straightdope.com/u/chappachula)\
**Post date:** [April 4, 2016, 11:19am UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/16 "2016-04-04T11:19:53Z")

</div>

> [@Chronos](#):
>
> Well, Google knows that about very nearly every traffic light in the civilized world.

But what about the non-civilized world?  
For example, the construction site on my street last week.

They put up a temporary traffic light for a few days while they worked. It was a regular traffic light, but mounted on a shorter-than-average wooden pole, and the pole wasn’t verticle. It leaned a bit, supported by a barrel of cement in an awkward location, marked by a few pylons that you had to swerve around.

---

<div class="post-metadata">

**Author:** ![RivkahChaya](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rivkahchaya/32/8919_2.png) [@RivkahChaya](https://boards.straightdope.com/u/RivkahChaya)\
**Post date:** [April 4, 2016, 12:08pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/17 "2016-04-04T12:08:36Z")

</div>

I don’t think self-driving cars are to the point where you can sleep behind the wheel. I think you still have to act as a fail-safe for the system. Otherwise, people could get in their cars drunk, or sit behind the wheel playing Tetris on their phones, or you could stick your kid in the back seat, and send them somewhere, and we’re not there yet.

Probably something that could really mess up a self-driving car is a street light that is out. If the car knows the light is there, but can’t get any color signal from it, it may treat it as a stop sign, but more likely, it will stop and just wait for the signal.

Another thing that going to be really tough for self-driving cars is construction sites where it’s one lane for a short stretch, and there are those guys with the “stop/slow” signs that let you know when you can use the single lane.

If I sat here for a while, I could come up with lots of things that are examples of why there still needs to be a licensed, sober driver behind the wheel of a self-driving car.

---

<div class="post-metadata">

**Author:** ![SmartAlecCat](https://avatars.discourse-cdn.com/v4/letter/s/67e7ee/32.png) [@SmartAlecCat](https://boards.straightdope.com/u/SmartAlecCat)\
**Post date:** [April 4, 2016, 12:16pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/18 "2016-04-04T12:16:51Z")

</div>

I suspect even before autonomous cars become ubiquitous, we’ll have more smaller scale traffic innovations, including traffic lights and roads that communicate directly with cars. Those will improve driving safety for human drivers now and enable better and easier computer driving later.

---

<div class="post-metadata">

**Author:** ![jtur88](https://avatars.discourse-cdn.com/v4/letter/j/e9c0ed/32.png) [@jtur88](https://boards.straightdope.com/u/jtur88)\
**Post date:** [April 4, 2016, 1:20pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/19 "2016-04-04T13:20:27Z")

</div>

- “Our system has been deployed on multiple cars, and has provided  
reliable and timely information about the state of the traffic  
lights during thousands of drives through intersections” \*

Even the worst human driver drives through thousands of intersections without an accident. In a thousand urban miles, there are 8,000 intersections. To me, that is not a convincing reassurance. Driverless cars are useful only if they reduce accidents to near-zero, not just make a dent in the number.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [April 4, 2016, 1:32pm UTC](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031/20 "2016-04-04T13:32:44Z")

</div>

Driverless cars are useful if they make any reduction at all in the number of accidents. They’re even useful if they don’t change the accident rate, or even increase it slightly, because they also have the advantage of freeing up human time. What’s the advantage of having human-driven cars?

[Next page](https://boards.straightdope.com/t/how-do-self-driving-cars-deal-with-stoplights/751031.md?page=2)
