# Possibly the worst idea in history (giving ethics to robots)

**URL:** <https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297>\
**Category:** Great Debates\
**Created:** [May 22, 2009, 3:16pm UTC](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297 "2009-05-22T15:16:14Z")\
**Posts on this page:** 4\
**Page:** 5

<div class="post-metadata">

**Author:** ![tagos](https://avatars.discourse-cdn.com/v4/letter/t/bbe5ce/32.png) [@tagos](https://boards.straightdope.com/u/tagos)\
**Post date:** [May 26, 2009, 9:58am UTC](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297/81 "2009-05-26T09:58:12Z")

</div>

> [@DrCube](#):
>
> So at worst, half as many people die? Man, that’s horrible! But wait, maybe robots could minimize civilian deaths, thereby reducing the human death toll even further. Atrocious!

Given the propensity of the USA to wage unjust wars, barely constrained by the need to hide the body-bags, then yes - I have big problems with a technology that allows the USA to wage aggressive wars cost-free. And I see no way at all that robots would ‘reduce civilian deaths’.

---

<div class="post-metadata">

**Author:** ![BrainGlutton](https://avatars.discourse-cdn.com/v4/letter/b/82dd89/32.png) [@BrainGlutton](https://boards.straightdope.com/u/BrainGlutton)\
**Post date:** [May 26, 2009, 11:25pm UTC](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297/82 "2009-05-26T23:25:18Z")

</div>

Let’s not get ahead of ourselves. The question of autonomous fighting machines having ethics or not is irrelevant until we have intelligent machines. But we don’t **have** intelligent machines. We might **never** have intelligent machines. Strong AI is like controlled nuclear fusion, always ten years in the future.

---

<div class="post-metadata">

**Author:** ![begbert2](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/begbert2/32/3357_2.png) [@begbert2](https://boards.straightdope.com/u/begbert2)\
**Post date:** [May 26, 2009, 11:40pm UTC](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297/83 "2009-05-26T23:40:07Z")

</div>

> [@tagos](#):
>
> Given the propensity of the USA to wage unjust wars, barely constrained by the need to hide the body-bags, then yes - I have big problems with a technology that allows the USA to wage aggressive wars cost-free. And I see no way at all that robots would ‘reduce civilian deaths’.

Too late - a recent US government considered the use of human soldiers “cost free”\*.

- since you’re clearly not talking about monetary cost, since robots don’t grow on trees.

---

<div class="post-metadata">

**Author:** ![Dead\_Badger](https://avatars.discourse-cdn.com/v4/letter/d/848f3c/32.png) [@Dead\_Badger](https://boards.straightdope.com/u/Dead_Badger)\
**Post date:** [May 27, 2009, 11:55am UTC](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297/84 "2009-05-27T11:55:05Z")

</div>

> [@Grumman](#):
>
> At least with an autonomous robot, you can verify beforehand what it will and will not do.

Not so, unless you can exhaustively predict every conceivable situation it will confront, and can rely on its perception algorithms to reliably interpret these situations. This robotics PhD student can assure you that even were the former possible (and it’s not), we aren’t even close to the latter. The real world is so impossibly messy, our current sensory abilities so woefully under-equipped to perceive it and our software so laughably incapable of fully interpreting even the limited information our sensors can provide, that pretending we can fully predict what a robot will or will not do in a battlezone is almost criminally self-deceptive.

Secondly, a large problem with robotics isn’t in working out what the robot will do when everything is fine, but how it will fail. Most of our robotic techniques rely heavily on making massive assumptions about the domain in which a robot is operating, as this is the only thing that allows it to interpret the welter of sensor data with which it’s confronted. If these assumptions break down, behaviour can become completely unpredictable. Moreover, it’s frequently far from obvious (to the robot) that this has occurred, making the design of failsafe mechanisms incredibly tricky.

Certain domains present relatively clean sensory environments for drones. This is why UAVs have proven reasonably successful; they operate in a near-empty space, have a lot of easily-interpreted data from traditional avionics, and need only identify targets on a 2D plane. But even then the problem of distinguishing friendlies from targets is huge and intractable.

> [@BrainGlutton](#):
>
> Let’s not get ahead of ourselves. The question of autonomous fighting machines having ethics or not is irrelevant until we have intelligent machines. But we don’t have intelligent machines. We might never have intelligent machines.

Quite. This isn’t about imbuing machines with ethics at all (although the military would surely like us to think so, as it sounds vaguely worthy). It is about _humans_ taking the ethical choice to delegate life and death decisions to dumb algorithms.

[Previous page](https://boards.straightdope.com/t/possibly-the-worst-idea-in-history-giving-ethics-to-robots/497297.md?page=4)
