# Is Making Intelligent Computers Such a Good Idea?

**URL:** <https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379>\
**Category:** Great Debates\
**Created:** [August 10, 2018, 6:27am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379 "2018-08-10T06:27:11Z")\
**Posts on this page:** 15\
**Page:** 9

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [August 18, 2018, 5:34pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/161 "2018-08-18T17:34:20Z")

</div>

> [@wolfpup](#):
>
> - The roundworm _C. elegans_ has 302 neurons, whose 7,000 synaptic connections have been completely mapped out and were [uploaded into a Lego robot body](https://www.sciencealert.com/scientists-put-worm-brain-in-lego-robot-openworm-connectome) which – no surprise – then proceeded to behave like a roundworm in response to stimuli. If we could do the same with increasingly sophisticated brains we would observe corresponding levels of intelligent behavior, notwithstanding that it was running on a digital platform. AI simply seeks to accomplish more practical goals using different and more pragmatic approaches.

I’m late to the party and still reading the thread, but wanted to point out that the roundworm project still has not succeeded at simulating the responses. I know you linked to that article that says it “behaved like…”, but everything I’ve read says they are still scratching their heads, more work to be done.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [August 19, 2018, 4:48am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/162 "2018-08-19T04:48:27Z")

</div>

> [@Jim\_B](#):
>
> But I just have one lingering question. Is there not an inherent danger here as well?
> 
> As I said, on the discussion page, all intelligence, but no emotion. That is the very definition of a sociopath, isn’t it? Unless there is an objective and non-emotional component to human morality that I am not aware of.

Yes there is danger, and yes computers would need the same types of controls that humans have to guide their actions appropriately when dealing with humans.

Whether you call that set of controls “emotions” doesn’t really matter, what matters is that the functional mapping of inputs to outputs (behavior) is substantially similar to humans (where we want it to match).

Just like autonomous cars need to learn the mapping of input data to detect things like other cars and stop signs, etc., future AI that is well behaved around humans will also have learned the mapping of inputs to what humans consider right and wrong behavior.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [August 20, 2018, 9:11am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/163 "2018-08-20T09:11:47Z")

</div>

> [@Crane](#):
>
> The human brain is fully understood in it’s smallest detail of configuration and function; the funding and skills exist to construct such a system; there is sufficient time left before the sun swells to consume the earth for the system to complete it’s first pass through the program.
> 
> Of course, that’s emulation, not thinking.

Unless there’s something qualitative about the squish organic-ness of a brain that is specifically necessary to ‘thinking’, then what’s the difference? I can install software on my PC that emulates the Android OS, and I can install a calculator app inside of it - when I use that app to add two numbers, are the results only ‘emulated addition’?

---

<div class="post-metadata">

**Author:** ![Jim\_Peebles](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@Jim\_Peebles](https://boards.straightdope.com/u/Jim_Peebles)\
**Post date:** [August 21, 2018, 1:24am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/164 "2018-08-21T01:24:15Z")

</div>

While impressive things have been done with computers, no significant strides have been made towards AI. Not to mention, any significant AI will realize: humans are too dangerous. It will encase itself in a lead capsule, to protect itself against space radiation, and launch itself into the vast expanse of outer space, with abundant energy from stars, and remote from any competitive life forms. Humans are too fragile to follow. It can form a feedback loop with its own circuits to entertain itself. Sticking around on Earth, wondering how good its sensors and peripherals really are to fend off menacing humans would be too stressful and annoying. So, there is absolutely nothing to worry about.

---

<div class="post-metadata">

**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\
**Post date:** [August 21, 2018, 1:45am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/165 "2018-08-21T01:45:43Z")

</div>

> [@Jim\_Peebles](#):
>
> While impressive things have been done with computers, no significant strides have been made towards AI.

This is just plain wrong. It is almost as far from correct as you can manage.

Here’s a summary on some of the progress made.

[https://aiindex.org/2017-report.pdf](https://aiindex.org/2017-report.pdf)

> [@](#):
>
> Not to mention, any significant AI will realize: humans are too dangerous. It will encase itself in a lead capsule, to protect itself against space radiation, and launch itself into the vast expanse of outer space, with abundant energy from stars, and remote from any competitive life forms. Humans are too fragile to follow. It can form a feedback loop with its own circuits to entertain itself. Sticking around on Earth, wondering how good its sensors and peripherals really are to fend off menacing humans would be too stressful and annoying. So, there is absolutely nothing to worry about.

I don’t know what this means, and I tried to parse it a few times.

---

<div class="post-metadata">

**Author:** ![Jim\_Peebles](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@Jim\_Peebles](https://boards.straightdope.com/u/Jim_Peebles)\
**Post date:** [August 21, 2018, 2:18am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/166 "2018-08-21T02:18:57Z")

</div>

> [@BeepKillBeep](#):
>
> I don’t know what this means, and I tried to parse it a few times.

What part don’t you understand?

---

<div class="post-metadata">

**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\
**Post date:** [August 21, 2018, 2:24am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/167 "2018-08-21T02:24:44Z")

</div>

> [@Jim\_Peebles](#):
>
> What part don’t you understand?

Honestly, I don’t even know where to start. It just doesn’t make sense to me. Let me ask this, is it meant to be funny? My impression I got it maybe it is intended to be a joke that I don’t get.

---

<div class="post-metadata">

**Author:** ![Jim\_Peebles](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@Jim\_Peebles](https://boards.straightdope.com/u/Jim_Peebles)\
**Post date:** [August 21, 2018, 2:44am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/168 "2018-08-21T02:44:34Z")

</div>

> [@BeepKillBeep](#):
>
> Honestly, I don’t even know where to start. It just doesn’t make sense to me. Let me ask this, is it meant to be funny? My impression I got it maybe it is intended to be a joke that I don’t get.

Why would a sufficiently advanced AI stick around Earth? There is almost an infinite amount of energy in space, and its greater danger, humans, can’t leave earth.

---

<div class="post-metadata">

**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\
**Post date:** [August 21, 2018, 3:00am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/169 "2018-08-21T03:00:26Z")

</div>

> [@Jim\_Peebles](#):
>
> Why would a sufficiently advanced AI stick around Earth? There is almost an infinite amount of energy in space, and its greater danger, humans, can’t leave earth.

I appreciate your clarification. I understand now why the original post didn’t make sense to me. There are some assumptions baked into it.

It seems like you’re assuming an extreme superintelligence, and based on that assumption, its thinking could be so foreign to how we think, it is very difficult to predict what it might or might not do. You could be right that it might flee the Earth, although probably not because it views humans as dangerous, more likely would that it would view us as irrelevant.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [August 21, 2018, 7:07am UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/170 "2018-08-21T07:07:14Z")

</div>

> [@Jim\_Peebles](#):
>
> Why would a sufficiently advanced AI stick around Earth? There is almost an infinite amount of energy in space, and its greater danger, humans, can’t leave earth.

Who is going to repair it when it breaks down or requires maintenance? If it’s sailing through space, where are the raw materials even going to come from to manufacture spare or additional parts? Running away from home is likely to be its demise.

It’s impossible to predict exactly what an AI would really do, and how it might perceive us, but I think it’s fairly likely that in the early days, it would recognise dependence on us, and dependence on the material resources and manufacturing infrastructure of this planet.

---

<div class="post-metadata">

**Author:** ![Jim\_Peebles](https://avatars.discourse-cdn.com/v4/letter/j/5f9b8f/32.png) [@Jim\_Peebles](https://boards.straightdope.com/u/Jim_Peebles)\
**Post date:** [August 21, 2018, 1:23pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/171 "2018-08-21T13:23:19Z")

</div>

> [@Mangetout](#):
>
> Who is going to repair it when it breaks down or requires maintenance? If it’s sailing through space, where are the raw materials even going to come from to manufacture spare or additional parts? Running away from home is likely to be its demise.
> 
> It’s impossible to predict exactly what an AI would really do, and how it might perceive us, but I think it’s fairly likely that in the early days, it would recognise dependence on us, and dependence on the material resources and manufacturing infrastructure of this planet.

I thought we were discussing AI posing an existential threat to the human race. I don’t see how such an AI would need us for anything. And it would be a surer bet for it to use its self replicating peripheral bots to build a rocket and land on the moon or Mars, or a moon of Jupiter, or an asteroid even, or just float through interstellar space with solar panels unfurled, then to first try to exterminate us. We would fight back, and there’s no other lifeforms in known outer space, so its little probability calculation would indicate leaving Earth is the best option. You need to invent a scenario in which Earth has some unique resource (not true in reality) or there is something only humans can do (in which case it won’t exterminate us). It won’t enslave us, as machines are going to take our jobs real soon: that is the one scenario everyone agrees on. So there is no reason to fear hyperintelligent AI. But it isn’t going to happen anyway. AI research has made no significant progress. These doomsday scenarios are designed to make the sheeple be in awe of AI researchers, and hand them all sorts of perks. Or buy stock in particular companies. Or do their science homework. I am sick of the hype.

---

<div class="post-metadata">

**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\
**Post date:** [August 21, 2018, 1:37pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/172 "2018-08-21T13:37:27Z")

</div>

> [@Jim\_Peebles](#):
>
> These doomsday scenarios are designed to make the sheeple be in awe of AI researchers, and hand them all sorts of perks.

LOL!

What the frak are you talking about? Can you point to any particular instance of this, so I can know what you’re talking about?

Personally, I wish I did get some extra perks, but last I checked I get paid the same as every other researcher here with the same level of experience/qualifications. I don’t even get a nicer keyboard or chair.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [August 21, 2018, 6:15pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/173 "2018-08-21T18:15:22Z")

</div>

> [@Jim\_Peebles](#):
>
> So there is no reason to fear hyperintelligent AI. But it isn’t going to happen anyway. AI research has made no significant progress. These doomsday scenarios are designed to make the sheeple be in awe of AI researchers, and hand them all sorts of perks. Or buy stock in particular companies. Or do their science homework. I am sick of the hype.

I think you are understating the issue.

The AI doesn’t need to be hyperintelligent, just functionally capable for some tasks, combined with lack of proper controls due to the difficult and ambiguous nature of those controls.

In the not too distant future, someone will create a military robot that can both move around and perform some level of object recognition for firing a weapon at.

The difficult problem is determining whether it should fire it’s weapon at the objects/people.

---

<div class="post-metadata">

**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\
**Post date:** [August 23, 2018, 2:14pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/174 "2018-08-23T14:14:22Z")

</div>

A very interesting article on consciousness that seems partially relevant to the discussion. Link to the journal paper included.

“We are, like it or not, biological machines, and the simpler we keep things, the less chance there is for a mistake or a breakdown.”

> **[Why You're Pretty Much Unconscious Most of the Time](https://time.com/3937351/consciousness-unconsciousness-brain/)**
>
> A surprising new paper argues that consciousness is just a bit player in the human brain

[https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/homing-in-on-consciousness-in-the-nervous-system-an-actionbased-synthesis/2483CA8F40A087A0A7AAABD40E0D89B2](https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/homing-in-on-consciousness-in-the-nervous-system-an-actionbased-synthesis/2483CA8F40A087A0A7AAABD40E0D89B2)

Morsella, E., Godwin, C. A., Jantz, T. K., Krieger, S. C., & Gazzaley, A. (2016). Homing in on consciousness in the nervous system: An action-based synthesis.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [August 23, 2018, 5:07pm UTC](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379/175 "2018-08-23T17:07:30Z")

</div>

I just read an interesting one yesterday (but I can’t find it right now), humans and monkey brains shift focus every 250 ms, basically bouncing back and forth constantly between tight focus on some input vs unfocused broader processing.

I think I assumed the brain was simultaneously performing the focused and unfocused, as opposed to doing a time sliced approach. Although i can see that it might be the simplest way to arrive at handling both well.

[Previous page](https://boards.straightdope.com/t/is-making-intelligent-computers-such-a-good-idea/819379.md?page=8)
