# Artificial Intelligence question.

**URL:** https://boards.straightdope.com/t/artificial-intelligence-question/439655
**Category:** Factual Questions
**Created:** [February 29, 2008, 5:31pm UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655 "2008-02-29T17:31:51Z")
**Posts on this page:** 9
**Page:** 5

<div class="post-metadata">

### Author: ![Voyager](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/voyager/32/133_2.png) [@Voyager](https://boards.straightdope.com/u/Voyager)
#### Post date: [March 4, 2008, 1:45am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/81 "2008-03-04T01:45:56Z")

</div>

[QUOTE=chorpler]  
Not really – clearly we have no idea what “consciousness” is or what it is about the brain that creates it. It’s just that with something relatively simple like a guy following simple rules to look something up a book or moving cards around (or a single neuron, for that matter) it seems intuitively obvious to say “No way can this be conscious or exhibit behavior that seems conscious,” and the Chinese Room concept relies on that intuition holding all the way up the chain to “Since none of the individual pieces is conscious, the whole can’t be conscious either.”

But when you get to a massively complex collection of simple things, that exhibits the ability to converse like a human being and convincingly argue that it **is** conscious, it’s not so easy to rely on intuition and say “That can’t possibly be conscious” anymore.  
[/QUOTE]

I think that when you get right down to it those who think AI is impossible on the basis of the Chinese Room concept are in some way saying that a “soul” or other thing not emergent from the hardware is the basis of intelligence. (I put soul in quotes because I am not saying this requires any sort of god belief.) Assuming you are not limiting the size or the interconnectedness of the things in the room, you could model the brain exactly, since the brain is clearly made up of components and interconnect. As mentioned above, the Chinese Room model does limit the interconnectedness. I don’t think you’re allowed to write new cards, for instance. But the deeper implication is that something non-physical has to be going on for intelligence to emerge.

As for complexity, too little makes intelligence impossible but more doesn’t guarantee it.

---

<div class="post-metadata">

### Author: ![chorpler](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chorpler/32/2888_2.png) [@chorpler](https://boards.straightdope.com/u/chorpler)
#### Post date: [March 4, 2008, 3:11am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/82 "2008-03-04T03:11:42Z")

</div>

[QUOTE=Voyager]  
I think that when you get right down to it those who think AI is impossible on the basis of the Chinese Room concept are in some way saying that a “soul” or other thing not emergent from the hardware is the basis of intelligence. (I put soul in quotes because I am not saying this requires any sort of god belief.) Assuming you are not limiting the size or the interconnectedness of the things in the room, you could model the brain exactly, since the brain is clearly made up of components and interconnect. As mentioned above, the Chinese Room model does limit the interconnectedness. I don’t think you’re allowed to write new cards, for instance. But the deeper implication is that something non-physical has to be going on for intelligence to emerge.

As for complexity, too little makes intelligence impossible but more doesn’t guarantee it.  
[/QUOTE]

I know there are plenty of people who think that, but I’m not sure that Searle is saying that – he says in **Are We Spiritual Machines?** that:

“Actual human brains cause consciousness by a series of specific neurobiological processes in the brain. The essential thing is to recognize that consciousness is a biological process like digestion, lactation, photosynthesis, or mitosis …”

and

“The brain is a machine, a biological machine to be sure, but a machine all the same. So the first step is to figure out how the brain does it and then build an artificial machine that has an equally effective mechanism for causing consciousness.”

and

“We know that brains cause consciousness with specific biological mechanisms…”

I don’t think Searle’s Chinese Room is intended to argue that something non-hardware-dependent or non-physical is needed for consciousness (although there are plenty of people who think that, and other authors in **Are We Spiritual Machines?** argue that, I’m sure, since the book is published by Intelligent Design advocates); I think it’s intended to illustrate that it’s possible to appear conscious without actually being conscious. But I think it fails miserably at this, and that Kurzweil is vastly more convincing than Searle. In response to Kurzweil saying that if a computer can convincingly make a case for its consciousness, then we should accept it as conscious, Searle actually makes the following argument:

> [@](#):
>
> I can already program my computer so that it says that it is conscious—i.e., it prints out “I am conscious”—and a good programmer can even program it so that it will carry on a rudimentary argument to the effect that it is conscious. But that has nothing to do with whether or not it really is conscious.

I remember reading that passage at the airport and thinking “Is he yanking my chain?”

---

<div class="post-metadata">

### Author: ![Voyager](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/voyager/32/133_2.png) [@Voyager](https://boards.straightdope.com/u/Voyager)
#### Post date: [March 4, 2008, 6:35am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/83 "2008-03-04T06:35:02Z")

</div>

[QUOTE=chorpler]  
I know there are plenty of people who think that, but I’m not sure that Searle is saying that – he says in **Are We Spiritual Machines?** that:

“Actual human brains cause consciousness by a series of specific neurobiological processes in the brain. The essential thing is to recognize that consciousness is a biological process like digestion, lactation, photosynthesis, or mitosis …”

and

“The brain is a machine, a biological machine to be sure, but a machine all the same. So the first step is to figure out how the brain does it and then build an artificial machine that has an equally effective mechanism for causing consciousness.”

and

“We know that brains cause consciousness with specific biological mechanisms…”

[/quote]

All reasonable. There are certainly many ways to implement something.

> [@](#):
>
> I remember reading that passage at the airport and thinking “Is he yanking my chain?”

The whole reason for the Turing test is that there is hardly any way of telling if anyone or anything is conscious. We might ask the computer about its thought processes in any desired depth. I don’t think anything that doesn’t do self examination can be conscious. The passage that you quoted illustrates that some people seem to have this reaction against any machine being called intelligent.

I don’t see the Chinese room having any purpose but what I mentioned. If it was somehow able to examine its own thought processes, why couldn’t it be conscious? There is an assumption that someone would be able to write cards for any eventuality, but by making one answer dependent on the last, and allowing say 10 choices each not that many steps, you can get more cards needed than atoms in the galaxy. So your intuition about it being a simplistic exercise is something I agree with.

---

<div class="post-metadata">

### Author: ![Digital\_Stimulus](https://avatars.discourse-cdn.com/v4/letter/d/aeb1de/32.png) [@Digital\_Stimulus](https://boards.straightdope.com/u/Digital_Stimulus)
#### Post date: [March 4, 2008, 7:06am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/84 "2008-03-04T07:06:06Z")

</div>

[QUOTE=Voyager]  
Did you see something that said something like plug an FPGA in and your problems are solved?  
[/quote]

Might as well have. The phrase “reconfigurable hardware” does inspire some nutty thoughts and excessive flights of fancy…

> [@](#):
>
> While it is true that in the long run all hardware fails, the question is if anyone is going to care when that happens. Your answer is different if you’re designing for a deep space probe or for the sound chip on a greeting card.

Well, that’s not quite right when we’re talking (dreaming?) about actual AI, right? At least, that is, AI that makes it out of a lab. I should think five 9s is a minimum goal; even better if it can be adaptively self-healing.

> [@](#):
>
> As for the reference, it is something I saw. I think it was at the Custom Integrated Circuits Conference, but I don’t see a paper that rings a bell.

That sort of confirms **alterego** ’s ref; I’ll look into it. (Amazing what one can find on the IBM site…I’ll have to set aside a couple hours, as I know I’ll get distracted by unrelated stuff.)

---

<div class="post-metadata">

### Author: ![alterego](https://avatars.discourse-cdn.com/v4/letter/a/6bbea6/32.png) [@alterego](https://boards.straightdope.com/u/alterego)
#### Post date: [March 4, 2008, 7:42am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/85 "2008-03-04T07:42:55Z")

</div>

For some reason locating this was a real strain on my Google Fu! But here it is: IBM’s [eFuse](http://en.wikipedia.org/wiki/EFUSE). Somewhat surprisingly, this tech seems to have made it into the Xbox 360.

---

<div class="post-metadata">

### Author: ![chorpler](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chorpler/32/2888_2.png) [@chorpler](https://boards.straightdope.com/u/chorpler)
#### Post date: [March 4, 2008, 8:18am UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/86 "2008-03-04T08:18:40Z")

</div>

[QUOTE=Voyager]  
All reasonable. There are certainly many ways to implement something.  
[/quote]

Reasonable, although he’s just assuming that something special in neurons creates consciousness, whereas Kurzweil argues that it’s an emergent pattern. But I was quoting those to show that he isn’t arguing for a non-physical soul, but for something neurons do to create consciousness.

> [@](#):
>
> The whole reason for the Turing test is that there is hardly any way of telling if anyone or anything is conscious. We might ask the computer about its thought processes in any desired depth. I don’t think anything that doesn’t do self examination can be conscious. The passage that you quoted illustrates that some people seem to have this reaction against any machine being called intelligent.

Indeed. But his argument was basically “Kurzweil said a machine that claims to be conscious should be believed, but I can make my computer say that right now by typing PRINT “I AM CONSCIOUS” in my BASIC interpreter and running the program, so it means nothing!” Which is such a ludicrously stupid version of what Kurzweil actually said that I get the impression Searle is trying to pull a fast one, hoping we won’t notice that he entirely left out the part about the imagined machine having to argue for its own consciousness **convincingly** , not just display “I AM CONSCIOUS.”

> [@](#):
>
> I don’t see the Chinese room having any purpose but what I mentioned. If it was somehow able to examine its own thought processes, why couldn’t it be conscious? There is an assumption that someone would be able to write cards for any eventuality, but by making one answer dependent on the last, and allowing say 10 choices each not that many steps, you can get more cards needed than atoms in the galaxy. So your intuition about it being a simplistic exercise is something I agree with.

As I understand it, the purpose isn’t to argue for the necessity of some kind of soul, but to argue that if you created a neural network (or whatever) on a computer that learned to act like a human and even eventually passed the Turing test, it wouldn’t necessarily be conscious, because there’s something special about neurons that creates consciousness that a neural network wouldn’t have, no matter how conscious it seemed.

Again, I just don’t buy this – I think if a thing convincingly seems conscious, it almost certainly must actually _be_ conscious. The Turing test would, therefore, be sufficient (although not necessary) evidence for consciousness for me. If Searle is right about there being something in neurons that is required for true consciousness, then I expect no simulated-on-traditional-hardware AI could ever behave as if it were conscious.

---

<div class="post-metadata">

### Author: ![Voyager](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/voyager/32/133_2.png) [@Voyager](https://boards.straightdope.com/u/Voyager)
#### Post date: [March 4, 2008, 5:34pm UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/87 "2008-03-04T17:34:58Z")

</div>

[QUOTE=chorpler]  
Reasonable, although he’s just assuming that something special in neurons creates consciousness, whereas Kurzweil argues that it’s an emergent pattern. But I was quoting those to show that he isn’t arguing for a non-physical soul, but for something neurons do to create consciousness.

[/quote]

Ah. Kind of like a hive mind thing, composed of neurons. That’s so bizarre I never considered it.

> [@](#):
>
> Indeed. But his argument was basically “Kurzweil said a machine that claims to be conscious should be believed, but I can make my computer say that right now by typing PRINT “I AM CONSCIOUS” in my BASIC interpreter and running the program, so it means nothing!” Which is such a ludicrously stupid version of what Kurzweil actually said that I get the impression Searle is trying to pull a fast one, hoping we won’t notice that he entirely left out the part about the imagined machine having to argue for its own consciousness **convincingly** , not just display “I AM CONSCIOUS.”

Haven’t these people ever heard of Eliza? That nonsense got dealt with when I was in college.

> [@](#):
>
> As I understand it, the purpose isn’t to argue for the necessity of some kind of soul, but to argue that if you created a neural network (or whatever) on a computer that learned to act like a human and even eventually passed the Turing test, it wouldn’t necessarily be conscious, because there’s something special about neurons that creates consciousness that a neural network wouldn’t have, no matter how conscious it seemed.
> 
> Again, I just don’t buy this – I think if a thing convincingly seems conscious, it almost certainly must actually _be_ conscious. The Turing test would, therefore, be sufficient (although not necessary) evidence for consciousness for me. If Searle is right about there being something in neurons that is required for true consciousness, then I expect no simulated-on-traditional-hardware AI could ever behave as if it were conscious.

But that is an assumption Searle makes but can never prove. If everyone saw a conversation with the Chinese room, and it seemed conscious, why not, just as easily, say the cards have that special something? And it still sounds like Searle is assuming a kind of soul, albeit one broken into little bits of soul. The extra something is added at the neuron level, not the brain level. So, I think I still feel what is going on here is a rejection of a purely physical explanation of consciousness.

---

<div class="post-metadata">

### Author: ![Digital\_Stimulus](https://avatars.discourse-cdn.com/v4/letter/d/aeb1de/32.png) [@Digital\_Stimulus](https://boards.straightdope.com/u/Digital_Stimulus)
#### Post date: [March 4, 2008, 11:42pm UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/88 "2008-03-04T23:42:49Z")

</div>

[QUOTE=alterego]  
I am unaware of a convincing argument that the brain is the only possible arrangement of matter in the universe that can achieve intelligence (or phenomenal consciousness, if that’s what floats your boat).  
[/quote]

Sure. But the nice thing about “brain” is that it provides an existence proof that intelligence can arise from matter (assuming one doesn’t posit supernatural forces). Since it’s the _only_ one we have at this point, it makes a good target.

> [@](#):
>
> An interesting article in Seed Magazine today discussing Henry Markram and the Blue Brain project: [Out of the Blue: Can a thinking, remembering, decision-making, biologically accurate brain be built from a supercomputer?](http://www.seedmagazine.com/news/2008/03/out_of_the_blue.php?page=all&p=y)

Busy day; thanks for that. I’ll read it when I get the chance, along with the eFuse reference.

---

<div class="post-metadata">

### Author: ![Digital\_Stimulus](https://avatars.discourse-cdn.com/v4/letter/d/aeb1de/32.png) [@Digital\_Stimulus](https://boards.straightdope.com/u/Digital_Stimulus)
#### Post date: [March 4, 2008, 11:50pm UTC](https://boards.straightdope.com/t/artificial-intelligence-question/439655/89 "2008-03-04T23:50:24Z")

</div>

…

[Previous page](https://boards.straightdope.com/t/artificial-intelligence-question/439655.md?page=4)
