# Question about AI and conciseness.

**URL:** <https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024>\
**Category:** Factual Questions\
**Created:** [January 22, 2010, 7:12pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024 "2010-01-22T19:12:48Z")\
**Posts on this page:** 13\
**Page:** 2

<div class="post-metadata">

**Author:** ![njtt](https://avatars.discourse-cdn.com/v4/letter/n/ecd19e/32.png) [@njtt](https://boards.straightdope.com/u/njtt)\
**Post date:** [January 24, 2010, 4:53am UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/21 "2010-01-24T04:53:01Z")

</div>

> [@CookingWithGas](#):
>
> Well, yes, a conscious mind is processing input from its surroundings but that doesn’t mean it’s the very definition of consciousness.

I never said it was the definition. I was objecting to your definition: “that’s what consciousness is, the awareness of self, not awareness of surroundings.” If you deny that at least some of the things of which people are conscious are the things in their surroundings then you are not talking about the phenomenon that everybody else is talking about.

> [@CookingWithGas](#):
>
> I don’t believe that consciousness has a scientifically testable definition today. IMHO it is partly a matter of science and partly a matter of philosophy. Therefore I am not making a claim, I am putting forth one model.

Definition is not the issue here. You made an empirical claim: that a brain cut off from all input and output could remain conscious. You can’t back it up. The experiment has not been done, and almost certainly cannot be done. I make the contrary empirical claim. I do not have the empirical evidence either but I have theoretical reasons for believing it, some of which I have tried to explain in my posts in this thread. I think you must have theoretical reasons for your claim too (since I know you do not have empirical ones), and I tried to articulate what I think they would have to be:

> [@CookingWithGas](#):
>
> You are putting words in my mouth. I’ve said nothing of the kind. In fact I reject wholesale the outmoded models of the “the man in the driver’s seat” that require something separate from the physical self to establish consciousness. I believe that consciousness is a physical process, not a metaphysical entity.

I am not surprised to hear that you are not a Cartesian dualist and that you think that consciousness is physical (so do I), but I did not assert that were. However, I think it is a reasonably safe bet that the theoretical reasons that lead you to think that a disconnected brain would be conscious amount to what I called Cartesian Materialism:

> [@](#):
>
> **njtt:**  
> the idea that it [consciousness] depends on something inside you - a ‘self’ if you like - that is real, but less than your physical organism as a whole. For Descartes that something was an immaterial soul. For modern Cartesian Materialists it is something-we-know-not-what in the brain.

It does not matter whether you believe that that _something_ might be a particular bunch of neurons, or a particular pattern of electrochemical activity in a bunch or neurons, or in the brain as a whole, or something else physical in there if you like. What makes it Cartesian, in the sense I intend, is that whatever it is, it is something inside you, that is, or can give rise to, consciousness in its own right, regardless of how it may or may not be able to interact with anything outside it. If you do not believe that, then I do not see how your claim that consciousness is possible in an isolated brain could be justified.

> [@CookingWithGas](#):
>
> Human consciousness requires something more than reactionary processing of external stimulus; much of that processing has been shown to fly under the radar of consciousness.

I do not disagree with that. I do not think it is to the point, though.

> [@CookingWithGas](#):
>
> It requires the ability to think abstractly, and consider the past and future, for example.

I do not see any reason to think that consciousness _requires_ those abilities. We have those abilities, but I do not see why there might not be animals that are unable to think abstractly or consider the past and future, but are nevertheless conscious (of the things around them that they are able to sense, for example).

> [@CookingWithGas](#):
>
> It is not necessary to have external stimulus to do these things; I can think about the nature of the cosmos, yesterday’s ball game, or my to-do list for tomorrow work day without a whit of external stimulus to do so. That is the basis for my “claim” that you could cut off input and still remain conscious.

Two points:  
First of all, you could not think about the cosmos, or a ball game, or a to-do list if you had never experienced, or heard about, or otherwise indirectly learned about all of those things from some external source. (Maybe you accept that, since you sem to agree that a brain that has never interacted with the external world might not be conscious.)

Secondly, although I certainly do not deny that you can think about a ball game, or whatever, when you are not currently experiencing a ball game, I do in fact deny that you have ever thought about anything when you are not experiencing anything at all external to your brain, or, indeed, when your brain is not interacting (back and forth) with many, many things external to it. When you are thinking about the ball game you are still seeing things, and hearing things, and probably doing things, and your brain is still regulating your body in all sorts of complex ways. It does not follow from the fact that you can think about things that are not present to you, that you could think about them if nothing whatsoever (including your own body) was present to you. What I am suggesting is that it may be the case that a brain that is not interacting with anything outside itself (a _very_ unnatural condition for a brain to be in) might not be able to be conscious of anything. It may be the case that brains alone (systems of interacting neurons, glia, etc.) are not sufficient support consciousness, but that it actually requires systems consisting of brains, bodies, and their surrounding environments. There is certainly no empirical evidence to the contrary. Furthermore, even if it could be shown that disconnected brains can be conscious in some way, such consciousness would undoubtedly be very different indeed from the conscious experience we richly interconnected human beings actually enjoy.

> [@CookingWithGas](#):
>
> The closest we are likely to come is the [sensory deprivation chamber](http://en.wikipedia.org/wiki/Sensory_deprivation), which for short-term use is reported to enhance meditation (certainly a conscious activity). (Longer use can have profound psychological effects but that in itself does not affect a theoretical discussion about the nature of consciousness.)

Yes, that may be the closest we are likely to come, but it is not very close at all to what I am talking about. It may cut the level of external stimulation down a lot, but it certainly cannot block _all_ external stimuli. Nor, I think, are you prevented from moving, and thus acting on the external world (even if it is only the warm water, or whatever, you are floating in). More importantly, it does not interfere at all with the brain’s continual, rich and multifarious interaction with the rest of the body. This is not the experiment you are looking for.

---

<div class="post-metadata">

**Author:** ![Half\_Man\_Half\_Wit](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/half_man_half_wit/32/21766_2.png) [@Half\_Man\_Half\_Wit](https://boards.straightdope.com/u/Half_Man_Half_Wit)\
**Post date:** [January 24, 2010, 10:11am UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/22 "2010-01-24T10:11:47Z")

</div>

> [@RaftPeople](#):
>
> This is the person that created the proof, I’m not sure if it’s been validated or not:  
> [Hava Siegelmann - Wikipedia](http://en.wikipedia.org/wiki/Hava_Siegelmann)
> 
> Given that the brain appears to be a recurrent neural network, it would seem to imply that we can not simulate everything the brain does on a regular computer. Maybe.

Well, it’s easy to create theoretical machines that are capable of hypercomputation (Turing himself did it with his O-machines), but as far as I know, it’s not been shown that such devices are actually physically implementable. If I’m not mistaken, Siegelmann’s proposal is basically a kind of analog/real computation, which typically depends on being able to measure a physical quantity to arbitrary precision, something that generally runs into problems with thermal noise (or, even if you could eliminate that, into noise generated by quantum fluctuations).

---

<div class="post-metadata">

**Author:** ![Capt.Ridley\_s\_Shooting\_Party](https://avatars.discourse-cdn.com/v4/letter/c/cc9497/32.png) [@Capt.Ridley\_s\_Shooting\_Party](https://boards.straightdope.com/u/Capt.Ridley_s_Shooting_Party)\
**Post date:** [January 24, 2010, 3:49pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/23 "2010-01-24T15:49:08Z")

</div>

Exactly. Turing’s PhD thesis was on the subject of hypercomputation. We’ve know about models of hypercomputation for 60 years: just allow a UTM to call an oracle for the halting problem as a subprocedure. But coming up with a model means nothing unless you can actually demonstrate that hypercomputers actually exist “in the wild”.

---

<div class="post-metadata">

**Author:** ![The\_Tao\_s\_Revenge](https://avatars.discourse-cdn.com/v4/letter/t/73ab20/32.png) [@The\_Tao\_s\_Revenge](https://boards.straightdope.com/u/The_Tao_s_Revenge)\
**Post date:** [January 24, 2010, 4:32pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/24 "2010-01-24T16:32:12Z")

</div>

> [@Mangetout](#):
>
> Philosophically, there isn’t any way to know for sure whether something is experiencing consciousness or if it’s just dumbly but completely simulating all the outward signs of it.  
> This applies to you and me too - I know I have an internal thought life and sense of self, but I can’t be truly sure you have. Likewise you can’t be sure this wasn’t typed by a complex, but completely unthinking, non-experiencing automaton.

Yes but that’s the path to Solopism. Philosophically, you can’t be sure of anything other then “I think, therefore I am”.

I’d put fourth the counter argument that if it quacks, walks and learns like a duck you’ll be pretty safe assuming it’s a duck.

---

<div class="post-metadata">

**Author:** ![CookingWithGas](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cookingwithgas/32/485_2.png) [@CookingWithGas](https://boards.straightdope.com/u/CookingWithGas)\
**Post date:** [January 24, 2010, 5:53pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/25 "2010-01-24T17:53:35Z")

</div>

> [@The\_Tao\_s\_Revenge](#):
>
> Yes but that’s the path to Solopism. Philosophically, you can’t be sure of anything other then “I think, therefore I am”.
> 
> I’d put fourth the counter argument that if it quacks, walks and learns like a duck you’ll be pretty safe assuming it’s a duck.

Here’s a thought experiment which I first read about in Discover Magazine, but with unclear origins. I have edited out asides that reference the technical feasibility of actual performing this experiment, but that’s not really germane to this point.

> [@Jaron Lanier in Discover](#):
>
> Imagine a computer program that can simulate a neuron, or even a network of neurons…Now imagine a tiny wireless device that can send and receive signals to neurons in the brain…Replace one nerve in your brain with one of those wireless gadgets…Next, the artificial neuron will be connected over a wireless link to a simulation of a neuron in a nearby computer. Every neuron has unique chemical and structural characteristics that must be included in the program. Do the same with your remaining neurons…
> 
> Now for the big question: Are you still conscious after the process has been completed? Furthermore, because the computer is completely responsible for the dynamics of your brain, you can forgo the physical artificial neurons and let the neuron-control programs connect with each other through software alone. Does the computer then become conscious? If you believe in consciousness, is your consciousness now in the computer, or perhaps in the software?

I don’t have an answer, but with the “duck test” you would have consciousness.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [January 24, 2010, 7:06pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/26 "2010-01-24T19:06:37Z")

</div>

> [@Half\_Man\_Half\_Wit](#):
>
> Well, it’s easy to create theoretical machines that are capable of hypercomputation (Turing himself did it with his O-machines), but as far as I know, it’s not been shown that such devices are actually physically implementable. If I’m not mistaken, Siegelmann’s proposal is basically a kind of analog/real computation, which typically depends on being able to measure a physical quantity to arbitrary precision, something that generally runs into problems with thermal noise (or, even if you could eliminate that, into noise generated by quantum fluctuations).

True, and I should have pointed out that it’s not necessarily physically implementable, but it did seem like an interesting result that could imply that simulating the brain requires a different physical structure for the computer.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [January 24, 2010, 7:13pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/27 "2010-01-24T19:13:43Z")

</div>

> [@CookingWithGas](#):
>
> Here’s a thought experiment which I first read about in Discover Magazine, but with unclear origins. I have edited out asides that reference the technical feasibility of actual performing this experiment, but that’s not really germane to this point.
> 
> …
> 
> I don’t have an answer, but with the “duck test” you would have consciousness.

I personally believe that once the process is completed (if done properly, not as described), then yes the resulting software/hardware is conscious.

However, while the thought experiment gets the idea across, in reality you would need to take into account everything that impacts computation. The neurons are sitting in a vat of chemicals that impact communication, as well as electric fields doing the same (coordinating activities and being used as a medium for communication across large distances of physically unconnected neurons).

---

<div class="post-metadata">

**Author:** ![Nicolas\_Bourbaki](https://avatars.discourse-cdn.com/v4/letter/n/ecc23a/32.png) [@Nicolas\_Bourbaki](https://boards.straightdope.com/u/Nicolas_Bourbaki)\
**Post date:** [January 25, 2010, 1:57am UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/28 "2010-01-25T01:57:22Z")

</div>

> [@RaftPeople](#):
>
> It appears that there are things that can be computed by a recurrent neural network that can **not** be computed by a turing machine that is allowed to complete an infinite number of steps.
> 
> This is the person that created the proof, I’m not sure if it’s been validated or not:  
> [Hava Siegelmann - Wikipedia](http://en.wikipedia.org/wiki/Hava_Siegelmann)
> 
> Given that the brain appears to be a recurrent neural network, it would seem to imply that we can not simulate everything the brain does on a regular computer. Maybe.

From the Wikipedia article on hypercomputation:

> [@](#):
>
> In the early 1990s, Hava Siegelmann proposed a new computational model, the Artificial Recurrent Neural Network (ARNN), and proved that it could perform hypercomputation. It is based on evolving an artificial neural network through an infinite succession of states.

Given that I’m pretty sure the brain doesn’t go through an infinite succession of states, I would guess it’s not applicable.

---

<div class="post-metadata">

**Author:** ![jackdavinci](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jackdavinci/32/3259_2.png) [@jackdavinci](https://boards.straightdope.com/u/jackdavinci)\
**Post date:** [January 26, 2010, 7:50am UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/29 "2010-01-26T07:50:00Z")

</div>

People have made working calculators out of things like tinkertoys or legos so assuming a ridonkulous amount of mechanical parts you could do it.

The biggest problem, as some have mentioned, is that the reaction time to stumuli would be much much slower, so you could only simulate a really slow brain lol.

The idea that neural calculations are somehow unique seems painfully easy to refute since you can simulate any neural net using standard computation.

---

<div class="post-metadata">

**Author:** ![RaftPeople](https://avatars.discourse-cdn.com/v4/letter/r/6f9a4e/32.png) [@RaftPeople](https://boards.straightdope.com/u/RaftPeople)\
**Post date:** [January 26, 2010, 4:12pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/30 "2010-01-26T16:12:56Z")

</div>

> [@Nicolas Bourbaki](#):
>
> Given that I’m pretty sure the brain doesn’t go through an infinite succession of states, I would guess it’s not applicable.

The original article I read about the proof talked about a small network with arbitrary real number weights. It seemed to me that it would be possible that an analog system could have arbitrary real weights instead of a set of discrete values. But, maybe not, I’m not a mathematician/physicist, but it seemed like a pretty interesting result.

> [@jackdavinci](#):
>
> The idea that neural calculations are somehow unique seems painfully easy to refute since you can simulate any neural net using standard computation.

You can’t simulate an analog recurrent neural network with arbitrary real numbered weights as described in her proof. It can perform computations that are beyond the Turing limit. But it looks like this is really in theoretical mathematics land then in our brain.

---

<div class="post-metadata">

**Author:** ![MrDibble](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mrdibble/32/114_2.png) [@MrDibble](https://boards.straightdope.com/u/MrDibble)\
**Post date:** [January 28, 2010, 5:02am UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/31 "2010-01-28T05:02:06Z")

</div>

> [@Mangetout](#):
>
> Philosophically, there isn’t any way to know for sure whether something is experiencing consciousness or if it’s just dumbly but completely simulating all the outward signs of it.  
> This applies to you and me too - I know I have an internal thought life and sense of self, but I can’t be truly sure you have. Likewise you can’t be sure this wasn’t typed by a complex, but completely unthinking, non-experiencing automaton.

I’m with Dennett in that you can’t simulate consciousness without being in some way conscious. In other words, zombies don’t, and can’t, exist. Or we are all zombies, take your pick.

---

<div class="post-metadata">

**Author:** ![Silverstreak\_Wonder](https://avatars.discourse-cdn.com/v4/letter/s/a88e57/32.png) [@Silverstreak\_Wonder](https://boards.straightdope.com/u/Silverstreak_Wonder)\
**Post date:** [January 28, 2010, 2:53pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/32 "2010-01-28T14:53:26Z")

</div>

The first thing you need is a logic diagram showing what consciousness is, once you know the process then you would try to program it into a computer, and you could if you can say what the process is. I don’t think that can be done because has anyone ever made a diagram of just what it is to be self-aware, all the processes needed? That knowledge has to come first, then the program for those processes.

That is why I have always thought consciousness is what is referred to in scripture as being in the image of God. If you can duplicate it and invent a program which actually understands itself, that it knows it is a computer program, and has its own opinion about you, you will win every science prize on the planet. But to start, you need that logic diagram flowchart. first.

---

<div class="post-metadata">

**Author:** ![psychonaut](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/psychonaut/32/4655_2.png) [@psychonaut](https://boards.straightdope.com/u/psychonaut)\
**Post date:** [January 31, 2010, 1:19pm UTC](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024/33 "2010-01-31T13:19:29Z")

</div>

> [@Silverstreak\_Wonder](#):
>
> The first thing you need is a logic diagram showing what consciousness is, once you know the process then you would try to program it into a computer, and you could if you can say what the process is. I don’t think that can be done because has anyone ever made a diagram of just what it is to be self-aware, all the processes needed?

[Clearly you don’t hang out on Usenet very much.](http://www.nothingisreal.com/mentifex_faq.html)🙂

[Previous page](https://boards.straightdope.com/t/question-about-ai-and-conciseness/526024.md?page=1)
