# Is Computer Self-Awareness Possible

**URL:** <https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787>\
**Category:** Great Debates\
**Created:** [May 22, 2011, 5:20pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787 "2011-05-22T17:20:58Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Whambulance](https://avatars.discourse-cdn.com/v4/letter/w/e9a140/32.png) [@Whambulance](https://boards.straightdope.com/u/Whambulance)\
**Post date:** [May 22, 2011, 5:20pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/1 "2011-05-22T17:20:58Z")

</div>

Will a human-built machine constructed of silicone etc. i.e., a traditionally built computer, ever achieve self-awareness (I am just trying to differentiate between some of the biological systems theorized as of late.)?

Not necessarily sapience or reasoning, but self-awareness in particular.  
If so or not, why?

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [May 22, 2011, 5:38pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/2 "2011-05-22T17:38:11Z")

</div>

Of course it’s possible. There’s nothing a meat brain can do that’s inherently impossible for a silicon brain. There’s a lot of things that we don’t understand _how_ a meat brain does it, but both kinds of brains are based on the same principles of physics.

Will it happen? Probably, eventually, if we don’t stop building computers first. But who knows when.

---

<div class="post-metadata">

**Author:** ![Der\_Trihs](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/der_trihs/32/233_2.png) [@Der\_Trihs](https://boards.straightdope.com/u/Der_Trihs)\
**Post date:** [May 22, 2011, 7:30pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/3 "2011-05-22T19:30:55Z")

</div>

Yes. It’s just like flight; the existence of birds demonstrated that heavier-than-air flight was possible centuries before we had any idea how to pull it off. By the same token, the existence of self aware organic brains demonstrates that self awareness is possible even if we can’t duplicate it yet. There’s nothing so physically exotic about the brain that there’s any reason to think its function can’t be artificially duplicated; it’s not made of neutronium or strange matter, just common elements.

---

<div class="post-metadata">

**Author:** ![Sage\_Rat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/sage_rat/32/399_2.png) [@Sage\_Rat](https://boards.straightdope.com/u/Sage_Rat)\
**Post date:** [May 22, 2011, 10:56pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/4 "2011-05-22T22:56:31Z")

</div>

Run a simulator which knows how to simulate basic physics and chemistry, model the womb and add some sperm, and just let it play out. We don’t need to understand how the brain works to make a brain, we just need to have enough RAM and CPU to be able to model a sufficient number of atoms.

---

<div class="post-metadata">

**Author:** ![MrDibble](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mrdibble/32/114_2.png) [@MrDibble](https://boards.straightdope.com/u/MrDibble)\
**Post date:** [May 23, 2011, 1:23pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/5 "2011-05-23T13:23:58Z")

</div>

I’m not convinced it’s all in the modelling. I think in order to be self-aware, a computer must have sensory input as well. It needs to learn to be self aware, just like, for instance, human babies aren’t born self-aware but acquire it.

---

<div class="post-metadata">

**Author:** ![WordMan](https://avatars.discourse-cdn.com/v4/letter/w/e8c25b/32.png) [@WordMan](https://boards.straightdope.com/u/WordMan)\
**Post date:** [May 23, 2011, 2:27pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/6 "2011-05-23T14:27:30Z")

</div>

How do you define self-awareness? If a computer is designed to evaluate all of the brute-force alternatives to a given set of events and it comes up with responses that mimic self-aware behaviors, when does mimicking morph into actual self-awareness, if ever?

I guess my point is: plenty of situations are coming where the distinctions will be meaningless.

Given our current approach to computer design we appear to be coming at more complex reasoning in computers in a way that is different than biological brains - we given computers an ability to “out brute force” the inductive approach of bio brains.

But we have so many examples where a digital tech is approaching an organic tech - so that in enough applications, the distinction is negligible.

So, to me, a better question is: what specific activities seem to cross the line into machines acting sufficiently self-aware?

- If robot-companions (servants/pets) become sufficiently responsive to an individual’s needs?
- If a “net bot construct” designed to facilitate chats and interactivity on a social website actually maintains a lead role vs. just getting the conversation started?

---

<div class="post-metadata">

**Author:** ![Dissonance](https://avatars.discourse-cdn.com/v4/letter/d/85f322/32.png) [@Dissonance](https://boards.straightdope.com/u/Dissonance)\
**Post date:** [May 23, 2011, 3:14pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/7 "2011-05-23T15:14:08Z")

</div>

Before I worked in programming computer self-awareness sounded plausible. I’ve since come to the conclusion that a computer is as likely to become sentient as a toaster is. The closest you could come is programming a computer to mimic self-awareness, but being able to do that doesn’t invoke the divine spark.

---

<div class="post-metadata">

**Author:** ![BrainGlutton](https://avatars.discourse-cdn.com/v4/letter/b/82dd89/32.png) [@BrainGlutton](https://boards.straightdope.com/u/BrainGlutton)\
**Post date:** [May 23, 2011, 3:17pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/8 "2011-05-23T15:17:10Z")

</div>

> [@Dissonance](#):
>
> Before I worked in programming computer self-awareness sounded plausible. I’ve since come to the conclusion that a computer is as likely to become sentient as a toaster is. The closest you could come is programming a computer to mimic self-awareness, but being able to do that doesn’t invoke the divine spark.

Do you have any reason to think “the divine spark” is not simply synonymous with “a very high degree of complexity”?

---

<div class="post-metadata">

**Author:** ![SimonMoon5](https://avatars.discourse-cdn.com/v4/letter/s/9f8e36/32.png) [@SimonMoon5](https://boards.straightdope.com/u/SimonMoon5)\
**Post date:** [May 23, 2011, 5:13pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/9 "2011-05-23T17:13:27Z")

</div>

> [@Dissonance](#):
>
> Before I worked in programming computer self-awareness sounded plausible. I’ve since come to the conclusion that a computer is as likely to become sentient as a toaster is.

I disagree. I think a computer is as likely to become sentient as an _abacus_ is.

A computer simply performs operations.

While it might be possible to artificially create something which is sentient, I seriously doubt that it is possible to accidentally create a device with the potential for sentience since it is very very hard to _intentionally_ create a device which is sentient (so hard that humans haven’t managed it yet).

---

<div class="post-metadata">

**Author:** ![Gagundathar](https://avatars.discourse-cdn.com/v4/letter/g/a183cd/32.png) [@Gagundathar](https://boards.straightdope.com/u/Gagundathar)\
**Post date:** [May 23, 2011, 5:17pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/10 "2011-05-23T17:17:13Z")

</div>

The way a brain works and the way a computer works are fundamentally different.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [May 23, 2011, 5:26pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/11 "2011-05-23T17:26:03Z")

</div>

A brain simply performs operations, too. We have pretty much complete understanding of how a neuron works, and we can accurately simulate neurons with computers.

Quoth **MrDibble** :

> [@](#):
>
> I’m not convinced it’s all in the modelling. I think in order to be self-aware, a computer must have sensory input as well. It needs to learn to be self aware, just like, for instance, human babies aren’t born self-aware but acquire it.

OK, I’ll grant that. But there’s no reason a computer can’t be built with sensory input, of most of the same sorts that humans have. The laptop I’m sitting in front of right now can be reasonably said to have sight, hearing, and touch, and if taste and smell are actually essential, then there’s probably some way to arrange those, too.

---

<div class="post-metadata">

**Author:** ![Bytegeist](https://avatars.discourse-cdn.com/v4/letter/b/9dc877/32.png) [@Bytegeist](https://boards.straightdope.com/u/Bytegeist)\
**Post date:** [May 23, 2011, 5:30pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/12 "2011-05-23T17:30:13Z")

</div>

[QUOTE=Dissonance]  
Before I worked in programming computer self-awareness sounded plausible. I’ve since come to the conclusion that a computer is as likely to become sentient as a toaster is. The closest you could come is programming a computer to mimic self-awareness, but being able to do that doesn’t invoke the divine spark.  
[/QUOTE]

No one’s proposing that a self-aware machine would be hosted on a Dell.

True AI might very well require things like (1) massive parallel processing, and (2) analog or non-discrete states and signals — the things that natural brains are made of. Also, some like Roger Penrose argue that the brain might depend on quantum mechanical effects, which ordinary computers don’t use (yet).

---

<div class="post-metadata">

**Author:** ![Dissonance](https://avatars.discourse-cdn.com/v4/letter/d/85f322/32.png) [@Dissonance](https://boards.straightdope.com/u/Dissonance)\
**Post date:** [May 23, 2011, 5:33pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/13 "2011-05-23T17:33:16Z")

</div>

> [@BrainGlutton](#):
>
> Do you have any reason to think “the divine spark” is not simply synonymous with “a very high degree of complexity”?

Yes. A computer is never going to have an original thought - or any thought for that matter. It will only ever do what it has been programmed to do, no matter how complex that may be.

---

<div class="post-metadata">

**Author:** ![Dissonance](https://avatars.discourse-cdn.com/v4/letter/d/85f322/32.png) [@Dissonance](https://boards.straightdope.com/u/Dissonance)\
**Post date:** [May 23, 2011, 5:43pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/14 "2011-05-23T17:43:26Z")

</div>

> [@Bytegeist](#):
>
> No one’s proposing that a self-aware machine would be hosted on a Dell.
> 
> True AI might very well require things like (1) massive parallel processing, and (2) analog or non-discrete states and signals — the things that natural brains are made of. Also, some like Roger Penrose argue that the brain might depend on quantum mechanical effects, which ordinary computers don’t use (yet).

How does any of this lead to sentience? Normally skeptical people accept a lot of woo when it comes to AI; it’s the same desire to create life from the non-living as a golem or Frankenstein’s monster.

---

<div class="post-metadata">

**Author:** ![RTFirefly](https://avatars.discourse-cdn.com/v4/letter/r/c77e96/32.png) [@RTFirefly](https://boards.straightdope.com/u/RTFirefly)\
**Post date:** [May 23, 2011, 5:58pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/15 "2011-05-23T17:58:41Z")

</div>

> [@Chronos](#):
>
> A brain simply performs operations, too. We have pretty much complete understanding of how a neuron works, and we can accurately simulate neurons with computers.

Hmmm…has anyone managed to create a computer that gets upset at the idea that you might permanantly turn it off?

I could see the possibility of a computer being self-aware in some way. But the true miracle of the animal kingdom seems to me to be this matter of _volition_, and it’s certainly not just a human thing. A mosquito, at least at some primitive level of mosquito consciousness and intellect, _cares_ whether I swat it or not, and will try its damnedest to get a meal out of me without being swatted. The computer I’m sitting in front of, not so much.

---

<div class="post-metadata">

**Author:** ![WordMan](https://avatars.discourse-cdn.com/v4/letter/w/e8c25b/32.png) [@WordMan](https://boards.straightdope.com/u/WordMan)\
**Post date:** [May 23, 2011, 6:12pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/16 "2011-05-23T18:12:30Z")

</div>

> [@Gagundathar](#):
>
> The way a brain works and the way a computer works are fundamentally different.

Yes - hence my re-framing of the OP: at what point will a computer’s ability to replicate self-aware behavior become close enough, within the execution of some functions, that the distinction becomes negligle?

---

<div class="post-metadata">

**Author:** ![tim314](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tim314/32/3468_2.png) [@tim314](https://boards.straightdope.com/u/tim314)\
**Post date:** [May 23, 2011, 6:14pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/17 "2011-05-23T18:14:08Z")

</div>

Even if you built a computer that responded exactly like a human being to every possible stimulus, I’m not sure that this would necessarily imply sentience. I.e., I think it’s possible in principle that a computer could be indistinguishable from a sentient being without actually being sentient – a [philosophical zombie](http://en.wikipedia.org/wiki/Philosophical_zombie). I’m not saying it necessarily _would_ be that, but it’s possible (or at least, I can’t say with certainty that it’s impossible).

Some will say “indistinguishable from sentience” = “sentience”, but I’m not convinced. I have direct awareness of my own sentience, but as far as I know everyone else in the world could merely be an automaton who both perfectly duplicates the appearance of sentience, and falsely reports having direct awareness of their own sentience, without actually having it. I _assume_ everyone else is as truly sentient as me, because the alternative is to assume that I occupy a privileged position in the universe, which I think is unlikely. With a computer, whose origins and inner workings are drastically different than my own, I have less reason to trust this assumption.

---

<div class="post-metadata">

**Author:** ![Bytegeist](https://avatars.discourse-cdn.com/v4/letter/b/9dc877/32.png) [@Bytegeist](https://boards.straightdope.com/u/Bytegeist)\
**Post date:** [May 23, 2011, 6:32pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/18 "2011-05-23T18:32:13Z")

</div>

> [@Dissonance](#):
>
> How does any of this lead to sentience?

If I knew the details of that, I could quit my day job.

> [@](#):
>
> Normally skeptical people accept a lot of woo when it comes to AI; it’s the same desire to create life from the non-living as a golem or Frankenstein’s monster.

If you believe that sentience requires some sort of “divine spark”, some non-physical thing in addition to the physical, then yes, you’d conclude man-made AI is impossible. The discussion is pretty much over then.

But aside from appealing to our ignorance about where exactly consciousness comes from, there’s no reason to think that our minds are anything other than the result of brain activity — purely physical brain activity. And if Mother Nature, through natural selection, could find out how to make a sentient being out of physical parts, it’s at least plausible we could figure it out too, especially since we’re going about it deliberately.

I’ll grant you that actually inventing AI might very well turn out to be a monstrous, Frankenstein-ish mistake. Of course that didn’t stop us from inventing nuclear weapons either. We as a species aren’t exactly known for our caution or long-term thinking. I was just addressing what’s _possible_, not what’s wise or useful.

---

<div class="post-metadata">

**Author:** ![Bytegeist](https://avatars.discourse-cdn.com/v4/letter/b/9dc877/32.png) [@Bytegeist](https://boards.straightdope.com/u/Bytegeist)\
**Post date:** [May 23, 2011, 6:48pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/19 "2011-05-23T18:48:57Z")

</div>

> [@RTFirefly](#):
>
> I could see the possibility of a computer being self-aware in some way. But the true miracle of the animal kingdom seems to me to be this matter of _volition_, and it’s certainly not just a human thing. A mosquito, at least at some primitive level of mosquito consciousness and intellect, _cares_ whether I swat it or not, and will try its damnedest to get a meal out of me without being swatted. The computer I’m sitting in front of, not so much.

I’m not so sure there’s any self-awareness in that mosquito. Insects are capable of some pretty elaborate behavior which, when tested, turns out to be very rigid and computer-like. (Witness the [digger wasp](http://www.personalityresearch.org/evolutionary/sphexishness.html) for example.) A mosquito might be no more aware than a chess game that “wants” to win at chess, and acts in all ways to protect its king from checkmate, but which we can be pretty sure has no real volition.

---

<div class="post-metadata">

**Author:** ![Zeriel](https://avatars.discourse-cdn.com/v4/letter/z/58956e/32.png) [@Zeriel](https://boards.straightdope.com/u/Zeriel)\
**Post date:** [May 23, 2011, 6:49pm UTC](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787/20 "2011-05-23T18:49:28Z")

</div>

> [@Gagundathar](#):
>
> The way a brain works and the way a computer works are fundamentally different.

And is that going to be true forever?

[Next page](https://boards.straightdope.com/t/is-computer-self-awareness-possible/582787.md?page=2)
