# AIs getting confused

**URL:** <https://boards.straightdope.com/t/ais-getting-confused/960254>\
**Category:** Factual Questions\
**Tags:** ai\
**Created:** [February 28, 2022, 9:18pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254 "2022-02-28T21:18:58Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![Schnitte](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/schnitte/32/9033_2.png) [@Schnitte](https://boards.straightdope.com/u/Schnitte)\
**Post date:** [March 1, 2022, 4:18pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/21 "2022-03-01T16:18:59Z")

</div>

Well, do you ever watch YouTube videos that you’ve seen before? I know I do, for instance because I often let music videos from YouTube run in the background, and I have some favourites there. So the algorithms have, presumably, learnt about me that having watched a video is not a reason for not them not to recommend it to me. I agree with you that it would be a sign of bad performance on the algorithms’ part if they recommended you a video that you’ve seen before even though you never re-watch anything; so my guess is that, as a matter of fact, you do re-watch videos more frequently than you think you remember you do.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 1, 2022, 4:24pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/22 "2022-03-01T16:24:32Z")

</div>

This does not fit with my own (non-technical) experience of machine learning - for example with text to image GANs, one can ask for (and sometimes receive) things like ‘A tortoise on toast’ and as long as the algorithm has been sufficiently trained with tortoises, toast, and ‘things ON things’, it will have a go at composing it. Not always successfully, but with enough success to make me believe that there is some generalisable learning.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 1, 2022, 4:25pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/23 "2022-03-01T16:25:19Z")

</div>

I mean, for example, look at this:

> **[DALL·E: Creating Images from Text](https://openai.com/blog/dall-e/)**
>
> We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language.

---

<div class="post-metadata">

**Author:** ![Schnitte](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/schnitte/32/9033_2.png) [@Schnitte](https://boards.straightdope.com/u/Schnitte)\
**Post date:** [March 1, 2022, 4:27pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/24 "2022-03-01T16:27:16Z")

</div>

> [@naita](#):
>
> And all we have then is a narrow mimicry of one particular task humans can do.

I agree that AI is narrower than human intelligence; but it keeps getting wider. An example for that is the fusion of speech recognition and automatic translation. Both are things that have been worked on for a long time in AI, and algorithms to do either have been around for decades (though with poor results in the early years). Both are, in themselves, a narrow mimicry of one particular task humans can do. But take a reasonably well functioning speech recognition system and a reasonably well functioning translation system, combine them, and voilà, you have an app which, in real time, interprets spoken language from one language to another. Which is still relatively narrow, compared to the overall range of tasks humans can do, but it’s wider than either of the two before they were combined. In the next decades, we’ll see a lot of those mergers of previously separate algorithms to widen the range of human tasks that can be performed algorithmically.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 1, 2022, 4:31pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/25 "2022-03-01T16:31:52Z")

</div>

> [@naita](#):
>
> And all we have then is a narrow mimicry of one particular task humans can do. To me that is an algorithm, and not an intelligence. Though I freely admit that “an intelligence” is a concept I find it exceedingly hard to conceive of a valid test for.

If we were to distil it down though, is that not true of many things humans do? I’m able to speak  
because I learned to mimic what my parents could already do. That mimicry is happening because of processes in my brain that are just processes.

---

<div class="post-metadata">

**Author:** ![Sage\_Rat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/sage_rat/32/399_2.png) [@Sage\_Rat](https://boards.straightdope.com/u/Sage_Rat)\
**Post date:** [March 1, 2022, 4:52pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/26 "2022-03-01T16:52:47Z")

</div>

I’ll just add that there’s nothing to stop Google from including a button that let’s you inform the AI that it did it wrong. If they did, the AI would be able to continue learning and improving.

The problem with that, though, is incidents like these:

> **[Microsoft shuts down AI chatbot after it turned into a Nazi](https://www.cbsnews.com/news/microsoft-shuts-down-ai-chatbot-after-it-turned-into-racist-nazi/)**
>
> ​Microsoft's attempt to engage with millennials went badly awry within 24 hours

> **[Another AI chatbot shown spouting offensive views](https://techcrunch.com/2017/10/24/another-ai-chatbot-shown-spouting-offensive-views/)**
>
> Yandex, Russia's homegrown Google rival -- which offers a suite of similar products in its target non-U.S. markets, from search to webmail to maps -- outed another equivalent offering earlier this month: An AI assistant.

When the AI is trainable by users, some users will take advantage of that and teach it to do the wrong thing.

Crowdsourcing the teaching could (in theory) be immensely quick and powerful, for creating near-perfect AIs. But, in the real world, the companies have to generate their own training data and that means hiring people to sit in a room and generate examples, then have another group go through and sift through that to remove anything problematic, and then have another group go through to make sure that there wasn’t any [unconscious bias](https://research.aimultiple.com/ai-bias/) put in through sample selection, etc. This results in you having a fairly small set of training data and thus having an AI that can’t act correctly under all scenarios.

---

<div class="post-metadata">

**Author:** ![md-2000](https://avatars.discourse-cdn.com/v4/letter/m/9d8465/32.png) [@md-2000](https://boards.straightdope.com/u/md-2000)\
**Post date:** [March 1, 2022, 6:47pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/27 "2022-03-01T18:47:26Z")

</div>

This reminds me of the news article from about 2002 “Help! My TIVO Thinks I’m Gay!”

Apparently by setting it to record _Will and Grace_ his TIVO started suggesting and pre-recording dozens of gay-themed TV shows. There’s a follow-up article on how to do an intervention on your TIVO.

---

<div class="post-metadata">

**Author:** ![jjakucyk](https://avatars.discourse-cdn.com/v4/letter/j/3d9bf3/32.png) [@jjakucyk](https://boards.straightdope.com/u/jjakucyk)\
**Post date:** [March 1, 2022, 7:03pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/28 "2022-03-01T19:03:38Z")

</div>

> [@Schnitte](#):
>
> Well, do you ever watch YouTube videos that you’ve seen before?

Occasionally, but not 10 minutes or even days later, more like months. I swear I’ll finish watching a video, go back to the homepage, and there it is in the recommendations. Useless. Now at some point the red bar disappears from videos you have watched before. I’m not sure how the algorithm handles that.

---

<div class="post-metadata">

**Author:** ![BigT](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bigt/32/12044_2.png) [@BigT](https://boards.straightdope.com/u/BigT)\
**Post date:** [March 1, 2022, 7:16pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/29 "2022-03-01T19:16:45Z")

</div>

> [@Schnitte](#):
>
> This is, I think, not an accurate description. It’s true that the online giants like Google, Amazon and Facebook are primarily interested in you in order to make money off you; but their way of doing that is not simply by increasing engagement quantitatively. They also (or even primarily) want to improve engagement qualitatively, by giving you the content you’re interested in. Trainable AI that learns your preferences is used for this purpose.

YouTube sure doesn’t seem to be listening to my feedback about this. I just got 20 videos in a row I had already seen, many of which in the last 24 hours. I report them as “Not interested \> already seen it” because I was getting tired of so many of those, and now I get a lot more.

I’ve given feedback many times about how annoying this is, but YouTube seems to care as much about that as they do about their pornbot spam problem.

---

<div class="post-metadata">

**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\
**Post date:** [March 1, 2022, 8:02pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/30 "2022-03-01T20:02:00Z")

</div>

> [@naita](#):
>
> Yes, goalposts have been moved. In my opinion because the goals were bad goals. Intelligence to me requires generalizable knowledge.

I largely disagree with this. Goalposts have mostly been moved by self-styled AI skeptics, like the late Hubert Dreyfus who famously declared that computers would _ **never** _ (regardless of computing power) be able to play anything better than a very elementary child-like beginner level of chess. He had to eat his words and move the goalposts when he accepted a challenge and was himself soundly beaten by one of the earliest chess programs to demonstrate real skill and apparent strategy.

I disagree with the idea that intelligence requires generalizable knowledge. This sounds like a skeptic’s fallacy arising from an unwillingness to accept that intelligence in a narrow domain should be regarded as “true” intelligence, even when it’s effectively solving real intellectual problems. It seems to me that it’s more reasonable to establish _a priori_ that if some entity – whether human or machine – is capable of performing a certain task of reasoning that would be commonly regarded as requiring intelligence, then it should be deemed intelligent in that domain, whether human or machine. Otherwise the goalposts just keep moving forever and the whole argument becomes meaningless, simply a circular declaration that “if a machine does it, it’s not real intelligence”.

> [@naita](#):
>
> When talking about computers beating humans at chess futurists weren’t overestimating the complexity of chess, they were underestimating the power of a focused, brute force approach in a world of exponentially growing computer power.

I disagree with this, too. The skeptics weren’t “underestimating the power of a focused, brute force approach” as that’s not the way successful AI systems generally work. Indeed, the chess challenge that beat Dreyfus occurred in 1967, and ran on a DEC PDP-6, a machine first released in 1964. This machine was absurdly slow by modern standards. No, what the skeptics were underestimating was the power of heuristics and clever algorithms to dramatically trim the search tree when evaluating chess moves. More broadly, they failed to understand the potential of stored-program computers to effectively create the behaviours of human intelligence. There’s no question that faster computers have been a great boon to AI (lots of computer power was involved in creating the IBM Watson Jeopardy champion) but that’s just one factor of many.

Sorry for the digression, but I felt I should respond to those points.

---

<div class="post-metadata">

**Author:** ![naita](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/naita/32/5862_2.png) [@naita](https://boards.straightdope.com/u/naita)\
**Post date:** [March 1, 2022, 9:35pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/31 "2022-03-01T21:35:44Z")

</div>

> [@Mangetout](#):
>
> This does not fit with my own (non-technical) experience of machine learning - for example with text to image GANs, one can ask for (and sometimes receive) things like ‘A tortoise on toast’ and as long as the algorithm has been sufficiently trained with tortoises, toast, and ‘things ON things’, it will have a go at composing it. Not always successfully, but with enough success to make me believe that there is some generalisable learning.

To my mind text-to-image is a less complicated task than image description, at least by the success criteria it seems you are applying. The extent to which this “learning” is generalizable also seems to be built into the task. It seems my use of generalizable in the context I meant it isn’t generalizable to others. 😉

> [@Mangetout](#):
>
> If we were to distil it down though, is that not true of many things humans do? I’m able to speak  
> because I learned to mimic what my parents could already do. That mimicry is happening because of processes in my brain that are just processes.

Yes, but you aren’t limited to that one particular task and the mimicry was only part of the learning process. I’ve taught math for over a decade and find it a complete waste of my and my students’ time if they never move beyond rote repetition of an algorithm.

---

<div class="post-metadata">

**Author:** ![naita](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/naita/32/5862_2.png) [@naita](https://boards.straightdope.com/u/naita)\
**Post date:** [March 1, 2022, 9:45pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/32 "2022-03-01T21:45:47Z")

</div>

> [@wolfpup](#):
>
> This sounds like a skeptic’s fallacy arising from an unwillingness to accept that intelligence in a narrow domain should be regarded as “true” intelligence, even when it’s effectively solving real intellectual problems.

And this sounds like an unwillingness to accept that “intelligence” is a word like any other with varying definitions. To me intelligence is close to consciousness in vagueness and complexity and I don’t think it valid to _a priori_ establish tasks that could be completed that would show a system had one or the other. I think machine intelligence is much more likely than computer consciousness, but by how I think about the concept of intelligence, machines are nowhere near.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 1, 2022, 10:54pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/33 "2022-03-01T22:54:07Z")

</div>

> [@naita](#):
>
> To my mind text-to-image is a less complicated task than image description, at least by the success criteria it seems you are applying. The extent to which this “learning” is generalizable also seems to be built into the task. It seems my use of generalizable in the context I meant it isn’t generalizable to others. 😉

Text to image _requires_ image description as part of the process - that’s how GANs work - one algorithm is trying to make an image of ‘tortoise on toast’, while a competing algorithm criticises it for accuracy.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 1, 2022, 11:01pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/34 "2022-03-01T23:01:13Z")

</div>

> [@naita](#):
>
> Yes, but you aren’t limited to that one particular task and the mimicry was only part of the learning process. I’ve taught math for over a decade and find it a complete waste of my and my students’ time if they never move beyond rote repetition of an algorithm.

One selected aspect of me is not the whole of me. Never said it was. Machine learning can perform some feats of learning that are similar to some of the things that humans can do. The mistake is to imagine that they can only do things they are explicitly programmed to do - the ability is in the emergent properties of the learning.

But a machine that has learned to paint pictures isn’t going to suddenly get dissatisfied and decide to teach itself piano - that sort of generalisation isn’t expected from anything like we’ve been discussing.

---

<div class="post-metadata">

**Author:** ![DesertDog](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/desertdog/32/11503_2.png) [@DesertDog](https://boards.straightdope.com/u/DesertDog)\
**Post date:** [March 2, 2022, 5:58am UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/35 "2022-03-02T05:58:30Z")

</div>

Decades ago I read an article in _Analog_ about AI where it was comparing today’s attempts at AI with the early attempts at flight, the one where you see a flapping machine shaking itself to pieces instead of getting itself off of the ground. It wasn’t until, instead of trying to fly as birds do, the idea of a fixed wing and propeller was perfected that powered flight was possible.

He argued we need to come up with the intelligence equivalent of propeller-and-wing before we’ll get anywhere.

---

<div class="post-metadata">

**Author:** ![Schnitte](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/schnitte/32/9033_2.png) [@Schnitte](https://boards.straightdope.com/u/Schnitte)\
**Post date:** [March 2, 2022, 8:07am UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/36 "2022-03-02T08:07:07Z")

</div>

Depending on how long ago that was, that author might have been too pessimistic. The dominant techniques that have allowed machine learning to make its recent rapid progress are things like neural networks or statistical methods such as linear regression that have been around for a long time. In a way they’re inspired by the natural role mode of the human brain and apply similar principles, but they’re not a direct copy of it.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 2, 2022, 10:59am UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/37 "2022-03-02T10:59:18Z")

</div>

> [@wolfpup](#):
>
> I disagree with the idea that intelligence requires generalizable knowledge. This sounds like a skeptic’s fallacy arising from an unwillingness to accept that intelligence in a narrow domain should be regarded as “true” intelligence, even when it’s effectively solving real intellectual problems. It seems to me that it’s more reasonable to establish _a priori_ that if some entity – whether human or machine – is capable of performing a certain task of reasoning that would be commonly regarded as requiring intelligence, then it should be deemed intelligent in that domain, whether human or machine. Otherwise the goalposts just keep moving forever and the whole argument becomes meaningless, simply a circular declaration that “if a machine does it, it’s not real intelligence”.

Yeah, it seems like if we make a machine do something that a human can do, it’s ‘merely mimicking’ and if we make it do something interestingly different it’s ‘not like a human’. Skeptics need to define in advance what are the criteria to be met, rather than this continual game of ‘yes… but’.

---

<div class="post-metadata">

**Author:** ![Schnitte](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/schnitte/32/9033_2.png) [@Schnitte](https://boards.straightdope.com/u/Schnitte)\
**Post date:** [March 2, 2022, 11:26am UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/38 "2022-03-02T11:26:20Z")

</div>

Edsger Dijsktra famously said that the question whether computers can think is about as irrelevant as the question whether submarines can swim. I don’t know exactly what he meant by that; but my interpretation is that one can have lengthy semantic discussions about whether the word “swim” should be applied to what submarines do, but that this does not alter the fact that submarines are very good at what they were built to do, and probably better in some respects than humans are in a comparable activity, no matter which word you apply to it.

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 2, 2022, 12:37pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/39 "2022-03-02T12:37:20Z")

</div>

I can’t help thinking if it’s whole-species loneliness. We want to see if we can communicate with animals; we want to try to communicate with extraterrestrials; we want to build things that can think like we do, so we can have someone to talk to…

---

<div class="post-metadata">

**Author:** ![md-2000](https://avatars.discourse-cdn.com/v4/letter/m/9d8465/32.png) [@md-2000](https://boards.straightdope.com/u/md-2000)\
**Post date:** [March 2, 2022, 1:00pm UTC](https://boards.straightdope.com/t/ais-getting-confused/960254/40 "2022-03-02T13:00:29Z")

</div>

I think the next AI frontier will be “it may be conscious, but how would we tell?” We will have built systems so good at imitating some attributes of human interaction that we will wonder for say, a Turing test, whether it’s simply complex analysis of context to provide responses and such, or whether there’s conscious action at work…

My friends and I used to joke that we knew plenty of humans who could not pass a Turing test.

[Previous page](https://boards.straightdope.com/t/ais-getting-confused/960254.md?page=1)

[Next page](https://boards.straightdope.com/t/ais-getting-confused/960254.md?page=3)
