# Is it unethical (for AI) to invent fake people?

**URL:** <https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004>\
**Category:** Miscellaneous and Personal Stuff I Must Share\
**Tags:** ai\
**Created:** [June 5, 2023, 12:55am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004 "2023-06-05T00:55:30Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [June 5, 2023, 10:05pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/21 "2023-06-05T22:05:04Z")

</div>

Fifteen years ago, Progressive Insurance invented a fake person named Flo, to try to convince me to buy insurance. Nine years ago, Amazon invented a fake person named Alexa to make it easier for folks to buy stuff from them while sitting on their couches. Earlier today, fake people named Edgin, Holga, Simon, Doric, and Yendar, who were invented to entertain me, did so. Is this a problem? Is it only now a problem?

---

<div class="post-metadata">

**Author:** ![Dr\_Paprika](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr_paprika/32/3042_2.png) [@Dr\_Paprika](https://boards.straightdope.com/u/Dr_Paprika)\
**Post date:** [June 5, 2023, 10:07pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/22 "2023-06-05T22:07:32Z")

</div>

Not sure. Were you aware they were fake people? Do you consider yourself “the most skeptical of interlocutors”? Or are you kind of talking about something completely different?

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [June 5, 2023, 10:28pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/23 "2023-06-05T22:28:42Z")

</div>

Of course I knew they were fake people. So? Even knowing that the people are fake doesn’t make advertising or movies any less effective.

---

<div class="post-metadata">

**Author:** ![Dr\_Paprika](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr_paprika/32/3042_2.png) [@Dr\_Paprika](https://boards.straightdope.com/u/Dr_Paprika)\
**Post date:** [June 5, 2023, 10:38pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/24 "2023-06-05T22:38:14Z")

</div>

You’re probably not having a real conversation with an annoying company mascot, nor are they trying to identify your current mood or vulnerabilities. Sure, the article has some handwringing but the ideas have some validity.

---

<div class="post-metadata">

**Author:** ![kayaker](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kayaker/32/441_2.png) [@kayaker](https://boards.straightdope.com/u/kayaker)\
**Post date:** [June 5, 2023, 10:38pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/25 "2023-06-05T22:38:36Z")

</div>

> [@Dr\_Paprika](#):
>
> Were you aware they were fake people?

Hell, I’ve known them. Worked with them.

---

<div class="post-metadata">

**Author:** ![Dr\_Paprika](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr_paprika/32/3042_2.png) [@Dr\_Paprika](https://boards.straightdope.com/u/Dr_Paprika)\
**Post date:** [June 5, 2023, 10:40pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/26 "2023-06-05T22:40:11Z")

</div>

They probably pretended they were into acid jazz and wakeboarding despite not liking either. Ferschlugginer _poseurs_.

---

<div class="post-metadata">

**Author:** ![kayaker](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kayaker/32/441_2.png) [@kayaker](https://boards.straightdope.com/u/kayaker)\
**Post date:** [June 5, 2023, 10:58pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/27 "2023-06-05T22:58:39Z")

</div>

one and all.

---

<div class="post-metadata">

**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\
**Post date:** [June 5, 2023, 11:19pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/28 "2023-06-05T23:19:37Z")

</div>

If it becomes mandatory to clearly identify fake people, I’m not sure what I’d do with knowledge. It could go either way. I mean, is the probability that a fake person is evil and malicious higher or lower than a real person?

I’m only half joking. When AI passes a point where we _really_ cannot tell even with complex and intimate interactions, that opens up the possibility of immersive VR where we can interact with a world from which the programming excludes psychopaths and assholes.

---

<div class="post-metadata">

**Author:** ![Banquet\_Bear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/banquet_bear/32/373_2.png) [@Banquet\_Bear](https://boards.straightdope.com/u/Banquet_Bear)\
**Post date:** [June 5, 2023, 11:44pm UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/29 "2023-06-05T23:44:00Z")

</div>

…in NZ we recently had the case of a political party inventing fake brown people for political advertisements. (one of them looking very much like the current co-leader of the Green Party)

[![](https://i.guim.co.uk/img/media/6ec3895154e6ba897c715eda7efaffc0896badc2/0_8_2332_1399/master/2332.jpg?width=620&quality=45&dpr=2&s=none) ](https://i.guim.co.uk/img/media/6ec3895154e6ba897c715eda7efaffc0896badc2/0_8_2332_1399/master/2332.jpg?width=620&quality=45&dpr=2&s=none)

And fake scared white people worried about crime.

[![](https://i.guim.co.uk/img/media/4cd261fab2f4e3b3afe9618ce402872859bc1f99/0_1_2332_1399/master/2332.jpg?width=620&quality=45&dpr=2&s=none) ](https://i.guim.co.uk/img/media/4cd261fab2f4e3b3afe9618ce402872859bc1f99/0_1_2332_1399/master/2332.jpg?width=620&quality=45&dpr=2&s=none)

And they were planning on a big campaign on this until the uproar it caused and now they’ve stopped. The images were created in Midjourney, so there was a public log of all the images they were either planning on using or didn’t use.

[![](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/2ubWjokCiR9Rm_4vxD94POvRVTo=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/YKQTBVXNKRFY5DZKOIENIQGHVI.png) ](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/2ubWjokCiR9Rm_4vxD94POvRVTo=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/YKQTBVXNKRFY5DZKOIENIQGHVI.png)

[![](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/6yBHot62l8hjk51wHh26UrevDpk=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/UNSGVX44JFCCFK4CMWT4MZ3BOE.png) ](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/6yBHot62l8hjk51wHh26UrevDpk=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/UNSGVX44JFCCFK4CMWT4MZ3BOE.png)

Using stock images of brown people to promote political messaging have long been criticised here. But literally inventing fake tangata whenua to support a political agenda?

There are a ton of ethical and cultural issues to deal with here.

---

<div class="post-metadata">

**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\
**Post date:** [June 6, 2023, 12:08am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/30 "2023-06-06T00:08:29Z")

</div>

I can see the blowback in creating fake minority people but the nervous white woman looking out the window is a big shrug for me. Obviously they didn’t find a real nervous woman at the moment of her peering out the window so who cares if it’s a unique staged photo, purchased from Shutterstock or AI generated?

---

<div class="post-metadata">

**Author:** ![Banquet\_Bear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/banquet_bear/32/373_2.png) [@Banquet\_Bear](https://boards.straightdope.com/u/Banquet_Bear)\
**Post date:** [June 6, 2023, 12:32am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/31 "2023-06-06T00:32:08Z")

</div>

> [@Jophiel](#):
>
> Obviously they didn’t find a real nervous woman at the moment of her peering out the window so who cares if it’s a unique staged photo, purchased from Shutterstock or AI generated?

…another image that was created (but not used) in the campaign:

[![](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/8vJ_izLFlAemg8zGFubttmJXAcs=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/ZPIYQP4DBBFNJCVB2SLMK5BHJM.png) ](https://tvnz-1-news-prod.cdn.arcpublishing.com/resizer/8vJ_izLFlAemg8zGFubttmJXAcs=/1600x0/filters:format(png):quality(70)/cloudfront-ap-southeast-2.images.arcpublishing.com/tvnz/ZPIYQP4DBBFNJCVB2SLMK5BHJM.png)

I find it as problematic that fake white people that are obviously scared of fake brown people are being used as part of a dog-whistle campaign. Its the ease of generation that is part of the problem.

You mention stock photography: and I just had a look and only found a single similar image on Shutterstock. This isn’t an easy photo to create. As a (former) commercial photographer, I would have charged thousands for this. Talent, hair, make up, lighting, crew, time on set, post-production. Effective propaganda doesn’t come cheap.

Well I should say…it _used_ to not come cheap. Now it can be mass produced with a few clicks. Ethical issues remain _regardless_ of the colour of the skin. Its just that creating fake brown people raises _more_ ethical issues.

---

<div class="post-metadata">

**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\
**Post date:** [June 6, 2023, 12:49am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/32 "2023-06-06T00:49:22Z")

</div>

> [@Banquet\_Bear](#):
>
> …another image that was created (but not used) in the campaign:

What’s supposed to be going on with her putting her bag handle around her neck?

---

<div class="post-metadata">

**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\
**Post date:** [June 6, 2023, 12:50am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/33 "2023-06-06T00:50:55Z")

</div>

> [@Banquet\_Bear](#):
>
> You mention stock photography: and I just had a look and only found a single similar image on Shutterstock.

So much for AI just cribbing all the stock photos wholesale 😉

I found a few stock photo night time images of frightened white women clutching purses with a casual Google Image search. Not exact copies but certainly good enough to say “I’ll stop this sort of thing” on a political mailer. Whether not not the message is shitty is secondary in point (here) to the fact that, again, whether the image was a stock photo, a photo shot for the ad or AI generated really doesn’t matter. I mean, the flier or online ad wouldn’t be _better_ if they used one of the stock photos I saw, would it?

I guess I just don’t see the outrage over the AI factor.

The “make a brown person for the ad” is problematic for the same reason it was when U. of Wisconsin got caught photoshopping a black student onto their course catalog. They’re trying to claim an inclusive environment without being able to make good with even a single unedited photo. Likewise when you’re faking a couple of minority nurses supposedly supporting your campaign. On the other hand, the scared women photos are so obviously staged (the unused ones to the point of being cartoonish) there’s no legitimate argument to be made that we’re supposed to see those people as supporting the campaign. They’re just obvious props and not presented as anything other than props. Whether those props are AI generated or not seems meaningless.

---

<div class="post-metadata">

**Author:** ![Banquet\_Bear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/banquet_bear/32/373_2.png) [@Banquet\_Bear](https://boards.straightdope.com/u/Banquet_Bear)\
**Post date:** [June 6, 2023, 1:36am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/34 "2023-06-06T01:36:30Z")

</div>

> [@Jophiel](#):
>
> So much for AI just cribbing all the stock photos wholesale 😉

…well no. Its cribbing from professional photographers who have invested thousands of dollars, thousands of hours of time, all without permission or compensation. This was a difficult shot. It takes skill, experience, and the right equipment to take a photo like this. There aren’t similar photos on the stock sites because for stock photographers, you’d be investing more in the image than the likely return.

The very fact that this photo “cribbed” from the labour and expertise of exerienced photographers is an ethical issue in itself. I’m glad you bought it up.

> [@Jophiel](#):
>
> I guess I just don’t see the outrage over the AI factor.

I don’t see a lot of outrage in this thread.

> [@Jophiel](#):
>
> They’re trying to claim an inclusive environment without being able to make good with even a single unedited photo. Likewise when you’re faking a couple of minority nurses supposedly supporting your campaign. On the other hand, the scared women photos are so obviously staged (the unused ones to the point of being cartoonish) there’s no legitimate argument to be made that we’re supposed to see those people as supporting the campaign.

I’m not seeing a material difference here. “Endorsement” isn’t the only issue, and while this particular white-woman image was “staged”, that won’t be the case every single time. As I mentioned one of the nurses looks very much like the co-leader of the Green Party. This was almost certainly accidental on behalf of the prompters. But how many of these “fake people” will bear close resemblance to real people? (Especially, in regards to brown people)the “training dataset” probably doesn’t have that many brown people to begin with?)

This is just _one_ of the issues.

> [@Jophiel](#):
>
> On the other hand, the scared women photos are so obviously staged (the unused ones to the point of being cartoonish) there’s no legitimate argument to be made that we’re supposed to see those people as supporting the campaign. They’re just obvious props and not presented as anything other than props. Whether those props are AI generated or not seems meaningless.

“Obviously staged” is kind-of-a-meaningless thing to say about propaganda. Almost all propaganda is staged and designed to provoke an emotional response. Many people won’t look at that image and think “oh, its obviously staged.” The _intent_ of the image is to blow the dog-whistle. And the target demographic will look at that image and get _angry_ at people like me.

---

<div class="post-metadata">

**Author:** ![LSLGuy](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lslguy/32/5813_2.png) [@LSLGuy](https://boards.straightdope.com/u/LSLGuy)\
**Post date:** [June 6, 2023, 1:53am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/35 "2023-06-06T01:53:58Z")

</div>

In sum:

1. Propaganda is a problem. It makes irrational people do irrational things on command.
2. AI artwork makes emotionally persuasive propaganda cheaper to produce, by a factor of hundreds or thousands.
3. AI prose production makes emotionally persuasive propaganda cheaper to produce, by a factor of hundreds or thousands.
4. Having hundreds or thousands of times as much propaganda as now will essentially drown out all non-AI non-propaganda sources of public discourse.

Seems to me we ought to have a hell of a lot more outrage about is in evidence so far.

---

<div class="post-metadata">

**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\
**Post date:** [June 6, 2023, 2:08am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/36 "2023-06-06T02:08:31Z")

</div>

> [@Banquet\_Bear](#):
>
> I don’t see a lot of outrage in this thread.

Referring to your comment that _“And they were planning on a big campaign on this until the uproar it caused and now they’ve stopped”_

---

<div class="post-metadata">

**Author:** ![Banquet\_Bear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/banquet_bear/32/373_2.png) [@Banquet\_Bear](https://boards.straightdope.com/u/Banquet_Bear)\
**Post date:** [June 6, 2023, 2:10am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/37 "2023-06-06T02:10:02Z")

</div>

> [@Jophiel](#):
>
> Referring to your comment that _“And they were planning on a big campaign on this until the uproar it caused and now they’ve stopped”_

…the uproar was primarily over the fake tangata whenua.

---

<div class="post-metadata">

**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\
**Post date:** [June 6, 2023, 2:10am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/38 "2023-06-06T02:10:49Z")

</div>

> [@Banquet\_Bear](#):
>
> the uproar was primarily over the fake tangata whenua.

Well, I guess me and the uproarers are in agreement – one of them feels like a problem, the other feels like a “meh”

---

<div class="post-metadata">

**Author:** ![Banquet\_Bear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/banquet_bear/32/373_2.png) [@Banquet\_Bear](https://boards.straightdope.com/u/Banquet_Bear)\
**Post date:** [June 6, 2023, 2:12am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/39 "2023-06-06T02:12:33Z")

</div>

> [@Riemann](#):
>
> What’s supposed to be going on with her putting her bag handle around her neck?

…that wasn’t even the worst of them. What the heck were these?

[![](https://images.thespinoff.co.nz/1/2023/05/StoryImage_AI4.png?w=1290) ](https://images.thespinoff.co.nz/1/2023/05/StoryImage_AI4.png?w=1290)

[![](https://images.thespinoff.co.nz/1/2023/05/StoryImage_AI3.png?w=1290) ](https://images.thespinoff.co.nz/1/2023/05/StoryImage_AI3.png?w=1290)

> **[Ranked: the grotesque images and bleak prompts behind National’s AI ads](https://thespinoff.co.nz/politics/27-05-2023/ranked-the-grotesque-images-and-bleak-prompts-behind-nationals-ai-ads)**
>
> Prompt: 'Sad mother counting coins at the supermarket because she is poor.'

---

<div class="post-metadata">

**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\
**Post date:** [June 6, 2023, 2:21am UTC](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004/40 "2023-06-06T02:21:26Z")

</div>

Most of those images feel like a good argument that we’re not about to be swamped by oceans of AI made professional-grade propaganda images 😃

[Previous page](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004.md?page=1)

[Next page](https://boards.straightdope.com/t/is-it-unethical-for-ai-to-invent-fake-people/985004.md?page=3)
