# DALL-E 2 random text on graphics

**URL:** <https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421>\
**Category:** Factual Questions\
**Tags:** ai\
**Created:** [February 27, 2023, 3:03am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421 "2023-02-27T03:03:15Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![CookingWithGas](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cookingwithgas/32/485_2.png) [@CookingWithGas](https://boards.straightdope.com/u/CookingWithGas)\
**Post date:** [February 27, 2023, 3:03am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/1 "2023-02-27T03:03:15Z")

</div>

I have been experimenting with using DALL-E 2 to design a logo. I gave it a description, and then it gives me an image with random-looking text superimposed on the image. For example, I said, “Design an impressionistic logo for a jazz guitarist” and it gave me an nice image with “Juszt Gister” written at the bottom. Others had “Jigin Jun” and “Pasti Pistor Pation”. Any idea what is going on here? It would be reasonable to use “Lorem Ipsum” style placeholder text if you could just replace it but in some cases it’s overlaid on the image so you can’t just Photoshop it out.

---

<div class="post-metadata">

**Author:** ![gnoitall](https://avatars.discourse-cdn.com/v4/letter/g/bb73d2/32.png) [@gnoitall](https://boards.straightdope.com/u/gnoitall)\
**Post date:** [February 27, 2023, 4:04am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/2 "2023-02-27T04:04:40Z")

</div>

DALL-E “recognizes” that logos have graphical elements humans would recognize as text. But it doesn’t know what text really is, so it does its best to create random blobs that sometimes look like letters.

---

<div class="post-metadata">

**Author:** ![Ponderoid](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ponderoid/32/19221_2.png) [@Ponderoid](https://boards.straightdope.com/u/Ponderoid)\
**Post date:** [February 27, 2023, 4:19am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/3 "2023-02-27T04:19:20Z")

</div>

Our own @Mangetout just put out a video yesterday on this subject:

[![](https://img.youtube.com/vi/sYiP-nqdwaA/maxresdefault.jpg "AI Image Generation Algorithms - Breaking The Rules, Gently") ](https://www.youtube.com/watch?v=sYiP-nqdwaA)

---

<div class="post-metadata">

**Author:** ![Snarky\_Kong](https://avatars.discourse-cdn.com/v4/letter/s/a183cd/32.png) [@Snarky\_Kong](https://boards.straightdope.com/u/Snarky_Kong)\
**Post date:** [February 27, 2023, 4:36am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/4 "2023-02-27T04:36:16Z")

</div>

> [@gnoitall](#):
>
> DALL-E “recognizes” that logos have graphical elements humans would recognize as text. But it doesn’t know what text really is, so it does its best to create random blobs that sometimes look like letters

Endorsed.

DALL-E doesn’t generate text. It generates pixels such that the result looks like it could be part of the data distribution of the training set. Training data has text in it, but the model isn’t in any way generating a logo and then superimposing relevant text on top.

Why is the text gibberish? The model isn’t optimized for that. You often see other artifacts in generative AI images. It’s just that text artifacts immediately stand out. Interestingly, with big enough models, generative AI starts generating good text: [https://parti.research.google/](https://parti.research.google/).

---

<div class="post-metadata">

**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\
**Post date:** [February 27, 2023, 4:44am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/5 "2023-02-27T04:44:26Z")

</div>

> [@CookingWithGas](#):
>
> but in some cases it’s overlaid on the image so you can’t just Photoshop it out.

You can upload the image into the editor, erase the words, and give it a new prompt to have it fill it back in. Just avoid terms like “logo,” or anything else which might imply words or writing.

---

<div class="post-metadata">

**Author:** ![Cervaise](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cervaise/32/16693_2.png) [@Cervaise](https://boards.straightdope.com/u/Cervaise)\
**Post date:** [February 27, 2023, 7:07am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/6 "2023-02-27T07:07:24Z")

</div>

> [@gnoitall](#):
>
> it does its best to create random blobs that sometimes look like letters.

This applies to basically everything made by these AI-engine “artists.” They’re notorious, for example, for making hands that are recognizably “handlike” but have random numbers of fingers and other bizarre problems. That’s because they don’t know what “a hand” is, in the abstract. They just know, after digesting hundreds of thousands of images, that there is a collection of shapes and colors in this location in the overall image which conforms to certain parameters, so it manufactures a blob conforming to those parameters. Those parameters do not include “a hand has five fingers” because the vagaries of perspective and composition do not allow that to be generalized as a rule. Hence, these nightmares:

[![](https://pbs.twimg.com/media/FnGX1cmXwAYu79n.jpg) ](https://pbs.twimg.com/media/FnGX1cmXwAYu79n.jpg)

---

<div class="post-metadata">

**Author:** ![CookingWithGas](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cookingwithgas/32/485_2.png) [@CookingWithGas](https://boards.straightdope.com/u/CookingWithGas)\
**Post date:** [February 27, 2023, 4:18pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/7 "2023-02-27T16:18:55Z")

</div>

> [@Snarky\_Kong](#):
>
> DALL-E doesn’t generate text. It generates pixels such that the result looks like it could be part of the data distribution of the training set. Training data has text in it, but the model isn’t in any way generating a logo and then superimposing relevant text on top.
> 
> Why is the text gibberish? The model isn’t optimized for that.

Interesting. I would think if I asked for a logo for a band named “Jazz Band” that it would be smart enough to understand that “Jazz Band” is text and that’s what should be in the image. I am not very familiar with the internals of how these things work. A lot has changed since I studied AI in 1978.

---

<div class="post-metadata">

**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\
**Post date:** [February 27, 2023, 5:09pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/8 "2023-02-27T17:09:18Z")

</div>

It doesn’t ‘know’ anything. It’s just that images in its training set are much more likely to have text-shaped objects in them if their metadata says they’re logos. So when you ask for a logo, it’s going to give you something with text-shaped objects because that’s what logos look like.

---

<div class="post-metadata">

**Author:** ![Snarky\_Kong](https://avatars.discourse-cdn.com/v4/letter/s/a183cd/32.png) [@Snarky\_Kong](https://boards.straightdope.com/u/Snarky_Kong)\
**Post date:** [February 27, 2023, 11:15pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/9 "2023-02-27T23:15:00Z")

</div>

There’s no logic, it just turns your prompt into a vector representation and then uses that to guide the diffusion process into an image. Modern AI is extremely data driven, things like expert systems are out of fashion.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [February 27, 2023, 11:58pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/10 "2023-02-27T23:58:19Z")

</div>

One does occasionally get actual legible and sensible text. Though that depends on a fair bit of luck.

---

<div class="post-metadata">

**Author:** ![Whack-a-Mole](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/whack-a-mole/32/141_2.png) [@Whack-a-Mole](https://boards.straightdope.com/u/Whack-a-Mole)\
**Post date:** [February 28, 2023, 12:49am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/11 "2023-02-28T00:49:52Z")

</div>

John Oliver did a bit on AI in his most recent episode. The video below (queued to about 30 seconds before you see the image) shows the AI blurring “Getty Images” in content it creates. Interestingly, the AI is not really “blurring” anything but, rather, it was trained on scraping images off the internet and so many had the “Getty Image” watermark the AI just figured that is part of art. Getty is suing over it.

[![](https://img.youtube.com/vi/Sqa8Zo2XWc4/maxresdefault.jpg "Artificial Intelligence: Last Week Tonight with John Oliver (HBO)") ](https://www.youtube.com/watch?v=Sqa8Zo2XWc4)

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 28, 2023, 1:22am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/12 "2023-02-28T01:22:31Z")

</div>

> [@CookingWithGas](#):
>
> I have been experimenting with using DALL-E 2 to design a logo. I gave it a description, and then it gives me an image with random-looking text superimposed on the image. For example, I said, “Design an impressionistic logo for a jazz guitarist” and it gave me an nice image with “Juszt Gister” written at the bottom. Others had “Jigin Jun” and “Pasti Pistor Pation”. Any idea what is going on here? It would be reasonable to use “Lorem Ipsum” style placeholder text if you could just replace it but in some cases it’s overlaid on the image so you can’t just Photoshop it out.

The AIs sometimes manage to integrate something similar to words in your prompt, such as “juszt gister” clearly comes from “jazz guitar”. ([Here](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/518) is one of mine that comes close to writing the word “cotton”.)

You should try using Stable Diffusion at [this](https://playgroundai.com/create) site. If you have an area you don’t like on an otherwise interesting image, you can mark that area and have the AI redo just that area (this is called "inpainting).

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 28, 2023, 1:28am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/13 "2023-02-28T01:28:06Z")

</div>

> **[A cat holding a sign saying "Stable Diffusion can't write for shit"...](https://creator.nightcafe.studio/creation/QUIm8zSmeTS9RhSLkt5Z)**
>
> AI Art Generator App. ✅ Fast ✅ Free ✅ Easy. Create amazing artworks using artificial intelligence.

---

<div class="post-metadata">

**Author:** ![Ponderoid](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ponderoid/32/19221_2.png) [@Ponderoid](https://boards.straightdope.com/u/Ponderoid)\
**Post date:** [February 28, 2023, 2:11am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/14 "2023-02-28T02:11:25Z")

</div>

I got a popup from your link: “This creation has been flagged by the automoderator and has not yet been reviewed by a human moderator.”

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 28, 2023, 2:21am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/15 "2023-02-28T02:21:29Z")

</div>

Huh. That set isn’t even made public.

---

<div class="post-metadata">

**Author:** ![CookingWithGas](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cookingwithgas/32/485_2.png) [@CookingWithGas](https://boards.straightdope.com/u/CookingWithGas)\
**Post date:** [February 28, 2023, 11:52am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/16 "2023-02-28T11:52:23Z")

</div>

Me too and I just clicked “Show anyway”. I am guessing it got flagged for “shit.”

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [March 20, 2023, 4:08am UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/17 "2023-03-20T04:08:07Z")

</div>

I recently got an interesting section of image while asking Stable Diffusion for funny cat memes. I trimmed out that portion and tried expanding the sides with more of the same content (excluding the cat with a towel on its head). When I ask for rusty cans surrounded by fruit, Stable Diffusion keeps trying to write the words “rusty” and “cans” on the cans. (And cover them with fruit.)

[![](https://i.postimg.cc/6pK2MXPr/Cat-can-wide.jpg) ](https://i.postimg.cc/6pK2MXPr/Cat-can-wide.jpg)

[![](https://i.postimg.cc/Wb88mXW1/Cans-spelling.jpg) ](https://i.postimg.cc/Wb88mXW1/Cans-spelling.jpg)

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [March 20, 2023, 12:16pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/18 "2023-03-20T12:16:53Z")

</div>

Sometimes the interpretation of the prompt seems to be weighted toward more plausible scenes.

I asked for ‘A giant number three, shouting at kids’ - I got pictures of a kid, shouting, in front of a big, but rather ordinary numeral 3 - I think because it’s more likely that a kid would be the one to be shouting, in a normal English sentence.

In the same way with ‘rusty cans’ - the interpretation might have been skewed by oil cans, baked bean cans, coke cans, soup cans, etc - where the description of the can is also about its contents (and by extension, its labelling); the algorithm perhaps intepreted ‘rusty can’ as a can of something called ‘rusty’.

---

<div class="post-metadata">

**Author:** ![Jasmine](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jasmine/32/2964_2.png) [@Jasmine](https://boards.straightdope.com/u/Jasmine)\
**Post date:** [March 20, 2023, 12:18pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/19 "2023-03-20T12:18:46Z")

</div>

> [@CookingWithGas](#):
>
> I gave it a description, and then it gives me an image with random-looking text superimposed on the image.

Can you just “shut off” the text part of the logo creation process?

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [March 20, 2023, 12:29pm UTC](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421/20 "2023-03-20T12:29:05Z")

</div>

> [@Jasmine](#):
>
> Can you just “shut off” the text part of the logo creation process?

No. AI image generation is more “want what you get” than “get what you want”. The best that you can do is try to aim it in the right direction. (You could try putting “text” as a negative prompt, but I doubt that would work.)

[Next page](https://boards.straightdope.com/t/dall-e-2-random-text-on-graphics/980421.md?page=2)
