# Digital art creator algorithm website **URL:** \ **Category:** Cafe Society\ **Tags:** arts-crafts, ai\ **Created:** [April 1, 2022, 1:26am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081 "2022-04-01T01:26:49Z")\ **Posts on this page:** 20\ **Page:** 15
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 28, 2022, 5:45pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/281 "2022-04-28T17:45:46Z")
Okay, trying it in Chrome (instead of Firefox) gives the same problem, bit doing it from the app works. ---
**Author:** ![EinsteinsHund](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/einsteinshund/32/8400_2.png) [@EinsteinsHund](https://boards.straightdope.com/u/EinsteinsHund)\ **Post date:** [April 28, 2022, 5:47pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/282 "2022-04-28T17:47:11Z")
Strange, I did it in Chrome on Windows and it gave me the direct url to the image. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 28, 2022, 7:49pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/283 "2022-04-28T19:49:07Z")
**Colorado Horror Story** Prompts: “overlook hotel | the shining” & “the stanley hotel | stephen king” [![](https://images.nightcafe.studio/jobs/jagHoAnwrmh3ybbM0Cg6/jagHoAnwrmh3ybbM0Cg6_6x.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/jagHoAnwrmh3ybbM0Cg6/jagHoAnwrmh3ybbM0Cg6_6x.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [April 28, 2022, 8:48pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/284 "2022-04-28T20:48:00Z")
> [@DPRK](#): > > That may be some sort of emergent property (the way neural network layers recognize straight lines at various angles, then at a higher level different textures and patterns, then pieces and patches, an eye, a tail, etc.), but it is not literally how it is programmed: DALL-E also uses CLIP and GLIDE and diffusion as components in its pipeline. The increased performance evidently comes from the way they put them together (and leveraged the aforementioned 15 kW GPUs for training the models) I maintain that, in order to produce that elephant tea party image, DALL-E must have had an image in its training library featuring an elephant in that exact pose. I maintain that because I do not believe it is possible for an artist, meat or silicon, to put an elephant in that pose without a very detailed model of what an elephant is and how it works, and I further do not believe that it is possible to create such a model using only 2-dimensional still images. The information simply isn’t there. Likewise, I maintain that the training library must have contained pictures of leopards in the dominoes poses, and photographs of broccoli matching each of the frames in the broccoli vs. apple fight. In cases where the AI didn’t have appropriate poses available that were so apropos to the requested subject matter, the results wouldn’t be nearly as good. But we don’t see that, because only the good pictures are being published. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 28, 2022, 9:36pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/285 "2022-04-28T21:36:23Z")
**Dystopian Statue of Liberty** Prompts: ["Iron Maiden](https://boards.straightdope.com/t/a-perfectly-reasonable-amount-of-schadenfreude-about-things-happening-to-trump-his-enablers/925537/5142) [Statue of Liberty"](https://boards.straightdope.com/t/a-perfectly-reasonable-amount-of-schadenfreude-about-things-happening-to-trump-his-enablers/925537/5144) & “Charles Addams drawing” [![](https://images.nightcafe.studio/jobs/38rBMHEQ9da55iAZ2I3X/38rBMHEQ9da55iAZ2I3X_6x.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/38rBMHEQ9da55iAZ2I3X/38rBMHEQ9da55iAZ2I3X_6x.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 28, 2022, 9:42pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/286 "2022-04-28T21:42:07Z")
Now I feel super patriotic. 👍 🇺🇸 ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 28, 2022, 9:48pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/287 "2022-04-28T21:48:43Z")
Awesome. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 28, 2022, 9:53pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/288 "2022-04-28T21:53:17Z")
I like how the hand throwing devils horns pops out of the fog like that. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 28, 2022, 10:01pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/289 "2022-04-28T22:01:09Z")
I stumbled across [this](https://creator.nightcafe.studio/creation/bM9GmHfZqOivAdd1UjNx) amazing image today (the complexity of the prompts makes me feel like a rank beginner). Replacing the “wolf face” mention with your own idea, plus removing the photo and adding your own if you want does have an effect, though I think you have to be pretty choosy for the subject to work well. You can turn off the extra accuracy and medium image to go from 4 credits to 1. Some of that stuff can surely be pared away. For instance, the first prompt seems to be just the title. I did find that you could get a base origami effect by just adding “origami” to your prompt. ---
**Author:** ![Folly](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/folly/32/3219_2.png) [@Folly](https://boards.straightdope.com/u/Folly)\ **Post date:** [April 28, 2022, 10:04pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/290 "2022-04-28T22:04:55Z")
um, Putin riding a nuclear warhead. [![](https://images.nightcafe.studio/jobs/KiX1e2l3kOTa4cVKK17W/KiX1e2l3kOTa4cVKK17W.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/KiX1e2l3kOTa4cVKK17W/KiX1e2l3kOTa4cVKK17W.jpg?tr=w-1600,c-at_max) I guess all available paintings of Putin are naked Putin. ---
**Author:** ![Folly](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/folly/32/3219_2.png) [@Folly](https://boards.straightdope.com/u/Folly)\ **Post date:** [April 28, 2022, 10:06pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/291 "2022-04-28T22:06:11Z")
> [@Darren\_Garrison](#): > > (the complexity of the prompts makes me feel like a rank beginner) I’ve also seen people using negative weight prompts. I guess to try to get rid of watermarks and stuff. Don’t know how to do it or how effective it is. ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [April 28, 2022, 10:28pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/292 "2022-04-28T22:28:24Z")
A number of those prompts feel contradictory as well: 16k Res/8k Res, Hyperrealism/Cel-shaded/Concept Art, etc. ---
**Author:** ![DPRK](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@DPRK](https://boards.straightdope.com/u/DPRK)\ **Post date:** [April 28, 2022, 10:43pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/293 "2022-04-28T22:43:54Z")
They will not be releasing the training data set, so all we know is > The model was trained on publicly available image-caption data. This was done through a combination of crawling a handful of websites and using commonly-used pre-existing image datasets such as [YFCC100M](http://projects.dfki.uni-kl.de/yfcc100m/). A large portion of the data comes from our crawling of the internet. But it’s probably safe to assume that if there are pictures of elephants/leopards/tea parties on the 'net, which there are, they made it in there. It’s not trained on “only 2-dimensional still images”, though. CLIP is trained on (image, text) pairs. That is the part of the model that learns to link text to a visual representation (which objects are present, the aesthetic style, colors and materials, and whatever else is described by the caption). A GLIDE is trained to take a CLIP encoding as input, and generate a new image that maintains the “salient features” of the original. (Not literally reproduce the exact image, though.) Technically, the final image generation is a [two-stage process](http://adityaramesh.com/posts/dalle2/dalle2.html): the text encoding is transformed into an image encoding consistent with it, and that is then "un-CLIP"ped. The “unCLIP” model contains the information CLIP discards— how the elephant is “put together”, in your words. [If you click on that link, there is a good example of variations on an input image [![](http://adityaramesh.com/posts/dalle2/images/variations.jpg) ](http://adityaramesh.com/posts/dalle2/images/variations.jpg) (in the centre) I am not convinced that cutting and pasting are the right words to describe it, though you are surely right that the “features” are all presumably present in the training library, otherwise how could it have learned them?] If you skim though some of the papers, there are absolutely some failures there, especially when the text prompt did not match anything the model had seen, (e.g. there was no problem depicting “a teddy bear”, but it [not DALL-E but some older research model] did less well with “a bicycle with tracks instead of wheels”); who would expect otherwise? We could find out a hell of a lot more about how it works in practice by playing with it. I am apparently now on some waiting list, but since I do not plan to give them money or develop an app with them, realistically, I am not holding my breath. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 29, 2022, 2:18am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/294 "2022-04-29T02:18:36Z")
I was feeling a little silly: **The Old Men of the Mountain** Starting prompts “Napoleon Blownapart” & “Drawing by Charles Addams” gave the hint of a face (the one on the right) after one evolution so I added “The Face of Boe”. [![](https://images.nightcafe.studio/jobs/C3SxWFaohpMCSPjpSIrq/C3SxWFaohpMCSPjpSIrq_6x.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/C3SxWFaohpMCSPjpSIrq/C3SxWFaohpMCSPjpSIrq_6x.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [April 29, 2022, 2:52am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/295 "2022-04-29T02:52:00Z")
### A Man-of-War Firing a Broadside [![](https://images.nightcafe.studio/jobs/KjadOprs6KRxGRLp7rZS/KjadOprs6KRxGRLp7rZS.jpg) ](https://images.nightcafe.studio/jobs/KjadOprs6KRxGRLp7rZS/KjadOprs6KRxGRLp7rZS.jpg) That might be a man of war, but it’s not a Man-of-War. Still, I thought it was a pretty good painting of a soldier under fire on a beach, lighting off his cannon in return. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 29, 2022, 3:28am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/296 "2022-04-29T03:28:28Z")
**1984 Louisiana World Exposition** Second prompt: “New Orleans Waterfront” [![](https://images.nightcafe.studio/jobs/EqjMd9iHB1HLCNpkNxN1/EqjMd9iHB1HLCNpkNxN1_6x.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/EqjMd9iHB1HLCNpkNxN1/EqjMd9iHB1HLCNpkNxN1_6x.jpg?tr=w-1600,c-at_max) I don’t remember them having fireworks… ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 29, 2022, 4:17am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/297 "2022-04-29T04:17:37Z")
FWIW, the AI seems to understand style terms like 3/4 profile portrait, full-length portrait, and half-length portrait. Understanding Luke Skywalker? So much. [![](https://images.nightcafe.studio/jobs/GxO53FQci8xvdFlXlW7b/GxO53FQci8xvdFlXlW7b.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/GxO53FQci8xvdFlXlW7b/GxO53FQci8xvdFlXlW7b.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 29, 2022, 4:30am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/298 "2022-04-29T04:30:28Z")
> [@Jophiel](#): > > That might be a man of war, but it’s not a Man-of-War. Still, I thought it was a pretty good painting of a soldier under fire on a beach, lighting off his cannon in return. I submitted [this](http://www.rebelscum.com/photo.asp?image=/swsaga/sw0245ephantmonfront.jpg) photo of Ephant Mon with the prompt Ephant Mon. What I got was a cartoon cat glaring out of the face-hole of some sort of over-sized suit and his Portuguese Man o’ War sidekick. I think that they are super heros. Or possibly super villians. Either way, I want them to have their own TV series. [![](https://i.imgur.com/4t8Z4Bs.jpg) ](https://i.imgur.com/4t8Z4Bs.jpg) ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 29, 2022, 6:16am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/299 "2022-04-29T06:16:54Z")
> [@Darren\_Garrison](#): > > Either way, I want them to have their own TV series. _Catlock and Bloop_, a new original animated series on Hulu, streaming this Summer. Don’t miss their exciting and psychedelic adventures through through time and dreams! ---
**Author:** ![DPRK](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@DPRK](https://boards.straightdope.com/u/DPRK)\ **Post date:** [April 29, 2022, 11:21am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/300 "2022-04-29T11:21:06Z")
To summarize, the AI knows what leopards, or Rick and Morty, look like in various poses because it has gone through every picture it could find on the Internet. It does not know how to depict them via some understanding of three dimensional geometry, perspective, detailed anatomy and the interplay of muscles, because that is not how the model works. All it knows about are visual features of 2-D images. (But that is enough to put together a teddy bear riding a skateboard in Times Square, Lego Arnold Schwarzenegger, A Man Soldering a PCB by Rembrandt, Winnie the Pooh as The Thinker, Tesla and Edison battling with lightsabers, etc. because it understands enough of what the words mean and knows how to compose a coherent image. No, it is far from flawless, but you always get… something.) Think of it as a tool. If you are a digital artist and want to create a masterpiece this way, you are going to have to do a non-zero amount of work, including understanding adjusting the parameters, selecting specific variations, knowing how to work with images and text prompts together rather than just one or the other, masking parts of the image to have the AI work only on certain details, and so on. [Previous page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=14) [Next page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=16)