# Digital art creator algorithm website **URL:** \ **Category:** Cafe Society\ **Tags:** arts-crafts, ai\ **Created:** [April 1, 2022, 1:26am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081 "2022-04-01T01:26:49Z")\ **Posts on this page:** 20\ **Page:** 62
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [February 21, 2023, 2:33am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1222 "2023-02-21T02:33:47Z")
With SD, I was able to get some reasonable college tries with just “Elephant\_rhino\_hybrid, (rhino)” using the SD v1.5 model. It’s probably helpful to specify which version/model of SD one is using since I could train a model on nothing but elephants and rhinos or I could run my prompt through a model made for generating anime waifus but neither would really prove much. [![](https://i.imgur.com/EuwlXJv.png) ](https://i.imgur.com/EuwlXJv.png) [![](https://i.imgur.com/AfkpvEo.png) ](https://i.imgur.com/AfkpvEo.png) (Not saying those are amazing but I think they’d make a good starting point for refinement) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 21, 2023, 6:52pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1223 "2023-02-21T18:52:18Z")
Played around again with generating a krasue (as covered far up-thread). This time I used a trimmed and rotated version of the drawing from the Wikipedia entry and img2img, and used various prompts including “woman’s head”, “dangling organs”, and lists of various organs. Some images moved in the direction of the desired results, at least. (I got several versions of the “weird person with head hat” theme.) [![](https://i.imgur.com/dK7ILwO.jpeg) ](https://i.imgur.com/dK7ILwO.jpeg) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 22, 2023, 3:47pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1224 "2023-02-22T15:47:10Z")
The NSFW censorship on Night Cafe really needs work. I often get what seem to be (through the blurring) innocuous images from innocuous prompts blurred. But today a fairly innocuous prompt (aiming at horror, nothing else) produced [this](https://creator.nightcafe.studio/creation/BdG6Qei2L8k6PnA9lId5). (Linked instead of embedded because it is seriously N. S. F. W. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 22, 2023, 8:55pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1225 "2023-02-22T20:55:43Z")
Here’s an article on Controlnet, which, if you haven’t been reading the SD reddit page, is a very powerful tool for Stable Diffusion for people who have the hardware to run a local copy. Just miles beyond what you can do with current web services. Be sure to at least skim the 33 page PDF linked at the bottom of the article. > **[ControlNet: Another step-change in AI image generation](https://www.redsharknews.com/controlnet-another-step-change-in-ai-image-generation)** > > Until now, one of the main stumbling blocks for truly great AI image generation was user control. The ControlNet assistant for Stable Diffusion solves that and hands the power back to the artist. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [February 22, 2023, 10:50pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1226 "2023-02-22T22:50:17Z")
I sort of get the feeling that a proper NSFW filter for one of these art generators would have to have been implemented at the source-images level, not at the output level. Like, in the initial tagging, make sure every NSFW image was tagged NSFW, and then give that tag a very high weight. As-is, I get the impression that the possibility of NSFW art (somehow) didn’t even occur to the creators, until after the AIs were up and running. Up-thread, I had a few experiments I did with the most minimal prompts I could think of, and they all seem to have ended up NSFW. For instance, a prompt of just “.”, a single period, resulted in a giant vulva. And a prompt of “” (open and close quote marks themselves as the prompt) was an abstract but very breast-ish thing. All I can figure is that the training data contained a lot of images of breasts and vulvae, so when the AI has no other guidance, it just falls back on what’s common. ---
**Author:** ![Jack\_Batty](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jack_batty/32/3201_2.png) [@Jack\_Batty](https://boards.straightdope.com/u/Jack_Batty)\ **Post date:** [February 25, 2023, 3:27am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1227 "2023-02-25T03:27:30Z")
For those on Playground AI - which I’m liking more and more (more than NightCafe) - they have five new built in filters to play with. They produce some pretty cool results. There is a Pop Art (very Lichtenstein), Fashion Magazine (Perfume II), Dark Comic (graphic novel), MixPunk (steam, solar, diesel, you name it) & Kid’s Storybook (watercolor, scrawly drawing - which makes for interesting results when using it to create a variation on a source). Also on the floor … I’ve been looking into running Stable Diffusion locally. I think I’ve found some decent sites walking me through installation but if anyone has any tips, I’m all ears. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 25, 2023, 3:57am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1228 "2023-02-25T03:57:12Z")
> [@Jack\_Batty](#): > > For those on Playground AI - which I’m liking more and more (more than NightCafe) I seem to get different results with the same settings than at Night Cafe. Playground seems to do a much better job of infilling and img2img, for example, for some reason. Possibly because it is working at 768x512 instead of 576x384 for landscape? As for a local setup, do you read the reddit group? Tons of resources there. I’d love to be able to use Controlnet, “plain” SD seems crippled in comparison. ---
**Author:** ![DPRK](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@DPRK](https://boards.straightdope.com/u/DPRK)\ **Post date:** [February 25, 2023, 5:15am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1229 "2023-02-25T05:15:49Z")
> [@Jack\_Batty](#): > > Also on the floor … I’ve been looking into running Stable Diffusion locally. I think I’ve found some decent sites walking me through installation but if anyone has any tips, I’m all ears. I would suggest just cloning one of the forks on Github, e.g. > **[GitHub - AUTOMATIC1111/stable-diffusion-webui: Stable Diffusion web UI](https://github.com/AUTOMATIC1111/stable-diffusion-webui)** > > Stable Diffusion web UI. Contribute to AUTOMATIC1111/stable-diffusion-webui development by creating an account on GitHub. does not really matter exactly which one; then it automatically sets itself up with a convenient web-UI to all the features (e.g. there are instructions there for getting ControlNet working) ---
**Author:** ![Jack\_Batty](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jack_batty/32/3201_2.png) [@Jack\_Batty](https://boards.straightdope.com/u/Jack_Batty)\ **Post date:** [February 25, 2023, 5:44am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1230 "2023-02-25T05:44:10Z")
Thanks. Looks promising. How do I clone a fork. The site isn’t that intuitive (at least not for me). ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 25, 2023, 6:08am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1231 "2023-02-25T06:08:28Z")
> [@Jack\_Batty](#): > > For those on Playground AI - which I’m liking more and more (more than NightCafe) - they have five new built in filters to play with. Dark Comic and Kid’s Storybook are pretty interesting for original creations. And KS is great for img2img. I used a photo of my cat yawning with the prompt “cat yawning”. [![](https://i.imgur.com/Hei1xRk.jpeg) ](https://i.imgur.com/Hei1xRk.jpeg) Not especially kid-friendly, though. (The two rightmost images are from Woolitize.) ---
**Author:** ![DPRK](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@DPRK](https://boards.straightdope.com/u/DPRK)\ **Post date:** [February 25, 2023, 6:28am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1232 "2023-02-25T06:28:40Z")
You need Python anyway to run all the scripts; you do not have to, but I suggest installing Miniconda/anaconda, which makes it easy to install the exact version it wants. Once that is set up, I believe you should be able to `conda install -c anaconda git` from an Anaconda prompt window. You also need the model files and various dependencies listed [here](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Dependencies). There is also a guide: > **[How to Run Stable Diffusion Locally With a GUI on Windows](https://www.howtogeek.com/832491/how-to-run-stable-diffusion-locally-with-a-gui-on-windows/)** > > You can install Stable Diffusion locally on your PC, but the typical process involves a lot of work with the command line to install and use. Fortunately for us, the Stable Diffusion community has solved that problem. Here’s how to install a... In any case, after git is installed you can `git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git` like it says. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 25, 2023, 7:45am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1233 "2023-02-25T07:45:18Z")
It is insane that nobody has created a simple, one-click Windows installer like they have for the Mac. > **[How to run Stable Diffusion on your Mac | Digital Trends](https://www.digitaltrends.com/computing/how-to-run-stable-diffusion-on-your-mac/)** > > Looking for AI image generation apps to use on Mac? Here are the best ways to get Stable Diffusion software working on your Mac, from downloads to plugins. ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [March 4, 2023, 6:40pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1234 "2023-03-04T18:40:08Z")
In the world of Stable Diffusion, there is now (well, has been for a month or two, I think?) something called a Low Rank Adaptation or “Lora”. It’s basically a small training injection you can use on top of another model. It can also be trained quickly (GPU depending) and on a small number of images (though more can mean better results). As an example, the SD model I was using had no idea what the D&D monster [Grell](https://static.wikia.nocookie.net/forgottenrealms/images/b/b7/Grell-5e.png/revision/latest?cb=20171011021138) is. Asking for images of a wizard fighting a grell provided this: [![](https://i.imgur.com/LADcqdH.jpg) ](https://i.imgur.com/LADcqdH.jpg) Didn’t even try. But training a Lora on only seven images and asking for a wizard fighting a grell gave me: [![](https://i.imgur.com/wqorv8R.jpg) ](https://i.imgur.com/wqorv8R.jpg) One thing I noticed was that seven images of grells against plain backgrounds doesn’t exactly help teach it a sense of scale 😃 A couple more grell images including fantasy and then, changing models, a “Grell ordering a martini in a singles bar” and “An anime game about a grell finding romance” to pull our monster out of the fantasy painting style: [![](https://i.imgur.com/TtGM22v.png) ](https://i.imgur.com/TtGM22v.png) [![](https://i.imgur.com/3kqLsBP.png) ](https://i.imgur.com/3kqLsBP.png) [![](https://i.imgur.com/sRHb0BF.png) ](https://i.imgur.com/sRHb0BF.png) [![](https://i.imgur.com/wrumIwt.png) ](https://i.imgur.com/wrumIwt.png) Anyway, thought it was pretty cool and the rate this stuff is advancing is amazing. (Side note, this was more proof of concept so I made no attempt to clean up or inpaint any of the images. All of them could be a lot better with some work and re-rendering but I just wanted to see if it would draw me some grells and understand “a grell” as part of a prompt) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 5, 2023, 1:00am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1235 "2023-03-05T01:00:21Z")
Lora is one of the things that I envy local-run Stable Diffusion for. I have absolutely no real need whatsoever for making images of Gizmo (from _Gremlins_) or Alf (from _Alf_), but early in my AI testing I tried for various pop-culture creatures that came to mind. Min-dall-e and Craiyon actually do a pretty good job of making both of them (but not together) but Stable Diffusion has only the very vaguest idea of what they are, tending to make something vaguely dogish, puppetish, or dog-puppetish. I’ve wondered what was different about the training data that allowed those AIs to do a respectable job while Stable Diffusion has nothing. So if I had Lora access, I’d probably train it for Alf and Gizmo. I could probably use some of the Craiyon images as training data. Stable Diffusion shouldn’t be beat by min-Dall-e or Craiyon, damnit! [![](https://i.imgur.com/OVlU0Ar.jpeg) ](https://i.imgur.com/OVlU0Ar.jpeg) [![](https://i.imgur.com/JXlZai4.jpeg) ](https://i.imgur.com/JXlZai4.jpeg) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 5, 2023, 1:03am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1236 "2023-03-05T01:03:47Z")
I just noticed that one of the middle left Alfs looks like it has stuffing leaking out of it. A training set including damaged Alf dolls? ---
**Author:** ![Folly](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/folly/32/3219_2.png) [@Folly](https://boards.straightdope.com/u/Folly)\ **Post date:** [March 11, 2023, 3:23am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1237 "2023-03-11T03:23:31Z")
Anyone have any tips to get actual english words to generate as per the latest challenge? ---
**Author:** ![Folly](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/folly/32/3219_2.png) [@Folly](https://boards.straightdope.com/u/Folly)\ **Post date:** [March 11, 2023, 3:40am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1238 "2023-03-11T03:40:58Z")
OK. Right after I posted I had _some_ success. Basically by starting with an image with a superimposed word, lowering the noise weight, and then trying a bunch of times. Glad, there is a single image free option now. > **[to your mother - AI Generated Artwork](https://creator.nightcafe.studio/creation/T6tlhmjzWP2EQGPyslFr)** > > AI Art Generator App. ✅ Fast ✅ Free ✅ Easy. Create amazing artworks using artificial intelligence. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [March 13, 2023, 6:01pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1239 "2023-03-13T18:01:15Z")
The results of an experiment aimed at creating fictional players for a baseball text sim: > **[Baseball Player Portrait Photos - AI Generated Artwork](https://creator.nightcafe.studio/creation/LiMF82XxkivAiZYS6zLL)** > > AI Art Generator App. ✅ Fast ✅ Free ✅ Easy. Create amazing artworks using artificial intelligence. > **[More Baseball Player Portrait Photos - AI Generated Artwork](https://creator.nightcafe.studio/creation/ZkTRbvyXLYcudhruIuS9)** > > AI Art Generator App. ✅ Fast ✅ Free ✅ Easy. Create amazing artworks using artificial intelligence. > **[Still More Baseball Player Portrait Photos - AI Generated Artwork](https://creator.nightcafe.studio/creation/dv2C7TMrJMx8nTRrNWHB)** > > AI Art Generator App. ✅ Fast ✅ Free ✅ Easy. Create amazing artworks using artificial intelligence. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 13, 2023, 7:31pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1240 "2023-03-13T19:31:51Z")
A comic/meme was recently posted on reddit, where (if you don’t want to click) a woman is practically swooning over the idea that the man in front of her in the subway with a sketchpad might be drawing her. But in the final panel, we see he is writing a prompt based on her. A number of people have tried the prompt on reddit > **[r/StableDiffusion - True! Lovin' it! 😂](https://www.reddit.com/r/StableDiffusion/comments/11papvs/true_lovin_it/)** > > 2,263 votes and 146 comments so far on Reddit (The prompt is “Imagine red hair woman, mid-30s, great smile, purple sweater, brown jeans, cross-hatching technique, pencil sketch, 4k”.) I tried the straight prompt, it produced results, some better than others. But of course I went on to tweak it, varying the description of the woman. Then made various additions to the style. In the process, I found a set of artist prompts that tends to produce very nice results in SD 1.5 (but not so much in SD 2.1). You need to try “Dan Witz, Mark Ryden, Margaret Keane, Pino Daeni” as a group in a prompt or twenty. (I intended to post some samples, and hopefully I will later, but Imgur is having “technical difficulties” for now.) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 13, 2023, 9:46pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1241 "2023-03-13T21:46:10Z")
Imgur still isn’t working, so I’m trying out a different hosting site. So I’ll skip posting examples of the plain reddit prompt and simple variations. But here are variations after adding “Dan Witz, Mark Ryden, Margaret Keane, Pino Daeni” to the prompt. I started out with simple changes of the physical description, including aging her up and down. The sweater became a Christmas sweater (and then a Cthulhu Christmas sweater) to add a new level of detail. Trying for cat sweaters lead to cat people. [![](https://i.postimg.cc/V66bHVcv/4sample2.jpg) ](https://i.postimg.cc/V66bHVcv/4sample2.jpg) [![](https://i.postimg.cc/qRKcJFzR/4sample5.jpg) ](https://i.postimg.cc/qRKcJFzR/4sample5.jpg) [![](https://i.postimg.cc/pT6nNJ2Z/4sample3.jpg) ](https://i.postimg.cc/pT6nNJ2Z/4sample3.jpg) I went further afield. The Olan Mills moose-ish insert in the Santa shot happened all on its own without being in the prompt. [![](https://i.postimg.cc/VkqMStRf/4sample4.jpg) ](https://i.postimg.cc/VkqMStRf/4sample4.jpg) Then I pretty much abandoned the original prompt entirely and made famous people riding things. (The last is George Lucas on the shark.) [![](https://i.postimg.cc/rsRRqRsL/4sample1.jpg) ](https://i.postimg.cc/rsRRqRsL/4sample1.jpg) This final example was reasonably close to the original meme prompt (Imagine japanese girl, mid-teens, great smile, christmas sweater, jeans, 4k, medium shot, Dan Witz, Mark Ryden, Margaret Keane, Pino Daeni). I did some infill tweaks and expanded the top and bottom. Her body proportions are really distorted, but I think she turned out pretty cute [![](https://i.postimg.cc/yNnZjzt2/cupgirl-before-after.jpg) ](https://i.postimg.cc/yNnZjzt2/cupgirl-before-after.jpg) [Previous page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=61) [Next page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=63)