# Digital art creator algorithm website **URL:** \ **Category:** Cafe Society\ **Tags:** arts-crafts, ai\ **Created:** [April 1, 2022, 1:26am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081 "2022-04-01T01:26:49Z")\ **Posts on this page:** 20\ **Page:** 92
**Author:** ![Tibby](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tibby/32/17030_2.png) [@Tibby](https://boards.straightdope.com/u/Tibby)\ **Post date:** [December 3, 2023, 12:53pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1823 "2023-12-03T12:53:31Z")
I’ve found Stable Video Diffusion to be pretty good at rotating some objects, like nature scenes, but less accurate with artificial objects, and terrible with printed items, like labels. I was kind of expecting that. I rendered rotating jars with product labels surrounded by a variety of medicinal plants with penetrating sun rays. The plants and sun-rays rotated and looked great; the jars deformed a little; the labels immediately became unrecognizable. It would take time consuming tracking and rotobrushing of the labels in After Effects for me to make that clip look realistic. But, I see the potential with Stable Video. I think it’s just a matter of time until it nails nature, man-made, and print. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [December 3, 2023, 6:07pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1824 "2023-12-03T18:07:24Z")
> [@Darren\_Garrison](#): > > This is a compilation of 75 if the 4 second clips, all generated from images I made using Dall-E or Stable Diffusion. Of course, one would expect it to have better comprehension of the sorts of objects it’s generating in the first place. Does it perform as well with real or human-generated images? And is there any ability to prompt it for what kind of motion you want? ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 6:15pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1825 "2023-12-03T18:15:12Z")
I haven’t experimented with real photos yet. The version I use doesn’t allow for any type of prompt or instructions at all. Probably not a fundamental limitation of the model itself, though. > **[Stable Video Diffusion - a Hugging Face Space by multimodalart](https://huggingface.co/spaces/multimodalart/stable-video-diffusion)** > > Discover amazing ML apps made by the community ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 3, 2023, 6:38pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1826 "2023-12-03T18:38:20Z")
I haven’t seen any Video Diffusion examples/clients that suggested I could say “Make him wave” or “She should be move her hands to be steering the car”. It’s more like small rotations, jerky movements\* and wind/water effects. Amusing, if unconvincing, with the results usually looking like a student’s first CGI project video. I think I’m currently more excited about the One Step diffusion generation than this though I’m sure it’ll get there. \*Jerky movements could possibly be helped by increasing framerates which means longer generation times. But a lot of it is just in the rendering itself and the AI not knowing the steps in creating an convincing eyebrow lift or smile. I don’t see any reason why it wouldn’t work on a photo. You’re just uploading a jpg or png file and the AI doesn’t know what the origin of that file was. I uploaded it locally just because I enjoy having the option for local control of my stuff and because you never know when an online provider will lock stuff down. It takes a long time (40+min) on my 12GB 3080Ti though and that’s a heck of a wait to say “Heh” at the result so I don’t see myself using it very often. Of course, queues for free online generators also take a long while. 4090s are going for $2,500 (!!) now which makes me reflect on when I scoffed at buying for the inflated price for $1,800 😃 ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 3, 2023, 7:16pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1827 "2023-12-03T19:16:18Z")
Random recent renders presented without comment just for funsies [![](https://i.imgur.com/fFlYxNR.png) ](https://i.imgur.com/fFlYxNR.png) [![](https://i.imgur.com/yCMuO66.png) ](https://i.imgur.com/yCMuO66.png) [![](https://i.imgur.com/j1umoeG.png) ](https://i.imgur.com/j1umoeG.png) [![](https://i.imgur.com/DCXDUav.png) ](https://i.imgur.com/DCXDUav.png) [![](https://i.imgur.com/btNst9I.png) ](https://i.imgur.com/btNst9I.png) [![](https://i.imgur.com/pWfceK0.png) ](https://i.imgur.com/pWfceK0.png) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 7:17pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1828 "2023-12-03T19:17:04Z")
It takes around a minute or so on the A10G at Hugging Face. The wait varies, from maybe 5 minutes up to around 15. When I’m using it I usually have one copy open in Firefox and one in Chrome, so the time is effectively halved. ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 3, 2023, 7:22pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1829 "2023-12-03T19:22:50Z")
I was getting 15-20min queues but I’m sure that depends on time of day, phase of moon and luck. Certainly better than running it locally though I like to keep my options open for when some organization suddenly decides that “Joe Biden beatboxing” or “woman with bare ankles” is verboten. I haven’t used it a ton though (from either method) since the current results typically range from mildly amusing to “I waited 20min for this?”. Midjourney is supposedly integrating more robust video creation in their upcoming model(s) so maybe that’ll be more worthwhile. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 7:39pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1830 "2023-12-03T19:39:01Z")
I forgot, I have tried one photo with SVD: [![](https://img.youtube.com/vi/-57QqhAZwVU/hqdefault.jpg "Woman yells at cat, the motion picture") ](https://www.youtube.com/watch?v=-57QqhAZwVU) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 8:14pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1831 "2023-12-03T20:14:34Z")
One thing that I’ve thought about with image generators. We’ve gone through the stage of raw experimentation, being impressed to see anything at all. We’ve gone through the stage of laughing at how bad mistakes are. We’ve gone through the stage of showing off the language tricks you have to use to get the type of image you want. But now we are entering the stage where you have an idea for a concept that you want to illustrate, and you simply type in a prompt and get it. Especially with Dall-E 3. It isn’t nearly pefrect yet, but it is getting there. For example, trending since yesterday on the Facebook AI groups are posts that start with “You’ve heard of Elf on the Shelf, but how about…” followed by an image, and it isn’t about the process of getting it(, and it isn’t about laughing at the flaws in the image, but is about the image itself. (Here are some I have generated) [![](https://i.postimg.cc/RqrX3r0K/espg.jpg) ](https://i.postimg.cc/RqrX3r0K/espg.jpg) ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 3, 2023, 8:24pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1832 "2023-12-03T20:24:02Z")
I animated a couple clips using images from Midjourney. Although they were four second clips, they both should have stopped after second number three 😃 [https://i.imgur.com/Vk4F5nX.mp4](https://i.imgur.com/Vk4F5nX.mp4) [https://i.imgur.com/E4UpG4H.mp4](https://i.imgur.com/E4UpG4H.mp4) Rocket-Trike baby was more successful [https://i.imgur.com/mqDW499.mp4](https://i.imgur.com/mqDW499.mp4) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 8:30pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1833 "2023-12-03T20:30:29Z")
I tried an experiment of taking the final frame from a clip I liked (the swaying ghosts from the beginning of my compilation video) and using that as an input for a new clip. Unfortunately neither continued the same type of action. One did a pan, the other had the ghosts hopping and dissolving into a mess. I don’t know if I would have got more consistent results if I had preserved the original seed, but probably not. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 8:42pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1834 "2023-12-03T20:42:31Z")
Okay, I just did a video of a photo of my cat. (This time the wait was more than 20 minutes). It only did a shakeycam thing instead of giving the cat any movement, but it did a reasonable job of creating parallax changes on the various depths of objects. [![](https://img.youtube.com/vi/TZs2mBBZP04/hqdefault.jpg "Stable Video Diffusion img2video of cat") ](https://www.youtube.com/watch?v=TZs2mBBZP04) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 3, 2023, 9:15pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1835 "2023-12-03T21:15:17Z")
SDV does have a slider for the amount of motion, which I haven’t messed with before. I tried the cat photo again (another 20 minute wait) with the slider moved from the default of 127 to the max of 255. This time…it did not go well. [![](https://img.youtube.com/vi/B901JEmMqkw/hqdefault.jpg "SVD cat img2video, take two") ](https://www.youtube.com/watch?v=B901JEmMqkw) ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [December 4, 2023, 5:21am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1836 "2023-12-04T05:21:14Z")
Not sure how this happened. Interesting, though. [![](https://images.nightcafe.studio/jobs/ESfQjDupA6T015krqnV7/ESfQjDupA6T015krqnV7--1--gfyfs.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/ESfQjDupA6T015krqnV7/ESfQjDupA6T015krqnV7--1--gfyfs.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 4, 2023, 5:48am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1837 "2023-12-04T05:48:24Z")
A prompt with terms like infographic or informational poster will often give similar results. YMMV of course. ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [December 4, 2023, 5:51am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1838 "2023-12-04T05:51:54Z")
I wasn’t trying for more Sci-Fi covers but these look like they belong on pulp novels. [![](https://images.nightcafe.studio/jobs/lBwCT7c7m7VfEuQtIep0/lBwCT7c7m7VfEuQtIep0--9--p2348.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/lBwCT7c7m7VfEuQtIep0/lBwCT7c7m7VfEuQtIep0--9--p2348.jpg?tr=w-1600,c-at_max) [![](https://images.nightcafe.studio/jobs/lBwCT7c7m7VfEuQtIep0/lBwCT7c7m7VfEuQtIep0--14--9sy24.jpg?tr=w-1600,c-at_max) ](https://images.nightcafe.studio/jobs/lBwCT7c7m7VfEuQtIep0/lBwCT7c7m7VfEuQtIep0--14--9sy24.jpg?tr=w-1600,c-at_max) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 5, 2023, 2:41am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1839 "2023-12-05T02:41:16Z")
> [@Jophiel](#): > > As a result, it was completing _two images per second_ on my RTX 3080Ti when I tested it. That’s hecka fast. [https://www.reddit.com/r/StableDiffusion/comments/189onqs/today\_i\_hit\_77\_images\_per\_second\_at\_512x512\_with/](https://www.reddit.com/r/StableDiffusion/comments/189onqs/today_i_hit_77_images_per_second_at_512x512_with/) ---
**Author:** ![Jophiel](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jophiel/32/66_2.png) [@Jophiel](https://boards.straightdope.com/u/Jophiel)\ **Post date:** [December 5, 2023, 3:03am UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1840 "2023-12-05T03:03:38Z")
Hah, that’s cool. For lack of a 4090 though I’ll still be happy with 2+ images per second 😉 ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 5, 2023, 7:51pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1841 "2023-12-05T19:51:48Z")
> **[Chinese Tech Giant Alibaba Shows Off AI That Can ‘Animate Anyone’ - Decrypt](https://decrypt.co/208614/chinese-tech-giant-alibaba-shows-off-ai-that-can-animate-anyone?amp=1)** > > If you can't dance, Animate Anyone can make it happen with just one still photo. And MagicAnimate is gaining fast. ---
**Author:** ![Dr\_Paprika](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr_paprika/32/3042_2.png) [@Dr\_Paprika](https://boards.straightdope.com/u/Dr_Paprika)\ **Post date:** [December 5, 2023, 9:19pm UTC](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081/1842 "2023-12-05T21:19:01Z")
As an aside to this fascinating thread (and it is amazing how it has evolved in a short time), which platforms would you now recommend to play around with: A) which is free? B) which is low cost? C) which is most professional? [Previous page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=91) [Next page](https://boards.straightdope.com/t/digital-art-creator-algorithm-website/962081.md?page=93)