# Open AI's latest wonder: text to video with Sora **URL:** \ **Category:** Cafe Society\ **Tags:** ai\ **Created:** [February 16, 2024, 9:36am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648 "2024-02-16T09:36:30Z")\ **Posts on this page:** 20\ **Page:** 3
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 15, 2024, 12:59am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/41 "2024-03-15T00:59:07Z")
The link embedded the video directly instead of giving a link like I expected. Here’s the site > **[Haiper | Generative AI For Video Content Creation](https://haiper.ai/)** > > Transform your vision into reality with Haiper’s generative AI video tools. Unleash your creativity and bring your ideas to life like never before. ---
**Author:** ![MortSahlFan](https://avatars.discourse-cdn.com/v4/letter/m/3bc359/32.png) [@MortSahlFan](https://boards.straightdope.com/u/MortSahlFan)\ **Post date:** [March 18, 2024, 7:13pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/42 "2024-03-18T19:13:37Z")
Thanks for posting the free site… There’s a lot of technology I can’t stand, even music, and can’t listen to “drum machines” et et., but this new AI stuff (starting with vocals) is great for someone who wants to do something who might not have the money and/or patience to deal with people who won’t show up. ---
**Author:** ![MortSahlFan](https://avatars.discourse-cdn.com/v4/letter/m/3bc359/32.png) [@MortSahlFan](https://boards.straightdope.com/u/MortSahlFan)\ **Post date:** [March 18, 2024, 10:18pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/43 "2024-03-18T22:18:55Z")
Wow, I just used it, but only the free trial… How do you describe what you wanna get? It doesn’t seem to understand what I say, but 4 seconds isn’t much time, although some reactions are very weird and nothing close to what I typed out. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 18, 2024, 10:39pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/44 "2024-03-18T22:39:50Z")
That Haiper is much, much less sophisticated than Sora. (Or Runway, whichever one you tried.) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [March 22, 2024, 8:15pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/45 "2024-03-22T20:15:47Z")
> **[Runway now lets you give your AI video characters a voice — and I put it to...](https://www.tomsguide.com/ai/ai-image-video/runway-now-lets-you-give-your-ai-video-characters-a-voice-and-i-put-it-to-the-test)** > > It even animates the head ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [April 5, 2024, 5:23pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/46 "2024-04-05T17:23:34Z")
Awesome. > **[OpenAI just dropped a Sora nature documentary — check out the fake hybrid...](https://www.tomsguide.com/ai/ai-image-video/forget-david-attenborough-sora-just-dropped-an-ai-generated-nature-documentary-for-made-up-animals)** > > See mom... pigs can fly! ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 15, 2024, 4:50pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/47 "2024-06-15T16:50:51Z")
The newest contender, Dream Machine. > **[14 Legendary Memes That, With The Help Of AI, We Can Finally See What Happens...](https://www.boredpanda.com/video-meme-recreations-funny/)** > > The Internet is being flooded by AI animations of famous memes and here are 14 of them. ---
**Author:** ![Maserschmidt](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/maserschmidt/32/18829_2.png) [@Maserschmidt](https://boards.straightdope.com/u/Maserschmidt)\ **Post date:** [June 15, 2024, 5:06pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/48 "2024-06-15T17:06:19Z")
Jesus, many of those are terrifying in the Salvador Dali acid dream kind of way. ---
**Author:** ![Velocity](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/velocity/32/18006_2.png) [@Velocity](https://boards.straightdope.com/u/Velocity)\ **Post date:** [June 15, 2024, 5:35pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/49 "2024-06-15T17:35:06Z")
Quite possible that within a decade, everyone can be their own private movie director. You don’t need $200 million anymore, you might be able to create a full-length blockbuster film for just $20/month. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 15, 2024, 9:15pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/50 "2024-06-15T21:15:49Z")
I’ve tried Dream Machine now (free accounts get 30 videos per month). Unlike Runway and Stable Diffusion Video, which do not allow text prompts to be included with an image prompt, Dream Machine requires it. Out of 8 videos that I’ve reated from images, there is only one that I consider highly successful. The rest are from simply disappointing (only moving the camera around but not the subject) to weird failures. The one success is a Dall-E created image that I have put through all three engines. Dream Machine has the best results of the three. [![](https://img.youtube.com/vi/CtMooiPk-q8/maxresdefault.jpg "Runway image to video test") ](https://www.youtube.com/watch?v=CtMooiPk-q8) [![](https://img.youtube.com/vi/gHQEKke0EMw/hqdefault.jpg "Stable Diffusion image to video test") ](https://www.youtube.com/watch?v=gHQEKke0EMw) [![](https://img.youtube.com/vi/EvXwuyoIxNI/maxresdefault.jpg "Dream Machine image to video test") ](https://www.youtube.com/watch?v=EvXwuyoIxNI) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 15, 2024, 9:27pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/51 "2024-06-15T21:27:20Z")
And here are two failures. What I hoped to see was the cat moving some and the thing on the wall wiggling around a little. The prompt with the image was “A cat in a room with an octopus alien behind it.” [![](https://img.youtube.com/vi/1ZTyxnNxwV4/maxresdefault.jpg "Dream Machine test") ](https://www.youtube.com/watch?v=1ZTyxnNxwV4) What I hoped for was the face on the seashell being animated. (That is a photo of a real helmet shell with a face that was infilled using Stable Diffusion.) The prompt was “A laughing talking seashell monster”. [![](https://img.youtube.com/vi/G7V4xaOllJA/maxresdefault.jpg "Dream Machine test") ](https://www.youtube.com/watch?v=G7V4xaOllJA) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 16, 2024, 7:29pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/52 "2024-06-16T19:29:25Z")
I love this one. Using this image [![](https://i.postimg.cc/4y2CZDxv/ugly-cute-scary-funny-weirds-fossil-polaroid-kodachrome-ektar-1970s-954451527-1.jpg) ](https://i.postimg.cc/4y2CZDxv/ugly-cute-scary-funny-weirds-fossil-polaroid-kodachrome-ektar-1970s-954451527-1.jpg) And the prompt “An alien and a man posing for a photo at night.” Got this: [![](https://img.youtube.com/vi/GP_EZe4Qka0/maxresdefault.jpg "Dream Machine sample talkative alien") ](https://www.youtube.com/watch?v=GP_EZe4Qka0) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 17, 2024, 5:42pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/53 "2024-06-17T17:42:56Z")
The queue time to create a Luma Dream Machine video is up around 6 hours now. This one submitted last night is my favorite yet, not only cute but also technically very impressive. Notice how it manages to separate the individual whiskers on the cats and hairs on the elephant from the background and move them around mostly realistically. [![](https://img.youtube.com/vi/1F-CnlwRBlk/maxresdefault.jpg "Luma Dream Machine sample video") ](https://www.youtube.com/watch?v=1F-CnlwRBlk) On an opposite note, there is censorship involved in the system. When I submitted this image (with a prompt of something like "strange biological specimen flopping on a dissecting tray) it was rejected with a message about an unsafe image detected. [![](https://i.postimg.cc/Gtg2CrVv/chrome-image-Jul-15-2023-1-29-18-AM-EDT.jpg) ](https://i.postimg.cc/Gtg2CrVv/chrome-image-Jul-15-2023-1-29-18-AM-EDT.jpg) An article I read about the engine says that it can create 120 frames in 120 seconds. (Since the videos are 5 seconds that of course means they are at 24 fps.) ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [June 18, 2024, 1:05pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/54 "2024-06-18T13:05:45Z")
And now there is new version of Runway, announced yesterday. > **[Runway unveils Gen-3 — AI video just took a big leap forward](https://www.tomsguide.com/ai/ai-image-video/runway-unveils-gen-3-ai-video-just-took-a-big-leap-forward#section-1-taking-the-train)** > > Promises better motion and realism ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 10, 2024, 12:19am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/55 "2024-12-10T00:19:19Z")
It’s heéeeeeeeere. > **[OpenAI has finally released Sora](https://www.theverge.com/2024/12/9/24317092/openai-sora-text-to-video-ai-launch)** > > OpenAI’s text-to-video tool is now widely available. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [December 10, 2024, 5:30am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/56 "2024-12-10T05:30:55Z")
It’s still awful at text: > Nevertheless, just about everything else about it is perfect. The talking heads, the scrolling chyron, the hard-to-describe quality of the different video feeds, etc. ---
**Author:** ![Maserschmidt](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/maserschmidt/32/18829_2.png) [@Maserschmidt](https://boards.straightdope.com/u/Maserschmidt)\ **Post date:** [December 10, 2024, 2:29pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/57 "2024-12-10T14:29:03Z")
> [@Dr.Strangelove](#): > > [x.com](https://x.com/MKBHD/status/1866152437838393797) It’s just happening to freeze on a panel where there are cars on the sidewalk in odd places & the roadway/sidewalk are blended, but it does look plausible. Sora is now open as of yesterday, but they’ve suspended account creation because of heavy traffic, even if you already have an OpenAI user ID. But I’m looking forward to playing with it! ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 10, 2024, 5:21pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/58 "2024-12-10T17:21:06Z")
Saw this just now. Possibly Sora, possibly one of the others. > **[57K views · 10K reactions | | | | | | | #cat #cats #mcm #catpuppet #monsters...](https://www.facebook.com/reel/1088868609455894?mibextid=D5vuiz&rdid=znFzeScznAdTwvHT&share_url=https%3A%2F%2Fwww.facebook.com%2Fshare%2Fr%2F1X381WJZQy%2F%3Fmibextid%3DD5vuiz)** > > | > | > | > | > | > | > \#cat #cats #mcm #catpuppet #monsters #1960s #scifi #vintagescifi #horror #midcenturymodern #vintagedolls #psychedelic > \#trippy   #horrormovie #puppet > \#aiart #hailuoai #hailuo... ---
**Author:** ![Lantern2](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lantern2/32/3010_2.png) [@Lantern2](https://boards.straightdope.com/u/Lantern2)\ **Post date:** [December 11, 2024, 8:35am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/59 "2024-12-11T08:35:30Z")
Can’t wait to try it. I am a Chat GPT Plus user and I think we get some free credits though it doesn’t seem to be open yet. I wonder what the first use cases at scale will be. This thing seems perfect for amateur music videos and small music groups will probably use it for that. Shouldn’t be too difficult to integrate real video footage of a group with video generated by AI. Commercials for smaller companies would be another big use case. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 21, 2024, 2:21am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/60 "2024-12-21T02:21:51Z")
Yet another video model: > **[A new, uncensored AI video model may spark a new AI hobbyist movement](https://arstechnica.com/ai/2024/12/a-new-uncensored-ai-video-model-may-spark-a-new-ai-hobbyist-movement/)** > > Will Tencent’s “open source” HunyuanVideo launch an at-home “Stable Diffusion” moment for uncensored AI video? [Previous page](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648.md?page=2) [Next page](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648.md?page=4)