# Open AI's latest wonder: text to video with Sora

**URL:** <https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648>\
**Category:** Cafe Society\
**Tags:** ai\
**Created:** [February 16, 2024, 9:36am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648 "2024-02-16T09:36:30Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lantern2](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lantern2/32/3010_2.png) [@Lantern2](https://boards.straightdope.com/u/Lantern2)\
**Post date:** [February 16, 2024, 9:36am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/1 "2024-02-16T09:36:30Z")

</div>

> **[Sora: Creating video from text](https://openai.com/sora)**

The latest sensation sweeping the Intertubes.

Some thoughts:  
I don’t follow this space closely but I am stunned at the quality of the videos, the level of detail and the ability to modify on the fly. I would have guessed this would be years away.  
I think what we have seen is already good enough to be used in short advertising videos. The video ad industry may be revolutionized practically overnight.

I wonder how much compute these videos require and I am guessing an enormous amount compared to a single picture in Dall-E. The full service will probably be expensive though possibly they may release a lower-quality service with strict quantity limits as part of the Chat GPT subscription.

The scope for mischief, political and otherwise, is obvious. There are no doubt safety features to prevent the use of celebrities on these videos but smart people may find a way around them and there are lots of other harmful things people could do. It will be an interesting race between OpenAI and assorted miscreants, not least in a US Presidential election year.

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 16, 2024, 10:04am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/2 "2024-02-16T10:04:04Z")

</div>

> [@Lantern2](#):
>
> I don’t follow this space closely but I am stunned at the quality of the videos

The videos are a pretty huge leap above the next best, both in quality and duration. One of the most impressive ones to me is the cat in the 5th video of the last set.

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 16, 2024, 10:12am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/3 "2024-02-16T10:12:52Z")

</div>

Another one that especially impressed me was the second video in the 3rd set, the view out the train window that at one point passes through shadow and you can see the reflection of the passenger.

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 16, 2024, 10:21am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/4 "2024-02-16T10:21:12Z")

</div>

Here’s that cat video alone in a Twitter post:

> <https://twitter.com/bennash/status/1758200859547025779>

---

<div class="post-metadata">

**Author:** ![Pardel-Lux](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pardel-lux/32/20182_2.png) [@Pardel-Lux](https://boards.straightdope.com/u/Pardel-Lux)\
**Post date:** [February 16, 2024, 10:21am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/5 "2024-02-16T10:21:30Z")

</div>

Bloody hell! This is highly demotivating: why invest any effort at all in painting or drawing when the AI can do it effortlessly? I should learn prompting instead of drawing, where can I learn that?

---

<div class="post-metadata">

**Author:** ![solost](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/solost/32/11776_2.png) [@solost](https://boards.straightdope.com/u/solost)\
**Post date:** [February 16, 2024, 1:41pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/6 "2024-02-16T13:41:55Z")

</div>

That is insane.

> [@Pardel-Lux](#):
>
> Bloody hell! This is highly demotivating: why invest any effort at all in painting or drawing when the AI can do it effortlessly? I should learn prompting instead of drawing, where can I learn that?

I know how you feel. Whenever an AI thread like this one appears, you get some posters saying “what’s left for us humans now?” followed by other posters saying that the AI revolution will open up all kinds of new career opportunities. But doing what? Are we all to become mere AI prompt jockeys?

**Studio head:** this video of T Rexs battling woolly mammoths in an alien gladiatorial arena is amazing, Smith! I like the little touch of the rainy weather and the reflections from the wet floor of the open arena.

**AI Prompt Jockey Smith:** That was my idea, sir! I typed “the arena is open to the alien planet’s weather, and the floor of the arena is wet and reflects the action like a mirror”.

**Studio head:** Fantastic work, Smith! I see a promotion to _ **Head** _ AI Prompt Jockey in your future!

---

<div class="post-metadata">

**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\
**Post date:** [February 16, 2024, 2:11pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/7 "2024-02-16T14:11:35Z")

</div>

People said the same thing when photography became a thing. Why bother drawing or painting when a camera will do it effortlessly?

---

<div class="post-metadata">

**Author:** ![CoolHandCox](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/coolhandcox/32/16233_2.png) [@CoolHandCox](https://boards.straightdope.com/u/CoolHandCox)\
**Post date:** [February 16, 2024, 2:22pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/8 "2024-02-16T14:22:01Z")

</div>

Wow.

Just so I’m clear, is AI generating these videos from nothing (versus finding it somewhere)?

---

<div class="post-metadata">

**Author:** ![Dorjan](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dorjan/32/12440_2.png) [@Dorjan](https://boards.straightdope.com/u/Dorjan)\
**Post date:** [February 16, 2024, 2:45pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/9 "2024-02-16T14:45:35Z")

</div>

> [@CoolHandCox](#):
>
> Just so I’m clear, is AI generating these videos from nothing (versus finding it somewhere)?

That is correct, the videos are generated from the text prompt describing it.

---

<div class="post-metadata">

**Author:** ![Pardel-Lux](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pardel-lux/32/20182_2.png) [@Pardel-Lux](https://boards.straightdope.com/u/Pardel-Lux)\
**Post date:** [February 16, 2024, 3:42pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/10 "2024-02-16T15:42:57Z")

</div>

> [@Johnny\_Bravo](#):
>
> People said the same thing when photography became a thing.

But now it is [digital](https://schumanchu.eu/html/l/l_00074digital~world.html), if you get my drift.

---

<div class="post-metadata">

**Author:** ![Lantern2](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lantern2/32/3010_2.png) [@Lantern2](https://boards.straightdope.com/u/Lantern2)\
**Post date:** [February 16, 2024, 6:03pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/11 "2024-02-16T18:03:54Z")

</div>

> [@Pardel-Lux](#):
>
> Bloody hell! This is highly demotivating: why invest any effort at all in painting or drawing when the AI can do it effortlessly? I should learn prompting instead of drawing, where can I learn that?

There is still a lot that AI can’t do and for the most part AI be more for brainstorming and raw material directly providing a polished final product. But yes the AI will get better and humans will have to constantly relearn new skills to fill in the gaps of what AI cannot do yet. As AI fills in those gaps, new gaps will appear and the rewards will go to the workers who can fill them the quickest. That is how work will be in the forseeable future.

There is a whole new emerging field of “prompt engineering”. You will find some resources on Youtube and the rest you can pick up on your own through trial and error.

---

<div class="post-metadata">

**Author:** ![Sitnam](https://avatars.discourse-cdn.com/v4/letter/s/6a8cbe/32.png) [@Sitnam](https://boards.straightdope.com/u/Sitnam)\
**Post date:** [February 16, 2024, 6:34pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/12 "2024-02-16T18:34:10Z")

</div>

My father is a bit nervous that AI videos will come out with a generated AI Biden saying something heinous and 2/3 of America will believe it enough to swing the election. Almost like the email harangues about Hillary’s computer.

That doesn’t seem beyond reason here.

---

<div class="post-metadata">

**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\
**Post date:** [February 16, 2024, 6:41pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/13 "2024-02-16T18:41:17Z")

</div>

I’ve posted this clip before in threads about generative AI, but this is the future I’ve always wanted. Tell the computer anything you want, the computer makes it.

[![](https://img.youtube.com/vi/NXX0dKw4SjI/maxresdefault.jpg "It Was Long") ](https://www.youtube.com/watch?v=NXX0dKw4SjI)

(And the holodeck didn’t have celebrity “guard rails”, either. You want to date Leah Brahms? Sure, have at it!)

---

<div class="post-metadata">

**Author:** ![Maserschmidt](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/maserschmidt/32/18829_2.png) [@Maserschmidt](https://boards.straightdope.com/u/Maserschmidt)\
**Post date:** [February 17, 2024, 3:45pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/14 "2024-02-17T15:45:41Z")

</div>

> [@CoolHandCox](#):
>
> Just so I’m clear, is AI generating these videos from nothing (versus finding it somewhere)?

> [@Dorjan](#):
>
> That is correct, the videos are generated from the text prompt describing it.

I mean, kind of? Mostly? (NB he mixes up left and right in the original tweet)

> <https://twitter.com/bcmerchant/status/1758537510618304669?s=61&t=7zPHcBzjb1UW-wh6DrDc3g>
>
> Eduardo Borges @duborges

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [February 17, 2024, 3:49pm UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/15 "2024-02-17T15:49:17Z")

</div>

Well, not from _nothing_ exactly - it’s producing these based on its training, which consists of ‘looking’ intently at a lot of existing videos.

It’s not copying those videos or making a collage of pieces of them, or anything as simple as that; it’s ‘watched’ a lot of videos and on the basis of that training, ‘knows’ how to make them.

---

<div class="post-metadata">

**Author:** ![CoolHandCox](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/coolhandcox/32/16233_2.png) [@CoolHandCox](https://boards.straightdope.com/u/CoolHandCox)\
**Post date:** [February 18, 2024, 1:40am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/16 "2024-02-18T01:40:17Z")

</div>

Thanks. That answers my question.

---

<div class="post-metadata">

**Author:** ![Smapti](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/smapti/32/17938_2.png) [@Smapti](https://boards.straightdope.com/u/Smapti)\
**Post date:** [February 18, 2024, 1:50am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/17 "2024-02-18T01:50:03Z")

</div>

> [@Darren\_Garrison](#):
>
> Another one that especially impressed me was the second video in the 3rd set, the view out the train window that at one point passes through shadow and you can see the reflection of the passenger.

And not pointing her phone at the window, thereby showing off that this video is impossible.

---

<div class="post-metadata">

**Author:** ![Ponderoid](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ponderoid/32/19221_2.png) [@Ponderoid](https://boards.straightdope.com/u/Ponderoid)\
**Post date:** [February 18, 2024, 2:06am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/18 "2024-02-18T02:06:38Z")

</div>

> [@Darren\_Garrison](#):
>
> but this is the future I’ve always wanted. Tell the computer anything you want, the computer makes it.

That was so rare for them to showcase the holodeck’s potential like that.

Another favorite holodeck scene in which inspired use of that tech enables an augmented intelligence hard takeoff:

[![](https://img.youtube.com/vi/O9lGfLAvTVk/maxresdefault.jpg "Barclay?!") ](https://www.youtube.com/watch?v=O9lGfLAvTVk&t=172s)

---

<div class="post-metadata">

**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\
**Post date:** [February 18, 2024, 2:14am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/19 "2024-02-18T02:14:25Z")

</div>

> [@Sitnam](#):
>
> My father is a bit nervous that AI videos will come out with a generated AI Biden saying something heinous and 2/3 of America will believe it enough to swing the election.

Deep fakes have been a reality for a while unfortunately. Debunking them has become an industry.

Don’t forget the flip side of that which Trump tries to exploit frequently; that the existence of fake videos gives people the chance to claim a real video, audio, or photo is fake.

---

<div class="post-metadata">

**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\
**Post date:** [February 18, 2024, 2:39am UTC](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648/20 "2024-02-18T02:39:15Z")

</div>

Extremely impressive alright, and I’m going to have to start doing some reading about it! But in the spirit of “a picture is worth a thousand words” and a video presumably many times more, ISTM that a great deal of the detail must be supplied by the AI unprompted since it would be practically impossible to describe it all. I imagine this must make heavy use of iteration.

[Next page](https://boards.straightdope.com/t/open-ais-latest-wonder-text-to-video-with-sora/997648.md?page=2)
