OpenAI SORA: Creating Video from Text

The place for questions about shooting with Blackmagic Cameras.
  • Author
  • Message
Offline
User avatar

robedge

  • Posts: 2691
  • Joined: Tue Dec 24, 2019 1:24 am
  • Location: U.S.
  • Real Name: Rob Edge

OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 2:56 am

Announced today. Examples: https://openai.com/sora#research

The press has been ramping up coverage of this over the last few hours. Marques Brownlee posted a video about the examples a short while ago:

Video Cameras: iPhone, Pocket 4K
Microphones: Schoeps, DPA
Audio Recorder: Sound Devices
Offline
User avatar

Cary Knoop

  • Posts: 1452
  • Joined: Sun Mar 12, 2017 6:35 pm
  • Location: Newark, CA USA

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 3:26 am

Offline
User avatar

robedge

  • Posts: 2691
  • Joined: Tue Dec 24, 2019 1:24 am
  • Location: U.S.
  • Real Name: Rob Edge

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 3:31 am

Cary Knoop wrote:Sora:
https://openai.com/sora


Just to avoid confusion, that's the same page as the link in the first post, except this link starts at the top of the page.
Video Cameras: iPhone, Pocket 4K
Microphones: Schoeps, DPA
Audio Recorder: Sound Devices
Offline

Tom Roper

  • Posts: 541
  • Joined: Sat Apr 14, 2018 4:59 pm
  • Real Name: Tom Roper

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 7:39 am

It's lovely but it's not here.
Last edited by Tom Roper on Sun Feb 18, 2024 7:21 pm, edited 2 times in total.
Offline

John Paines

  • Posts: 5820
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 3:22 pm

For once, this would actually seem to be a real new frontier -- not for image making, or for Hollywood, but for no-budget filmmaking (assuming, of course, the technology is freely available). The "uncanny valley", falling somewhere between live action and animation, would become another dramatic convention, the material sustaining a dreamy remove from both animation and live action movies. Until that effect is worked to death, it may actually serve as an enhancement.

These movies would still require "performance", as in dialogue delivery, but there are ways around that as well, for filmmakers (if they still are "filmmakers") without access to professional actors.

In a word, this is filmmaking for writers. Which would be a revolution in American independent film, where literary sensibilities are (trying to be kind) somewhat rudimentary.
Offline
User avatar

robedge

  • Posts: 2691
  • Joined: Tue Dec 24, 2019 1:24 am
  • Location: U.S.
  • Real Name: Rob Edge

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 4:38 pm

John Paines wrote:
These movies would still require "performance", as in dialogue delivery, but there are ways around that as well, for filmmakers (if they still are "filmmakers") without access to professional actors.


Harvesting of human voice samples and their use to "create" dialogue has already become an issue.
Video Cameras: iPhone, Pocket 4K
Microphones: Schoeps, DPA
Audio Recorder: Sound Devices
Offline

John Paines

  • Posts: 5820
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 16, 2024 4:48 pm

No, I'm thinking of other more basic strategies..... No harvesting or AI science required.

Of course, the interval of promise and freedom will last about 3 hours. Festivals, overwhelmed by submissions, will have to ban these productions outright, since they can't get through the thousands of live action submissions they already have to deal with. And big budget action pictures are already 98% fake, so nothing new there.

Eventually one application will write the script and "produce" the movie, at which point....
Offline
User avatar

Darko Djerich

  • Posts: 397
  • Joined: Wed Feb 27, 2013 10:00 pm
  • Location: Perth, Australia

Re: OpenAI SORA: Creating Video from Text

PostWed Feb 21, 2024 9:18 am

Great post, it would be interesting to see if BMD has something up the sleeves in AI coming up soon.

Been carefully observing all this, Chat GPT is very helpful, some of the image generating tools are also interesting.

As far as video, have not seen anything that is ready yet, perhaps, animation and cartoonish stuff for the younger audiences.

Directing acting and actors and creating story that touches on the human level, it is IMO personal touch that is unique to every director and relationship between the two.

Not a great fan nor I believe that true artistic value can be created with AI, generic, probably yes.

Humans are much more complex creatures then 3d models, yes, they can be Metahuman-ized and look stunning, my take on this, bit like Tarantino on film:

Why bother going thru all this trouble to make it like a human, just work with human.

Tarantino says similar thing about the film, why shoot on digital to look like film, just shoot film.

Argument goes both ways and there is no right or wrong, just a personal take.

I was tempted to wait and ad few scenes with AI SORA in my feature film, but after looking deeper into results, decided not to.
Artist
Creative Film Enterprises Pty Ltd
creativefilm.com.au
ARRI Alexa EV, ALEXA Plus, MBP M3Pro, iMac5k i7 48gb AERO 5 OLED rtx3070ti BMD eGPU phase one p40+, UM4.6 ef bmcc ef bmpcc, speed editor, Ultrastudio mini 4k dji Inspire RAW 4K
Offline

RubenS89

  • Posts: 47
  • Joined: Sat Jun 01, 2019 7:12 am
  • Real Name: Ruben Stuveling

Re: OpenAI SORA: Creating Video from Text

PostWed Feb 21, 2024 10:23 am

Completely agree Darko.

I feel people who say AI's are going to replace everything are gravely underestimating the intelligence, intellect, complexity and creativity of human beings. After all without human input an AI is literally nothing. Everything an AI creates is in one way, shape or form a derivative of what humans already created.
Offline

John Paines

  • Posts: 5820
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: OpenAI SORA: Creating Video from Text

PostWed Feb 21, 2024 2:30 pm

Darko Djerich wrote:Why bother going thru all this trouble to make it like a human, just work with human.


It's really just a matter of money. Among their samples, what do you think it would cost to build that Japanese set, and execute the crane shot? Or, the skill, investment and equipment needed even to do an animated version of it?

I don't think anyone is arguing for eliminating "human" content. But filmmaking is already 99.98% illusion. What's the difference between building a set on a sound stage and creating a credible one through AI?

Or consider classic Japanese animation, which doesn't aspire to realism. That remove from literal physical reality doesn't at all limit the scope or appeal of the material.
Offline
User avatar

Darko Djerich

  • Posts: 397
  • Joined: Wed Feb 27, 2013 10:00 pm
  • Location: Perth, Australia

Re: OpenAI SORA: Creating Video from Text

PostWed Feb 21, 2024 4:15 pm

John Paines wrote:
Darko Djerich wrote:Why bother going thru all this trouble to make it like a human, just work with human.


It's really just a matter of money. Among their samples, what do you think it would cost to build that Japanese set, and execute the crane shot? Or, the skill, investment and equipment needed even to do an animated version of it?

I don't think anyone is arguing for eliminating "human" content. But filmmaking is already 99.98% illusion. What's the difference between building a set on a sound stage and creating a credible one through AI?

Or consider classic Japanese animation, which doesn't aspire to realism. That remove from literal physical reality doesn't at all limit the scope or appeal of the material.




I was referring to 3d models of actors, not sets, directing actors vs asking AI to direct it for you.

AI is more hype IMO. Not sure i would go to cinema and want to pay ticket to watch AI film.

Cinema cameras are safe, not going anywhere.

I am usually excited about technology, and have no issue with AI, it has its use.

Just cant see the acting performance being done to the level of the human.
Artist
Creative Film Enterprises Pty Ltd
creativefilm.com.au
ARRI Alexa EV, ALEXA Plus, MBP M3Pro, iMac5k i7 48gb AERO 5 OLED rtx3070ti BMD eGPU phase one p40+, UM4.6 ef bmcc ef bmpcc, speed editor, Ultrastudio mini 4k dji Inspire RAW 4K
Offline

Howard Roll

  • Posts: 2559
  • Joined: Fri Jun 03, 2016 7:50 am

Re: OpenAI SORA: Creating Video from Text

PostThu Feb 22, 2024 3:23 pm

I expect this will initially be useful for b-roll and stock footage, probably some pretty useful game applications as well. In the near future AI, will become more relevant upstream.

AI basically breaks down the language barrier between humans and machines. It's like Star Trek, "Computer, generate an 1850's gold mining town". Once AI becomes available in apps like Blender, and After Effects things could get a little hairy. When AI is generating meshes then it can handle the broad strokes and the smaller elements can be finesses either through further AI manipulation or by hand.

...and yes, it's kind of a bummer than computers are once again the answer. However, folks are plugged in on average of nearly 7 hours a day. That's a massive demand for content. Ultimately AI will empower better content with higher production value. Sure, some folks will suffer as part of the development, that's how the industry, or any organism evolves.

I don't see a ton of difference between using AI and an LED volume, at a certain point it's all smoke and mirrors. Is it meaningful to the story if the town was generated in 30 seconds or it took 30 guys 30 days to build?

Good Luck
Offline

soohyun

  • Posts: 60
  • Joined: Mon Feb 07, 2022 2:22 am
  • Real Name: Soohyun Kim

Re: OpenAI SORA: Creating Video from Text

PostThu Feb 22, 2024 4:39 pm

I agree with Howard; this will become the "CGI" of narrative fiction. No production is going to ignore a cheap and easy way to make an otherwise complex and expensive shot. Closeups will probably use a real camera and a real actor, though.
Soohyun Kim

Micro Cinema Camera
Offline

John Paines

  • Posts: 5820
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: OpenAI SORA: Creating Video from Text

PostThu Feb 22, 2024 4:58 pm

Guys, I don't disagree, but such uses are assumed -- the industry will gladly adopt any cheaper and potentially better way of doing what they've already been doing for years with digital image making and green screen.

The new frontier, if there is one, would be outside the industry. "Real actors" is a different question..... And not as straightforward as it may seem.
Offline

soohyun

  • Posts: 60
  • Joined: Mon Feb 07, 2022 2:22 am
  • Real Name: Soohyun Kim

Re: OpenAI SORA: Creating Video from Text

PostThu Feb 22, 2024 6:15 pm

I mean, sure; if we're speaking long term, the day will come when consumers will be able to generate our own movie right here with our computers, without paying for a ticket at the movie theater or a subscription to a streaming service. Enter a prompt, modify the results as you like, and you'll have something that's literally perfect, because you made it to your own tastes.

There are many declaring that they'll never appreciate AI-generated content like that, but for the rest of the world, I suspect it won't be a hard pill to swallow. Those illustrators and pixiv artists who made a living off commissions that are now displaced by AI will be happy to chime in.

But for now, I'm speaking in the short term, as I'm sure nobody really knows exactly how we'll be affected, and we can only make predictions.
Soohyun Kim

Micro Cinema Camera
Offline

WahWay

  • Posts: 794
  • Joined: Tue Apr 07, 2020 11:54 am
  • Real Name: Simon Chan

Re: OpenAI SORA: Creating Video from Text

PostThu Feb 22, 2024 8:13 pm

A student today already asking us for access to Sora. Sorry we are not Tesla :D
Online
User avatar

Uli Plank

  • Posts: 21632
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 1:56 am

soohyun wrote:Enter a prompt, modify the results as you like, and you'll have something that's literally perfect, because you made it to your own tastes.


OMG, tons of cat videos and 'adult' stuff…
Now that the cat #19 is out of the bag, test it as much as you can and use the subforum.

Studio 18.6.6, MacOS 13.6.6, 2017 iMac, 32 GB, Radeon Pro 580
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G
Offline
User avatar

timbutt2

  • Posts: 2918
  • Joined: Tue Nov 12, 2013 10:32 am
  • Location: St. Petersburg, Florida, United States of Amercia

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 2:34 am

I'm of the personal belief that at some point people will reject the AI driven content and embrace the artistry of stories created by real people. AI generated content will be worth less that the work created by real humans. In the end, the studio execs who embrace AI as a replacement for people will suffer more financial loses.

Now, AI can be useful for helping filmmakers make their content. But in the end we will still strive to prove our worth by working with a team of people to create stories on the level of our predecessors. They didn't need AI to create such fantastic works. So, in the end artists will strive to prove they don't need it either.

More so we'll use it as a tool to eliminate the monotonous tasks no one likes to do. Rotoscoping, and such is a good example.

Granted, I'm also a person who believes a moron like David Zaslav can be replaced by AI but a filmmaker like Denis Villeneuve cannot be replaced.
"I'm well trained in the art of turning **** to gold." - Tim Buttner (timbutt2)

Cameras: URSA Mini Pro G2 & Pocket 6K Pro
Past: UM4.6K, P6K, BMCC 2.5K
Computers: iMac 5K (Mid 2020) & MacBook Pro Retina 15.4in (Mid 2018)
Online
User avatar

Uli Plank

  • Posts: 21632
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 2:42 am

As long as there are audiences who notice that difference, I second you.
Unfortunately, if I look at todays politics, and the influence of 'social' media on social interactions, I'm afraid we are a minority.
Now that the cat #19 is out of the bag, test it as much as you can and use the subforum.

Studio 18.6.6, MacOS 13.6.6, 2017 iMac, 32 GB, Radeon Pro 580
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G
Offline
User avatar

robedge

  • Posts: 2691
  • Joined: Tue Dec 24, 2019 1:24 am
  • Location: U.S.
  • Real Name: Rob Edge

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 4:53 am

I don't see why it won't be possible to generate an actor who looks and sounds just like, say, Humphrey Bogart. No shortage of samples to work from. Bogart made 75 films, and there may be plenty of him and his voice that isn't in the films.

Not quite good enough for current cinema? Change cinema to suit. Or massage games to suit. It's said that games are already bigger than cinema.

Add a talented producer, director and writer and you may have a hit on your hands, maybe several.
Video Cameras: iPhone, Pocket 4K
Microphones: Schoeps, DPA
Audio Recorder: Sound Devices
Online
User avatar

Uli Plank

  • Posts: 21632
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 5:12 am

robedge wrote:…, and there may be plenty of him and his voice that isn't in the films.

If somebody took care of the archives.
Now that the cat #19 is out of the bag, test it as much as you can and use the subforum.

Studio 18.6.6, MacOS 13.6.6, 2017 iMac, 32 GB, Radeon Pro 580
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G
Offline

WahWay

  • Posts: 794
  • Joined: Tue Apr 07, 2020 11:54 am
  • Real Name: Simon Chan

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 5:13 am

They could easily replace the poor CGI in Titanic with AI today.
Offline

John Paines

  • Posts: 5820
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 1:37 pm

timbutt2 wrote:I'm of the personal belief that at some point people will reject the AI driven content and embrace the artistry of stories created by real people. AI generated content will be worth less that the work created by real humans. In the end, the studio execs who embrace AI as a replacement for people will suffer more financial loses.


I think it's a whole lot simpler than that, for now. We're not talking, at least in the case of SORA, of producing anything other than visuals. Much of that is *already* digitally created, and even the less successful attempts (which is most of it) are generally accepted by audiences.

Whether actors could be synthesized, whether AI can write passable scripts, etc. is a whole other question, beyond SORA and what SORA could do for movie creation out of the home, as it were.

What this engine could do is make the writer predominate in movies, or movies of a certain kind, in the same way writers are (for example) predominate in the "golden age" of cable TV, which is recent. SORA potentially rids the writer of two great annoyances: the producer and the financiers. If there were more frustrated screenwriters in this thread, there would likely be more enthusiasm for this tool. Even if the result stands at a remove from live action, so what? The same is true of animation which, in other countries, is regarded as an art form, not children's entertainment or a marketing vehicle for other products.

This does of course raise uncomfortable questions about the nature of cinema -- and cinematography. But since "cinema", in that sense, is generally unattainable without money, it's less urgent at the low budget end. The choice would be between a movie which exists and a movie which never will. So there's nothing to compare.
Offline
User avatar

Peter J. DeCrescenzo

  • Posts: 2424
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Portland, Oregon USA

Re: OpenAI SORA: Creating Video from Text

PostFri Feb 23, 2024 9:45 pm

FYI: Tyler Perry, a guy who writes checks to pay people in the cinema business, has thoughts on the topic:

https://www.hollywoodreporter.com/busin ... 235833276/
Offline
User avatar

timbutt2

  • Posts: 2918
  • Joined: Tue Nov 12, 2013 10:32 am
  • Location: St. Petersburg, Florida, United States of Amercia

Re: OpenAI SORA: Creating Video from Text

PostSat Feb 24, 2024 2:46 am

We're talking about the same AI that we all tell to "F off and that we want to talk to a person" right? I mean, I can't be the only frustrated by support bots and AI bots for voice navigation in phone services? Right? Those things are the worst. They are worthless and never help solve any issues. You ALWAYS need to "speak to a representative" because the AI is just the worst.

So, I'm not afraid of that AI replacing me and my work. However, replacing someone like a Zaslav I can see because people like that are worthless.
"I'm well trained in the art of turning **** to gold." - Tim Buttner (timbutt2)

Cameras: URSA Mini Pro G2 & Pocket 6K Pro
Past: UM4.6K, P6K, BMCC 2.5K
Computers: iMac 5K (Mid 2020) & MacBook Pro Retina 15.4in (Mid 2018)
Online
User avatar

Uli Plank

  • Posts: 21632
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: OpenAI SORA: Creating Video from Text

PostSat Feb 24, 2024 3:15 am

Well, those crappy support bots have been around for years and I'm pretty sure they have not (yet?) been replaced by any serious AI.
Wait until you have to deal with your bank or insurance company, after they chased all their employees and installed a strong AI.
Now that the cat #19 is out of the bag, test it as much as you can and use the subforum.

Studio 18.6.6, MacOS 13.6.6, 2017 iMac, 32 GB, Radeon Pro 580
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G
Offline
User avatar

robedge

  • Posts: 2691
  • Joined: Tue Dec 24, 2019 1:24 am
  • Location: U.S.
  • Real Name: Rob Edge

Re: OpenAI SORA: Creating Video from Text

PostSat Feb 24, 2024 3:32 am

Peter J. DeCrescenzo wrote:FYI: Tyler Perry, a guy who writes checks to pay people in the cinema business, has thoughts on the topic:

https://www.hollywoodreporter.com/busin ... 235833276/


Thanks Peter. I don't think that the producers and the unions have a common interest in this, and nor do I think that legislatures will intervene to protect the film industry. That aside, it's an interesting article.
Video Cameras: iPhone, Pocket 4K
Microphones: Schoeps, DPA
Audio Recorder: Sound Devices

Return to Cinematography

Who is online

Users browsing this forum: No registered users and 91 guests