How to handle a big project

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

BitAlpha

  • Posts: 9
  • Joined: Wed Aug 28, 2024 6:08 am
  • Real Name: Ross Ozarka

How to handle a big project

PostSun Nov 24, 2024 2:23 am

Hi,

I'm using DR Studio 19.1, build 12.

I'm making an puppetry/animation feature film. It's 81 minutes in length, with about 1500 clips so far. The clips are HD video footage, proxied, of rough animatic, which I am slowly replacing with finished animation. The finished 4K animation is composited together in fusion. So I'm going to end up with 1500 fusion clips. I currently have about 20 fusion clips in the timeline. In fusion I am greenscreening, some color grading (in addition to grading on the color page), making light wraps, and animating transform nodes, and that's it.

This seems to be too much for my computer, and the project crashes constantly, and I think it's due to the fact I'm using fusion. It crashes if I try to play back or scrub a fusion clip. However, I also get crashes when doing activities that have nothing to do with fusion, such as trying to export the animatic.

Here is a link to a diagnostics log created after the latest DR crash.

https://drive.google.com/file/d/13Yf8rT ... drive_link

This crash happened when I was exporting 50 minutes of my HD rough animation footage, no fusion clips involved. It can't export this footage without crashing. I used to be able to export the entire 81 minutes of HD footage no problem. I never had these problems before upgrading to DR Studio 19.

Basically I have a project that crashes all the time, for multiple suspected reasons, and it's a problem because I plan on making this project much bigger. I can't do any work on this project because of how often it crashes.

My questions for you:

1. Based on the diagnostic log, can you identify what caused my last crash?
2. if a professional editor was making a special-effects heavy feature film and compositing 1500 clips in fusion, would that editor work on the entire project in one big timeline, as I have done?
3. Is my computer adequate or inadequate for my project as I have described it, and if inadequate, what upgrades do I need to make?
4. What other useful information can I supply?
Nvidia GeForce RTX 3060
Samsung SSD EVO Plus 500GB
Windows 10 Home 64-bit
AMD Ryzen 5 3600 6-Core Processor 3.59 GHz
64 GB RAM
Offline
User avatar

Uli Plank

  • Posts: 25075
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: How to handle a big project

PostSun Nov 24, 2024 2:49 am

The first thing, and probably the cheapest to do here for hardware, is extending your RAM. It's definitely too small for any heavy Fusion work.
And then, it's a pretty good idea to separate those 80 minutes into smaller chunks. Heck, the first thing you could try is rendering in chunks of 20 minutes or so into a good intermediate codec.
If all of that doesn't help, do you have. backup from version 18? Are there features in 19 you desperately need? Yes, software is getting more demanding on the hardware by every major version.
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3
Offline
User avatar

Marc Wielage

  • Posts: 12708
  • Joined: Fri Oct 18, 2013 2:46 am
  • Location: Hollywood, USA

Re: How to handle a big project

PostSun Nov 24, 2024 6:29 am

I agree with everything Uli says above.

I would also add: 1500 Fusion shots in a single project? Good luck. (I would say the same thing about 1500 After Effects shots in a single project.)

I think you might be able to maybe have 10 Fusion shots spread out over 150 timelines, but I wouldn't try to create a single 90-minute timeline with everything in it... unless they were all rendered out, flattened files.

I would also budget for buying the fastest computer in the world, tons of RAM, and multiple GPUs (though Fusion is more CPU-based), because you're going to need it. Fusion is very, very demanding on hardware.
Certified DaVinci Resolve Color Trainer • AdvancedColorTraining.com
Offline

Ryan Bloomer

  • Posts: 844
  • Joined: Tue Jul 09, 2013 6:58 pm

Re: How to handle a big project

PostSun Nov 24, 2024 7:15 pm

I agree with both Uli and Marc's suggestions. Especially upgrading your RAM. With 16gigs I think you would struggle to do all of the compositing shot by shot even in Fusion Standalone. Which, if your funds limit you, might be the only way to achieve your ambitious project.

It'd be worth exploring a single shot in Fusion Standalone and see if you can successfully get through it with your hardware. Make sure to try this without any other apps running, Fusion will use all of your resources in most cases.

If using Fusion Studio standalone does work, depending on how much of your comps can be templated, we can explore making an automated template for your shots. I used to do this with 1000s of composites in Fusion standalone before the Fusion tab existed in Resolve.
Offline

Stephen Swaney

  • Posts: 203
  • Joined: Tue Jun 15, 2021 4:23 pm
  • Location: Michigan, USA
  • Real Name: Stephen Swaney

Re: How to handle a big project

PostSun Nov 24, 2024 10:00 pm

1. Based on the diagnostic log, can you identify what caused my last crash?

Download link requires access.

Maybe I do not understand the workflow, but it sounds like Render In Place would be your friend here.
Offline

BitAlpha

  • Posts: 9
  • Joined: Wed Aug 28, 2024 6:08 am
  • Real Name: Ross Ozarka

Re: How to handle a big project

PostThu Nov 28, 2024 9:40 am

Stephen Swaney wrote:
1. Based on the diagnostic log, can you identify what caused my last crash?

Download link requires access.

Maybe I do not understand the workflow, but it sounds like Render In Place would be your friend here.


Sorry Stephen, my mistake. Please try the link for that previous crash log again: https://drive.google.com/drive/folders/ ... drive_link

I have just installed 64GB of RAM and attempted the same export, only to have it crash again. This particular timeline is 54m of graded HD footage, with perhaps 1 or 2 shots in this particular timeline being fusion comps. It has no problem rendering the fusion comps. Instead, Resolve crashed on the same shot twice, and the shot was nothing more than a pre-comp of an image sequence. I tried rendering it in place, to no avail, still crashing on the same shot upon render. There is about a TB of free space left on the drive.

There are 2 diagnostics logs in the folder I have shared, one is the one from my post a few days ago:
DaVinci-Resolve-logs-20241124-144401

The other is the crash log from what I have described above: DaVinci-Resolve-logs-20241128-223603

Thank you for your assistance!
Nvidia GeForce RTX 3060
Samsung SSD EVO Plus 500GB
Windows 10 Home 64-bit
AMD Ryzen 5 3600 6-Core Processor 3.59 GHz
64 GB RAM
Offline

BitAlpha

  • Posts: 9
  • Joined: Wed Aug 28, 2024 6:08 am
  • Real Name: Ross Ozarka

Re: How to handle a big project

PostThu Nov 28, 2024 10:11 am

Uli Plank wrote:The first thing, and probably the cheapest to do here for hardware, is extending your RAM. It's definitely too small for any heavy Fusion work.
And then, it's a pretty good idea to separate those 80 minutes into smaller chunks. Heck, the first thing you could try is rendering in chunks of 20 minutes or so into a good intermediate codec.


Marc Wielage wrote:I think you might be able to maybe have 10 Fusion shots spread out over 150 timelines, but I wouldn't try to create a single 90-minute timeline with everything in it... unless they were all rendered out, flattened files.


Thank you, Uli and Marc, I have upgraded my RAM to 64GB and it's a massive improvement, I can actually scrub the timeline now. I am happy to use the "Render In Place" feature to surmount this issue, it seems to give me better results and I can decompose back to the fusion comp if needed. I think this is an acceptable solution to this aspect of my problem.

However, I don't understand why playing a timeline with 1500 fusion clips is different than playing back a timeline containing only one fusion clip. Da Vinci only plays one clip at a time (assuming I have just one track) -- so surely it only ever has to play back the clip currently under the playhead?

But anyway, I am actually still experiencing my issue with DR crashing upon export. Would you mind reading my previous post in this thread, my reply to Stephen Swaney, and see if you can help?

Ryan Bloomer wrote:It'd be worth exploring a single shot in Fusion Standalone and see if you can successfully get through it with your hardware. Make sure to try this without any other apps running, Fusion will use all of your resources in most cases.


Thanks for the interesting suggestion, however I specifically switched to Resolve because Fusion was integrated into it, I like swapping back and forth. between NLE, compositing, and grading.
Nvidia GeForce RTX 3060
Samsung SSD EVO Plus 500GB
Windows 10 Home 64-bit
AMD Ryzen 5 3600 6-Core Processor 3.59 GHz
64 GB RAM
Offline

paultom

  • Posts: 28
  • Joined: Fri Nov 08, 2019 5:16 pm
  • Real Name: Paul Thomas

Re: How to handle a big project

PostThu Nov 28, 2024 6:10 pm

I've recently finished a 75 minute feature length 4k project, including some animation + a lot of grading, on a Mac Studio M2 32gb, and DaVinci coped fine – so this is really just a message to confirm that you should be expecting DaVinci to perform well. I've also done some editing of the project on a 2019 MacBook Pro, while travelling and the MacBook was happy too.

With large projects (and editing for 18 months), managing the edit well with well organised bins is a challenge, and it's good to work out a system at the outset of your edit.

I also work from 4TB SSDs for both the original media and a use another SSD drive for the proxy media & rendering, and this makes a significant difference to speed & performance while editing. With the old spinning hard drives, I would usually destroy one hard drive every project - with the high data throughput, but all the SSDs are still running happily.
Offline
User avatar

Uli Plank

  • Posts: 25075
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: How to handle a big project

PostThu Nov 28, 2024 11:44 pm

paultom wrote:With the old spinning hard drives, I would usually destroy one hard drive every project - with the high data throughput, but all the SSDs are still running happily.
That should not happen, at least not with enterprise class HDDs.
Of course, SSDs are faster by orders of magnitude.
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3
Offline
User avatar

Marc Wielage

  • Posts: 12708
  • Joined: Fri Oct 18, 2013 2:46 am
  • Location: Hollywood, USA

Re: How to handle a big project

PostFri Nov 29, 2024 8:48 am

BitAlpha wrote:Thank you, Uli and Marc, I have upgraded my RAM to 64GB and it's a massive improvement, I can actually scrub the timeline now. I am happy to use the "Render In Place" feature to surmount this issue, it seems to give me better results and I can decompose back to the fusion comp if needed. I think this is an acceptable solution to this aspect of my problem.

Yeah, render in place (or doing it as an actual render and then bringing the flattened shot back into Resolve) is a reasonable workflow for many TV shows and films. Just consider the VFX a separate project.

[quote[ However, I don't understand why playing a timeline with 1500 fusion clips is different than playing back a timeline containing only one fusion clip. Da Vinci only plays one clip at a time (assuming I have just one track) -- so surely it only ever has to play back the clip currently under the playhead?[/quote]
I'd say one Fusion shot in a timeline can be challenging, and 1500 of them could be a thousand times more difficult. Resolve will try to load most or all of the shots into RAM, and because Fusion is more demanding than the Color portion of Resolve, it'll stress out the system.

I think with a lot of post-production you have to pick your battles and figure out a workflow that will actually allow you to complete the project on schedule and on budget. Chopping this project up into 10 or 15 shorter timelines might be a valid solution.
Certified DaVinci Resolve Color Trainer • AdvancedColorTraining.com

Return to DaVinci Resolve

Who is online

Users browsing this forum: bmcfarl1, Jadran, khantrol, Lucius Snow, panos_mts, RobinDj, YaBoySuccuboi, Yarrokon and 283 guests