Media Management with huge amount of data

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline
User avatar

Ugo Laurenti

  • Posts: 49
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Media Management with huge amount of data

PostFri Feb 19, 2021 8:50 pm

Hi all,
I'm working as conformer on a documentary with almost only DPX files from scanned 16mm film and archival footage. It's huge mainly because the edit took more than a year so the director and the editor collected a ridiculous amount of material, more than 45Tb.
I've all these files spanned on eight Lacie d3 disks, so I can't really play it realtime due the poor throughput of them.
Now I need to collect only the refined timeline on a faster disk trimming the used clips.
If I try to Media Manage the whole timeline Resolve (I'm on the 16.2.8 on Windows10) stops after a while maybe because those disks (connected via TB3) sometimes disconnect by themself, so I've sliced the timeline to 5 reels.
I've found that I can't "relink to new files" if I select only one of the reels: the option is unavailable. Next Monday I'll try to make it works creating a different Project for each Reel, that's insane IMHO.
Meanwhile: are there a simpler alternative for us Windows users?
MacBook Pro (Mid 2014),2,5 GHz Intel i7, 16 GB 1600 MHz DDR3,NVIDIA GeForce GT 750M 2Gb. Resolve 16.2.3, Mojave 10.14.6
PC Gigabyte z390, i9-9900k 3,6, 32Gb, Zotac 1080ti, Decklink MiniMonitor, Eizo CG2420 Windows10Pro, ResolveStudio 16.2.3.15
Offline
User avatar

Ugo Laurenti

  • Posts: 49
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Re: Media Management with huge amount of data

PostMon Feb 22, 2021 5:10 pm

[UPDATE]: looks like the best way is what I (and someone else) wrote elsewhere: 1 Project for every single reel with a single Timeline, Media Manage the Copy of this Timeline with handles and relink to the copied clips. It takes a while due the poor throughput of the spinning disk where are stored the DPX, but now my 13 minutes first reel is "only" 251Gb stored in a fast SSD.
Tomorrow I'll do the same with the remaining 5 reels.
MacBook Pro (Mid 2014),2,5 GHz Intel i7, 16 GB 1600 MHz DDR3,NVIDIA GeForce GT 750M 2Gb. Resolve 16.2.3, Mojave 10.14.6
PC Gigabyte z390, i9-9900k 3,6, 32Gb, Zotac 1080ti, Decklink MiniMonitor, Eizo CG2420 Windows10Pro, ResolveStudio 16.2.3.15
Online

Uli Plank

  • Posts: 9433
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Media Management with huge amount of data

PostTue Feb 23, 2021 2:50 am

Sounds like the reasonable thing to do. I suppose nobody answered since such a huge task is rare these days.
Please report if it was reliable for you, some folks seem to have encountered problems with Media Management.

From my experience, make sure that several short snippets from a long take should be defined as subclips.
Resolve Studio 17 and Fusion Studio 17 under MacOS Mojave 10.14.6
iMac 2017 Radeon Pro 580 8 GB VRAM, 32 GB RAM
2018 Mac mini 16 GB RAM, eGFX Breakway Radeon RX 580 under Catalina 10.15.7
MacBook Air M1
Offline
User avatar

Ugo Laurenti

  • Posts: 49
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Re: Media Management with huge amount of data

PostTue Feb 23, 2021 9:15 pm

I've reconformed everything reconnecting the Reels on my SSD disk. I've encountered only a minor issue with a couple of clips, the only coming from a mxf files because the film negative is missing.
This film editing lasted a year with a huge amount of footage scanned from the archive of Istituto LUCE in Rome, Italy.
They massed up almost 50 Tb of 2k DPX on a bunch of spinning disks.
The Media managed project is less than 2 Tb now.
MacBook Pro (Mid 2014),2,5 GHz Intel i7, 16 GB 1600 MHz DDR3,NVIDIA GeForce GT 750M 2Gb. Resolve 16.2.3, Mojave 10.14.6
PC Gigabyte z390, i9-9900k 3,6, 32Gb, Zotac 1080ti, Decklink MiniMonitor, Eizo CG2420 Windows10Pro, ResolveStudio 16.2.3.15

Return to DaVinci Resolve

Who is online

Users browsing this forum: Google [Bot], Leonardo Levy, Mike Warren, Peter Cave, ResolveNoob, Tamis Kwikkers and 78 guests