Media Management with huge amount of data

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline
User avatar

Ugo Laurenti

  • Posts: 81
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Media Management with huge amount of data

PostFri Feb 19, 2021 8:50 pm

Hi all,
I'm working as conformer on a documentary with almost only DPX files from scanned 16mm film and archival footage. It's huge mainly because the edit took more than a year so the director and the editor collected a ridiculous amount of material, more than 45Tb.
I've all these files spanned on eight Lacie d3 disks, so I can't really play it realtime due the poor throughput of them.
Now I need to collect only the refined timeline on a faster disk trimming the used clips.
If I try to Media Manage the whole timeline Resolve (I'm on the 16.2.8 on Windows10) stops after a while maybe because those disks (connected via TB3) sometimes disconnect by themself, so I've sliced the timeline to 5 reels.
I've found that I can't "relink to new files" if I select only one of the reels: the option is unavailable. Next Monday I'll try to make it works creating a different Project for each Reel, that's insane IMHO.
Meanwhile: are there a simpler alternative for us Windows users?
PC A MB z390, i9-9900k 3,6MHz,32Gb, GTX 1080ti, Decklink MiniMonitor PC B MB ProArt Z790, i7-14700K 3,4MHz, 64Gb, RTX 4080 Super, Decklink MiniMonitor 4k, Eizo CG2420 Windows11Pro, Resolve Studio 19.1, Tangent Element Panel Kit, MB Air m1.
Offline
User avatar

Ugo Laurenti

  • Posts: 81
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Re: Media Management with huge amount of data

PostMon Feb 22, 2021 5:10 pm

[UPDATE]: looks like the best way is what I (and someone else) wrote elsewhere: 1 Project for every single reel with a single Timeline, Media Manage the Copy of this Timeline with handles and relink to the copied clips. It takes a while due the poor throughput of the spinning disk where are stored the DPX, but now my 13 minutes first reel is "only" 251Gb stored in a fast SSD.
Tomorrow I'll do the same with the remaining 5 reels.
PC A MB z390, i9-9900k 3,6MHz,32Gb, GTX 1080ti, Decklink MiniMonitor PC B MB ProArt Z790, i7-14700K 3,4MHz, 64Gb, RTX 4080 Super, Decklink MiniMonitor 4k, Eizo CG2420 Windows11Pro, Resolve Studio 19.1, Tangent Element Panel Kit, MB Air m1.
Offline
User avatar

Uli Plank

  • Posts: 25124
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Media Management with huge amount of data

PostTue Feb 23, 2021 2:50 am

Sounds like the reasonable thing to do. I suppose nobody answered since such a huge task is rare these days.
Please report if it was reliable for you, some folks seem to have encountered problems with Media Management.

From my experience, make sure that several short snippets from a long take should be defined as subclips.
My disaster protection: export a .drp file to a physically separated storage regularly.

Studio 19.1.3
MacOS 13.7.4, 2017 iMac, 32 GB, Radeon Pro 580 + eGPU
MacBook M1 Pro, 16 GPU cores, 32 GB RAM, MacOS 14.7.2
SE, USM G3
Offline
User avatar

Ugo Laurenti

  • Posts: 81
  • Joined: Sat Oct 24, 2015 4:37 pm
  • Location: Italy

Re: Media Management with huge amount of data

PostTue Feb 23, 2021 9:15 pm

I've reconformed everything reconnecting the Reels on my SSD disk. I've encountered only a minor issue with a couple of clips, the only coming from a mxf files because the film negative is missing.
This film editing lasted a year with a huge amount of footage scanned from the archive of Istituto LUCE in Rome, Italy.
They massed up almost 50 Tb of 2k DPX on a bunch of spinning disks.
The Media managed project is less than 2 Tb now.
PC A MB z390, i9-9900k 3,6MHz,32Gb, GTX 1080ti, Decklink MiniMonitor PC B MB ProArt Z790, i7-14700K 3,4MHz, 64Gb, RTX 4080 Super, Decklink MiniMonitor 4k, Eizo CG2420 Windows11Pro, Resolve Studio 19.1, Tangent Element Panel Kit, MB Air m1.

Return to DaVinci Resolve

Who is online

Users browsing this forum: AndreN, Bing [Bot], Majestic-12 [Bot], Yahoo [Bot] and 272 guests