Size of cache / scratch disk?

Do you have questions about Desktop Video, Converters, Routers and Monitoring?
  • Author
  • Message
Offline

Jeroen Pool

  • Posts: 3
  • Joined: Fri Dec 08, 2017 9:49 am

Size of cache / scratch disk?

PostMon Jan 15, 2018 1:10 pm

Hi all,

I'm in the process of upgrading and future-proofing my editing system. I'm planning on putting my cache / scratch (Resolve, Premiere Pro) on a dedicated external drive, probably SSD.

I work with editing, not grading.

My question is fairly simple: what is a good average size for a cache disk - that is, a disk used for media stills, rendering etc? 256GB? 512GB? Even bigger?

I realise this question depends on a number of factors, such as number of projects that are edited / require cache access and the size of the projects. I can make a reasonable calculation when it comes to my planned dedicated Media / Source drive, but have very few clear pointers as to what size a cache disk should be.

One element I'm considering is that cache is by definition temporary and can be rebuild, if needed. This is why I'm currently looking at 256 GB / 512 GB disks. Though without really knowing how much space I might really need.

Does anyone have any pointers?
Offline

sinha.s

  • Posts: 4
  • Joined: Wed Apr 24, 2019 6:36 am
  • Real Name: Sandeep Sinha

Re: Size of cache / scratch disk?

PostTue Apr 30, 2019 12:17 pm

I am looking for an answer to the same question: Does it help to have a Dedicated Media Cache/Scratch drive and if yes, what would be its ideal size for a feature length project (no multiple projects, no client delivery etc).
@Sandeep Sinha
Offline

MishaEngel

  • Posts: 1432
  • Joined: Wed Aug 29, 2018 12:18 am
  • Real Name: Misha Engel

Re: Size of cache / scratch disk?

PostTue Apr 30, 2019 2:56 pm

That depends on your workflow, resolution and what you want to cache.

Let's assume you work with 8192x4320 Full Resolution - Uncompressed DPX (RGB, no alpha).
At DPX 16-bit 24fps, 4.75 GB/s or 284.77 GB/min at the same.
Let's say you cache around max 5 minutes, then you would need ~ 1.424 TB ~ 2 TByte.

I.o.w. it depends on what you edit and with what codecs.
Offline

sinha.s

  • Posts: 4
  • Joined: Wed Apr 24, 2019 6:36 am
  • Real Name: Sandeep Sinha

Re: Size of cache / scratch disk?

PostTue Apr 30, 2019 5:46 pm

Thanks for your response Misha. This is my first professional build to work with 4K Footage in ProRes HQ (from Ninja V-GH5S) for a feature length independent film.

My Build: Ryzen 1700/RX580/32GB RAM/B450 Motherboard with two M2 slots (one of which is PCle Gen3 x4). The purpose of this build is primarily to Edit and do light grading work - in Resolve.

Since its too early for me to take the RAID/higher cost route, I would like to know my best case scenario with 2/3 SSDs (sata and Nvme) and HDD - that i am to purchase. I do have a 970 Evo Plus (250 GB).

I am not sure what to put where in terms of Source Media & Project Files, Cache files, back up etc. Pls guide.
@Sandeep Sinha
Offline

sinha.s

  • Posts: 4
  • Joined: Wed Apr 24, 2019 6:36 am
  • Real Name: Sandeep Sinha

Re: Size of cache / scratch disk?

PostTue Apr 30, 2019 5:57 pm

I gather that I should have been more precise with my queries. Its 4k 10 bit footage in H.264 and ProRes HQ to be edited on a 2 hour timeline - Editing & Grading.

1. What should I use the M2 (Gen3 PCle X4) slot for : OS & Applications or Scratch Disk & Media & Project Files?
2. How many drives should I buy ?
2. What should be the size of my storage for each of these needs?

Thanks
@Sandeep Sinha
Offline

MishaEngel

  • Posts: 1432
  • Joined: Wed Aug 29, 2018 12:18 am
  • Real Name: Misha Engel

Re: Size of cache / scratch disk?

PostTue Apr 30, 2019 7:02 pm

Use the EVO 250 GB as system drive in the slower M2 slot (PCIe 2 x4) and get a 970 pro (atleast 512 GB) for scratch drive in the fast M2 slot (PCIe 3 x4). The 970 pro has a longer live span and has faster continous write speed.

For storage I would use 4(Seagate Ironwolf for example) fast spinning drives (7200 rpm) in raid 10 (200..400 MB/s seq R/W), fast enough and secure because of raid 10.
Offline

sinha.s

  • Posts: 4
  • Joined: Wed Apr 24, 2019 6:36 am
  • Real Name: Sandeep Sinha

Re: Size of cache / scratch disk?

PostWed May 01, 2019 1:09 pm

Thanks a lot for your suggestions. implementing the same.
@Sandeep Sinha
Offline
User avatar

Gabi Bucataru

  • Posts: 334
  • Joined: Tue Jan 12, 2016 1:39 am

Re: Size of cache / scratch disk?

PostFri May 03, 2019 4:05 pm

I'm also curious for this, thanks for the replies so far!

Was wondering if storing the video files on a raid10 array (7200 rpm), and using the M2 slot with the 970 for cache would be a smart idea to work for editing. Or should I have everything on a fast drive?

Also - I have multile projects already and was wondering how to empty the cache for those? Should I open each project and empty the cache from the Playback-Delete Render cache menu or should I just delete derectly from the file explorer?

Thanks!
gabi
Resolve 18.6.2 Studio * WIN10 Pro 64-bit * intel core i7-7700K CPU 4.20Ghz * 32 Gb RAM * NVIDIA GeForce GTX 1080 Ti *
Offline

Dermot Shane

  • Posts: 2720
  • Joined: Tue Nov 11, 2014 6:48 pm
  • Location: Vancouver, Canada

Re: Size of cache / scratch disk?

PostMon May 06, 2019 2:37 pm

i have 64Tb of raid5 spinning disks on a SAS connected to a Lsi raid controler
Offline
User avatar

Gabi Bucataru

  • Posts: 334
  • Joined: Tue Jan 12, 2016 1:39 am

Re: Size of cache / scratch disk?

PostThu May 09, 2019 4:49 pm

Dermot Shane wrote:i have 64Tb of raid5 spinning disks on a SAS connected to a Lsi raid controler


Thanks! Do you mind giving us some details on the Lsi raid controller model, and the machine specs, etc.? Did you built it yourself?

Thanks
G
Resolve 18.6.2 Studio * WIN10 Pro 64-bit * intel core i7-7700K CPU 4.20Ghz * 32 Gb RAM * NVIDIA GeForce GTX 1080 Ti *
Offline

Dan Sherman

  • Posts: 1185
  • Joined: Fri Jul 01, 2016 11:07 pm

Re: Size of cache / scratch disk?

PostThu May 09, 2019 5:04 pm

If you want to run a big raid you might be better off with a dedicated FreeNAS build today. A lot of the new higher end motherboards come with a 10 gigabit connection, so you can put the NAS in another room and eliminate a lot of the noise. You don't even need an expensive switch/router, you can connect your machine directly to the NAS with an ad-hoc network (not bad like it sounds).
AMD 7950X | AMD 7900XTX (23.20.24) | DDR5-6000 CL30-40-40-96 2x32 GB | Multiple PCIe 4.0 X4 NVME | ASUS x670e HERO | Win 11 Pro 23H2 | Resolve Studio 18.6.5 B7
Offline
User avatar

Gabi Bucataru

  • Posts: 334
  • Joined: Tue Jan 12, 2016 1:39 am

Re: Size of cache / scratch disk?

PostFri May 10, 2019 4:18 pm

Dan Sherman wrote:If you want to run a big raid you might be better off with a dedicated FreeNAS build today. A lot of the new higher end motherboards come with a 10 gigabit connection, so you can put the NAS in another room and eliminate a lot of the noise. You don't even need an expensive switch/router, you can connect your machine directly to the NAS with an ad-hoc network (not bad like it sounds).


Thanks Dan!

I've built a dedicated FreeNAS but it has the older 1Gb network card in it.
I am wondering if I could swap the older card for a newer 10Gb.
I like the idea of an ad-hoc network!

Thanks!
Resolve 18.6.2 Studio * WIN10 Pro 64-bit * intel core i7-7700K CPU 4.20Ghz * 32 Gb RAM * NVIDIA GeForce GTX 1080 Ti *
Offline

Dan Sherman

  • Posts: 1185
  • Joined: Fri Jul 01, 2016 11:07 pm

Re: Size of cache / scratch disk?

PostFri May 10, 2019 4:43 pm

Gabi Bucataru wrote:
Dan Sherman wrote:If you want to run a big raid you might be better off with a dedicated FreeNAS build today. A lot of the new higher end motherboards come with a 10 gigabit connection, so you can put the NAS in another room and eliminate a lot of the noise. You don't even need an expensive switch/router, you can connect your machine directly to the NAS with an ad-hoc network (not bad like it sounds).


Thanks Dan!

I've built a dedicated FreeNAS but it has the older 1Gb network card in it.
I am wondering if I could swap the older card for a newer 10Gb.
I like the idea of an ad-hoc network!

Thanks!



I'm not sure what hardware you are running, but both these super micro board have dual 10Gb connections.

https://www.supermicro.com/products/mot ... SSH-TF.cfm

https://www.supermicro.com/products/mot ... SH-CTF.cfm
AMD 7950X | AMD 7900XTX (23.20.24) | DDR5-6000 CL30-40-40-96 2x32 GB | Multiple PCIe 4.0 X4 NVME | ASUS x670e HERO | Win 11 Pro 23H2 | Resolve Studio 18.6.5 B7

Return to Post Production

Who is online

Users browsing this forum: thecakemaker and 35 guests