Page 1 of 1

Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Thu Nov 16, 2023 11:18 pm
by antoine
Hi editors,

I figured it'd be interesting if we all share our .BRAW Blackmagic RAW Speed Test results on our different workstations. This test software provided by Blackmagic Design is launching a lot of decoding of a sample .braw file that is the same for everyone, in different resolutions / compression ratio / CPU vs. GPU. Those benchmarks will help us :
  • see differences of performance with a benchmark more adapted to our usual workloads (compared to benchmark online who are not made for video editing but more for gaming)
  • identify if something is wrong with our current setup by comparing with others who have similar computers
  • be able to know what to expect and this could influence their next computer purchase decision

I'll start with some of my workstations and then describe the methodology to follow so we all follow the same process to try to get more consistent results :

M1 Max, Macbook Pro 16 inch 2021 M1 Max 32 GB (Metal), macOS Sonoma 14.1, BRAW 3.4
Antoine_Autokroma_BlackmagicRAWSpeedTest_Macbook Pro 16 inch 2021 M1 Max 32 GB (Metal), macOS Sonoma 14.1, BRAW 3.4.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_Macbook Pro 16 inch 2021 M1 Max 32 GB (Metal), macOS Sonoma 14.1, BRAW 3.4.png (181.23 KiB) Viewed 10978 times



Laptop nVidia, Windows 10, RTX 2060 Mobile (CUDA), Intel i7-9750H 2.6 Ghz, 32 GB RAM, NVME SSD, BRAW 3.4
Antoine_Autokroma_BlackmagicRAWSpeedTest_Legion Laptop nVidia[b], Windows 11, RTX 2060 Mobile (CUDA), Intel i7-9750H 2.6 Ghz, 32 GB RAM.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_Legion Laptop nVidia[b], Windows 11, RTX 2060 Mobile (CUDA), Intel i7-9750H 2.6 Ghz, 32 GB RAM.png (51.03 KiB) Viewed 10978 times


Some benchmarks made by others are already available online, for example https://techgage.com/news/testing-out-8 ... teen-cpus/ they get on BRAW 8K 8:1 (note that the : 34 fps AMD Ryzen 3700X, 50 fps AMD Ryzen 3900X, 39 fps Intel i9-9900K.

Methodology to produce the screenshot to share here :

  1. Install latest Blackmagic RAW 3.4 from here https://www.blackmagicdesign.com/suppor ... al-cameras and update your latest GPU Drivers if you can. If you're on a laptop, make sure your battery is full and you're plugged in
  2. Restart computer, don't open your usual apps, disconnect internet, on Windows open Blackmagic RAW player, go in the About and make sure you are running version 3.4 then run BRAW Speed Test, on macOS you can directly run BRAW Speed Test and go in the About of the BRAW Speed Test and check it is version 3.4
  3. Do not touch any setting on the middle gear above the Start button (keep it at BRAW 8K 12:1, the default value)
  4. Click that big red button START !
  5. Wait that the whole test suite gets properly benchmarked (we're actually more interested in the results inside the table below !) with all the resolutions
  6. Once finished click on the gear icon above the START button to stop the tests and click Save Screenshot (it's better than using your own screenshot tool so we get consistent screenshot images, for example without macOS drop shadow)
  7. Post your screenshot here with a description of your workstation (CPU, GPU, Disk Drive, RAM, OS version etc.), if you're using CUDA, Metal or OpenCL to decode on your GPU

Waiting for your results !

Antoine from Autokroma


(Edit : the computer below was not correctly configured, see below posts for a real benchmark)
[b]Desktop nVidia, Windows 11, RTX 4090 (CUDA), Intel i9-14900K 5.6 GHz, 32 GB RAM, NVME SSD, BRAW 3.4, Not Overclocked, I just configured this workstation and it might not run at max perf
Antoine_Autokroma_BlackmagicRAWSpeedTest_RTX 4090 (CUDA), Intel i9-14900K, 32 GB RAM, NVME SSD, BRAW 3.4.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_RTX 4090 (CUDA), Intel i9-14900K, 32 GB RAM, NVME SSD, BRAW 3.4.png (55.55 KiB) Viewed 10978 times


Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Nov 17, 2023 5:54 am
by Uli Plank
This is the result on my completely outdated ;-) Apple laptop (see sig):
Speed.jpg
Speed.jpg (559.58 KiB) Viewed 10884 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Nov 17, 2023 9:25 pm
by MrRipfrog
Desktop - Windows 11, RTX 4090, AMD Threadripper 3960X, 128 GB RAM, MVME SSD, No Overclock
BlackmagicRAWSpeedTest_Threadripper.png
BlackmagicRAWSpeedTest_Threadripper.png (204.14 KiB) Viewed 10831 times


RazerBlade 16 Laptop, Windows 11, RTX 4090, Intel i9-13950HX, 32 GB RAM, NVME SSD, No Overclock
BlackmagicRAWSpeedTest_RazerBlade.png
BlackmagicRAWSpeedTest_RazerBlade.png (293.98 KiB) Viewed 10831 times


M3 Max Macbook Pro 16, 64 GB RAM, 4TB Hard Drive
BlackmagicRAWSpeedTest_MacBook.png
BlackmagicRAWSpeedTest_MacBook.png (294.51 KiB) Viewed 10831 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Nov 17, 2023 10:05 pm
by antoine
Thanks for your tests Uli and Eric ! Something's def wrong with my latest Windows workstation, both my CPU and GPU underperform :( . M3 Max is insane !

Adding another benchmark of a small Windows laptop

Lightweight Laptop, ASUS Zenbook UX363EA 13 inch Laptop Windows 11, Intel i7-1165G7 2.8 GHz, GPU Iris Xe Graphics G7 96EUs (OpenCL), 16 GB RAM, NVME SSD, BRAW 3.4

Antoine_Autokroma_BlackmagicRAWSpeedTest_ASUS Zenbook UX363EA Laptop Windows 11, Intel i7-1165G7 2.8 GHz, GPU Iris Xe Graphics G7 96EUs (OpenCL), 16 GB RAM, NVME SSD, BRAW 3.4.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_ASUS Zenbook UX363EA Laptop Windows 11, Intel i7-1165G7 2.8 GHz, GPU Iris Xe Graphics G7 96EUs (OpenCL), 16 GB RAM, NVME SSD, BRAW 3.4.png (52.18 KiB) Viewed 10825 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Tue Nov 28, 2023 2:41 pm
by antoine
This thread already is useful, it made me realize how seriously bad my computer was. I've changed my motherboard, now dual channel DDR5 2x32 GB is working, both CPU and GPU perform as they should and this BRAW Speed Test finally gives REAL results, instead of 72 / 103 fps I get 125-130 fps for the CPU and 132-141 fps with CUDA, on par with benchmark results from Eric Sorensen / MrRipfrog (Thanks Eric !) :

Desktop nVidia, Windows 11, RTX 4090 (CUDA), Intel i9-14900K 5.6 GHz, 2x32 GB RAM, NVME SSD, BRAW 3.4, Not Overclocked

Antoine_Autokroma_BlackmagicRAWSpeedTest_V2_Best_RTX 4090 (CUDA), Intel i9-14900K, 2x32 GB RAM, NVME SSD, BRAW 3.4.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_V2_Best_RTX 4090 (CUDA), Intel i9-14900K, 2x32 GB RAM, NVME SSD, BRAW 3.4.png (38.25 KiB) Viewed 10825 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Wed Nov 29, 2023 5:53 am
by Cpuraider
Dissapointing result, but improved after enabling resizable BAR.
Intel 8600K, 16GB DDR4, Intel Arc A770 16GB

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Thu Nov 30, 2023 7:35 am
by Uli Plank
I’d assume that the ARC is not yet showing its full potential with BM.

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Thu Nov 30, 2023 8:05 am
by ilitaratefella
Desktop Intel ARC, Windows 10, ARC A750 (OpenCL + Resize Bar), Intel i3-12100F 3.3Ghz, 2x16 GB RAM, NVME SSD, BRAW 3.6, Not Overclocked
BlackmagicRAWSpeedTestNEW SETUP.png
BlackmagicRAWSpeedTestNEW SETUP.png (202.8 KiB) Viewed 9543 times


Apparently the Ryzen does not agree with Intel Graphics:
Desktop Intel ARC, Windows 10, ARC A750 (OpenCL + Resize Bar), Ryzen 3 3200G 3.6Ghz, 2x16 GB RAM, NVME SSD, BRAW 3.4, Not Overclocked
BlackmagicRAWSpeedTest.png
BlackmagicRAWSpeedTest.png (200.63 KiB) Viewed 10277 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Dec 01, 2023 2:54 am
by Cpuraider
Edward,

Have you enabled resizable BAR? You Motherboard may or may not support this, but I gained about a 60 to 70 percent jump in GPU performance across the board after I did. It might not help the CPU scores, but I bet it will drastically improve the GPU side of things.

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Dec 01, 2023 8:15 am
by Helge Tjelta
M1 Ultra, MacOS 14.1.2
Skjermbilde 30.png
Skjermbilde 30.png (564.3 KiB) Viewed 10183 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Fri Dec 01, 2023 4:49 pm
by carlomacchiavello
BlackmagicRAWSpeedTest.png
BlackmagicRAWSpeedTest.png (219.96 KiB) Viewed 10133 times

Monterey Hackintosh I5 9600k 48gb ram Radeon Vega 64 Metal

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Sat Dec 02, 2023 1:24 pm
by Nicolas from Autokroma
MSI GS75 Stealth 10SE - Win11 - Intel i7-10750H 2.60GHz - 16GB RAM - NVME SSD - RTX 2060 (CUDA) - BRAW 3.4, Not overclocked

BlackmagicRAWSpeedTest.png
BlackmagicRAWSpeedTest.png (505.21 KiB) Viewed 10050 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Sun Dec 10, 2023 4:16 pm
by antoine
Thanks Nico for the benchmark. Thanks Cpuraider / Paul Eaton for mentioning BAR, actually it's the opposite for me, disabling BAR in my BIOS gives me a boost, once I disable it go from 132-141 fps with CUDA to 162 - 171 fps (see results below). Note that others CPU and GPU benchmarks stay the same whether I have BAR or not. Maybe there's something special about how the .braw frame is uploaded to the GPU for further decoding.

It would be interesting to link results of those tests to performance of DaVinci Resolve / Adobe Premiere Pro with BMD Blackmagic RAW plugin and BRAW Studio

Antoine_Autokroma_BlackmagicRAWSpeedTest_V3_No_BAR_RTX 4090 (CUDA), Intel i9-14900K, 2x32 GB RAM, NVME SSD, BRAW 3.4.png
Antoine_Autokroma_BlackmagicRAWSpeedTest_V3_No_BAR_RTX 4090 (CUDA), Intel i9-14900K, 2x32 GB RAM, NVME SSD, BRAW 3.4.png (224.2 KiB) Viewed 9694 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Sun Jan 21, 2024 9:48 am
by TomsheenPL
AMD Ryzen 9 5900X, Radeon RX6800 XT, 32 GB RAM, macOS 11.7.10 (hackintosh) & Windows 11

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Sun Jan 21, 2024 5:42 pm
by Roberto Castellano
Apparently the Ryzen does not agree with Intel Graphics:
Desktop Intel ARC, Windows 10, ARC A750 (OpenCL + Resize Bar), Ryzen 3 3200G 3.6Ghz, 2x16 GB RAM, NVME SSD, BRAW 3.4, Not Overclocked
BlackmagicRAWSpeedTest.png
[/quote]

It seems that the BMRAW SPEED test is currently utilizing the Ryzen Integrated graphics instead of the Intel GPU. Nevertheless, the Ryzen 3200G is considered a relatively underpowered processor, largely due to its significantly limited memory bandwidth. Temporarily disable the R3 3200G GPU from the Devices List to ensure that the test runs using the correct GPU.

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Wed Jan 31, 2024 10:20 pm
by antoine
TomsheenPL wrote:AMD Ryzen 9 5900X, Radeon RX6800 XT, 32 GB RAM, macOS 11.7.10 (hackintosh)


Wow it's insane that a RX6800 XT beats my 4090 on a hackintosh ! Would be interesting to know what results you get on Linux or Windows using the same hardware. Maybe the Metal parts of the BRAW SDK are very well optimized also

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Thu Feb 01, 2024 2:57 pm
by Nelson Villamil
Hi

My contribution, running Blackmagic RAW Speed Test Ver 3.6.1

Workstation APY: Intel i9 14900K / 64 GB RAM - DDR5 / Nvidia RTX A4000 (Ampere Architecture) / Windows 11 Pro

Just for fun ;)

Of course, we like to see the numbers on the "tachometers"
So there are the results, for the 4 tests respectively: 8K 3:1 / 6K 3:1 / 4K 3:1 / HD 3:1

test_8K.png
test_8K.png (169.5 KiB) Viewed 8066 times


test_6K.png
test_6K.png (169.65 KiB) Viewed 8066 times


test_4K.png
test_4K.png (168.01 KiB) Viewed 8066 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Thu Feb 01, 2024 2:59 pm
by Nelson Villamil
Workstation APY: Intel i9 14900K / 64 GB RAM - DDR5 / Nvidia RTX A4000 (Ampere Architecture) / Windows 11 Pro

the test #4: HD 3:1

test_HD.png
test_HD.png (197.8 KiB) Viewed 8064 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Wed Apr 17, 2024 5:37 pm
by Helge Tjelta
Old Mac Studio M1 Ultra 64GB ram

Skjermbilde 6.png
Skjermbilde 6.png (582.41 KiB) Viewed 5713 times

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Sun Apr 28, 2024 11:48 am
by 360VVSpain
I dont know what this means, but here it is. I only use this for color grading. My footage is 4k and deliver HD @24/30fps
Specs:
Z390 Desingware CF
i9 9900K@3.6 Ghz
128 GB RAM
Nvidia Quadro p4000. I am seeing those RTX are beasts!!! However, I am really fine with my Quadro for 4k.

So if any of you can give me an insight...but anyways, my workflow is smooth and my rendering times are really acceptable(for me)

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Wed May 01, 2024 12:50 pm
by antoine
Hey ! Thanks for the last batch of screenshots. Helge don't forget to post the full window, otherwise we only get the results for the item you selected in the list (here HD) and we don't know what compression (by default for me it is 8K 8:1 compression). In general the top results cannot be compared between us unless we're sure to all use the same resolution and compression ratio. Point 6) in the guide for the benchmarks : "Once finished click on the gear icon above the START button to stop the tests and click Save Screenshot (it's better than using your own screenshot tool so we get consistent screenshot images"

360VVSpain wrote:I dont know what this means, but here it is. I only use this for color grading. My footage is 4k and deliver HD @24/30fps
Specs:
Z390 Desingware CF
i9 9900K@3.6 Ghz
128 GB RAM
Nvidia Quadro p4000. I am seeing those RTX are beasts!!! However, I am really fine with my Quadro for 4k.

So if any of you can give me an insight...but anyways, my workflow is smooth and my rendering times are really acceptable(for me)


Your benchmarks seems a bit faster than the ones from Paul Eaton (Nov 29, 2023 5:53 am) - Intel 8600K, 16GB DDR4, Intel Arc A770 16GB, I'd say it's quite good given your GPU is 5 years older even taking into account the price was double. Maybe you can try to turn on or off the BAR setting in your BIOS to see if you can get some speed up like me.

Re: Share your Blackmagic RAW Speed Test ! Benchmarking

PostPosted: Wed May 01, 2024 2:27 pm
by SkierEvans
Tested on the three I have. Old editor now used for email WEB etc , Threadripper and Studio Max.

3770K +1080Ti

3770 and 1080Ti 8K.jpg
3770 and 1080Ti 8K.jpg (111.17 KiB) Viewed 3668 times


Threadripper + 4070Ti

Threadripper 4070Ti 8K.jpg
Threadripper 4070Ti 8K.jpg (106.27 KiB) Viewed 3668 times


Studio Max M1

Studio Max 8K.png
Studio Max 8K.png (283.57 KiB) Viewed 3668 times



Have all the other resolution if anyone is interested.