Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

The place for questions about shooting with Blackmagic Cameras.
  • Author
  • Message
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostTue Apr 06, 2021 9:58 pm

This makes no sense as the file sizes are larger and should be higher quality. I found this from doing my dynamic range test between my Sony A7RIV and my BMPCC4K on a sunny day with dark shadows. I recorded at 12:1 on the P4K because it's the best file size I can work with considering it was 20GB for around 10 minutes of footage at 4K24.00. Any reasons for this? Because if I have to shoot at a much lesser compression to match the lack of blocky leaves of an 8 bit Sony (near bottom of the barrel for color grading) then I might need to look for another camera with a more efficient compression process. I do like the colors out of the P4K but I really don't like what it's doing with these bushes. Take a look.

In the comparison shot, Sony leaves on left, Blackmagic on right.
Sony leaves.png
Sony leaves.png (697.75 KiB) Viewed 856 times

Pocket 4K leaves.png
Pocket 4K leaves.png (892.52 KiB) Viewed 856 times

Sony vs P4K leaves.png
Sony vs P4K leaves.png (519.13 KiB) Viewed 856 times
What will you create today?
Offline

JonPais

  • Posts: 108
  • Joined: Fri Mar 21, 2014 2:17 am

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 5:14 am

Nobody can draw any conclusions at all from those screen shots! smh
Last edited by JonPais on Wed Apr 07, 2021 5:30 am, edited 1 time in total.
https://daejeonchronicles.com
Offline

javier forza

  • Posts: 109
  • Joined: Wed Apr 10, 2019 12:34 pm
  • Real Name: javier forza

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 5:26 am

Braw needs NR Spacial or Temporal or both, depends your taste and distribution objetives. Even, could need some sharpness or contrast. If you have skills with color corrections there is multiple ways to get the results.

Easy way, not accurate, Luts.

If you want some image with pre processing you can try Pro Res flavors directly from camera.

8 Bits Sony Avchd mp4 has pre processing into the camera, NR, limiting alternatives in color post processing, but give you a final image. The advantages of Sony sensor are low light capabilities.
Online

Uli Plank

  • Posts: 9860
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 8:19 am

Yes, Sony is doing quite a bit of filtering in the camera.
Compare a RAW still out of the A7S with a video: at close examination it's worse.
And then, BRAW is an I-frame only codec, while the Sony is doing GOPs. You can't easily compare the file sizes.
Don't approach Resolve with your expectations from other NLEs! They are all different.
Resolve Studio 17.1.1 and Fusion Studio 17, macOS 10.15.7
iMac 2017 Radeon Pro 580 8 GB VRAM, 32 GB RAM
2018 Mac mini 16 GB RAM, eGFX Breakway RX 580 MacOS 10.14.6
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 1:42 pm

javier forza wrote:Braw needs NR Spacial or Temporal or both, depends your taste and distribution objetives. Even, could need some sharpness or contrast. If you have skills with color corrections there is multiple ways to get the results.

Easy way, not accurate, Luts.

If you want some image with pre processing you can try Pro Res flavors directly from camera.

8 Bits Sony Avchd mp4 has pre processing into the camera, NR, limiting alternatives in color post processing, but give you a final image. The advantages of Sony sensor are low light capabilities.

I did sharpen the BMPCC4K and Sony footage as I have sharpening in the Sony camera set to -7. The sharpening only made the macroblocks more clear.
What will you create today?
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 1:46 pm

JonPais wrote:Nobody can draw any conclusions at all from those screen shots! smh

Alright... I will get better stills from Resolve and also show the macroblocking that is happening on my hair.
What will you create today?
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 1:47 pm

Uli Plank wrote:Yes, Sony is doing quite a bit of filtering in the camera.
Compare a RAW still out of the A7S with a video: at close examination it's worse.
And then, BRAW is an I-frame only codec, while the Sony is doing GOPs. You can't easily compare the file sizes.

IDK how filtering would make macroblocks look like detail. This is right out of DaVinci Resolve. No rendering. In the render the same phenomenon shows up. Will post more stills.
What will you create today?
Offline

John Griffin

  • Posts: 1020
  • Joined: Sun Aug 23, 2015 4:18 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 1:57 pm

Alexrocks1253 wrote:
JonPais wrote:Nobody can draw any conclusions at all from those screen shots! smh

Alright... I will get better stills from Resolve and also show the macroblocking that is happening on my hair.

Are you sure this is 'macro blocking' and not aliasing / moire? The P4k is an 8mp sensor with no OLPF.
i7 6950x, 64gb RAM, GTX1080ti.
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 1:59 pm

John Griffin wrote:
Alexrocks1253 wrote:
JonPais wrote:Nobody can draw any conclusions at all from those screen shots! smh

Alright... I will get better stills from Resolve and also show the macroblocking that is happening on my hair.

Are you sure this is 'macro blocking' and not aliasing / moire? The P4k is an 8mp sensor with no OLPF.

This is macroblocking. Moire would bring false colors in and weird patterns that aren't like this. I will post more images, though PNGs are too large for here I guess.
What will you create today?
Offline
User avatar

roger.magnusson

  • Posts: 1700
  • Joined: Wed Sep 23, 2015 4:58 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 2:05 pm

It's as Uli explained, BRAW compresses each frame individually and the Sony calculates the differences between frames (an oversimplification for the sake of brevity) to achieve higher compression. There's tradeoffs to both methods once you decrease the bit rate. You should always use the appropriate bit rate for what you shoot.
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 2:18 pm

Here are some better frame grabs. Full PNG quality. In the comparison one, Sony left, Blackmagic right.
https://drive.google.com/drive/folders/1WWcULoyJNSK0aiyND8KXcc0BGmI95CQ0?usp=sharing
What will you create today?
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 2:22 pm

roger.magnusson wrote:It's as Uli explained, BRAW compresses each frame individually and the Sony calculates the differences between frames (an oversimplification for the sake of brevity) to achieve higher compression. There's tradeoffs to both methods once you decrease the bit rate. You should always use the appropriate bit rate for what you shoot.

I understand, but 100Mb/s hard to grade 8-bit 4:2:0 Sony IPB footage shouldn't outright beat the 272Mb/s All-I 12 bit 4:4:4 out of the P4K. I expect higher quality for higher file sizes. Plain and simple. If the higher file sizes bring worse quality, then they're not worth the higher storage cost associated with them.

I am seeing Bayer filter artifacts here too, but that is understandable given that it isn't doing any sampling and recording pixels 1:1.
What will you create today?
Offline

John Griffin

  • Posts: 1020
  • Joined: Sun Aug 23, 2015 4:18 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 2:45 pm

Just looks like the difference between 1:1 sampling and subsampling from a much higher res to me. The obvious test of macroblocking as a compression artefact is to compare 12:1 with one of the higher bitrate options on the P4k. Ultimately the P4k is not a very suitable camera for resolving fine irregular detail like this.
i7 6950x, 64gb RAM, GTX1080ti.
Offline
User avatar

rick.lang

  • Posts: 14523
  • Joined: Wed Aug 22, 2012 5:41 pm
  • Location: Victoria BC Canada

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 2:59 pm

Alexrocks1253 wrote:...
I did sharpen the BMPCC4K and Sony footage as I have sharpening in the Sony camera set to -7. The sharpening only made the macroblocks more clear.


Sharpening in a BMD camera is only intended to support Live Broadcast. If as ene needs enhancements, when you’re not live, best to do it with Resolve.
Rick Lang
Offline

smunaut

  • Posts: 258
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:17 pm

First, minor point but BRAW is 4:2:2 according to their own patent on it.

I expect higher quality for higher file sizes. Plain and simple.


You expect wrong ... an full Intra coder always has a disadvantage on a static (or nearly so) scene.
The advantage it has are :
- No artefact / sudden loss of quality during fast movements
- Lower latency / Computational complexity / Memory requirements (for hw implementation)
- Independent frames allowing for better editing (and no quality loss during editing due to recoding)

The disadvantages is that it achieves a lower coding efficiency ...
Ryzen 3700X - AMD R570X / NVidia RTX2700Super (switching between the 2) - Linux
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:18 pm

rick.lang wrote:
Alexrocks1253 wrote:...
I did sharpen the BMPCC4K and Sony footage as I have sharpening in the Sony camera set to -7. The sharpening only made the macroblocks more clear.


Sharpening in a BMD camera is only intended to support Live Broadcast. If as ene needs enhancements, when you’re not live, best to do it with Resolve.

I did all sharpening in post. The footage is Braw 12:1 with 0.48 sharpening and a simple grade.
What will you create today?
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:25 pm

smunaut wrote:First, minor point but BRAW is 4:2:2 according to their own patent on it.

I expect higher quality for higher file sizes. Plain and simple.


You expect wrong ... an full Intra coder always has a disadvantage on a static (or nearly so) scene.
The advantage it has are :
- No artefact / sudden loss of quality during fast movements
- Lower latency / Computational complexity / Memory requirements (for hw implementation)
- Independent frames allowing for better editing (and no quality loss during editing due to recoding)

The disadvantages is that it achieves a lower coding efficiency ...

My bad. I guess that all intra codecs don't seem to give too many benefits to me for what I need. My computer is beefy (I used to edit those crazy H.265 6K GH5 anamorphic files and the computer surprisingly kept up).

So to me IPB and All-I doesn't make too much of a difference other than taking up more space for a tiny quality improvement.
What will you create today?
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:28 pm

John Griffin wrote:Just looks like the difference between 1:1 sampling and subsampling from a much higher res to me. The obvious test of macroblocking as a compression artefact is to compare 12:1 with one of the higher bitrate options on the P4k. Ultimately the P4k is not a very suitable camera for resolving fine irregular detail like this.

I tried Q5 on the same scene and the macroblocks went away, the file size went up to the rate of a bit above 8:1, and the Bayer artifacts stayed. I wonder if the A7SIII would show the same Bayer artifacts because of the near 1:1 pixel readout?
What will you create today?
Offline

John Griffin

  • Posts: 1020
  • Joined: Sun Aug 23, 2015 4:18 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:51 pm

Alexrocks1253 wrote:
John Griffin wrote:Just looks like the difference between 1:1 sampling and subsampling from a much higher res to me. The obvious test of macroblocking as a compression artefact is to compare 12:1 with one of the higher bitrate options on the P4k. Ultimately the P4k is not a very suitable camera for resolving fine irregular detail like this.

I tried Q5 on the same scene and the macroblocks went away, the file size went up to the rate of a bit above 8:1, and the Bayer artifacts stayed. I wonder if the A7SIII would show the same Bayer artifacts because of the near 1:1 pixel readout?

File size is the price you pay for 12bit 4.4.4 ALL-I vs 8bit 4.2.0. long-gop
i7 6950x, 64gb RAM, GTX1080ti.
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 3:57 pm

John Griffin wrote:
Alexrocks1253 wrote:
John Griffin wrote:Just looks like the difference between 1:1 sampling and subsampling from a much higher res to me. The obvious test of macroblocking as a compression artefact is to compare 12:1 with one of the higher bitrate options on the P4k. Ultimately the P4k is not a very suitable camera for resolving fine irregular detail like this.

I tried Q5 on the same scene and the macroblocks went away, the file size went up to the rate of a bit above 8:1, and the Bayer artifacts stayed. I wonder if the A7SIII would show the same Bayer artifacts because of the near 1:1 pixel readout?

File size is the price you pay for 12bit 4.4.4 ALL-I vs 8bit 4.2.0. long-gop

Makes sense. Would you think 10-bit 4:2:2 would be a good compromise between file size and color quality?
What will you create today?
Offline

John Griffin

  • Posts: 1020
  • Joined: Sun Aug 23, 2015 4:18 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 4:06 pm

Shoot ProRes on the P4k if you want to keep file sizes to a minimum. ProRes vs BRAW should be indistinguishable if you nail exposure and WB in camera.
i7 6950x, 64gb RAM, GTX1080ti.
Offline

smunaut

  • Posts: 258
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 4:10 pm

The intra vs gop is what's costing more, the coding efficiency advantage of being able to use temporaly redudant information is huge.

Try with the sony codec : put a cover blocking the lens, then very quickly remove it, then look at the footage and the quality of the _very_ first frame that's not covered. That's the frame it had to code without any temporal information.
Ryzen 3700X - AMD R570X / NVidia RTX2700Super (switching between the 2) - Linux
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 4:38 pm

John Griffin wrote:Shoot ProRes on the P4k if you want to keep file sizes to a minimum. ProRes vs BRAW should be indistinguishable if you nail exposure and WB in camera.

I have found ProRes to be larger than BRaw except 3:1 or Q0.
What will you create today?
Offline

John Paines

  • Posts: 4222
  • Joined: Tue Jul 28, 2015 4:04 pm

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 4:57 pm

Prores HQ is about as sharp on fine detail as 3:1 and Q0, but slighter sharper (on close examination) than higher compression braw ratios. You'll see the difference between Prores and 12:1, for example, if you look for it. But as you noted, Prores HQ file sizes are generally much higher and, in theory, for less bit depth. Not a great bargain.
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostWed Apr 07, 2021 5:32 pm

John Paines wrote:Prores HQ is about as sharp on fine detail as 3:1 and Q0, but slighter sharper (on close examination) than higher compression braw ratios. You'll see the difference between Prores and 12:1, for example, if you look for it. But as you noted, Prores HQ file sizes are generally much higher and, in theory, for less bit depth. Not a great bargain.

Yeah. I understand the benefits in theory of ProRes but it seems better to shoot in raw that is as large as it or just shoot something in a high bitrate H.264/5 than to worry about it especially since I can edit and playback 200Mb/s HEVC 59.94fps just fine on my machine.
What will you create today?
Offline
User avatar

rick.lang

  • Posts: 14523
  • Joined: Wed Aug 22, 2012 5:41 pm
  • Location: Victoria BC Canada

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostThu Apr 08, 2021 5:18 am

Thanks for the clarification about where you applied sharpening. Good.
Rick Lang
Offline
User avatar

Alexrocks1253

  • Posts: 72
  • Joined: Mon Sep 21, 2020 9:15 pm
  • Location: Washington, DC
  • Real Name: Alexander Crocker

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostMon Apr 12, 2021 3:17 am

rick.lang wrote:Thanks for the clarification about where you applied sharpening. Good.

Yep! No matter what camera I'm using, it is the first option I turn as far down as possible, just like in camera NR (wish Sony would allow me to turn off its NR. DaVinci's is better...)
What will you create today?
Offline
User avatar

Eugenia Loli

  • Posts: 306
  • Joined: Mon May 04, 2015 6:47 am
  • Location: Spokane, WA, USA

Re: Macroblocking at 12:1 on BMPCC4K but not on 8 bit Sony?

PostMon Apr 12, 2021 8:49 am

I understand, but 100Mb/s hard to grade 8-bit 4:2:0 Sony IPB footage shouldn't outright beat the 272Mb/s All-I 12 bit 4:4:4 out of the P4K. I expect higher quality for higher file sizes. Plain and simple. If the higher file sizes bring worse quality, then they're not worth the higher storage cost associated with them.


This is not an accurate statement. The Sony gives you h.265 (or h.264) which are highly optimized codecs, and require hardware acceleration to decode. Basically, you do get smaller filesizes, but to decode them, you need to sacrifice a goat. You don't see that, because every GPU today can decode these formats. So for you, you get the impression that it's a "normal", "run of the mill" codec. It's not. It's HIGHLY dependent on hardware acceleration. Without it, you will be getting 1 fps.

BRAW on the other hand, it runs with minimal hardware decoding needs (it does use the GPU, but not for everything). And it gives you 12bit and 4:4:4 (which by themselves they REQUIRE more bits in order to fit in that bitrate).

So yes, the macroblocking you're seeing, is correct. A less hardware-dependent codec at 12:1, with added bonuses of 12bit/raw (which are bit-hungry), will perform LESS well than any modern codec at a lower bitrate, should that codec is highly hardware-dependent.

Basically, you trade size for hardware acceleration. Unfortunately, you can't create a new codec (like BRAW) and still get FULL hardware acceleration on every level like h.264 does, because that requires the GPU chip to be specifically designed for your codec. And nvidia/AMD/Intel don't care about BRAW (they barely care about Prores either). So, what you're seeing, is correct, and to be fully expected.
Collage artist, illustrator, filmmaker: https://vimeo.com/eugenia

Return to Cinematography

Who is online

Users browsing this forum: Dan Cotreau, Nick Kurucsev, Uli Plank and 19 guests