Overlay in ACES

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Overlay in ACES

PostTue Aug 13, 2019 6:52 pm

There is a problem with Overlay composite mode in ACES in DR16 and 16.1.

Adding film grain by a ProRes scan using Overlay in ACES has never been an issue before. Now in DR16 using overlay results in a major gamma shift. Please refer to stills attached.
Attachments
2.2.1_2.2.1.jpg
2.2.1_2.2.1.jpg (713.92 KiB) Viewed 6317 times
4.1.1_4.1.1.jpg
4.1.1_4.1.1.jpg (766.2 KiB) Viewed 6317 times
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Jim Simon

  • Posts: 30189
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Overlay in ACES

PostTue Aug 13, 2019 11:03 pm

What do you mean by overlay? Is that a video clip with alpha?
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

Hendrik Proosa

  • Posts: 3030
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Overlay in ACES

PostWed Aug 14, 2019 5:37 am

I think overlay composite mode means it is a composite mode named overlay. Overlay does not need alpha, just as plus, screen etc don't.

As time goes, I find less and less ACES related stuff that actually works.
I do stuff.
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostWed Aug 14, 2019 10:28 am

Jim Simon wrote:What do you mean by overlay? Is that a video clip with alpha?


It's a common way of adding film grain to a shot by having a grain scan on a second video layer then blending it in by the use of Overlay Composite Mode.
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Jim Simon

  • Posts: 30189
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Overlay in ACES

PostWed Aug 14, 2019 1:46 pm

Got it. Thanks, Boris.

I am seeing the image darken when using the Overlay mode in Composite in Studio 16.1b1 for Windows. Though I haven't sufficient experience to know what's normal here.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostThu Aug 29, 2019 10:51 am

So disappointed to see that this issue has not been fixed with the release of DR16.1b2.

It is making things even more complicated when working in ACES. I am unable to see the grain in context while coloring and have to export to REC709 in order to apply grain.

This is far from ideal, especially knowing that all was good in DR15.

Would someone from BMD please acknowledge the issue.

Thank you!
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline
User avatar

Bryan Ray

  • Posts: 2485
  • Joined: Mon Nov 28, 2016 5:32 am
  • Location: Los Angeles, CA, USA

Re: Overlay in ACES

PostThu Aug 29, 2019 4:48 pm

Strictly speaking, Overlay is an invalid blend mode in any scene-referred color workflow. It doesn't respond properly to values above 1.0.

That said, I can't think of any reason it should have changed from one version to the next, and some clarification of the operation that's being performed would be appreciated.

In the meantime, a 'more correct' application of grain is to subtract 0.5 from the grain plate, then add it to the image. This must be done in floating-point, which should be a given if you're in ACES.
Bryan Ray
http://www.bryanray.name
http://www.sidefx.com
Offline

Hendrik Proosa

  • Posts: 3030
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Overlay in ACES

PostThu Aug 29, 2019 5:01 pm

On Resolve side working space is most usually cc or cct log where values don't exceed 1.0, so none of the (scene)linear or pure gamma logic and blend modes properly apply anyway. But undocumented changes from one version to another is a "feature" one seems to have to live with.
I do stuff.
Offline

TobiJitsu

  • Posts: 11
  • Joined: Wed Apr 11, 2018 8:56 pm
  • Real Name: Tobias Schaarschmidt

Re: Overlay in ACES

PostFri Aug 30, 2019 10:30 am

Hendrik Proosa wrote:On Resolve side working space is most usually cc or cct log where values don't exceed 1.0, so none of the (scene)linear or pure gamma logic and blend modes properly apply anyway. But undocumented changes from one version to another is a "feature" one seems to have to live with.


The maximum floating point values of ACEScc and cct are 1.4679964.
Offline

Hendrik Proosa

  • Posts: 3030
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Overlay in ACES

PostFri Aug 30, 2019 4:06 pm

TobiJitsu wrote:The maximum floating point values of ACEScc and cct are 1.4679964.

Theoretical max yes, but in practice such high values are almost never seen and they will be clipped in anything but float storage. Log curve value 1.0 is somewhere in hundreds when linearized which no camera is able to produce anyway (dynamic range from mid gray is way higher than currently possible).
I do stuff.
Offline

TobiJitsu

  • Posts: 11
  • Joined: Wed Apr 11, 2018 8:56 pm
  • Real Name: Tobias Schaarschmidt

Re: Overlay in ACES

PostSat Aug 31, 2019 7:34 am

Hendrik Proosa wrote:
TobiJitsu wrote:The maximum floating point values of ACEScc and cct are 1.4679964.

Theoretical max yes, but in practice such high values are almost never seen and they will be clipped in anything but float storage. Log curve value 1.0 is somewhere in hundreds when linearized which no camera is able to produce anyway (dynamic range from mid grey is way higher than currently possible).


There is nothing theoretical about it. Although cameras do not produce dynamic range that exceeds ACES design limits at the moment, you regularly get out of gamut values when going from an OCF log format like Alexa LogC AWG to ACEScct AP1 - and with applying grading that even can get amplified, which is why the AMPAS does strongly recommend to use ACEScc/cct only as a working colour space inside a colour pipeline processing in 32bit floating point and not using it for storage or image transfer.

However, I realize this is all beside the point - I also would very much welcome a blend mode that allows for applying scanned film grain inside ACES Projects :)
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostSat Sep 14, 2019 5:31 pm

DR16.1b3 still no fix :( :( :(
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostFri Oct 18, 2019 9:19 am

DR16.1 out of beta and still no fix!!! Would someone from BMD please acknowledge the issue?
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

José Santos

  • Posts: 62
  • Joined: Wed Mar 11, 2015 1:46 pm

Re: Overlay in ACES

PostSat Oct 19, 2019 7:05 pm

I have also experienced this bug since Resolve 15.3! It's not just overlay any composite mode using a layer mixer node does not work as expected!! I'm on the newly released 16.1 and the bug is still here
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostThu Oct 31, 2019 12:12 pm

DR16.1.1 is out and still no fix!!! So disappointing this issue is being totally ignored by BMD :( :( :(
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Peter Chamberlain

Blackmagic Design

  • Posts: 13932
  • Joined: Wed Aug 22, 2012 7:08 am

Re: Overlay in ACES

PostMon Nov 04, 2019 3:09 am

We have someone looking into this but its not trivial so taking a little while.
DaVinci Resolve Product Manager
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostMon Nov 04, 2019 5:33 pm

Peter Chamberlain wrote:We have someone looking into this but its not trivial so taking a little while.


Great! Thank you so much!
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline
User avatar

Lee Niederkofler

  • Posts: 204
  • Joined: Wed Aug 29, 2012 12:42 pm

Re: Overlay in ACES

PostTue Nov 05, 2019 10:46 pm

Peter Chamberlain wrote:We have someone looking into this but its not trivial so taking a little while.


Thx
Offline

deezid

  • Posts: 392
  • Joined: Wed Sep 19, 2018 10:38 am
  • Real Name: Dennis Schmitz

Re: Overlay in ACES

PostThu Nov 07, 2019 9:20 pm

Peter Chamberlain wrote:We have someone looking into this but its not trivial so taking a little while.


Great news.
ACES is kinda flawed since version 15.2.3 on my machines.
Download my 55M Advanced Luts for the Pocket 4K and 6K and UMP12K here:
https://55media.net/55mluts/
Offline

Resolved Painter

  • Posts: 7
  • Joined: Mon Apr 01, 2019 6:53 am
  • Real Name: John Wiley Smith

Re: Overlay in ACES

PostSun Dec 22, 2019 9:04 pm

I just wrote a 3 page explanation of how this works one some machines and some not and on friends and production house having different experience. Then I clicked Submit it and I was logged out and the post is lost...

So here is the short version.

Was on 15.3 Lite on my main computer long time ago, having this setup for Grain:

This is made in Clip Panel so to add this to entire Video

Add 2x Layer Nodes (2x ALT+L)
Remove Feed from source to lower Node
Add Film Grain Matte to Lower Node
Add Alpha Channel from Matte to Lower Node.
Set Composite Mode to Linear Light
Set Key to about 0.300 (to your taste)

This used to yield exceptional results, with a very natural grain that merged with the Highlights and the Shadows.

I upgraded to 15.3 Studio and now exact same setup gives extreme Gamma shift. No matter what Composite mode, there is always either a slight or heavy gamma shift.

So I revert back to 15.3 Lite. The Gamma Shift stays, the Layer Mixer is broken.

Also when Disabling all nodes (ALT+D) in this setup after upgrading to Studio the image goes black, this did not use to be prior to the broken Layer Mixer.

Same for Version Studio 16+.

Been abroad for 3 Weeks.

I brought my crappy Laptop that has been running version 15.3 LITE. Strangely enough on this Laptop the Linear Light Composite Mode never worked, it Gamma Shifted like the Studio version does. I have been messing about with some grades and what not, playing around with Cinegrain and I stumbled upon a Workaround.

Workaround:

Add 2x Layer Nodes (2x ALT+L)
Remove Feed from source to lower Node
Add Film Grain Matte to Lower Node
Add Alpha Channel from Matte to Lower Node.
Switch the Feed from the two Nodes to the Layer Mixer, so Lower Node goes in Higher Input and Vice Versa.
Set Composite Mode to Multiply

And Voila! You get the beautiful grain with no Gamma Shift, merged beautifully with Highlights and Shadows. Also Disabling all Nodes now does not make the screen black (ALT+D). Only Caveat was that you could not Key out the grain this way, but I have full collection of Cinegrain so I have been able to find a suitable stock everytime.

Happy Happy days, so today I upgrade Resolve on this Laptop to Studio 16.12 and now this Workaround does not work anymore, instead it clips highlights like crazy. Disabling Nodes does not make the screen black though.

I feel these issue are very random at best, like some code being changed in one part messing up another? What is being changed under the hood causing this?

Edit: So this was the short version and I forgot to add that the issue is that the LAYER MIXER is obviously broken.

EDIT II: I just noticed now that this is in the BETA section, I am not running Beta but the issue is still there.

See also: L*a*b Color space issue: viewtopic.php?f=21&t=88475&p=548029&hilit=LAB+color+space#p548029
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostFri Mar 06, 2020 12:42 pm

DR16.2 issue is still present :(
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Resolved Painter

  • Posts: 7
  • Joined: Mon Apr 01, 2019 6:53 am
  • Real Name: John Wiley Smith

Re: Overlay in ACES

PostFri Mar 06, 2020 9:29 pm

yup still broken.

for months now I have been unable to use any grain stock in resolve.
Offline

Resolved Painter

  • Posts: 7
  • Joined: Mon Apr 01, 2019 6:53 am
  • Real Name: John Wiley Smith

Re: Overlay in ACES

PostSat Mar 07, 2020 1:32 pm

I reverted back to Studio 15.3.1 after playing around with Studio 16.2 the Color Managed mode is worse than before, now setting Input Color Space - Linear (RAW FOOTAGE) to OUTPUT Gamma and Color Space of any variant will clip all data at around 70 IRE. Effectively making Color Managed workflow useless now.

I keep feeling blackmagic is pushing us to just adobt ACES workflow, but I find it unnecessary to go with the ACES workflow when I dont have a bunch of cameras to match up and adding a lot of unnecessary steps when I just want to grade directly on the log and not rely on IDT and LUT's.

Image

Set Layer Mixer to Multiply.

Only caveat is that you can not adjust the key of the matte. But personally, with a collection of Cinegrain and other grain packs I've managed to find the right stock for the right footage, it does exclude some of the heftier grain stocks in lots of cases because they are too grungy.

Here's to 16.3!
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostFri Jul 31, 2020 8:20 am

Peter Chamberlain wrote:We have someone looking into this but its not trivial so taking a little while.


Hi, Peter,

Please could you give us an update on this issue? Will it ever be fixed or is there another way of adding grain in ACES that you could recommend?

Thanks!
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel
Offline

Peter Chamberlain

Blackmagic Design

  • Posts: 13932
  • Joined: Wed Aug 22, 2012 7:08 am

Re: Overlay in ACES

PostThu Aug 06, 2020 8:34 am

Is the workaround presented by John Wiley Smith above not working for you?
DaVinci Resolve Product Manager
Offline

Boris Tivchev

  • Posts: 49
  • Joined: Fri Aug 24, 2012 7:06 am

Re: Overlay in ACES

PostWed Nov 11, 2020 3:22 pm

DR17 is looking great, but I was shocked to see the issue is still there! :o

No workaround I've tried was of any use. I still have to export to PR4444 and apply grain in REC!. And just to think that 15 months ago and 2 releases earlier things were fine...
Mac Pro, MacOS 11.6.1, 2 x Radeon Pro Vega II 32GB, 3,2GHz 16-Core Intel Xeon W, 144GB RAM, QNAP TVS-1282T, APC Smart-UPS 3000 RM, BMD UltraStudio 4K, FSI CM250, BMD Teranex Mini SDI to HDMI 12G, Panasonic 55EZ950, DRS 17.4.6, BMD Mini Panel

Return to DaVinci Resolve

Who is online

Users browsing this forum: okiewardoyo, Spencer Morris and 119 guests