LUTs loss of information - shadows cutoff

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 10:27 am

Hi, recently I've been working with shadows recovery, all good until I want to generate a LUT from a simple contrast adjustment to share across different platforms, no matter what I do the LUTS are incapable of reproducing a simple contrast adjustment [attached image]. This is not specific of Davinci Resolve, it happens across all editors I work like Final Cut, Color Finale, Lattice, Catalyst Browse and even Photoshop.

I had issues before about this shadows cutoff when creating slog LUTs in lowlight but now I'm working with a GoPro 9 at -2 stops to protect highlights so the shadows recovery is more critical than ever.

I found weird that a simple contrast adjustment can't be shared across different platforms, with all the color science probably you all have knowledge of this issue so any advice would be really helpful.

ScreenShot.jpg
ScreenShot.jpg (989.23 KiB) Viewed 1850 times
Last edited by Isaac RC on Mon Apr 05, 2021 11:38 am, edited 1 time in total.
Offline

shebbe

  • Posts: 1406
  • Joined: Tue Mar 06, 2018 11:48 am
  • Location: Amsterdam
  • Real Name: Shebanjah Klaasen

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 10:36 am

From what I know is that a lut can only work within a 0-1 range so if there is any data originally outside of that it will be clipped on reapplying.

My question in your case would be why not shoot in log so you can expand contrast instead of reduce?

The other way to go about it would be to not create a lut for it but just grade it. Any reason it needs to be a lut?
Home System Resolve 20b2: Z790 / i9 13900K / 64GB DDR5 / RTX4090 / Win 11 / ASUS PA32UGC 1600 nits
Office System Resolve 20b2: X570 / Ryzen 9 5900X / 128GB DDR4 / RTX3090Ti / Win 11 / EIZO CG248-K
Offline
User avatar

Uli Plank

  • Posts: 25478
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 10:55 am

LUTs are destructive by nature.
My disaster protection: export a .drp file to a physically separated storage regularly.
Please visit digitalproduction.com/author/uliplank/

Studio 19.1.3
2017 iMac, MacOS 13.7.4, eGPU
MacBook M1 Pro and M4 Pro mini, MacOS 14.7.5
SE, USM G3
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 11:14 am

shebbe wrote:From what I know is that a lut can only work within a 0-1 range so if there is any data originally outside of that it will be clipped on reapplying.
My question in your case would be why not shoot in log so you can expand contrast instead of reduce?


Thanks for the info but as I mentioned this happens also in s-log (no data under 0-1 range) when making LUTs for lowlight the LUT result is washed out instead of a real blacks (and above 0 luminance). And if I remember well something similar happened trying as workaround to bake the s-log adjustments exporting a Prores file ( in Catalyst Browse), the result was also washed blacks. Note: the cutoff happens too with highlights if I remember well.

shebbe wrote:The other way to go about it would be to not create a lut for it but just grade it. Any reason it needs to be a lut?


Manual grading a contrast adjustment is as simple as it gets but as I expose in the post this limits to work from scratch only within one platform instead of working with LUTs that all editors can translate.
Last edited by Isaac RC on Mon Apr 05, 2021 11:41 am, edited 2 times in total.
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 11:33 am

Uli Plank wrote:LUTs are destructive by nature.


I don't think color scientists just decided to create LUTs destroying the work that are paid for in millionaire production movies.
Offline

shebbe

  • Posts: 1406
  • Joined: Tue Mar 06, 2018 11:48 am
  • Location: Amsterdam
  • Real Name: Shebanjah Klaasen

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 12:26 pm

Isaac RC wrote:Thanks for the info but as I mentioned this happens also in s-log (no data under 0-1 range) when making LUTs for lowlight the LUT result is washed out instead of a real blacks (and above 0 luminance).


Sorry, read over that part.
Maybe it is a bug then with your current version? Have you tried other Resolve versions?
I created a lut today and didn't see any issues there.
Home System Resolve 20b2: Z790 / i9 13900K / 64GB DDR5 / RTX4090 / Win 11 / ASUS PA32UGC 1600 nits
Office System Resolve 20b2: X570 / Ryzen 9 5900X / 128GB DDR4 / RTX3090Ti / Win 11 / EIZO CG248-K
Offline
User avatar

Uli Plank

  • Posts: 25478
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 12:36 pm

With "destructive by nature" I'm referring to the fact that you can't get anything back that has been shifted into crushed blacks or clipped highlights by a LUT. Any LUT.

With Resolve, you can over- or underexpose in one node and pull back in the next and it's all still there. A true grading program is far more flexible than a LUT.

A LUT is good if e.g. you need a quick solution to show dailies to a client after shooting log, which would look 'meh' to lay people. Even then you may want to design your own one, adapted to the lighting situation and the intended style. DR is great for preparing such a LUT too.
My disaster protection: export a .drp file to a physically separated storage regularly.
Please visit digitalproduction.com/author/uliplank/

Studio 19.1.3
2017 iMac, MacOS 13.7.4, eGPU
MacBook M1 Pro and M4 Pro mini, MacOS 14.7.5
SE, USM G3
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 12:51 pm

shebbe wrote:Sorry, read over that part.
Maybe it is a bug then with your current version? Have you tried other Resolve versions?


As I mentioned this issue happens across all platforms, been working with s-log and Davinci for years and that cutoff already existed

shebbe wrote:I created a lut today and didn't see any issues there.


Really? If you'd like to share the powergrade & LUT would be very interesting!
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 1:10 pm

Uli Plank wrote:With "destructive by nature" I'm referring to the fact that you can't get anything back that has been shifted into crushed blacks or clipped highlights by a LUT. Any LUT.


I'm aware of the "irreversible" properties of LUTs. You can check in the image posted that the LUT generated was actually from a single contrast adjustment to protect shadows&highlights from clipping, which by the way in reality aren't clipped but it's Davinci Resolve that transforms the input gamma expanding the luminance beyond 0-100.

Uli Plank wrote:A LUT is good if e.g. you need a quick solution to show dailies to a client after shooting log, which would look 'meh' to lay people. Even then you may want to design your own one, adapted to the lighting situation and the intended style. DR is great for preparing such a LUT too.


Yeah, I know, not that I'm an audiovisual technician but LUTs are used for many applications such as thermographic cameras, false color, etc. That's why I think there's something missing here.
Offline

Jim Simon

  • Posts: 36122
  • Joined: Fri Dec 23, 2016 1:47 am

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 2:31 pm

I'm thinking you're confusing a LUT with a Grabbed Still.

The latter will apply the exact same adjustment and produce the desired result. A LUT can't do that.

I don't think you can save that adjustment for use in other software and have it function identically.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

Hendrik Proosa

  • Posts: 3400
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 3:14 pm

Uli Plank wrote:LUTs are destructive by nature.

So a lut that maps 0.0-1.0 range to 0.0-1.0 range destroys what exactly?

LUTs are destructive in some cases, depends on LUT and data. And how relevant the destruction is in practice is another topic. 12bit prores encoding is destructive by nature too, so based on this info should we remove it from all ”pro” pipelines?

Every time there is an urge to state that ”luts are destructive m’kay”, I’d suggest taking a moment and explain to oneself what exactly a LUT is and how it is applied to color data (the math).
I do stuff
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostMon Apr 05, 2021 4:04 pm

Jim Simon wrote:I'm thinking you're confusing a LUT with a Grabbed Still.


Maybe it is confusing for you, that's why I uploaded an image for better understanding.

Jim Simon wrote:The latter will apply the exact same adjustment and produce the desired result. A LUT can't do that.


Nobody said nothing about grabbed stills. Actually, if you export a grabbed still in .tiff format you'll learn there's already a cutoff information happening. But this isn't the core of the matter here.

Jim Simon wrote:I don't think you can save that adjustment for use in other software and have it function identically.


LUTs do function identically with luma&chroma for any software, the matter here is that doesn't function with the same software that is creating it.
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostTue Apr 06, 2021 11:16 am

Found a workaround and the partial explanation of what is happening:

Found that Final Cut doesn't transform the gamma when video is imported so I export them as Prores and now Davinci works properly when generating LUTs.

I was working with Prores files transcoded with Apple Compressor, Compressor seems to apply the same gamma (or whatever the correct term is) transformation as Davinci: when importing the video gamma is scaled beyond 0-100 luminance, no information loss but then comes all the other problems with LUTs.

I'm going to keep this post updated as I gather more information.
Offline
User avatar

Isaac RC

  • Posts: 21
  • Joined: Wed Jan 15, 2020 11:06 am
  • Real Name: Isaac Rivas

Re: LUTs loss of information - shadows cutoff

PostSun Apr 11, 2021 11:41 am

Alright so finally the mistery it's been solved:

The cause: In this case the video editor misinterpretation of the video contrast levels is because the video itself lacks of the appropriate "color space tagging" [see example in attached image]

Generic Solution 1: to make Davinci Resolve apply LUTS as if the contrast levels where normal, just make a node with the contrast correction and then generate a new compound clip from this, afterwards any LUT applied will respect the corrected contrast. Note: make sure to deactivate the s-curve option from the projects settings.

Generic Solution 2: find a way of tagging the video file to its real color space ( HD 1-1-1 equals a 709 space), I'm currently searching how to do this one.

Specific Mac OS Solution: I updated to the last OS version and this solved the problems with GoPro, weird as you can see in the attached image GoPro does in fact tag correctly the color space of their videos.

Screen Shot.jpg
Screen Shot.jpg (384.25 KiB) Viewed 1473 times

Return to DaVinci Resolve

Who is online

Users browsing this forum: Bing [Bot], Dan Anon, Mark Weiss and 299 guests