[bug] Jagged edge when rotating media over another track

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

smunaut

  • Posts: 524
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

[bug] Jagged edge when rotating media over another track

PostSun Apr 04, 2021 3:26 pm

So if you take two "light background" media (easier to see the issue with light colors), and then you rotate the one being "above", the edge will appear jagged :

Example: Image

It's possible to work around the issue, if you crop a bit of that edge, that will fix it. Also using a fusion composition for the top clip fixes it ( even just an "empty" one with just media in -> media out will fix it ).

So not the end of the world, but still a sign that something isn't working quite right and should probably be looked at.
Resolve Studio - Ryzen 5800X3D - AMD RX6600 / NVidia RTX 4070 (switching between the 2) - Linux
Offline

Jim Simon

  • Posts: 36112
  • Joined: Fri Dec 23, 2016 1:47 am

Re: [bug] Jagged edge when rotating media over another track

PostSun Apr 04, 2021 3:50 pm

Under Project Settings>Image Scaling, what is your anti-aliasing set to?

Does it also export like that?
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

smunaut

  • Posts: 524
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

Re: [bug] Jagged edge when rotating media over another track

PostSun Apr 04, 2021 4:16 pm

Scaling was set to "Sharper". And yes, it's present in the render.

With scaling set to "sharper" or "smoother" the output is like this :
Image

With scaling set to "bicubic" or "bilinear" the output is like this : (no "black" but still stair case)
Image

If I either :
- In any scaling mode, I crop 1 pixel on the top.
- Or in "sharper" or "smoother", I add a fusion comp on the top clip (empty one, just go to fusion tab, move the node, go back to edit tab). For the "bicubic" / "bilinear" mode, adding the fusion comp doesn't change the result, still white staircase as above.

Then the result is like this : (which is what I would expect)
Image
Resolve Studio - Ryzen 5800X3D - AMD RX6600 / NVidia RTX 4070 (switching between the 2) - Linux
Offline

Jim Simon

  • Posts: 36112
  • Joined: Fri Dec 23, 2016 1:47 am

Re: [bug] Jagged edge when rotating media over another track

PostSun Apr 04, 2021 7:08 pm

Not Scaling, Anti-Aliasing?
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

smunaut

  • Posts: 524
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

Re: [bug] Jagged edge when rotating media over another track

PostSun Apr 04, 2021 7:56 pm

"Anti-Alias-Edge" ?

It's on "Auto". Setting it to "On" doesn't change anything.
Setting it to "Off" changes slightly, but still wrong / with black border.

(Done with "Sharper" resize filter)
Resolve Studio - Ryzen 5800X3D - AMD RX6600 / NVidia RTX 4070 (switching between the 2) - Linux
Offline

Jim Simon

  • Posts: 36112
  • Joined: Fri Dec 23, 2016 1:47 am

Re: [bug] Jagged edge when rotating media over another track

PostMon Apr 05, 2021 3:47 pm

Got it.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline
User avatar

visualfeast

  • Posts: 895
  • Joined: Sat May 19, 2018 6:51 pm
  • Real Name: BEN JORDAN

Re: [bug] Jagged edge when rotating media over another track

PostTue May 04, 2021 9:04 pm

I've found that the nVidia settings make a huge difference on the performance of anti-aliasing in Resolve. I tried tons of combinations (each having to re-start Resolve between changes!) and below was the best I found. It gave perfect quality on-screen and mostly acceptable on deliver. Note that project settings image scaling resize filter must be changed to bicubic or bilinear for this to work.

nVidia, app specific for Resolve-- FXAA: ON

https://prnt.sc/12hsc8l

Also, as you can see, with these particular settings in the nVidia control panel, the anti-alias setting in Resolve didn't seem to matter anymore.

Btw this is on my Quadro M5000M. Did not test on any desktop system yet.
•14700K/96G/4080SuperFE/24TB RAID/PA278CGV(x2)/U2415(x1)/StreamDeckXL+15
•5950x/64G/3080ti/80TB RAID/Intensity Pro 4K/U2415(x2)/Shogun 7/HPE LTO6/StreamDeck15
•ZBook 17 G3/64G/Quadro M5000M
•Inspiron 16+/32G/RTX3060
Studio v18.6.6, 19.1.4/Win10 Pro 22H2
Offline

smunaut

  • Posts: 524
  • Joined: Sat Jan 30, 2021 6:15 pm
  • Real Name: Sylvain Munaut

Re: [bug] Jagged edge when rotating media over another track

PostWed May 12, 2021 8:36 am

This seems to be fixed in 7.2
I played around with my test project and the results looked good no matter what I tried.
Resolve Studio - Ryzen 5800X3D - AMD RX6600 / NVidia RTX 4070 (switching between the 2) - Linux

Return to DaVinci Resolve

Who is online

Users browsing this forum: anas_colorist, Bing [Bot], FirePhoenix, mpetech, VMFXBV and 263 guests