Trying to figure out cause of nasty aliasing in render

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

Seth Goldin

  • Posts: 668
  • Joined: Wed Nov 04, 2015 7:43 pm

Trying to figure out cause of nasty aliasing in render

PostFri Apr 21, 2017 4:05 pm

Several months back, I created proxies for an offline edit with an earlier version of Resolve and an earlier version of CUDA.

The OCNs were UHD XAVC-I from an FS7 and the proxies were UHD ProRes 422 Proxy.

The proxies came out fine, and the offline editor, working in Premiere, would render out 1080p H.264 drafts that looked great. So Premiere was downscaling our UHD proxies to 1080p H.264, without any issues.

Here's a still from a proxy that's looking fine: http://imgur.com/a/lGJH4

Recently, we conformed back to the OCNs inside Resolve and were prepping a "single-clip" 1080p export for a 1080p finish.

The plan was to render the UHD XAVC-I to 1080p ProRes 4444. Unfortunately, Resolve now seems to be reading the OCNS with pretty nasty aliasing, and it does pass that aliasing along into the ProRes 4444 export. Whether merely previewing 1080p out of the DeckLink Mini Monitor or looking at the 1080p ProRes 4444 export, the aliasing is quite bad.

Here are stills of the 1080p DI, before and after some grading:
Log: http://imgur.com/mYeat1G
Some grading: http://imgur.com/a/sg8JS

Notice the edge of the subject's left shoulder. Compare the proxy to the ungraded and graded DI.

Image Scaling was set to "Sharper," and we tried all the settings for "Anti-alias edges:" auto, on, and off. Nothing seemed to improve the aliasing.

My hunch is that this might just be a CUDA issue, because that's the major thing that seems to have changed, but I'm not sure. I'm wondering how I might try to diagnose and fix this.

System specs:
NVIDIA Web Driver 378.05.05.05f01
CUDA driver 8.0.81
DaVinci Resolve 12.5.5.026
MacPro5,1 (Mid 2010)
macOS Sierra 10.12.4 (16E195)
NVIDIA GeForce GTX TITAN X 12288 MB (9-series with MacVidCards firmware)

There is an update for the NVIDIA Web Driver available, 378.05.05.05f02, but I'd like to confirm whether that would fix this issue before I update. Does anyone know of any issues with 378.05.05.05f01 or is there something else I might be missing?
https://www.sethgoldin.com
Offline

Seth Goldin

  • Posts: 668
  • Joined: Wed Nov 04, 2015 7:43 pm

Re: Trying to figure out cause of nasty aliasing in render

PostFri Apr 21, 2017 5:15 pm

I just tried the same OCNs on a different system entirely, and I don't think it's CUDA. 12.5.5 on a MacPro6,1 with AMD FirePros is also causing this problem, even with "Sharper" image scaling.

Seems like a Resolve bug. Can anyone else confirm? Possibly this thread will be made obsolete by Resolve 14's imminent release.


Sent from my iPhone using Tapatalk
https://www.sethgoldin.com
Offline

Andrew Kolakowski

  • Posts: 9211
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: Trying to figure out cause of nasty aliasing in render

PostFri Apr 21, 2017 6:19 pm

These sort of aliasing (stepping on diagonal lines) happens when you interpret progressive footage as interlaced and work in progressive project.

Are you sure your source clips are interpreted as progressive? (I assume you work with progressive sources)
Last edited by Andrew Kolakowski on Sun Dec 06, 2020 4:05 pm, edited 1 time in total.
Offline

Seth Goldin

  • Posts: 668
  • Joined: Wed Nov 04, 2015 7:43 pm

Re: Trying to figure out cause of nasty aliasing in render

PostFri Apr 21, 2017 8:05 pm

The footage is all progressive. All the problem clips are 23.976 fps, and Resolve is properly interpreting them as such.

Just to be sure, I just confirmed this in the Master Project Settings tab of the Project Settings window, as well as the Clip Attributes window for the problem clips.
https://www.sethgoldin.com
Offline

Seth Goldin

  • Posts: 668
  • Joined: Wed Nov 04, 2015 7:43 pm

Re: Trying to figure out cause of nasty aliasing in render

PostWed Apr 26, 2017 7:00 pm

I figured this out, in case anyone ever runs into a similar issue. The problem was that I was using video field processing on my progressive footage. This is a project-level setting.

So, all my footage was progressive, and I had accidentally checked: Project Settings>Master Project Settings>Timeline Format>Enable video field processing.

Once I unchecked this, the aliasing was gone.

An explanation from the manual:

Enable video field processing: Interlaced media is supported throughout DaVinci Resolve. The “Enable video field processing” checkbox forces Resolve to process all operations internally using separated fields. A corresponding checkbox in the Format settings of the Deliver page, “Field rendering,” lets you enable and disable field rendering when rendering file-based output. In addition, each clip in the Media Pool has a Field Dominance pop-up menu in the Video panel of the Clip Attributes window that lets you specify whether clips are upper- or lower-field dominant; an Auto setting makes this choice by default.

If you’re working with progressive-frame media, it is not necessary to turn this checkbox on. Furthermore, if you’re using interlaced clips in a progressive-frame project and you’re intending to deinterlace those clips using the Enable Deinterlacing checkbox in the Clip Attributes window, then you must turn “Enable video field processing” off. Otherwise, the Enable Deinterlacing checkbox will be disabled for all clips. For more information about deinterlacing clips, see the “Changing Clip Attributes” section of Chapter 9, “Working With Media.”

Whether or not it’s necessary to turn field processing on to maintain the field integrity of interlaced clips in your program depends on what types of corrections you’re applying to your clips. If you’re mastering your program to an interlaced format, and you’re applying any adjustments that would cause pixels from one field to move or bleed into adjacent fields, then field processing should be enabled; effects requiring field processing include filtering operations such as blur, sharpen, and OpenFX operations, as well as sizing transforms that include pan, tilt, zoom, rotate, pitch, and yaw.

On the other hand, regardless of whether you’re outputting interlaced or progressive- frame media, if you’re not filtering or resizing your clips, and you’re only applying adjustments to color and contrast, it’s not necessary to turn on field processing for interlaced material, and in fact, leaving it off may somewhat shorten your project’s rendering time.


Big thanks to Dmitry Kitsov on the Blackmagic tech support team for figuring this out.
https://www.sethgoldin.com
Offline
User avatar

SimplSam

  • Posts: 152
  • Joined: Fri Jan 04, 2019 11:36 pm
  • Location: London, UK
  • Real Name: Sam Cogheil

Re: Trying to figure out cause of nasty aliasing in render

PostWed May 08, 2019 2:58 pm

Seth Goldin wrote:I had accidentally checked: Project Settings>Master Project Settings>Timeline Format>Enable video field processing.

Ha Ha Ha Ha Ha Ha Ha Ha Ha Ha Ha Ha --- I'm Happy!

This solved a problem I was having on one of my machines and could not understand why it was creating jagged Text and more recently jagged videos when downscaled to 1080p. Turned out that (at some point) I had not only checked 'Enable video field processing', but then also saved it into my default settings. I also have a habit of using old projects as templates.

I had been cursing DR's lousy text handling when down-scaling, and always had to render at max resolution in order to get clean output. After unchecking this little beast I now have clean text output at 1080p, and DR is well and truly back in my good books!

Heaven (or similar) awaits you ....
Resolve Studio 18.6 » Win 11 Pro 64GB » NVIDIA GTX 1080ti 11GB

Sam
Offline
User avatar

Firehouse Creative

  • Posts: 80
  • Joined: Fri May 01, 2020 6:57 pm
  • Location: Nashville, TN
  • Real Name: Wes Langdon

Re: Trying to figure out cause of nasty aliasing in render

PostSun Dec 06, 2020 3:57 am

Just leaving this here to let you know that this just saved me. Very tough to google. Trying to flip an image 180* and it's like I downloaded a YouTube stream of my footage, garbled mess. All better now! What a find.
---
Wes Langdon
Instagram: @supervibrant

Resolve Studio (current) | Mac Studio M1 Ultra (20-core) | macOS Sonoma | Resolve Mini Panel | Resolve Editor Keyboard | Ultrastudio 4K Mini > LG EP950 & LG CX | Synology DS1821+ over 10Gbe

Return to DaVinci Resolve

Who is online

Users browsing this forum: c.lday44, David James and 144 guests