Help with screen replacement overlay

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

happytappin

  • Posts: 10
  • Joined: Mon May 04, 2020 3:01 am
  • Real Name: John HEBERT

Help with screen replacement overlay

PostFri Jul 30, 2021 1:00 am

Screen Shot 2021-07-29 at 7.54.10 PM.png
Screen Shot 2021-07-29 at 7.54.10 PM.png (605.12 KiB) Viewed 1172 times
Screen Shot 2021-07-29 at 7.54.10 PM.png
Screen Shot 2021-07-29 at 7.54.10 PM.png (605.12 KiB) Viewed 1172 times
So I did a screen overlay with an old commercial and it came out fantastic , looks like its coming from the TV and everything, but now when i walk in front of the TV you can see the obvious problem. How do I solve this?
Attachments
Screen Shot 2021-07-29 at 7.54.24 PM.png
Screen Shot 2021-07-29 at 7.54.24 PM.png (527.04 KiB) Viewed 1172 times
Offline

bounceHouse

  • Posts: 365
  • Joined: Tue Apr 14, 2020 12:40 am
  • Real Name: Wesley McDermott

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 2:12 am

There are multiple options; look up (in Youtube or the Davinci Resolve tutorials) on rotoscoping. There are multiple techniques (all manual, some tracking, etc.).

One approach is on the Color page, having selected the "tv video" clip from the list of clips you can apply correction to:
* turn on a power window (the one that looks like a "pen tool"), which you'll use to draw around your body as it moves across the TV,
* click the 'invert' the mask button next to it so that only the video that is NOT where your body is shows.
Go frame by frame adjusting the window, until you've passed the TV completely (at which point drag the whole mask off completely off the view - before you arrive and after you depart - for the rest of the video.

Early on, in the nodes area, right click to "add alpha output" and connecting the blue output (of your node that has the power window) to the alpha output that appears. Back on the Edit page, you'll be able to see the effect of the masked area.

Given the motion blur I see on the snapshot you provided, you'll likely want to soften the edges of your mask so that it blends well.

Have fun!
PC Win 10 Pro, 64GB ram; NVidia 522.30; dual monitor; RTX 3080 (10GB); auto/CUDA processing mode; SSD cache, separate SSD for data; Davinci Studio 18.6.5 build
Offline

Jason Conrad

  • Posts: 797
  • Joined: Wed Aug 16, 2017 3:23 pm

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 3:26 pm

Try Mocha. It’s pretty much the only game in town for rotoscoping, unfortunately.


Sent from my iPad using Tapatalk
-MacBook Pro (14,3) i7 2.9 GHz 16 GB, Intel 630, AMD 560 x1
-[DR 17.0 Beta9]
Offline

Jim Simon

  • Posts: 29672
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 3:30 pm

happytappin wrote:How do I solve this?

The simplest is don't walk in front of the TV.

That can be achieved with a reshoot, or cutting before you cross.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline
User avatar

Gary Hango

  • Posts: 883
  • Joined: Mon Apr 09, 2018 10:35 pm
  • Location: Left Coast
  • Real Name: Gary Hango

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 4:07 pm

If you reshoot, play a solid green or blue image on the tv while filming, then use a chroma key effect to “underlay” the image on the screen. Your arm will occlude the image.
Microsoft Windows 10 Pro x64
Intel(R) Core(TM) i7-6700, 3.40GHz, 32.0 GB
MB: MSI, BIOS: American Megatrends Inc. A.60, 12/17/2015
NVIDIA GeForce GTX 960, 2Gb
Resolve 18.1.1.0007(Free)
Offline

Hendrik Proosa

  • Posts: 3006
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 7:37 pm

Just roto the person. Roto isn't rocket science, it is just tedious. Fusion page is good enough, no need for mocha or whatnot. Why mocha is always suggested for simple roto is beyond me, it does roto just the same as everything else, only edge it has to Fu is better planar tracking which is just a helper for quicker roto. Professional roto artists use mostly Silhouette but no-one suggests that for some reason.
I do stuff.
Offline

Sander de Regt

  • Posts: 3487
  • Joined: Thu Nov 13, 2014 10:09 pm

Re: Help with screen replacement overlay

PostFri Jul 30, 2021 8:02 pm

Gary Hango wrote:If you reshoot, play a solid green or blue image on the tv while filming, then use a chroma key effect to “underlay” the image on the screen. Your arm will occlude the image.


PSA: Do not do this. What you gain from the ability to key (if it even works, because usually stuff passing in front of a TV will be motion blurry and out of focus so not that easy to key to begin with) you will lose on the realism front. If the TV is off you can use lumakeying to bring back the original reflections making it easier to make a realistic composit.

If it's on with blue or green, the reflections will be lost and blue/green will reflect all over your scene. It's not worth it compared to doing a quick roto like Hendrik already mentioned.
Sander de Regt

ShadowMaker SdR
The Netherlands
Offline
User avatar

Marc Wielage

  • Posts: 10852
  • Joined: Fri Oct 18, 2013 2:46 am
  • Location: Hollywood, USA

Re: Help with screen replacement overlay

PostSat Jul 31, 2021 1:43 am

Hendrik Proosa wrote:Just roto the person. Roto isn't rocket science, it is just tedious. Fusion page is good enough, no need for mocha or whatnot. Why mocha is always suggested for simple roto is beyond me, it does roto just the same as everything else, only edge it has to Fu is better planar tracking which is just a helper for quicker roto. Professional roto artists use mostly Silhouette but no-one suggests that for some reason.

I think this is the best suggestion. I actually can and have done very effective rotos within Resolve, and the key (no pun intended) is to break up the human shape into multiple parts. Don't try to roto out the entire human body with a single mask: do one for the arm, one for the trunk, one for the neck, one for one leg, another one for the other leg, and so on, track them all separately, and then use all of them combined in one node as an "occluded mask" to cover up the TV set image when necessary. If it's a five-second shot, it doesn't take that long to do. If it's a long, complicated, moving shot, I'd just send it out to a VFX artist, let them create an external mask, and use that. If it involves really complex issues like transparency a change in 3D depth (like a camera that moves to the side), I'd give up and hire a VFX specialist. The alternative is learning Fusion, which can be done -- it's just a matter of time and patience.

Details for using external masks are in the manual. So are dealing with masks during composites on the color page, in the section on chromakeying in Chapter 144: "Channel Splitting and Image Compositing," starting on p. 2838 of the Resolve 17.2 manual. There's also a bunch of YouTube videos out there that discuss it.
marc wielage, csi • VP/color & workflow • chroma | hollywood
Online
User avatar

Uli Plank

  • Posts: 21104
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: Help with screen replacement overlay

PostSat Jul 31, 2021 6:17 am

I second that Silhouette is the best tool for rotoscoping, but I'd hesitate to suggest such an expensive tool for this project.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline

Hendrik Proosa

  • Posts: 3006
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Help with screen replacement overlay

PostSat Jul 31, 2021 8:50 am

Sander de Regt wrote:If the TV is off you can use lumakeying to bring back the original reflections making it easier to make a realistic composit.

There is an easier way too, simply add (plus) the screen graphics. Since screen is emissive, emit light is added to all the reflections and plussing keeps the original strength of reflected light.

Both Silhouette and Mocha are unneeded for simple roto, thus the analogy I brought up. I'd suggest to not grab for compicated solutions for solving simple problems.
I do stuff.

Return to DaVinci Resolve

Who is online

Users browsing this forum: Baidu [Spider], Bing [Bot], lordbiggus, Majestic-12 [Bot], panos_mts, Uli Plank and 128 guests