3D Composite/Scene Clean Up Failure

Hi,

I’m trying to remove footsteps from this drone shot. I’ve followed the Blackmagic tutorial several times but I still can’t get it to work. Here’s a video I recorded showing the issue. Any suggestions would be greatly appreciated.

Issue explanation

Davinci Tutorial:

If geometry onto which you project stays in place then it might be a problem with mismatching resolutions. What's the res of that patch element you merge back on top of plate after projecting? Does that patch render itself show the patch in correct (relative) position?

I would give the Planar Tracker a crack at it as there appears to be enough trackable detail to get a good solid track. Here is an example of what you are trying to do. Track the ground concentrating on the area where the foot prints are located. Paint the footprints out on the frame that you select as your reference frame for tracking. That will be your clean plate to be fed into the corner pin of the tracker. Create masks that follow the footprints, these masks will replace the the areas where your footprints are located with relevant areas of your clean plate, the rest of the scene will be the original background plate.
Here is an example of what you are trying to do. You wont need the first Planar Tracker as your background is not revealed. I was able to create the clean plate using parallax from the first tracker in that example but that doesn't apply in your case.
The example could be improved slightly by snapping the front of the mask past a few slight artifacts and holding the trailing edge of the mask off and then snapping that past the area but it's just an example of the basic workflow.
Oh and you'll need to set your Corner Pin to full raster by inserting 0's and 1's in the relevant Reference Time Positions, no need to keyframe them unless you need to adjust the corner pin.

https://drive.google.com/file/d/1gswrYw ... drive_link

If geometry onto which you project stays in place then it might be a problem with mismatching resolutions. What's the res of that patch element you merge back on top of plate after projecting? Does that patch render itself show the patch in correct (relative) position?

Hi. So I used the paint tool to clone adjacent snow. The patch does start in the correct position, but it does doesn’t track correctly.

I would give the Planar Tracker a crack at it as there appears to be enough trackable detail to get a good solid track. Here is an example of what you are trying to do. Track the ground concentrating on the area where the foot prints are located. Paint the footprints out on the frame that you select as your reference frame for tracking. That will be your clean plate to be fed into the corner pin of the tracker. Create masks that follow the footprints, these masks will replace the the areas where your footprints are located with relevant areas of your clean plate, the rest of the scene will be the original background plate.
Here is an example of what you are trying to do. You wont need the first Planar Tracker as your background is not revealed. I was able to create the clean plate using parallax from the first tracker in that example but that doesn't apply in your case.
The example could be improved slightly by snapping the front of the mask past a few slight artifacts and holding the trailing edge of the mask off and then snapping that past the area but it's just an example of the basic workflow.
Oh and you'll need to set your Corner Pin to full raster by inserting 0's and 1's in the relevant Reference Time Positions, no need to keyframe them unless you need to adjust the corner pin.

https://drive.google.com/file/d/1gswrYw ... drive_link

Hi. Thank you. I will give the planar track another go. I tried initially but it said I didn’t have enough track points and wouldn’t even attempt to track. I don’t know if you know the answer to this, but if the background is already tracked, why do you need a mask around the area once the painting has been done? Wouldn’t the paint layer stay in the correct position? I only ask because I have foot prints all over the frame, so once I get this working, I want to simplify/be as efficient as possible. Thank you!

If geometry onto which you project stays in place then it might be a problem with mismatching resolutions. What's the res of that patch element you merge back on top of plate after projecting? Does that patch render itself show the patch in correct (relative) position?

Hi. So I used the paint tool to clone adjacent snow. The patch does start in the correct position, but it does doesn’t track correctly.

This doesn’t answer my question. What is the resolution of that patch element before it hits the merge and does it match the plate resolution?

You would be better with masks because it allows you to only replace the areas that need to be replaced and the rest will be as original. Since the tracked surface is not a plane you may get distortion of the image so keeping as much of the original should help. It's imposible to judge without seeing what's going on with the camera and how wide spread the footprints are. You might need more than one tracker if the surfaces are nowhere near co planar. From what I saw it didn't look like a lack of tracking points would be a problem, it's likely the tree branches are causing a problem, they really should be masked out with occlusion masks plugged into the occlusion mask input. They are nowhere near the ground plane that you need to track and will very likely create erroneous tracking data or may even cause the track to fail..
Hendrik's question is very important for the 3d method