Jump to: Board index » General » Fusion

Manually altering planar tracker in Fusion

Learn about 3D compositing, animation, broadcast design and VFX workflows.
  • Author
  • Message
Offline

mrbjjackson

  • Posts: 6
  • Joined: Tue Feb 26, 2019 11:29 pm
  • Real Name: Ben Jackson

Manually altering planar tracker in Fusion

PostThu Sep 12, 2019 2:37 pm

Hi there,

I'm sure this is possible and I've really search all over, and read the manual too but I can't work out how to manually edit tracking data in Fusion.

I'm using the Fusion tab in Resolve 15.
I've got my clip, added a Planar Tracking node.
I've marked out my tracking area and I've got the auto tracking working just fine but there are points where the auto tracking gets a bit off. So I go into the shape where it's gone off track, and pull it about a bit to make it fit again. But now if I go backwards in time these changes have been applied to all previous frames.

From my reading I've gathered that I think I need to create keyframes for each time I make a change to the shape. But I've tried loads of things, and I've searched all over but I can't work out how this is done.

Can someone please help?

Many thanks,
Ben
Offline

Hendrik Proosa

  • Posts: 793
  • Joined: Wed Aug 22, 2012 6:53 am
  • Location: Estonia

Re: Manually altering planar tracker in Fusion

PostThu Sep 12, 2019 5:45 pm

Wherever you use planar tracking (mocha, fu, nuke etc) the principle is the same: shape does not represent the tracking data. Shape provides the area that tracker follows, but underlying track itself is not the shape. Instead, shape is attached to underlying track and moves because of it. Now, if you change the shape, it does not change the track itself one bit. If you don't keyframe the shape and reshape it, this change propagates to all frames and will be off in other frames.

To my knowledge you can't change the actual tracking data of planar tracker in planartracking node itself.
I do stuff.
Offline

mrbjjackson

  • Posts: 6
  • Joined: Tue Feb 26, 2019 11:29 pm
  • Real Name: Ben Jackson

Re: Manually altering planar tracker in Fusion

PostFri Sep 13, 2019 1:24 pm

Hi Hendrik,

Thanks for the reply. I think this has clarified things a bit for me. I'm still struggling to do what I want though. I wonder if I could explain it could you point me in the direction I should be going.

I have a person in the shot that is moving around in front of a fairly complicated background.

I would like to remove the background. So I was trying to use the planar tracker to track her movement and then use the "Mask" output of the planar tracker to mask the original footage to remove the background.

But as the track is not perfect, I would like to manually alter the tracker shape (and the mask it produces) to fix it where the track gets lost.

Am I going about this the right way?

Thanks in advance.
B
Offline
User avatar

capthook

  • Posts: 53
  • Joined: Thu Aug 15, 2019 12:43 am
  • Real Name: Jack Jones

Re: Manually altering planar tracker in Fusion

PostTue Dec 17, 2019 6:51 am

I have spent weeks - off and on - trying to solve this. (Resolve 16.1.1 fusion)
The planar tracker often works the best of all the trackers - non-wobbly/jittery etc.
But seems to have the least options to modify the tracking data.

The color page window tracker is a breeze to keyframe/alter/adjust and works great.
The fusion tracker can be modified by hand and/or converting the spline points to x/y data.

The fusion planar tracker?!??
Wish I had a clue after so many hours of trying.
Basically seems nothing I do works.
Moving nor keyframing the tracking window doesn't change it.
Setting new keyframes doesn't change it.
The keyframes in the spline editor are locked......
and even unlocking them (right click a spline keyframe - select set key - move it - nothing)

So... if I have a basic scene where the tracking subject goes in/out/in of frame:
1. I stop the track
2. Click the cancel track data to end
3. Keyframe the blend of the planar tracker node to 0.
4. Create a new tracker node to track when subject begins to re-enter frame.

Or - really - switch to the basic fusion tracker and tweak/hope for non-jitters.

I have read the manual, searched for many hours on the interwebs and utubes.

Would be great if BM could make fusion trackers work more like the color page window tracker.
Or at least more user-friendly/editable.

Anyone with a clue that can help?
M2P | G85 | Crane V2 | DR Studio 16.1.2
i7-6700 3.4GHz | 16 GB RAM | GTX 970 4GB | Windows 10
Offline
User avatar

Bryan Ray

  • Posts: 1280
  • Joined: Mon Nov 28, 2016 5:32 am
  • Location: Los Angeles, CA, USA

Re: Manually altering planar tracker in Fusion

PostTue Dec 17, 2019 8:29 pm

At the moment, the Planar Tracker is a black box. We can't modify any of the data it produces.

You can reduce jitter using the regular Tracker node by tracking more than once with slightly different patterns. The result will be calculated from the average of the active trackers. I usually go once forward and once backward at least to remove statistical noise. If you're only tracking one feature like this, turn off Rotation and Scaling. Having two slightly jittery trackers very close together will cause problems.
Bryan Ray
http://www.bryanray.name
http://www.musevfx.com
Offline
User avatar

Igor Riđanović

  • Posts: 677
  • Joined: Thu Jul 02, 2015 5:11 am
  • Location: Los Angeles, Calif.

Re: Manually altering planar tracker in Fusion

PostThu Dec 19, 2019 7:58 am

You can commit the planar tracker to a plain transform node after the tracking is complete. Then you can edit the curves of the transform like you'd edit any other.

I also do that because the image quality produced by the planar tracker's algorithm is not great. The regular transform node offers several good options to choose from.
www.metafide.com - DaVinci Resolve™ Apps
Offline
User avatar

Bryan Ray

  • Posts: 1280
  • Joined: Mon Nov 28, 2016 5:32 am
  • Location: Los Angeles, CA, USA

Re: Manually altering planar tracker in Fusion

PostThu Dec 19, 2019 7:09 pm

Is that new in a more recent build than I have (my installation of v16 hasn't been updated in a good long time)? Because the only thing I see is the Create Planar Transform button, which makes the PlanarTransform tool, which has only the single, useless spline that locks up the entire matrix in a single un-editable value.
Bryan Ray
http://www.bryanray.name
http://www.musevfx.com
Offline

Sander de Regt

  • Posts: 1536
  • Joined: Thu Nov 13, 2014 10:09 pm

Re: Manually altering planar tracker in Fusion

PostThu Dec 19, 2019 9:54 pm

Bryan, I don't think it's a newer build. I think you guys are talking about different things.
Unless you only use a planar tracker set to position/rotation/scale, the results can't be reproduced in a normal tracker as far as I know, but maybe Igor can show us something we don't know yet.
Sander de Regt

ShadowMaker SdR
The Netherlands
Offline
User avatar

Igor Riđanović

  • Posts: 677
  • Joined: Thu Jul 02, 2015 5:11 am
  • Location: Los Angeles, Calif.

Re: Manually altering planar tracker in Fusion

PostFri Dec 20, 2019 12:28 am

I was partially incorrect. At the bottom of the Planar Tracker there is a button that creates a planar transform with baked in curves. Not a regular Xf transfom. This planar transform has a displacement curve. I don't know if there is a way to convert that curve into something more user friendly.
www.metafide.com - DaVinci Resolve™ Apps
Offline
User avatar

Bryan Ray

  • Posts: 1280
  • Joined: Mon Nov 28, 2016 5:32 am
  • Location: Los Angeles, CA, USA

Re: Manually altering planar tracker in Fusion

PostFri Dec 20, 2019 4:40 am

Darn; I thought you knew something I didn't!
Bryan Ray
http://www.bryanray.name
http://www.musevfx.com
Offline
User avatar

Igor Riđanović

  • Posts: 677
  • Joined: Thu Jul 02, 2015 5:11 am
  • Location: Los Angeles, Calif.

Re: Manually altering planar tracker in Fusion

PostFri Dec 20, 2019 7:18 pm

Bryan Ray wrote:Darn; I thought you knew something I didn't!

That would be hardly unlikely!
www.metafide.com - DaVinci Resolve™ Apps
Offline
User avatar

Igor Riđanović

  • Posts: 677
  • Joined: Thu Jul 02, 2015 5:11 am
  • Location: Los Angeles, Calif.

Re: Manually altering planar tracker in Fusion

PostFri Dec 20, 2019 7:24 pm

Here is a kludgy idea. Track with the planar tracker, create planar transform when done.

Use the planar transform to unsteady a tracking target. The target can be a black screen with a couple of hash marks.

Use the point tracker to track the unsteadied target and you end up with editable XY curves.
www.metafide.com - DaVinci Resolve™ Apps
Offline
User avatar

capthook

  • Posts: 53
  • Joined: Thu Aug 15, 2019 12:43 am
  • Real Name: Jack Jones

Re: Manually altering planar tracker in Fusion

PostSat Dec 21, 2019 5:21 am

Pretty nifty idea.
That's one thing great about Resolve/Fusion,
there are often 5 different ways to do many things.

I find using 'append' to the basic fusion tracker the easiest for problem tracks.
track8.jpg
track8.jpg (27.85 KiB) Viewed 884 times
M2P | G85 | Crane V2 | DR Studio 16.1.2
i7-6700 3.4GHz | 16 GB RAM | GTX 970 4GB | Windows 10
Offline
User avatar

Jed Mitchell

  • Posts: 147
  • Joined: Tue Nov 03, 2015 11:04 pm
  • Location: New York, NY

Re: Manually altering planar tracker in Fusion

PostSat Dec 21, 2019 7:43 pm

The way I deal with incomplete or partially successful planar tracks in Fusion is to add a Grid Warp after the planar transformation. A Grid Warp set to 1x1 can be treated as a plane and then manually adjusted on frames that gave me issues in the Planar Tracker (or to create additional frames beyond what the tracker was able to capture).

By setting the Grid Warp source positions to a rough bounding box around my source Planar Tracker shape the subsequent manual adjustments can be made to very closely match the Planar Tracker output itself. So on any jittering frames I'll delete the offending Planar Tracker keyframe and adjust the shape myself by keyframing the Grid Warp, etc.

To make the manual adjustments easier I pipe in a still frame created by a TimeSpeed node (set to the Planar Tracker source frame) to create a difference matte for comparison against my Grid Warp animation.

Keyframing the grid this way against a reference image basically *is* planar tracking, just done by hand, so you can accomplish whatever you need with it.
"It's amazing what you can do when you don't know you can't do it."


Systems:
R16.1 | Win10 | i9 7940X | 128GB RAM | 1x RTX Titan | 960Pro cache disk
R16.1 | Win10 | i9 7940X | 128GB RAM | 1x 2080 Ti | 660p cache disk

Return to Fusion

Who is online

Users browsing this forum: No registered users and 7 guests