Page 1 of 1

Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Sat Oct 05, 2019 6:35 pm
by Dennis Fassbaender
Just was watching this video..its amazing:


Possible with Fusion?

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Sat Oct 05, 2019 7:52 pm
by Sander de Regt
It's not (yet) possible in Fusion. (just as it isn't in AE without this plug-in)
There are definitely some ways to do something similar, but there is no automated way of doing this, no 'mesh building'.

In theory if you'd be able to access the raw trackers that are used for for example in the camera and/or planar tracker you'd be able to drive a warp with those, but as of now it's not possible.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Sat Oct 05, 2019 8:17 pm
by Dennis Fassbaender
Interesting...i think i have an ideas about how it could work with Blender.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Mon Oct 07, 2019 9:04 am
by Kel Philm
I did a pretty rough version using 24 trackers and a gridwarp which came out pretty average but didn't play around with it much.

DB Link:
https://www.dropbox.com/s/341qdy5yzc13n ... k.mov?dl=0

Not the way I would prefer, I think OpticalFlow might be the way forward here.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Mon Oct 07, 2019 4:33 pm
by Kays Alatrakchi
AEScripts and VideoCopilot are the best things that ever happened to Aftereffects. I swear if it wasn't for the amazing 3rd party add-ons I would have stopped using AE a long time ago!

If Blackmagic ever figures out a way to be compatible with AE plugins and scripts, that for me would be a massive game-changer!

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Tue Oct 08, 2019 11:24 am
by barbmsu
stx_patchPal plugin you can find in Reactor tries to do a similar job. Its under stx tools in reactor.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Fri Oct 11, 2019 12:16 am
by Kel Philm
barbmsu wrote:stx_patchPal plugin you can find in Reactor tries to do a similar job. Its under stx tools in reactor.


Did not get a good result with this, this implementation of Optical flow is not really very good for this sort of work.

I created a script that creates a tracker using the points from a GridWarp, tracks the points, then run another script that builds a new GridWarp from the tracked points with reasonable results:

https://www.dropbox.com/s/bngkyoq9f7pdn ... B.mov?dl=0

Can post them up on We Suck Less if anyone wants to take a peek.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Fri Oct 11, 2019 6:59 am
by Sander de Regt
Sure, put it up on WSL as well. It will be much easier to find there in a seperate topic/sub-forum etc.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Wed Oct 16, 2019 11:32 pm
by Kel Philm

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Thu Jan 07, 2021 11:39 am
by Dennis Fassbaender
Hey!
Thank you very much! This thing is awesome :)!
I´ve tested it a while and it does it job.

However- i would like to request something if it is okay for you:
Using a GridWarp-based-grid limits us to a rectangle. Is there a way to make a grid based on a polygon like with LockDown?
I´m asking this because i´m trying to use it on a human motion (see attached picture) where only the right side of the human needs to be tracked, but not the car around.
Is there a way to do it?
Like with the planar tracker as example. Or is there still a way to use planar-tracker for this kind of deformation effect...?

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Thu Jan 07, 2021 12:36 pm
by Sander de Regt
As far as I know this isn't (yet) possible. The only thing I could thing of to assist you in getting the result is by first creating a reverse matte to black out the stuff you don't want to track and then use the grid-warp tracker. Wherever it is black no points will be found, so you will only get tracks in your desired locations.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Thu Jan 07, 2021 1:35 pm
by Dennis Fassbaender
Good idea! Thank you.
BTW: The planar tracker worked better in my scene.
But on the elephant it failed.

Re: Is this possible with Fusion, too? (Non-planar Tracking)

PostPosted: Tue Jan 12, 2021 6:33 pm
by Dennis Fassbaender
By the way - i try to use a grid of 20x20 in a 4096x1716 timeline (Fusion Studio).
Fusion crashs when i try to "Make Tracker from GridWarp".

Is there a limit in resolution or number of trackers?
Is there anything i can do to make it working?