Animation links to file clip not version take?

I use Take Selector to flip between different versions of rendering. E.g. raw vs VFX.
However if I apply animation and cropping to a clip and then add a VFX version, the conformed animation/cropping key frames don't match the clip anymore. Is this a bug, intended outcome or am I just using take selector incorrectly?
Reproduction:
Drag in clip.
Animate a pan and scan animation to the transform and zoom controls.
Open take selector.
Add the VFX version of the clip.
Animation no longer lines up.
However if I apply animation and cropping to a clip and then add a VFX version, the conformed animation/cropping key frames don't match the clip anymore. Is this a bug, intended outcome or am I just using take selector incorrectly?
Reproduction:
Drag in clip.
Animate a pan and scan animation to the transform and zoom controls.
Open take selector.
Add the VFX version of the clip.
Animation no longer lines up.