MediaIn node stereoscopic 3D

Is there any future plans for having the fusion mediaIn node load stereoscopic clips properly?

Is there any future plans for having the fusion mediaIn node load stereoscopic clips properly?

Hi Tom.

Some of the things you have been requesting feature wise on the BMD Resolve beta forums about stereo 3D / 360 media in the Fusion page have already been solved using 3rd party addons, or can be implemented with standard Fusion nodes placed inside a Fusion macro, or macroLUT.

And TBH a lot of these features are available for free on the Steakunderwater website and inside the Reactor package manager for Resolve and Fusion.

Setting Stereo3D and 360 Viewer Metadata

Reactor MetadataVR Fuse.png (144.02 KiB) Viewed 1627 times

The MetadataVR fuse can be found in Reactor's "Tools/Metadata" category. This fuse allows you to define the metadata info for the stereoscopic frame layout (HStack/VStack) of footage that is loaded in the Fusion page's stereo 3D viewer. If defined, the frame layout setting will be used automatically inside of Fusion's stereoscopic 3D image processing nodes.

The MetadataVR fuse also defines the 360° image projection format tag that is used by the Fusion page 360° viewer, and the PanoMap node.

The MetadataVR.fuse node GUI looks like this:

MetadataVR Fuse.png (22.54 KiB) Viewed 1627 times

After you attach the MetadataVR fuse to your MediaIn node and configure the settings you want, you can use the Stereo3D viewer mode just by enabling it in the Viewer without needing to set the stereo frame layout each time.

Stereo Viewer - Enabled Mode.png (55.25 KiB) Viewed 1627 times

Also, the 360° viewer mode can be left in the "auto" configuration and the MetadataVR fuse provided metadata info will define the settings for you for the image projection.

Rendering Multiple Image Outputs from the Fusion Page

If you need to export 360° stereo footage from the Fusion page as EXR based image sequences that have more channels of image data present then Resolve's Deliver page RGBA output option allows, you could look at the LifeSaver fuse that is in Reactor's "Tools > IO" category.

The LifeSaver fuse allows you to have multiple output nodes present in your Fusion page comp at the same time. With several LifeSaver nodes in your comp, you can do concurrent image exports written to disk from inside of the Fusion page. This is a lot more flexible than the MediaOut node which currently supports only a single node output from a Fusion page composite.

The LifeSaver fuse uses the EXRIO library to re-create a lot of the capabilities of a Fusion Standalone "Saver" node from scratch. Then the fuse adds a combined multi-part and multi-channel EXR export mode, and Filename field token ${token} support too for automatic naming of your output.

If you used the Fusion Standalone / Resolve Fusion page optical flow and stereo tools to process your stereo 3D imagery, you could use the LifeSaver fuse to write EXR image sequences to disk that have the stereo disparity X and Y channel data preserved alongside your motion vector data, the RGBA, Z-depth and other channels of information.

You can read more about the LifeSaver fuse on the Steakunderwater forums page for the fuse.

Macros and MacroLUTs

It is possible to create your own Fusion page macros and save them into the LUTs: PathMap folder as a MacroLUT. A MacroLUT has a single image input and a single image output. Any exposed parameters in the macro are shown in the LUT's "EDIT" controls section of Resolve Fusion page/ Fusion Standalone GUI.

Using a MacroLUT approach would allow you to create simple nodes based tools that could let you preview 180VR stereo footage in Fusion's Viewer Window's 360° output mode, playback footage with exotic image projections, do 6DOF stereo RGBZ to LatLong stereo conversions, or do many other tasks with an interactive preview mode.

When a custom MacroLUT is activated in the Fusion viewer window, the LUT applies your custom graphics operations onto the live footage loaded into the viewer window. The MacroLUT happens before Fusion's Stereo 3D viewer or the 360° viewers get the footage so the macro can pre-process and apply effects to reformat your Stereo 3D and 360° media. You are able to pack Fusion 3D system nodes and even a renderer3D node into a MacroLUT as long as the final output is a single image output feed.

You can read a bit of information on Macro creation and MacroLUTs on the Macro Building Essentials Steakunderwater thread.

none of that supports the existing resolve stereoscopic pipeline

none of that supports the existing resolve stereoscopic pipeline

Maybe not. But it does make working with S3D and 360VR media inside of the Resolve Fusion page just a little bit nicer.