Blackmagic Forum

Does anyone know how to convert circular fisheye to 1:1 equirectangular for VR180 output?

I have not found built in tools or plugins to accomplish this. I am working on a Mac with Resolve Studio.

I have explored Resolve's Transform, lens distortion and Warp FX, as well as Toos > lens distort > 3DE4 Radial - Fisheye, without success, and have not had success finding relevant content when searching the manual for fisheye, creating equirectangular, or VR180.

I have used workarounds, such as VR180 creator (made by Google, now archived) and Hugin panoramic stitcher. However these are overly simplistic or onerous, when something within Resolve workflow would be much superior (especially if it can be done in same set of steps as aligning L+R sources).

Re:Lens makes a plugin for Resolve, however it seems more geared to convert a fisheye to pan within it for a standard video versus 1:1 full frame VR180. It is also quite pricey if that is the only effect one needs from the plugin.

If this is helpful:

I am working in stereo 3D VR180 and excited to use Resolve for its superior stereo 3D editing tools. I shoot stills and timelapse (to create high-res static and timelapse video sequences) with 8mm circular fisheye lenses, with single or paired side-by-side full frame DSLR cameras. Plugins for converting fisheye to equirectangular is surprisingly challenging to find, aside from the proprietary tools for dedicated cameras liker ZCam and Instar360 EVO.

Any suggestions much appreciated!

When searching YT you must have come across this guy

https://www.youtube.com/@hughhou/featured

He uses Resolve and has various tutorials

Thank you CougarJoe, I had searched through Hugh's tutorials earlier but did not find anything. He kindly responded to my question, and led me to an old tutorial for the canon R5 with dual fisheye lens, where apparently the same info could apply to single lens fisheye. Apparently using KartaVR plugins by Andrew Hazelden.



The Fusion plugins were no longer visible at the assets link, but I have since learned they can be downloaded within Resolve via Reactor.

Download Reactor here (scroll down page):

https://www.steakunderwater.com/wesuckl ... =32&t=3067

Tutorial to install reactor:



and all KartaVR plugins are there!

Looking forward to trying them, thank you Andrew Hazelden, Hugh Hou, and CougarJoe for prompting me to dig deeper there.

ps this is probably old news to most users, but thought I'd post the links for other newbies like me

If you look in the Reactor package manager in the category labelled "Kartaverse/KartaVP" you will see several new nodes that are optimized for parametric warping/post-processing of stereo 3D dual fisheye content.

There is a node for adjusting the frame cropping (kvrCropStereo), another for lens distortion correction (kvrLensStereo), and finally a node for dual fisheye to 180VR stereo 3D output (kvrViewer).

Node graph connections:
Loader/MediaIn -> kvrCropStereo -> kvrLensStereo -> kvrViewer -> AutoDomain

The kvrLensStereo node should be set to use the "Lens Distortion Model > Model: Panotools" setting when working with fisheye imagery

The kvrViewer node should be set to "Image Projection: Fisheye" with the stereo "Mode: Horiz" setting active for side-by-side formatted circular fisheye imagery.

Screenshots:

This looks like everything I was dreaming of. Looking forward to diving in. Thank you Andrew!

Wow, this is amazing and these Kartaverse tools are exactly what I was hoping might exist! Thank you so much for putting the work in to create them!

I have followed Andrew's well-written instructions on setting up the three Kvr nodes in the Fusion Page and have gotten them to successfully warp my dual-fisheye footage to be (mostly) equirectangular so that I can then reframe my 360 footage for 2D deliverables within DaVinci Resolve.

But now I have gotten stuck at trying to obtain an acceptable stitch. The tools seem to be working perfectly, I am pretty sure it's me that's the problem. Even after attempting to use all of the adjustment sliders within these nodes, I cannot seem to get the two hemispheres to line up correctly.

Is there a prescribed methodology to calibrating the these tools to the footage of specific cameras or a method of extracting a lens(es) profile (or importing an STmap?) from Insta360 Studio? (I'm currently working with footage from an "Insta 360 X2" and an "Insta 360 X5")

I'm a noob at 360 - I'd potentially even just render equirectangular from Insta360 Studio (to let it do the stitching) before moving the media into DaVinci, but that's not an option here (apparently), because some of the media are 360 .DNG stills from interval timelapses...and processing those in Insta360 Studio prior to importing them into Davinci results in the stills appearing as if they only have the green color channel - a color-space tag misinterpretation from what I can tell from reading forum posts of others having this same green issue.

A profuse amount of gratitude to anybody who's given their time to considering this!