Sony FX9/a7siii metadata support?

Get answers to your questions about color grading, editing and finishing with DaVinci Resolve.
  • Author
  • Message
Offline

Scott Danzig

  • Posts: 15
  • Joined: Sat Apr 22, 2017 1:37 pm

Sony FX9/a7siii metadata support?

PostSat Jul 25, 2020 4:14 pm

I see the a7siii about to be announced July 28th, and it looks like it's going to have gyroscope metadata for stabilization in post, just like the FX9. I'm wondering if there's any existing or planned support for using this data in Davinci Resolve and/or Fusion, or if the only way to use that is to preprocess the video before importing it into Resolve. I think from what I've seen, support for Prores RAW isn't in the roadmap either, at least publicly, but any updates on that would be great too.
Davinci Resolve v16.2
Windows 10 Pro
NVidia Titan X Pascal (12GB)
128 GB RAM
Dual Intel Xeon v2683v4 processors
512GB SSD, 2TB SSD, 4TB DD, 3TB DD
Offline

Jim Simon

  • Posts: 29809
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Sony FX9/a7siii metadata support?

PostSat Jul 25, 2020 9:20 pm

We typically don't get to know about what features BMD is working on until release, or very shortly before.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

Charles Hull

  • Posts: 27
  • Joined: Wed May 01, 2019 3:30 am
  • Real Name: Charles Hull

Re: Sony FX9/a7siii metadata support?

PostSat Oct 03, 2020 6:12 pm

I've now tried metadata stabilization with the Sony s7siii. I works very well; I'd say it is the best form of stabilization I have seen. But the workflow to use this with Catalyst Browse or Prepare is extremely poor, to the point it is not practical to utilize this stabilization in many cases.

If you've worked with Catalyst you are aware of its limitations so I won't go through that, but for the simple task of metadata stabilization the free version Browse only outputs HD, not 4K, so you need to purchase Prepare for 4K.

It would be extremely useful if Resolve had the capability to stabilize video from metadata from the a7S iii. Sony FX9 users will have the same issues, and it is likely future Sony cameras will have this stabilization technology. So this is a feature request, to incorporate metadata stabilization into DaVinci Resolve.
DaVinci Resolve Studio, MacBook Pro M1 Max, Pro Display XDR
Offline

Sergiu_M

  • Posts: 13
  • Joined: Sat May 11, 2019 11:19 am
  • Real Name: Sergiu Mihalache

Re: Sony FX9/a7siii metadata support?

PostSat May 15, 2021 11:36 am

I second that request, it would be very useful to people using gyro metadata for stabilization. I know Sony doesn't emphasize it too much (to the point it doesn't even mention it in the specification of the ZV-1), but this metadata and the stabilization potential it offers is a huge step forward and will probably be implemented in other cameras sooner or later, so this feature, which might seem niche at the moment, will be useful to many other users.
Offline
User avatar

joema4

  • Posts: 130
  • Joined: Wed Feb 03, 2021 3:26 pm
  • Real Name: Joe Marler

Re: Sony FX9/a7siii metadata support?

PostSun May 16, 2021 10:55 am

The following Sony cameras capture gyro stabilization metadata which Catalyst Browse can use in post:

Venice, FX9, FX6, FX3, A7SIII, A7C, and ZV-1.

Supposedly 17.2 implements this for Venice, but the few people who tried it cannot get it to work. I tested it myself on the FX6 and it doesn't work (although support for that camera wasn't stated).

This would be a great feature to implement.
Offline

Charles Hull

  • Posts: 27
  • Joined: Wed May 01, 2019 3:30 am
  • Real Name: Charles Hull

Re: Sony FX9/a7siii metadata support?

PostSun May 16, 2021 3:19 pm

The Sony A1 also has stabilization metadata.
DaVinci Resolve Studio, MacBook Pro M1 Max, Pro Display XDR
Offline
User avatar

Claire Watson

  • Posts: 114
  • Joined: Sat Aug 26, 2017 2:33 pm

Re: Sony FX9/a7siii metadata support?

PostSun May 16, 2021 9:31 pm

I registered version 2020.1.0.595 of Catalyst Browse because it wanted my A7Siii camera model and serial before it would play my 4K recordings. This week I have been recording HLG in XAVC S-I 4K 50p (Intra), with the camera's SteadyShot turned off. This so I can compare the difference between metadata stabilization and Resolve's own stabilization.

So far Resolve wins easily for me, while Catalyst stabilized clips do play smoothly they are dreadfully soft in comparison. This makes them unusable for me especially since adding Catalyst stabilized clips doubles the project size unless one is prepared to delete the originals.
Resolve Studio 18.6.4 Win10Pro 22H2 19045.3803, Gigabyte GA-X99, i7-5960X, 32GB DDR4 RAM, RTX 2080 Ti (537.58 driver), Decklink 4K Extreme 12G, Eizo CG319X DCI 4K HDR monitor
Offline

Shrinivas Ramani

Blackmagic Design

  • Posts: 2714
  • Joined: Wed Sep 20, 2017 10:19 am

Re: Sony FX9/a7siii metadata support?

PostWed May 19, 2021 7:41 am

The gyro information from Sony Venice cameras is included in the clip as per-frame metadata.

DaVinci Resolve 17.2 can read this per-frame information into the Camera Pan Angle, Camera Tilt Angle, Camera Roll Angle and Camera Position metadata fields and embed them in EXR exports in each frame.
Metadata View.png
Metadata View.png (76.1 KiB) Viewed 3174 times

To monitor the info for each frame, you can step through the footage in the Fusion Viewer with SubView turned on and set to Metadata (top arrow).
Fusion Viewer.png
Fusion Viewer.png (424.78 KiB) Viewed 3174 times
Offline

jallen0

  • Posts: 1003
  • Joined: Sun Jun 21, 2020 7:04 pm
  • Real Name: Justin Allen

Re: Sony FX9/a7siii metadata support?

PostWed May 19, 2021 10:18 am

I am not a big Fusion person so...how do you use this information to stabilize your footage?
2019 MacPro OS 12.1, 3.2GHz 16 Core, 160GB Mem, 4TB Drive, 8TB Internal Sonnet Raid, Dual Radeon Pro W5700X 16GB
LG UF 5k, 27" Tbolt Display, 55" LG C8
Resolve Edit Keyboard, Mini Panel, US 4K Mini
Resolve Studio Ver. 17.4.3
Desktop Video 12.1
Offline
User avatar

Gary Hango

  • Posts: 884
  • Joined: Mon Apr 09, 2018 10:35 pm
  • Location: Left Coast
  • Real Name: Gary Hango

Re: Sony FX9/a7siii metadata support?

PostWed May 19, 2021 2:11 pm

If the gyro data is only accurate to a tenth of a degree, I don’t think you’d be able to stabilize telephoto shots which usually need it the most. Where this would be useful is in compositing scene extensions and 3D objects in Fusion.
Microsoft Windows 10 Pro x64
Intel(R) Core(TM) i7-6700, 3.40GHz, 32.0 GB
MB: MSI, BIOS: American Megatrends Inc. A.60, 12/17/2015
NVIDIA GeForce GTX 960, 2Gb
Resolve 18.1.1.0007(Free)
Offline
User avatar

iestynx

  • Posts: 18
  • Joined: Thu Aug 15, 2013 4:19 pm
  • Location: Caernarfon, Cymru / Wales

Re: Sony FX9/a7siii metadata support?

PostMon Oct 11, 2021 12:00 pm

Instead of using the metadata to stabilize the shot, would there be a way to use it to place an object in the shot, so there would be no need to track the shot in Fusion?
Senior Designer / Small Time VFX Artist
Offline

Daniel Rivers

  • Posts: 54
  • Joined: Sun Aug 20, 2017 11:34 am

Re: Sony FX9/a7siii metadata support?

PostSat Dec 11, 2021 3:18 pm

Damn I want that feature badly! Catalyst browse is a PITA to use. If resolve could apply stabilization based on gyro data, that would be immencly cool! Maybe someone could make a fusion fx to do that if Resolve already CAN read this aforementioned metadata?
Offline
User avatar

sturmen

  • Posts: 81
  • Joined: Mon Jul 29, 2019 3:53 pm
  • Location: New York, NY
  • Real Name: Nicholas Tinsley

Re: Sony FX9/a7siii metadata support?

PostTue Mar 01, 2022 3:54 pm

For all my Sony shooters out there looking for gyro stabilization, there's a new Free and open source project called Gyroflow that does just that. The standalone version is in pre-release, and a Resolve plugin is on their roadmap.
MacBook Pro, 16", M1 Max 64GB

Return to DaVinci Resolve

Who is online

Users browsing this forum: Google [Bot], ohimbz, ondra_v, p.sudakovs, Patrick Abde, Steve Alexander, Timo92 and 177 guests