Time of Flight Autofocus is here!

The place for questions about shooting with Blackmagic Cameras.
  • Author
  • Message
Offline

Chris Shivers

  • Posts: 367
  • Joined: Sat Jul 01, 2017 3:12 am

Re: Time of Flight Autofocus is here!

PostWed Apr 28, 2021 4:40 am

I just thought about it, maybe you can use multiple ToF sensors while using AI to recognize faces. You can pinpoint where the face is and then have the sensors shoot infrared light when it comes into its vicinity. So instead of havin one sensor shoot light in the middle it can shoot it from the left and right or other directions
Offline
User avatar

Johannes Jonsson

  • Posts: 390
  • Joined: Mon May 01, 2017 2:35 pm
  • Location: Iceland

Re: Time of Flight Autofocus is here!

PostWed Apr 28, 2021 9:46 am

Csaba Nagy wrote:
Wayne Steven wrote:Just remember that it will be offset from the true lens centre, and it will not always be perfect in focus, as the different angle of view csn see the centre differently, as different levels of objects in the focus zone may make different things shift in or out of the centre of the TOF's view, so a gap would be there in the TOF, or part yhere, but the lens sees the area next to the gap. If you use a big region of focus, it should get rid of that, but you then you have to deal with the microfocus of which micro distance you want. The closer you are, or the more this can offset, the more it can effect.


This absolutely something to take into account, to put this effect into more visual terms I recorded a similar test in a near pitch black environment to see the infrared beam that is being used to measure distance ( its not visible to the human eye )

Finally something useful to come out of the lack of IR filtration... :lol:



Hi Csaba
Any news?
I never use AF but reading this thread is giving me the idea that your system could be great tool to have in many commercial shots so I am getting quite interested.
Johannes
Offline

chris.white

  • Posts: 185
  • Joined: Fri Aug 15, 2014 9:34 pm

Re: Time of Flight Autofocus is here!

PostTue May 25, 2021 8:01 pm

Kim Janson wrote:and there is also a 3rd solution I can think of, but not publick at this time 8-)


So, when is your version coming out, Kim? ;)
Offline
User avatar

Frank Glencairn

  • Posts: 1801
  • Joined: Wed Aug 22, 2012 7:07 am
  • Location: Germany

Re: Time of Flight Autofocus is here!

PostWed May 26, 2021 10:02 am

Any news on that?
Looked at the DJI ToF, but you can only use it with a gimbal, so that's no option for me.
http://frankglencairn.wordpress.com/

I told you so :-)
Offline

ricardo marty

  • Posts: 1596
  • Joined: Wed Apr 26, 2017 4:03 am

Re: Time of Flight Autofocus is here!

PostWed May 26, 2021 5:08 pm

If bmd can't develop a good af They should consider developing a lidar for video cameras. That would use blue tooth to update the camera focus. They got great engineers shouldn't be a huge problem. Im sure they can even better it.


Ricardo Marty
DVR_S 18.5, Asus ProArt PD5, 2.5 GHz i7 16-Core 64GB of 3200 MHz DDR4 RAM GeForce RTX 3070 1TB M.2 NVMe Window 11, LenovoLegion 2.6 i7 10750h 2.6, 64gb 3200mhz, rtx 2060, 1tb ssd M.2 Win 11 BenQ PD3420Q, Sony FS700R, Bmp4k, Sony A6700. PreSonus AudioBox
Offline
User avatar

Frank Glencairn

  • Posts: 1801
  • Joined: Wed Aug 22, 2012 7:07 am
  • Location: Germany

Re: Time of Flight Autofocus is here!

PostWed May 26, 2021 6:04 pm

I second that.

Having a "native" ToF module from BM would be awesome.
http://frankglencairn.wordpress.com/

I told you so :-)
Offline

chris.white

  • Posts: 185
  • Joined: Fri Aug 15, 2014 9:34 pm

Re: Time of Flight Autofocus is here!

PostWed May 26, 2021 9:55 pm

Kim Janson wrote:It might take some time, currently busy with this prototype, but it might be slightly related ;)


Looks interesting. I have to say, the part I really liked about Csaba's was that it used Tilta's Nucleus system... which I do have. So, if you're able to work whatever you're doing into that... ;)
---
Chris
Offline
User avatar

Csaba Nagy

  • Posts: 294
  • Joined: Sat Jul 13, 2013 7:01 pm
  • Location: AB, Canada

Re: Time of Flight Autofocus is here!

PostTue Jun 22, 2021 3:05 am

Long time coming. For those that have been following the development of the TOF Autofocus I demonstrated almost two years ago.

This is the next evolutionary step. Over the past few week's I have been prototyping a new product that will allow you to use a DJI 3D Focus Module without the RS2 gimbal! The prototype hardware connects to the 3D Focus module via it's USB-C connection and drives focus of a Blackmagic Camera over Bluetooth.

Images can be seen of the simple handheld setup and everything is powered from the camera. Very minimal!

Image

With the limited testing I've done so far, I can say this solution works fantastic with native MFT Lenses. For this project I actually acquired my first electronic MFT lens ( Lumix 25mm F1.7 ) and it's internal AF motor is perfect for applications such as this.

See more samples here:


This is merely an early look, keep and eye out here for further updates.

Cheers,
Csaba Nagy
Filmmaker
BMPCC4K
Offline

ricardo marty

  • Posts: 1596
  • Joined: Wed Apr 26, 2017 4:03 am

Re: Time of Flight Autofocus is here!

PostTue Jun 22, 2021 3:57 am

Csaba Nagy wrote:Long time coming. For those that have been following the development of the TOF Autofocus I demonstrated almost two years ago.


This is merely an early look, keep and eye out here for further updates.

Cheers,


Do you think it would work with other auto focus lenses? Like canon ef lenses on a 6k?


Ricardo Marty
DVR_S 18.5, Asus ProArt PD5, 2.5 GHz i7 16-Core 64GB of 3200 MHz DDR4 RAM GeForce RTX 3070 1TB M.2 NVMe Window 11, LenovoLegion 2.6 i7 10750h 2.6, 64gb 3200mhz, rtx 2060, 1tb ssd M.2 Win 11 BenQ PD3420Q, Sony FS700R, Bmp4k, Sony A6700. PreSonus AudioBox
Offline
User avatar

Csaba Nagy

  • Posts: 294
  • Joined: Sat Jul 13, 2013 7:01 pm
  • Location: AB, Canada

Re: Time of Flight Autofocus is here!

PostTue Jun 22, 2021 4:42 am

ricardo marty wrote:
Csaba Nagy wrote:Long time coming. For those that have been following the development of the TOF Autofocus I demonstrated almost two years ago.


This is merely an early look, keep and eye out here for further updates.

Cheers,


Do you think it would work with other auto focus lenses? Like canon ef lenses on a 6k?


Ricardo Marty


I don't have a BMPCC6K or 6KPro to test with. But I can say that Through the Metabones on the BMPCC4K is very hit and miss in the testing I've done. It's a fluid situation because as new firmware is released with the Blackmagic; compatibility and performance of adapted lenses seem to change constantly. Also Metabones and adapters have their own firmware that changes.

So in short, at least for the initial release: Native MFT lenses will be recommended as they have very good/consistent performance. This isn't to say adapted lenses wont work, it's simply that performance will vary.
Csaba Nagy
Filmmaker
BMPCC4K
Offline

chris.white

  • Posts: 185
  • Joined: Fri Aug 15, 2014 9:34 pm

Re: Time of Flight Autofocus is here!

PostFri Jul 09, 2021 8:18 pm

Are you still planning on a version for use with manual lenses and the Tilta Nucleus as previously demonstrated?
---
c

Csaba Nagy wrote:Long time coming. For those that have been following the development of the TOF Autofocus I demonstrated almost two years ago.

This is the next evolutionary step. Over the past few week's I have been prototyping a new product that will allow you to use a DJI 3D Focus Module without the RS2 gimbal! The prototype hardware connects to the 3D Focus module via it's USB-C connection and drives focus of a Blackmagic Camera over Bluetooth.

Images can be seen of the simple handheld setup and everything is powered from the camera. Very minimal!

Image

With the limited testing I've done so far, I can say this solution works fantastic with native MFT Lenses. For this project I actually acquired my first electronic MFT lens ( Lumix 25mm F1.7 ) and it's internal AF motor is perfect for applications such as this.

See more samples here:


This is merely an early look, keep and eye out here for further updates.

Cheers,
Offline

Ellory Yu

  • Posts: 3942
  • Joined: Wed Jul 30, 2014 5:25 pm

Re: Time of Flight Autofocus is here!

PostFri Jul 09, 2021 8:37 pm

Just watched the last test video. Pretty nice to see good progress happening. Keep up the good innovation. Hopefully BMD's next camera will have time of flight autofocus too.
URSA Mini Pro 4.6K G2, Blackmagic Design Pocket Cinema Camera 6K, Panasonic GH5
PC Workstation Core I7 64Gb, 2 x AMD R9 390X 8Gb, Blackmagic Design DeckLink 4K Mini Monitor, Windows 10 Pro 64-bit, Resolve Studio 18, BM Micro Panel & Speed Editor
Offline
User avatar

Frank Glencairn

  • Posts: 1801
  • Joined: Wed Aug 22, 2012 7:07 am
  • Location: Germany

Re: Time of Flight Autofocus is here!

PostMon Jul 12, 2021 6:30 am

Glad to hear that you take it a step further, and with the price of the DJI module it sound's like a sweet deal. But actually I was really hoping for a solution for manual glass, and an external motor.
http://frankglencairn.wordpress.com/

I told you so :-)
Offline
User avatar

Csaba Nagy

  • Posts: 294
  • Joined: Sat Jul 13, 2013 7:01 pm
  • Location: AB, Canada

Re: Time of Flight Autofocus is here!

PostMon Jul 12, 2021 8:13 am

Frank Glencairn wrote:Glad to hear that you take it a step further, and with the price of the DJI module it sound's like a sweet deal. But actually I was really hoping for a solution for manual glass, and an external motor.


This is a stepping stone product launch and so I hope to develop a more fully fledged "pro" model with motor control as you mention. I was among/if the not the first to demonstrate Tilta motor control almost two years ago now, so I will be aiming to make it compatible with that system.

An obvious extension of this first product is to do motor control using the DJI Motor, which unfortunately has been a bit difficult to reverse engineer but I'm optimistic I can figure that out eventually. Would help If I owned the RS2 and all the other bits to help in that endeavor :?

One thing at time, I was hoping to be a bit further than I am with the first batch of this product to this point, but nothing too severe.
Csaba Nagy
Filmmaker
BMPCC4K
Offline
User avatar

Frank Glencairn

  • Posts: 1801
  • Joined: Wed Aug 22, 2012 7:07 am
  • Location: Germany

Re: Time of Flight Autofocus is here!

PostTue Jul 13, 2021 6:02 am

Thanks Csaba, looking forward to it.
http://frankglencairn.wordpress.com/

I told you so :-)
Offline

ricardo marty

  • Posts: 1596
  • Joined: Wed Apr 26, 2017 4:03 am

Re: Time of Flight Autofocus is here!

PostThu Jul 29, 2021 6:46 pm

Csaba Nagy

I'm not sure how this works.

1- how do I connect to camera?

2- Does it automatically focus and follows or do I need a separate controlar?

Id wish there was a video on installation and how it operates during shooting.


Ricardo Marty
DVR_S 18.5, Asus ProArt PD5, 2.5 GHz i7 16-Core 64GB of 3200 MHz DDR4 RAM GeForce RTX 3070 1TB M.2 NVMe Window 11, LenovoLegion 2.6 i7 10750h 2.6, 64gb 3200mhz, rtx 2060, 1tb ssd M.2 Win 11 BenQ PD3420Q, Sony FS700R, Bmp4k, Sony A6700. PreSonus AudioBox
Offline

Henchman

  • Posts: 593
  • Joined: Fri Sep 21, 2018 12:43 am
  • Location: Los Angeles
  • Real Name: Mark Hensley

Re: Time of Flight Autofocus is here!

PostSun Aug 01, 2021 10:56 pm

Csaba Nagy wrote:
Frank Glencairn wrote:Glad to hear that you take it a step further, and with the price of the DJI module it sound's like a sweet deal. But actually I was really hoping for a solution for manual glass, and an external motor.


This is a stepping stone product launch and so I hope to develop a more fully fledged "pro" model with motor control as you mention. I was among/if the not the first to demonstrate Tilta motor control almost two years ago now, so I will be aiming to make it compatible with that system.

An obvious extension of this first product is to do motor control using the DJI Motor, which unfortunately has been a bit difficult to reverse engineer but I'm optimistic I can figure that out eventually. Would help If I owned the RS2 and all the other bits to help in that endeavor :?

One thing at time, I was hoping to be a bit further than I am with the first batch of this product to this point, but nothing too severe.



This sounds very cool.
I have the AFX but it's pretty big.
Am interested in seeing your product once it's finished.
https://www.imdb.com/name/nm0972296/
Offline
User avatar

danielschweinert

  • Posts: 107
  • Joined: Sat Nov 10, 2012 3:42 pm
  • Location: Germaringen, Germany

Re: Time of Flight Autofocus is here!

PostWed Aug 04, 2021 2:43 pm

Just got my Ronin RS2 PRO Combo and first thing I did, was open the focus motor case and take a look inside. I also took some photos :-) LOL
Maybe it's useful for someone here. I really like the idea to use this motor with the Lidar module without the gimbal.
Attachments
2021_08_04_0009.jpg
2021_08_04_0009.jpg (762.12 KiB) Viewed 3959 times
2021_08_04_0004.jpg
2021_08_04_0004.jpg (684.49 KiB) Viewed 3959 times
2021_08_04_0010.jpg
2021_08_04_0010.jpg (687.51 KiB) Viewed 3959 times
Offline
User avatar

Frank Glencairn

  • Posts: 1801
  • Joined: Wed Aug 22, 2012 7:07 am
  • Location: Germany

Re: Time of Flight Autofocus is here!

PostThu Aug 05, 2021 7:54 am

Kim Janson wrote:.. so should be reverse engineered.


Tilta already figured it out for their Float controller - you can switch between Tilta and DJI motors.
http://frankglencairn.wordpress.com/

I told you so :-)
Offline

Gerfried Guggi

  • Posts: 11
  • Joined: Fri Oct 26, 2012 2:26 pm

Re: Time of Flight Autofocus is here!

PostWed Nov 17, 2021 4:31 pm

Is there any update on your development for the Nucleus Nano Csaba?
It seems like CDA TEK did ship out some units, but no replys if they will do another batch or develop the firmware further. Would be really great to get some decent AF on pockets with manual lenses 8-)
I got the pocket 6k pro (Leica R kit) and an URSA (Angenieux EZ kit) and would be happy to participate as a beta tester :)
Offline

lost_soul

  • Posts: 239
  • Joined: Fri May 31, 2019 12:30 am
  • Location: Vancouver
  • Real Name: Shawn Metheny

Re: Time of Flight Autofocus is here!

PostWed Nov 17, 2021 8:38 pm

Kim Janson wrote:Hopefully BMD will make the protocol of the new focus and zoom controller available...
...
Over all I do not think fully automatic ToF focus is a solution

The ability to rack focus between two set points seemed a bit fumbly when Grant was showing it but I have no doubt that BMD will get that nailed down solid. When they do it would be a nice add for the cinema cameras.

As for ToF focus I have to agree. I use a mirrorless on the gimbal strictly for the eye autofocus and subject tracking when every thing is moving. ToF will never give us that or any thing close to it. Just because the subjects shirt is in focus doesn't mean their face is.

My opinion is autofocus is some thing that needs to be done in the camera using data from the sensor. Lots of companies are doing it that way and most of them work great. You can have an output from the camera to a follow focus system so it works with cine lenses but ToF feels like a stop gap solution to avoid doing the hard work of getting real AF working.

I am not saying getting AF working is simple. But a pretty big chunk of the industry is adding it and a lot of the early patents will have expired making things easier to do. Resolve does tracking like it is no ones buisness so BMD has in house knowledge abut how it works. They currently have one time autofocus so they know how to do focus. Put them together let me touch a subject on the screen follow it, keep it in focus and I will be happier than a pig in ....
Centos 8
RX 580
AMDGPU-pro
Studio (What ever the latest is)
Offline

Domingo Olmo Martin

  • Posts: 69
  • Joined: Mon Aug 27, 2012 3:09 pm

Re: Time of Flight Autofocus is here!

PostTue Nov 30, 2021 10:18 am

Hi Csaba Nagy,
Concerning Tilta Nucleus N communication protocol, are you aware of the following page on Github ?
https://github.com/err4o4/tilta-nucleus
Domingo Olmo Martin
Author - Director
Co-founder of Studio Barsoom
Previous

Return to Cinematography

Who is online

Users browsing this forum: Dan Anon, rimaledetto, Username, vivoices, xchrisx and 96 guests