Jump to: Board index » General » Fusion

For the experimentals: Channel Keyer first steps

Learn about 3D compositing, animation, broadcast design and VFX workflows.
  • Author
  • Message
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 12:49 am

This is an experimental version of a Channel Keyer supporting different Color Spaces to key with. It's pre alpha / hacked together today.

- Since I can't use the blender code, I had to pull stuff together by myself, and the whole coding a keyer is pretty new...and time to dig deeper is currently limited
- The color picker is just for input, wich sets the p1 p2 and p3 values of the channels. p1-p3 are the actual values wich are used during rendering
- The whole algorythm is borked
- YUV color space is calculated wrong please use YCbCr instead
- Only Fade p1 works globaly, Fade p2 and p3 have currently no effect, and I'm not sure if
I can incooperate it.
- Your image input has currently to be float to have an effect, will be changed in future
- The key image input currently has no effect
- I have problems loading compos wich uses the plugin.. I suspect something went wrong with my fusion install on the new computer, would be nice if some people can check this and report back
- win64 only
- Had one random crash...not sure what went wrong
- You have to play with fade and min max values

anyway as said, _very experimental_ it is not production ready

EDIT: plugin is now on my website visit:
http://www.splotchdog.com/index.php?opt ... cle&id=111
to get the newest version
Last edited by Chris Huf on Sun Apr 21, 2019 9:28 am, edited 1 time in total.
Offline
User avatar

michael vorberg

  • Posts: 943
  • Joined: Wed Nov 12, 2014 8:47 pm
  • Location: stuttgart, germany

Re: For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 9:02 am

Thanks for the time and effort
I don't want to be negative but a little bit "marketing" would be good:
Is this a native fusion plugin? Or fuse?
Any images or video to show what it does compared to the other keyers?
What problems are you trying to solve with it? Why do I need this?
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 2:30 pm

michael vorberg wrote:Thanks for the time and effort

Nothing to thank, its still in its early stages, and as said I only invested half a day in it, mainly to bring in the color space calculations. Its a testrung to get me again into coding.

michael vorberg wrote:I don't want to be negative but a little bit "marketing" would be good:

I'll setup a page on my website as soon as it reaches a certain level of quality, For now its just for the experimental minded.

michael vorberg wrote:Is this a native fusion plugin? Or fuse?
Any images or video to show what it does compared to the other keyers?
What problems are you trying to solve with it? Why do I need this?

Its basically a choma keyer wich uses different color spaces. Each space provides you with a different set of neighbouring pixels values wich might be more suiteable to key out certain footage. Its not a replacement for the ultrakeyer or primatte, and it never will, maybe I can get it to a level that it can completly replace the chroma and difference keyer in future, but thats all.
But I think its worth digging into it, and see if something interesting comes out.

Its a native fusion plugin for windows 64 bit only...

Thanks for the feedback

...now I still have to find out, why fusion under windows 10 pro does not load in the fusions correctly when a self compiled plugin is used..it did in the past.
Last edited by Chris Huf on Sat Feb 23, 2019 7:29 pm, edited 1 time in total.
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 4:49 pm

ahh...For those coders who run into similar problems (comps with custom plugins not loading any more with the error unexpected symbol near '.' ):
Changing the defintions of
Code: Select all
#define COMPANY_ID
#define COMPANY_ID_DOT
#define COMPANY_ID_SPACE
#define COMPANY_ID_DBS

in the Layer_App.h to match those of the FuPlugin.h seems to have solved it.

will also release a new compiled version of my 2 other plugins this weekend
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 5:56 pm

New version, fixes the loading problem (hopefully)
added a color correction option (slider) and the option to invert alpha
Attachments
tibe3_Fusion8_ChannelKey.zip
(22.83 KiB) Downloaded 522 times
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Feb 23, 2019 7:30 pm

btw updated the plugins on my site
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSun Feb 24, 2019 12:10 am

- Works now with non floating point images
- Difference keying ability added: Just add an image in the keyimage slot. Color selection then has no effect.For whatever reason the plugin crashes when I remove the keyimage from the slot...and I slowly but surely have no clue how to avoid this...(EDIT: might be fixed).
- Tweaked a bit the keying algorythm.. nothing big (yet)
Attachments
tibe3_Fusion8_ChannelKey.zip
(23.03 KiB) Downloaded 528 times
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSun Feb 24, 2019 11:16 am

- Added Alpha Blend, Offset and Multiply so the need for a Curve node is drastically reduced
- Fade is now a global operator, uses now a different calculation method (not sure if its better)
- Changed the color correction behaviour, also added a fade saturation by alpha slider
- Added a simple alpha blend operator so you can actually modify the alpha channel based on the input
Attachments
tibe3_Fusion8_ChannelKey.zip
(23.89 KiB) Downloaded 534 times
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Apr 13, 2019 11:19 am

Today is coding time :)) , small fixes to the plugin to get me
into mood again

- Fixed Alpha Desaturate when in invert node
- Fixed invert node not working on 0.0 alpha correctly
- Changed blending operation to last

(edit fixed bug in cc corection)
Attachments
tibe3_Fusion8_ChannelKey.zip
(23.89 KiB) Downloaded 479 times
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Apr 13, 2019 4:30 pm

Ok, added it officially on my site with a small description of the parameters / a small walktrough
only bigger updates will be annouinced in this thread, so I do not to spam the forum.

http://www.splotchdog.com/index.php?opt ... cle&id=111
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSun Apr 21, 2019 9:27 am

Update to the keying algorithm, Results should be better controleable.
http://www.splotchdog.com/index.php?opt ... cle&id=111
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSat Sep 19, 2020 9:01 pm

Had again the time / mood to get into it again. (With my current job things on the personal level gets a lot fragmented, so I have around 5 to 6 projects running at the same time wich are worked of depending on the time and mood I have...quality wise its a downer, I know it sucks)

- fixed the loading issues....still not sure if it works as intended..defintive something I have to revisit
- expanded the sliders values for the individual channels
- added a alpha multiply option

-still random crashes..

and again the usual disclaimer: This is experimental as hell, in 80% of the cases the build in keyers are the better choice. Its my little experimental project, wich I from to time get into and try some things out....

http://www.splotchdog.com/index.php?opt ... cle&id=111
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostTue Sep 29, 2020 8:34 am

Yesterday before work, I had some time to invest further into it, fixing some serious issues with the difference key. (Does now work in all color spaces...)
Bit surprised how litttle it did in YUV color space...but might be also a problem with the test footage.
(But thats the kind of insight im actually after)

Also added an option for the alpha interpolation to be changed from cosine (the previous default) to linear blending. Results are softer, but with heavy compressed footage introduces more noise.

http://www.splotchdog.com/index.php?opt ... cle&id=111
Last edited by Chris Huf on Tue Sep 29, 2020 8:42 am, edited 1 time in total.
Offline
User avatar

TheBloke

  • Posts: 1905
  • Joined: Sat Nov 02, 2019 11:49 pm
  • Location: UK
  • Real Name: Tom Jobbins

Re: For the experimentals: Channel Keyer first steps

PostTue Sep 29, 2020 8:38 am

This sounds really interesting, Chris. Any chance there might be a macOS version in future?
Resolve Studio 17.4.3 and Fusion Studio 17.4.3 on macOS 11.6.1

Hackintosh:: X299, Intel i9-10980XE, 128GB DDR4, AMD 6900XT 16GB
Monitors: 1 x 3840x2160 & 3 x 1920x1200
Disk: 2TB NVMe + 4TB RAID0 NVMe; NAS: 36TB RAID6
BMD Speed Editor
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostTue Sep 29, 2020 8:44 am

Yes this might be possible.
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSun Oct 18, 2020 12:58 pm

wanted to add some other stuff to it last week, unfortunately other stuff happened, and as it seems I'm very busy the next 2 weeks job wise (2x late shift wich is quite unproductive for other stuff) , so I'm releasing it at the state I had it in the beginning of this month:

- added another set of fallof functions
- added a different key method (DIST for distance) instead of MIN wich results in softer mattes, but also harder to key.

http://www.splotchdog.com/index.php?opt ... cle&id=111

still problems synchronising the channel sliders with the color input....wich is still the biggest hinderance gettting a 1.0 release out.
Offline
User avatar

Chris Huf

  • Posts: 53
  • Joined: Wed Mar 01, 2017 12:11 am

Re: For the experimentals: Channel Keyer first steps

PostSun Aug 08, 2021 10:29 am

Small update wich prevents the value sliders assigning illegal values to the color swatch.
Resulting in corrupt (not a number) entires in fusion files. Sadly this doesn't solve the synchronisation issue

https://www.splotchdog.com/index.php?op ... Itemid=154

Return to Fusion

Who is online

Users browsing this forum: No registered users and 41 guests