VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

Do you have questions about Desktop Video, Converters, Routers and Monitoring?
  • Author
  • Message
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 3:36 am

This VapourSynth + Plugins + Scripts + Hybrid [2022.03.20] DMG package includes:

VapourSynth-R57 Installer
Downloaded from https://forum.doom9.org/showthread.php?t=175522
VapourSynth Plugins for Hybrid
Downloaded from https://forum.doom9.org/showthread.php?t=175522
Hybrid 2022.03.20
Downloaded from https://www.selur.de/downloads
MKVToolNix 53.0.0 (The last version compatible with macOS 10.14 Mojave)
XQuartz 2.8.1 (Required to read image sequences by Hybrid)
Downloaded from https://www.xquartz.org/
D2V Witch v4 (Required to read and process VOB files and DVDs in Hybrid)
Downloaded from https://forum.doom9.org/showthread.php?t=175522
VulkanSDK 1.3.204.1 (Required to run Waifu2x nvk, SRMD, Placebo and other Vulkan-based VapourSynth filters in Hybrid)
Downloaded from https://vulkan.lunarg.com/sdk/home
JESExtensifier 3.0.5 (It helps to change aspect ratio and other metadata tags inside MOV container)
Downloaded from https://www.dropbox.com/sh/x8o2q07zyb6g ... Ome8a?dl=0
You can also use instead AMCDXVideoPatcher http://mogurenko.com/ or BBC QTFF Parameter Editor command line tool https://github.com/bbc/qtff-parameter-editor

:arrow: DOWNLOAD package from Google Drive: https://drive.google.com/drive/folders/ ... sp=sharing

Image


Quick FAQ for Beginners:

VapourSynth http://www.vapoursynth.com/ is a cross-platform Open Source application for video manipulation with command line interface. It also can be used as a plugin inside other video editing apps, video players and UI wrappers. It require Python https://www.python.org/ environment to work. VapourSynth support external Plugins http://vsdb.top/ (.dylib extension on macOS). Some plugins may require additional Dependencies Libraries (also .dylib extension on macOS). It also may require external Script files (.py extension) to automate some processes.
Current version of VapourSynth (including Python, Plugins, Dependencies Libraries and Scripts) is wrapped inside single Framework container. On macOS it is installed to:
/Library/Frameworks/VapourSynth.framework
Dependencies Libraries installed to:
/Library/Frameworks/VapourSynth.framework/lib/
External Plugins installed to:
/Library/Frameworks/VapourSynth.framework/lib/vapoursynth/
Scripts installed to:
/Library/Frameworks/VapourSynth.framework/lib/python3.8/site-packages/
Some legacy apps may read Dependencies Libraries and Pugins from legacy location:
/usr/local/lib/
To fix legacy incompatibility problems VapourSynth installs to that directory special alias links from "libvapoursynth-script.dylib" and "libvapoursynth.dylib" files.

QTGMC http://avisynth.nl/index.php/QTGMC is a series of scripts for VapourSynth that combine chain of different plugins and produce Motion Compensation deinterlace with double frame rate and amazing artifacts-free quality.

Hybrid http://www.selur.de/ is a cross-platform UI wrapper for VapourSynth filters, scripts https://github.com/Selur/VapoursynthScriptsInHybrid and a bunch of other video tools http://www.selur.de/licence It use well known FFmpeg library https://evermeet.cx/ffmpeg/ to read and write ProRes MOV files as well as many other codecs and file types. Scripts, FFmpeg, x264, MKVToolNix and some other important components located inside Hybrid.app can be easily updated manually.
Hybrid combines a lot of video tools inside but opposite to Windows version it don't contains pre-installed VapourSynth on macOS. To make QTGMC work on macOS you need to install and adjust VapourSynth with all required plugins and scripts separately.

Image


Prepare to Installation FAQ:

Hybrid 2022 contains a lot of fundamental internal changes. To avoid preferences conflict you need COMPLETELY UNINSTALL LEGACY HYBRID 2018 or 2020 VERSION, DON'T LAUNCH THAT LEGACY VERSIONS ANYMORE and DON'T IMPORT ANY SAVED LEGACY PRESETS TO NEW VERSION:
1. Make screenshots of pages with important Hybrid settings.
2. Delete "Hybrid.app" from "Applications" folder.
3. Delete folder ~/Library/Application Support/Hybrid
4. Delete file ~/Library/Preferences/de.selur.Hybrid.plist

Do NOT install VapourSynth with Homebrew https://brew.sh/ because it use legacy installation paths.
Do NOT mix this installer with other VapourSynth versions or with different installers made by other people.
If you used any other VapourSynth installations before - delete old versions before install this one.

Disable SIP (System Integrity Protection):
Restart computer
Hold down "Command + R" to reboot into Recovery Mode
Click Utilities, select Terminal and type:
Code: Select all
csrutil disable
Press "Enter" on keyboard and restart computer

Allow install apps from unidentified developers by typing in Terminal:
Code: Select all
sudo spctl --master-disable
Press "Enter" on keyboard.
Type your password.
Press "Enter" on keyboard.

Disable Gatekeeper turning back on automatically after 30 days by typing in Terminal:
Code: Select all
sudo defaults write /Library/Preferences/com.apple.security GKAutoRearm -bool NO
Press "Enter" on keyboard.
Type your password.
Press "Enter" on keyboard.

Disable quarantine for downloaded apps by typing in Terminal:
Code: Select all
sudo defaults write com.apple.LaunchServices LSQuarantine -bool NO
Press "Enter" on keyboard.
Type your password.
Press "Enter" on keyboard.

For more details see additional FAQs:
https://www.imore.com/how-open-apps-any ... and-mojave
https://www.imore.com/how-turn-system-i ... tion-macos
https://apple.stackexchange.com/questio ... -on-mojave
https://apple.stackexchange.com/questio ... t-to-the-t

Hybrid 2022 is fully compatible with macOS 10.14, 10.15 and 11.0, but i personally still recommend to use macOS 10.14.6 Mojave and don't see any practical reason move to newer macOS versions with increased security restrictions and without 32-bit apps support.


Installation FAQ:

1. Open "VapourSynth+Plugins+Scripts+Hybrid-2022.03.20.dmg"
2. Install "VapourSynth-R57.pkg"
3. Install "Hybrid 2022.03.20 and Plugins.pkg"
4. Install "XQuartz.pkg" (optional)
5. Install Vulkan SDK (optional)

VapourSynth installer creates "VapourSynth" folder on your Desktop with quick alias links to Plugins, Dependencies, Scripts and Uninstall script. You can move this folder to any location, or just delete it.

When you open "Hybrid 2022.03.20 and Plugins.pkg" or "Hybrid.app" first time, it may give you a message: "can’t be opened because the identity of the developer cannot be confirmed."
Image
To fix this problem mouse right-click on "Hybrid 2022.03.20 and Plugins.pkg" or "Hybrid.app", select in menu "Open", and next press "Open" button in pop-up window.
Image

UI Customization FAQ

It is possible (and highly recommended) to use native system buttons with text names instead of custom UI icons and also adjust UI font size from Menu -> View.

It is also possible to use "misc.ini" file to change some other hidden settings:
Show invisible files and folders by pressing "Command + Shift + ."
Image
Create invisible folder ".hybrid" in home directory ~/.hybrid/
Put "misc.ini" file included in DMG package inside that ".hybrid" folder

See more info about customization using "misc.ini" file here https://forum.selur.net/showthread.php?tid=10.


Usage FAQ:

Image Open File
Image Set Output Folder
Image Render file (Command-F1 keyboard shortcut)
Base -> Video: ProRes
Base -> Audio: passthrough all
Base -> Default container: mov
Base -> Generate
ProRes -> Profile: ProRes 422 HQ
Filtering -> (De-)Interlace/Telecine -> Deinterlacer: QTGMC (VapourSynth)
Filtering -> (De-)Interlace/Telecine -> Overwrite input scan type to: (For Hi8 tape sources set it to "Top Field List", For DV tape sources set it to "Bottom Field List". If rendered video plays back with with "jumping/strobing" frames effect, change Field List order setting)
Filtering -> (De-)Interlace/Telecine -> Preset: Slow (in "Custom mode" you can also experiment with other settings)
Filtering -> (De-)Interlace/Telecine -> Bob (use for double frame rate deinterlace mode)
Filtering -> VapourSynth -> Color -> -> Matrix -> ColorMatrix: From Rec.601/470bg/470m To BT.709 (apply only If you upscale SD to HD with Crop/Resize tools in Hybrid)
Filtering -> VapourSynth -> Frame -> Resize -> Resizer: NNEDI3
Neural network resizer NNEDI3 removes jaggies upscale artifacts on contrast diagonal lines, but don't adds artificial oversharpening. Recommended settings for CPU: Neurons 32 (64 max), Network 2. NNEDI3 use its own internal resize algorithm and don't depends of resize algorithm selected in "Crop/Resize" tab.


Some Tips to Speedup Workflow:

Turn on GPU and OpenCL support in plug-ins when possible and select "Device: -1" (autodetection). Depending of hardware it will give you 2x to 5x speed increase.
Instead of "Open File" dialog it is possible to drag and drop file directly to path field.
For batch processing you can select multiple files in "Open File" dialog or drag and drop multiple files directly to path field.

Config -> Filenames -> Suffix:
Config -> Paths -> Default input path:
Config -> Paths -> Default temp path:
Config -> Paths -> Adjust: Output path to source path
Config -> Profiles -> Auto save defaults (this allow to remember all program settings on next launch)
Config -> Internals -> FFmpeg/MEncoder threads: (set it according to your CPU)
Config -> View -> Uncheck "Show tooltip sidebar" (you can just mouse right-click on any text name to show tooltip)
Jobs -> Misc -> Delete jobs when finished


Known Bugs and Fixes:

Problem: Hybrid/FFmpeg renders ProRes 4444 only as 10 bit, but not as 12 bit.
:arrow: Problem fix: No any fix yet, because it is just a FFmpeg limitation https://trac.ffmpeg.org/ticket/8054

Problem: No correct NCLC color tags written to MOV container.
:arrow: Problem fix: Manually add tags with JESExtensifier, AMCDXVideoPatcher or with BBC QTFF Parameter Editor.

Problem: New versions of FFmpeg may produce incorrect .mov file duration when source video is very short (less than 1 second).
:arrow: Problem fix: Config -> Input -> Decoding -> FFmpeg vsync handling: Set it to "auto"

Problem: Error message "Title selection, returned no title!" when opening DVDs that contain multiple short films, cartoons or music videos that have length less than 10 minutes.
:arrow: Problem fix: Config -> Input -> Ignore playlists with: -> Set "Minimum length Mpis/DVD (min)" to 15/1

Problem: When opening DVDs that contains large amount of Titles, Hybrid UI may freeze for about 1-3 minutes during "Analyzing a/v for title X of XX" and same time "tccd" process in system monitor start to load CPU. "tccd" process also may start in background after finished DVD remuxing job.
If force close Hybrid while "tccd" process is running, it will load CPU forever until you restart computer.

:arrow: Problem Fix: "tccd" is normal system process that always runs on computer but in normal situation it don't loads CPU. Keep an eye on "tccd" process in system monitor and don't close Hybrid while this process loads CPU. Process usually finished automatically in about 1-3 minutes and Hybrid UI is back to normal.

Problem: "Jumping/strobing" frames effect during playback in QuickLook or QuickTime X Player, when video was rendered to MP4 x265 with "FFmpeg instead of MP4Box" setting.
:arrow: Problem fix v1: Do not use "FFmpeg instead of MP4Box"
:arrow: Problem fix v2: Use MKV container instead of MP4.

Problem: In disabled filters when cursor appears over areas with checkboxes, vertical scrolling suddenly stops.
:arrow: Problem fix: No any fix yet, because bug (or feature) in qt6 interface framework.

Problem: Startup slowdown and error pop-up message if for some reason you add Hybrid to "Allow the apps below to control your computer" list in macOS System Preferences -> Security & Privacy -> Accessibility.
:arrow: Problem fix: Do not add Hybrid to "Allow the apps below to control your computer" list.

Problem: Green Fullscreen window button sometimes may became active, but may not work correctly.
:arrow: Problem fix: Switch to Fullscreen mode using Menu -> View

Problem: Requirement to disable Gatekeeper, allow to install apps from unidentified developers and add some other system tweaks. Also when you start PKG installer or Hybrid first time, it give you a message: "can’t be opened because the identity of the developer cannot be confirmed."
:arrow: Problem fix: described earlier in Installation FAQ.

Problem: Some newer plugins are not compatible with macOS 10.14.6 Mojave.
:arrow: Problem fix: Use macOS 10.15 or higher if you need those plugins.

Problem: Vulkan SDK version 1.2.176.1 and higher fails to install on macOS 10.14.6 Mojave. https://github.com/KhronosGroup/MoltenVK/issues/1360
:arrow: Problem fix 1: Use macOS 10.15 or higher.
:arrow: Problem fix 2: For Mojave use Vulkan SDK version 1.2.170.0

Open "vulkansdk-macos-1.2.170.0.dmg"
Open Terminal & browse to the vulkan mount point with the following command:
Code: Select all
cd /Volumes/vulkansdk-macos-1.2.170.0
Press "Enter" on keyboard.
Run the following command to install:
Code: Select all
sudo ./install_vulkan.py
Press "Enter" on keyboard.
Type your password.
Press "Enter" on keyboard.


VapourSynth Plugins Used by Hybrid:

More detailed info about filter color models and bit depth restrictions here https://forum.selur.net/showthread.php?tid=1538
Direct download links from http://vsdb.top/vapoursynth/mac/
  1. AddGrain http://vsdb.top/vapoursynth/mac/AddGrai ... -r8.tar.gz
  2. Anime4KCPP [8-bit only] http://vsdb.top/vapoursynth/mac/Anime4K ... 3.0.tar.gz
  3. AWarpSharp2 http://vsdb.top/vapoursynth/mac/aWarpSh ... -v4.tar.gz
  4. BiFrost [8-bit only] http://vsdb.top/vapoursynth/mac/Bifrost ... 2.2.tar.gz
  5. Bilateral http://vsdb.top/vapoursynth/mac/Bilater ... -r3.tar.gz
  6. BilateralGPU (Depreciated, use CuPy)
  7. BM3D http://vsdb.top/vapoursynth/mac/BM3D/BM3D-r8.tar.gz
  8. Bwdif http://vsdb.top/vapoursynth/mac/Bwdif/Bwdif-r2.tar.gz
  9. CAS (Requires macOS 10.14+) http://vsdb.top/vapoursynth/mac/CAS/CAS-r2-(macOS-10.15+).tar.gz
  10. CNR2 [8-bit only] http://vsdb.top/vapoursynth/mac/CNR2/CNR2-v1.tar.gz
  11. CTMF http://vsdb.top/vapoursynth/mac/CTMF/CTMF-r5.tar.gz
  12. D2VSource (included in VapourSynth installer)
  13. DCTFilter http://vsdb.top/vapoursynth/mac/DCTFilt ... 2.1.tar.gz
  14. Deblock http://vsdb.top/vapoursynth/mac/Deblock ... -r6.tar.gz
  15. DeblockPP7 http://vsdb.top/vapoursynth/mac/Deblock ... -r4.tar.gz
  16. DeCross [8-bit only] http://vsdb.top/vapoursynth/mac/DeCross ... -v1.tar.gz
  17. Dedot [8-bit only] http://vsdb.top/vapoursynth/mac/Dedot/Dedot-v1.tar.gz
  18. DegrainMedian https://vsdb.top/vapoursynth/mac/Degrai ... ian-v1.tgz
  19. Descale http://vsdb.top/vapoursynth/mac/Descale ... -r2.tar.gz
  20. DFTTest (Requires macOS 10.14+) http://vsdb.top/vapoursynth/mac/DFTTest ... -r7.tar.gz
  21. dgdecnv (Windows only)
  22. DGHDRtoSDR (Windows only)
  23. DotKill [8-bit only] http://vsdb.top/vapoursynth/mac/DotKill ... -R2.tar.gz
  24. DPID (Conflicts with DeCross by producing Finder crash if click to one of these .dylib files) https://vsdb.top/vapoursynth/mac/DPID/DPID-r4.tar.gz
  25. EdgeFixer http://vsdb.top/vapoursynth/mac/EdgeFix ... -r2.tar.gz
  26. EEDI2 http://vsdb.top/vapoursynth/mac/EEDI2/EEDI2-r7.tar.gz
  27. EEDI3 (included in VapourSynth installer)
  28. EEDI3m http://vsdb.top/vapoursynth/mac/EEDI3m/EEDI3m-r4.tar.gz
  29. FFMS2 (included in VapourSynth installer)
  30. ffmtconv http://vsdb.top/vapoursynth/mac/Format% ... r22.tar.gz
  31. FFT3DFilter http://vsdb.top/vapoursynth/mac/FFT3DFi ... -R1.tar.gz
  32. Fix Telecined Fades http://vsdb.top/vapoursynth/mac/Fix%20T ... -r5.tar.gz
  33. Flash3kyuu Deband http://vsdb.top/vapoursynth/mac/Flash3k ... 0-1.tar.gz
  34. Fluxsmooth http://vsdb.top/vapoursynth/mac/Fluxsmo ... -v2.tar.gz
  35. HQDN3D [8-bit only] http://vsdb.top/vapoursynth/mac/HQDN3D/ ... 629.tar.gz
  36. ImageMagick (included in VapourSynth installer)
  37. IT [8-bit only] (Requires macOS 10.15+) http://vsdb.top/vapoursynth/mac/IT/IT-v1.2.tar.gz
  38. KNLMeansCL (Produce artifacts and may cause Kernel Panic) http://vsdb.top/vapoursynth/mac/KNLMean ... 1.1.tar.gz
  39. LGhost http://vsdb.top/vapoursynth/mac/LGhost/LGhost-r1.tar.gz
  40. LSMASHSource (included in VapourSynth installer)
  41. MiniDeen http://vsdb.top/vapoursynth/mac/MiniDee ... -r1.tar.gz
  42. MSmooth http://vsdb.top/vapoursynth/mac/MSmoosh ... 1.1.tar.gz
  43. MVTools (v20 and v21 works well. v22 and v23 error on render when use QTGMC Placebo or Very Slow presets "crashed: Helper1, exitCode: 11") http://vsdb.top/vapoursynth/mac/MVTools ... v21.tar.gz
  44. MVTools_SF (Needs C++20, not implemented in macOS yet)
  45. NEO_FFT3D (l33tmeatwad report that it crashes)
  46. NNEDI3 http://vsdb.top/vapoursynth/mac/NNEDI3/ ... v12.tar.gz
  47. NNEDI3CL http://vsdb.top/vapoursynth/mac/NNEDI3C ... -r8.tar.gz
  48. Placebo (Requires macOS 10.15+ and Vulkan SDK) https://vsdb.top/vapoursynth/mac/Placeb ... 3.1.tar.gz
  49. ReadMpls http://vsdb.top/vapoursynth/mac/ReadMpl ... -r4.tar.gz
  50. Retinex http://vsdb.top/vapoursynth/mac/Retinex ... -r4.tar.gz
  51. SangNom http://vsdb.top/vapoursynth/mac/SangNom ... r42.tar.gz
  52. SangNomMod [8-bit only] (Conflicts with SangNom due same namespace) http://vsdb.top/vapoursynth/mac/SangNom ... fix.tar.gz
  53. SceneChange http://vsdb.top/vapoursynth/mac/Scene%2 ... 0-2.tar.gz
  54. SRMD (Requires macOS 10.15+ and Vulkan SDK) http://vsdb.top/vapoursynth/mac/SRMD/SRMD-R2.tar.gz
  55. SSIQ [8-bit only] http://vsdb.top/vapoursynth/mac/SSIQ/SSIQ-v1.0.tar.gz
  56. SVP/Interframe [8-bit only] (Commercial filter)
  57. TCanny http://vsdb.top/vapoursynth/mac/TCanny/ ... r12.tar.gz
  58. TDeintMod http://vsdb.top/vapoursynth/mac/TDeintM ... 0.1.tar.gz
  59. TempLinearApproximate http://vsdb.top/vapoursynth/mac/TempLin ... -r3.tar.gz
  60. TemporalSoften http://vsdb.top/vapoursynth/mac/Tempora ... -v1.tar.gz
  61. TimeCube http://vsdb.top/vapoursynth/mac/TimeCub ... -r3.tar.gz
  62. TIVTC https://vsdb.top/vapoursynth/mac/TIVTC/ ... 095.tar.gz
  63. ToneMap http://vsdb.top/vapoursynth/mac/ToneMap ... -R2.tar.gz
  64. TTempSmooth http://vsdb.top/vapoursynth/mac/TTempSm ... -r3.tar.gz
  65. VagueDenoiser http://vsdb.top/vapoursynth/mac/VagueDe ... -r2.tar.gz
  66. vcmod http://vsdb.top/vapoursynth/mac/vcmod/l ... 720.tar.gz
  67. VFRToCFR http://vsdb.top/vapoursynth/mac/VFR%20t ... 1.0.tar.gz
  68. vs_avsreader (Windows only)
  69. vsfiltermod [8-bit only] (Windows only)
  70. vsrawvideo http://vsdb.top/vapoursynth/mac/RawSour ... 426.tar.gz
  71. Waifu2x-w2xc (Very slow. If possible use Waifu2x NCNN Vulkan instead) http://vsdb.top/vapoursynth/mac/Waifu2x ... 64a.tar.gz
  72. Waifu2x NCNN Vulkan (Requires macOS 10.15+ and Vulkan SDK) http://vsdb.top/vapoursynth/mac/Waifu2x ... -r3.tar.gz
  73. Yadifmod http://vsdb.top/vapoursynth/mac/Yadifmo ... 0.1.tar.gz
  74. ZNEDI3 http://vsdb.top/vapoursynth/mac/ZNEDI3/ZNEDI3-r2.tar.gz
Last edited by Dmytro Shijan on Sun Mar 20, 2022 4:25 pm, edited 183 times in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

David E King

  • Posts: 33
  • Joined: Sun May 28, 2017 4:18 am
  • Location: Big D Texas

Re: VapourSynth + QTGMC Deinterlace + Hybrid UI FAQ for macO

PostSun Mar 15, 2020 4:54 am

Nice Work!!...... Is there a Windows Version for all of this?
If not any chance you could put one together?
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid UI FAQ for macO

PostSun Mar 15, 2020 9:26 pm

Hybrid simply has bug in its preset for ProRes HQ SD.
profile:v should say 3 not 2.
HD presets (except different name) is exactly the same. No idea why you need 2 of them at all :D
Well Hybrid default ProRes presets are very plain, without any attempt to make final files more "correct" ones (no correct codec names, color tags etc).
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid UI FAQ for macO

PostSun Mar 15, 2020 9:36 pm

Yes, i also noticed there are no any tags in Hybrid rendered ProRes files.
I add tags and aspect ratio presets with JES Extensifier to fix this problem.
for Hi8 sources i use "PAL Integer" preset, so Resolve can read proper aspect ratio.
For DV sources seems you can just use in PAL preset. It is exact same ratio as PAL in Resolve Clip Attributes settings.
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 9:41 pm

This is old "analog" flagging.
I prefer digital one based on full 720 as active lines.

Resolve use to have many bugs related to non-square pixel based SD formats.

Hybrid is overloaded with all setting and possibilities, but lacks any polish. It's all very "default" based.
Way too much is happening behind you. I prefer pure ffmpeg and vs, so I know what exactly is happening. Hybrid is also not very good for beginners as it's overloaded with possibilities.
Last edited by Andrew Kolakowski on Sun Mar 15, 2020 10:07 pm, edited 4 times in total.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 9:53 pm

Interesting... Hi8 souses always have black borders from left and right and also some tiny artifacts from top and bottom. This affects aspect ratio.
DV tapes are true digital, don't have those additional black borders and seems fit exact to PAL ratio.

Also Resolve ignores virtual cropping "Clean aperture" tag. It always show real pixel data from DV files.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 10:01 pm

Yes, it's all just flagging and most tools don't respect them. This is exactly why I prefer "proper" digital tags.
Those 9 pixels on side comes from analog world where only 702 lines were used for active image.
I found it useless/wrong for modern TVs (it worked on CRT). DPP spec still says you should resize based on 702 active pixels (creating 9 pixels black bars on sides), but for me it's simply wrong as no one watches it on CRT TVs anymore. On current TVs it will give slightly wrong aspect- at leats it was on Pioneer KURO which I tested it on. BBC had article about it, but quickly removed it. Adobe did moved to this new (based on old analog spec) scaling though. I think is's causing more problems than good things.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 10:13 pm

Agree, but it is impossible to capture tape on Mac without those black bars. I usually zoom image in Resolve to crop those borders, so i need somehow preserve original analogue aspect ratio.
In early days i done a lot of captures on Windows with consumer TV tuner card, and capture card (or DV codec?) always crop those black fields automatically and always record 720 pixels wide without black borders. It seems like force cropping of analogue borders was some part of AVI DV specification.
But on Mac Intensity pro card+MediaExpress always record MOV DV as 720 pixels wide with black borders (but it may crop them virtually with "Clean Aperture" tag)
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 11:04 pm

Yes, you can crop them (and clean all edges) and this is probably best you can do.
Are you capturing to DV (I meant it gets encoded from HDMI/SDI feed to DV, not 1:1 DV copy)?
Worse codec ever (if you not just copying DV data 1:1).
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 15, 2020 11:13 pm

Andrew Kolakowski wrote:Yes, you can crop them (and clean all edges) and this is probably best you can do.
Are you capturing to DV (I meant it gets encoded from HDMI/SDI feed to DV, not 1:1 DV copy)?
Worse codec ever (if you not just copying DV data 1:1).


My mistake in text. Sure i capture to ProRes422HQ on Mac. I also discovered that ProRes444 is sort of useless because it anyway produce 422 when tapes captured with Intensity Pro.

DV codec is bad. Motion scenes full of square block artifacts. But when tape is lost you have no choice and deal with old AVI DV file captured from consumer TV tuner card.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 2:15 am

I'd like to do both cropping and resizing to square pixels (768 x 576 for PAL) in Hybrid. Unfortunately, I get this message:
Bildschirmfoto 2020-03-16 um 09.06.48.png


Some old digital camcorders produce black sides too, and not even the regular 9+9.

I'm aiming for a clean picture with square pixels to feed it into Topaz Video Enhance AI, which can do miracles.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 3:00 am

I can crop and resize. No any problem. Seems something wrong from your side with settings.

But i personally don't see any practical point to deal with resize inside Hybrid. Tiny intermediate resizes always produce quality loss. It is always better to keep original pixel size (720x576 for PAL) and do noise reduction, crop and resize to HD in single step inside Resolve. SuperScale resize in Resolve may work near same as Topaz Video AI (or may not)
Last edited by Dmytro Shijan on Mon Mar 16, 2020 4:14 am, edited 1 time in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 3:37 am

:arrow: Here is another interesting discovery:

When i capture from Hi8 tape to ProRes422 MOV, there are always some slightly clipped highlights and overloaded colors. It looks clipped in color managed QuicktimeX player as well as in non color managed VLC player.

I see same "clipped" look when i remux AVI DV source captured on Windows to MOV DV container without recompression.

That clipping amount is less than Full vs Video levels difference, so wrong Levels setup is not a source of this problem i guess.

If i put that "clipped" file to Resolve on mac OS, it also looks clipped but i can magically bring back large amount of clipped data by adjusting Gain down.

If i put that "clipped" file to Vegas Pro on Windows, and render again to native ProRes422 MOV, and then put it into Resolve - there is no clipping. It looks exact like with manually adjusted Gain.

It looks like some another very specific and strange macOS-related problem with some transformations between video and RGB...
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 4:04 am

Maybe just wrong flagging or some 'superwhite' from a Sony camera.

Topaz Video Enhance AI is doing better than Super Scale. Only marginally so for HD to UHD, but very visible from SD to HD if you set it to LQ. That doesn't mean a low-quality result, but such a source and doubles rendering time. You should have a strong Nvidia GPU or it will take ages. Well, even then it's slow and only worth it for important archival footage.

This is my DV clip: https://www.dropbox.com/s/7zet51ys8aqfm ... V.mov?dl=0

And this is the result from Topaz Video Enhance AI (obviously wrong gamma):
https://www.dropbox.com/s/7zet51ys8aqfm ... V.mov?dl=0

Have a look at the buildings and at small detail like cars or trees.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 6:07 am

You are right, Dmitry, let's continue in the proper thread.
Regarding that sound issue: it was a bit surprising since the source has good old stereo PCM 48 kHz 16 bits, nothing exotic.
But at a closer look, it has two extra tracks (empty) with 32 kHz 12 bits, I think from some Sony camcorder.
That might have upset Hybrid when set to pass-trough.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 6:11 am

Uli Plank wrote:Maybe just wrong flagging or some 'superwhite' from a Sony camera.


Superwhites, maybe...

:arrow: UPDATE. In DaVinci Resolve, if i render these videos with hidden clipped data to ProRes422HQ with render setting "Retain sub-black and super-white data" and import back to Resolve - it keeps that hidden clipped data, and i can recover it when adjust Gain down.

If i render without render setting "Retain sub-black and super-white data" and import back to Resolve - that hidden clipped data is lost and i see only plain digital clipping when adjust Gain down.

It feels like i deal with some kind of magic Hi8 RAW that never clips :)
I am not against adjusting in Resolve like this, but i just can't understand the nature of this phenomenon. Seems is not related specially to Hi8 or DV. I also noticed that hidden highlights are very different. Sometimes they so deep, that they are not fully recovered even if i change Video to Full levels in clip attributes.

Here are few examples. Capture chain: Hi8 Sony CCD-TR3100E S-Video OUT -> Kramer FC-400 Time Base Corrector -> BlackMagic Intensity Pro PCI card S-Video IN -> MediaExpress -> ProRes422HQ -> Resolve YRGB non color managed project Rec709/gamma2.4

Test pattern generated by Kramer TBS corrector looks ok. No clipping:
Image

Some extremely bright and saturated clipped experimental stuff. Hi8 tape:
Image

Same video with adjusted Gain:
Image

Other not so bright example but also clipped. Hi8 tape:
Image

Adjusted Gain:
Image

Here is another example from MiniDV tape. AVI DV was captured in WIndows directly from camera with FireWire interface.

Image
Image
Last edited by Dmytro Shijan on Tue Mar 17, 2020 12:58 am, edited 5 times in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 6:25 am

Took some time to upload (everybody at home and bringing down the internet?), but here is one of the possible versions from QTGMC plus Super Scale (preset very slow): https://www.dropbox.com/s/tsd5c5w08amic ... e.mp4?dl=0

I second the notion that it has too much noise reduction, but it's also Super Scale contributing to it's slightly 'painted' look. Topaz AI delivers more texture, it looks more, hmm, kind of 'tangible'.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 9:41 am

It seems in VapourSynth have some sort of neural network resizer :shock: Could it be similar to Topaz AI ? Only need to understand how to use it instead of normal resize filters...

:arrow: Check it in Hybrid at: Filtering -> VapourSynth -> Line -> Resizer -> NNEDI3
Network:
The number of different neural network predictions that are blended together to compute the final output value. Each neural network was trained on a different set of training data. Blending the results of these different networks improves generalisation to unseen data. Possible values are 1 and 2.
A value of 2 is recommended for image enlargement.
Last edited by Dmytro Shijan on Mon Mar 16, 2020 11:27 am, edited 2 times in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 11:01 am

NNEDI3 exists many years. It was probably first usable neural based scaler for use in video.
Last edited by Andrew Kolakowski on Tue Mar 17, 2020 10:18 am, edited 1 time in total.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostMon Mar 16, 2020 11:18 am

Nice! Seems i just need to turn on NNEDI3 and it works in combination with any algorithm in "Crop/Resize" tab.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 3:23 am

Uli Plank wrote:I'd like to do both cropping and resizing to square pixels (768 x 576 for PAL) in Hybrid. Unfortunately, I get this message: Some old digital camcorders produce black sides too, and not even the regular 9+9.
I'm aiming for a clean picture with square pixels to feed it into Topaz Video Enhance AI, which can do miracles.


Seems i was able to replicate your problem. I guess it is something related to crop and pixel ratio supported by internal processing. For 1440x1080 if i set Left/Right crop to 9/9 and Top/Bottom crop to 7/7 I got warning message: "Input requires ffmpeg as decoder, but mencoder for filtering!"
Image

But if i set Left/Right crop to 9/9 and Top/Bottom crop to 0/0 render goes without any problems.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 4:05 am

Some thoughts about Resize filters:

Lanczos Resize filter in Hybrid is slightly sharper than Resolve "Sharp" resize filter in project settings. But difference is very small and overall they produce 99% the same result.

Resolve SuperScale filter in Clip Attributes is with Sharpen/Noise Reduction set to Low/Low is definitely sharper than Lanczos Resize filter in Hybrid. For my subjective opinion it look too sharp and too plastic for SD sources upscaling.

Lanczos + NNEDI3 neural network resizer seems the best. It removes jaggies upscale artifacts on contrast diagonal lines, but doesn't add artificial oversharpening. On maximum settings it is very slow.

Here are SD to 1440x1080 renders additionally 200% magnified to see the difference:
Image
Image
Image
Last edited by Dmytro Shijan on Tue Mar 17, 2020 11:56 am, edited 3 times in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 5:05 am

You are right, it works if I don't try to crop the line with the heads switching (top line).
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 10:15 am

You can't crop odd numbers from height. You should always crop even ones (odd should work for 4:4:4 sources). It's key rule.
Also I prefer Spline64 over Lanczos.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 10:52 am

There is no Spline64 in outdated Hybrid menu. Maybe it is the same as Bicubic Spline? That Bicubic Spline in Hybrid menu also could be variation of too soft and blurry Cubic Spline resize. Need to test it...
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 12:27 pm

Dmitry Shijan wrote:Some thoughts about Resize filters:

Lanczos Resize filter in Hybrid is slightly sharper than Resolve "Sharp" resize filter in project settings. But difference is very small and overall they produce 99% the same result.

Resolve SuperScale filter in Clip Attributes is with Sharpen/Noise Reduction set to Low/Low is definitely sharper than Lanczos Resize filter in Hybrid. For my subjective opinion it look too sharp and too plastic for SD sources upscaling.

Lanczos + NNEDI3 neural network resizer seems the best. It removes jaggies upscale artifacts on contrast diagonal lines, but doesn't add artificial oversharpening. On maximum settings it is very slow.

Here are SD to 1440x1080 renders additionally 200% magnified to see the difference:
Image
Image
Image


Resolve and deinterlacing is big NO GO :)
Destroys progressive parts as hell. There is fundamental design flaw which was reported ages ago and still not changed.
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 12:29 pm

Dmitry Shijan wrote:There is no Spline64 in outdated Hybrid menu. Maybe it is the same as Bicubic Spline? That Bicubic Spline in Hybrid menu also could be variation of too soft and blurry Cubic Spline resize. Need to test it...
Image


No- looks like not exposed in Hybrid. It's vs feature.
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 12:54 pm

Andrew Kolakowski wrote:You can't crop odd numbers from height. You should always crop even ones (odd should work for 4:4:4 sources). It's key rule.


I know, I cut one from the bottom too, but the error message came up.
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 1:18 pm

Just an idea - don't crop in Hybrid at all. Keep original frame. Those black borders (as well as top and bottom line artifacts) are very random from tape to tape and from camera to camera and it is very complicated to guess how to crop them in Hybrid. Even if you do upscale in Hybrid, in most cases you still need to do some work in Resolve.

So here is workflow example (maximum quality but slow):
in Hybrid
- QTGMC Deinterlace
- NNEDI3 neural network resizer upscale from 720x576 to 1440x1080 without cropping borders.
- ColorMatrix: From Rec.601 to Rec.709
- Render to ProRes422HQ
In Resolve:
- Crop borders and zoom as you like
- Chroma Temporal Noise Reduction
- White balance
- Highlights recovery
- Optional color and artifacts correction
- Small amount of Film Grain to bring back fine texture
- Render to ProRes422HQ master video

Another Example (faster)
in Hybrid
- QTGMC Deinterlace. Keep 720x576 Don't crop.
- Render to ProRes422HQ
In Resolve:
- Upscale to 1440x1080 Timeline (SuperScale if you prefer sharp plastic look)
- Crop borders and zoom as you like
- Chroma Temporal Noise Reduction
- White balance
- Highlights recovery
- Optional color and artifacts correction
- Small amount of Film Grain to bring back fine texture
- Render to ProRes422HQ master video
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 2:18 pm

There are special scripts for avisynth and VapourSynth which will automatically detect needed crop size (taking into account whole master length).
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Mar 17, 2020 11:34 pm

Seems Auto crop in Hybrid is also broken.

Found some info about cropping and color space restrictions here https://forum.selur.net/showthread.php?tid=12

RGB: (4:4:4)

width no restriction
height no restriction if video is progressive
height mod-2 if video is interlaced

YUY2: (4:2:2)

width mod-2
height no restriction if video is progressive
height mod-2 if video is interlaced

YV12: (4:2:0)

width mod-2
height mod-2 if video is progressive
height mod-4 if video is interlaced
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 19, 2020 2:52 am

How slow is NNEDI3 on your hardware (which GPU)?
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 19, 2020 3:19 am

Even simple Resize without NNEDI3 is 2x slower than original straight transcoding. NNEDI3 is very slow only when you max settings to something like 256 neurons and Prescreening level 2 which is seems like useless.
Seems it don't use AMD GPU. At least i can't see any active switch to turn on OpenCL.

I didn't measure exact render times, but on Hackintosh based on 6 core/12 threads i7-8700K overclocked to 4.7ghz, QTMC with "Very Slow" preset takes about 2x time of original video length. QTMC "Very Slow" + Resize with default NNEDI3 settings takes something like 3x-4x of original video length. Also seems render time slightly depends of moving parts complexity in source video.
Last edited by Dmytro Shijan on Thu Mar 19, 2020 7:46 am, edited 1 time in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 19, 2020 6:02 am

Thanks!
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 19, 2020 10:34 am

QTGMC at 'very slow' is in most cases overkill (unless it's SD which is not that slow).
Don't go crazy with those settings as you will be gaining 1-5% of quality for 2-10x slowdown.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 19, 2020 1:57 pm

In addition problem with highlights clipping on Hi8/DV tapes captured with MediaExpress to ProRes422HQ on macOS, here is another example of very strange hidden highlights clipping problem in Hi8 and DV tapes captured earlier on Windows with consumer TV tuner card or digitally with FireWire card to AVI DV.

AVI DV -> QT Player 7 remux-to MOV DV -> Vegas CLIPPING

AVI DV -> Vegas NO CLIPPING

AVI DV -> QT Player 7 remux-to MOV DV -> Hybrid convert-to MOV ProRes422HQ -> Vegas NO CLIPPING

MediaExpress capture-to MOV ProRes422HQ -> Vegas NO CLIPPING

Same time on macOS tape captured to DV as well as to ProRes422HQ in ANY player or ANY app ALWAYS looks with clipped highlights.
But as described earlier, those hidden highlights are very easy to bring back in Resolve, or keep during render for future recovery by selecting render setting "Retain sub-black and super-white data". But it is impossible to bring them back in Vegas, even if switch Vegas project to 32 bit.

Clipping difference examples directly from Vegas 16 Preview:

Image
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostFri Mar 20, 2020 10:02 am

Here is another interesting problem.
I decide to transcode with Hybrid some archived Cineform AVI files to ProRes MOV just to keep things more compatible and unified. It was a little shock for me when some files where rendered with wired rainbow artifacts. It appears that early versions of Cineform coder and decoder where very different from current versions and backward compatibility sometimes not possible. Or it could be some sort of corrupted interlaced fields reading.
I checked those problematic Cineform AVI files in different apps:
VLC player - no rainbow, but feels like lower resolution.
Switch player - rainbow artifacts during playback.
Resolve - rainbow artifacts during playback.

As you may remember, I updated legacy FFmpeg component inside Hybrid to current stable 4.2.2 version. I was thinking - maybe it is due too modern version of Cineform in FFmpeg? So i downloaded original unchanged Hybrid from 2017, transcode Cineform file with it, and ... No any problem with rainbow artifacts anymore

:!: UPDATE: Seems old version of Cineform decoder in VLC and FFmpeg don't preserve original interlaced fields and output lower resolution single progressive field. Looking to this i do not recommended to use FFmpeg 4.0.2 and earlier versions as a reader for Cineform files.
Problem with corrupted legacy AVI Cineform files was finally fixed by installing old version of GoProStudioPC-2.5.7.549 Cineform codec to Windows and transcoding with Vegas 16 to Intermediate ProRes422HQ MOV.

Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSat Mar 21, 2020 11:24 am

VapourSynth + Plugins + Scripts + Hybrid package update 2020.03.23
Changes:
Package now includes D2V Witch.app required by Hybrid to process VOB files.
Updated FAQ.
Links to discussion forums.
:arrow: Download from same Dropbox folder: https://www.dropbox.com/sh/hzy3f0zyuyu4 ... O5zla?dl=0
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostWed Mar 25, 2020 5:12 pm

Higher quality QTGMC presets adds higher amount of "Final temporal smoothing". As a result footage looks cleaner but may miss some fine "breathing" analogue texture. Too large amount of "Final temporal smoothing" in combination with NNEDI3 Resize also attempt to fix tape shake artifacts and in some situations may produce some strange "fluid wavy" look to straight vertical lines. Also too many noise reduction may slightly distort original colors.

If i set QTGMC preset to "Very Slow", then switch to "Custom" and set "Final temporal smoothing" to 0, i got quality deinterlace with original tape grain structure. In combination with NNEDI3 Resize to 1440x1080 default settings (Neurons: 32, Network: 2, Prescreening: 1) it produce 100% no jaggies artifacts.

I also noticed that in some videos "Placebo", "Very Slow" and "Slower" produce strange "micro jumping" effect on small static objects visible only when inspect video frame by frame. Preset "Slow" don't have this problem probably because it combines and averages fields in simpler way.
Overall preset "Slow" with "Final temporal smoothing" 0 or 1 looks like very nice compromise when used together with NNEDI3 Resize to 1440x1080 default settings (Neurons: 32, Network: 2, Prescreening: 1)

Bug found:
Presets works great, but when switching to "Custom mode" i noticed a problem with one test video when some frames where not processed correctly and stay partially interlaced. Sometimes instead same frames where jumping back and forward. Also final video renders have slightly different amount of frames. It was tested on ProRes422HQ MOV files captured with MediaExpress and trimmed without recompression with QuickTime 7 player.
Bug fix:
It seems this problem was caused by damaged MOV file itself, because when i remux same video from MOV to MKV again - there was no error and no jumped or interlaced frames on render, but instead i got first black frame.
When i trimmed new file from same original source with QuickTime 7 player it don't produce artifacts anymore.

Image

Anyway, to be 100% on safe side with custom settings i suggest do it like this:
1. Open Hybrid, but don't import video yet.
2. Make sure to activate Config -> Profiles -> Auto save defaults
3. Adjust all custom settings.
4. Close Hybrid.
5. Open Hybrid, import video, render.

Other custom settings:
EZKeepGrain - (value 0-100) still can't understand how it works. No any visible effect on rendered image. Needs more testing
Source matching - can't see any profit, seems it only increase jaggies artifacts. Needs more testing.
Lossless - can't understand yet how it works. Needs more testing

QTGMC options are well described here http://avisynth.nl/index.php/QTGMC#Nois ... _Denoising
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 26, 2020 1:50 am

Thanks for all this testing, much appreciated!
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostThu Mar 26, 2020 11:16 pm

Here is another interesting discovery:

It appears that if you use NNEDI3 Resize, it always use only its internal resize method (looks like based on Lanczos) and don't depends of Resize method selected in "Crop/Resize" tab at all.

In case if for some reason you decide don't use NNEDI3 Resize, here are some test results of different Resize methods in "Crop/Resize" tab:
8 - Sinc: adds very aggressive sharpening effect
9 - Lanczos: tiny sharpening, crisp looking, OK for everyday.
3 - Experimental: sharpness somewhere between Bicubicspline and Lanczos.
10 - Bicubicspline: slightly softer than Lanczos
2 - Bicubic: softer than Bicubicspline
7 - Gauss: softer than Bicubic
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

SergeS

  • Posts: 44
  • Joined: Sun Jan 28, 2018 8:04 am
  • Real Name: Serge Stauffer

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSat Mar 28, 2020 2:36 pm

Finally a real solution for QTGMC Deinerlace on MacOS.
I have installed everything on High Sierra and it just works.

Right now I am doing tests, comparing best settings in HandBrake (Decomb / EEDI2 Bob) with Hybrid from your package (QTGMC fast Bob). The latter deinterlaces SD-Video at a quite usable speed (MP 5.1 12-Core, < 25fps) while best settings in HandBrake process about 2.5fps ...

Also the quality difference is clearly visible. QTGMC looks like there was no degradation at all while HandBrake ist ok, but obviously fails with lines (for example from shutters) and details partly look softer.

Thank you for putting everything together.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSat Mar 28, 2020 5:43 pm

VapourSynth + Plugins + Scripts + Hybrid package update 2020.03.28
Changes:
Package now includes JESExtensifier.app (it help to change aspect ratio and other metadata tags inside .MOV container)
Updated FAQ.

VapourSynth + Plugins + Scripts + Hybrid package update 2020.03.29
Changes:
VapourSynth R49
Updated FAQ.

:arrow: Download from same Dropbox folder: https://www.dropbox.com/sh/hzy3f0zyuyu4 ... O5zla?dl=0
Last edited by Dmytro Shijan on Sun Mar 29, 2020 9:47 am, edited 1 time in total.
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostSun Mar 29, 2020 7:36 am

Here is another interesting test. Poor quality chroma edges from miniDV camera where magically fixed by NNEDI3 resize. Further NNEDI3 Upscale to QHD (1920x1440) and UHD4K (2880x2160) compare to HD makes no real difference in quality even if compare side by side on UHD4K timeline.
Some people recommend 960x720 as a master copy for deinterlaced video because 1280x720 @50fps allows to playback from bluray disc, but as you can see NNEDI3 resize to 960x720 looks softer than NNEDI3 resize to HD.

Another interesting option is 1556x1152 (this is dual 768x576). It allow to crop black borders and fit source to 1440x1080 in Resolve without additional upscaling step.

Tests made on UHD 4K timeline:

QTGMC SLOW-FTS0, NO RESIZE
Image

QTGMC SLOW-FTS0, RESIZE to 720p NNEDI3-32-N2-P2
Image

QTGMC SLOW-FTS0, RESIZE to 1080p NNEDI3-32-N2-P2
Image

QTGMC SLOW-FTS0, RESIZE to 1440p NNEDI3-32-N2-P2
Image

QTGMC SLOW-FTS0, RESIZE to 2160p NNEDI3-32-N2-P2
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

carlomacchiavello

  • Posts: 2576
  • Joined: Tue Aug 28, 2012 6:04 pm
  • Location: italy

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 07, 2020 9:24 am

Dear Dmitry, thanks a lot
from many times i searching a solution for a good de interlacer and good scaler, i found your thread tonight, i start with test and it's near to be magic. many other payed solution give me worst result against that.
i had many shooting to manage, with more noise and defects, but you give me a way to explore.
Thanks a bunch.
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 07, 2020 1:48 pm

Here is one more important thing. Seems that extended highlights data needs proper processing. When you simply adjust gain or highlights down, it may produce some hard edges in luma. The effect is very subtle but just to be 100% safe in any situation i suggest always add Gamut Mapping node in the end (set gamma to Timeline and Tone Mapping to Luminance Mapping). Same node could be useful for adjusting chroma.
The effect is better visible on desaturated image. Here are some examples:

Old AVI DV capture. Most Super-Whites data clipped during capture, but dark-to-light gradients always looks very smooth:
Image

New ProRes422HQ capture with MediaExress. All Super-Whites data is there but when gain adjusted down, there is a hard transition line appears on dark-to-light gradients.
Image

New ProRes422HQ capture with MediaExress with Fixed with Luminance Mapping Node. Gain adjusted, but dark-to-light gradients now looks very smooth.
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 14, 2020 6:38 am

Some bit depth tests...

Test Setup:
32 bit Gradient generated in Resolve, rendered to ProRes444 and next rendered again with different apps, settings, codecs and bit depths. Next it was opened in Resolve and applied extreme Levels adjustment to illustrate bit depth limits.
Image
Hybrid and Handbrake x264/265 compression was set to near lossless quality RF1 L4.1 slow grain --ref 3 --bframes 0 --keyint 25 --min-keyint 1
Resolve x264/265 compression was set to L4.1 Max bitrate 200000, Frame Reordering turned OFF (same as B-frames turned off)

Test Results:
Hybrid FFmpeg renders ProRes422HQ as 10 bit and ProRes444 also only as 10 bit (odd FFmpeg limitation or some bug in Hybrid :( )
Hybrid FFmpeg renders honest 8 bit and 10 bit x264/x265 files and even real 12 bit depth x265 files.

Handbrake always use some sort of dithering. It may be useful in 8 bit files but probably useless in 10 bit.

DaVinci Resolve renders ProRes422HQ as 10 bit and ProRes444 as true 12 bit.
DaVinci Resolve even with maximum bitrate settings produce rather poor quality x264 because there is no any fine manual controls for x264.265 parameters.

Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
Image
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline
User avatar

Uli Plank

  • Posts: 21107
  • Joined: Fri Feb 08, 2013 2:48 am
  • Location: Germany and Indonesia

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 14, 2020 8:09 am

Thanks again for all that research!
Maybe AI can help you. Or make you obsolete.

Studio 18.6.5, MacOS 13.6.5
MacBook M1 Pro, 16 GPU cores, 32 GB RAM and iPhone 15 Pro
Speed Editor, UltraStudio Monitor 3G, iMac 2017, eGPU
Offline
User avatar

Dmytro Shijan

  • Posts: 1760
  • Joined: Wed Sep 17, 2014 7:15 pm
  • Location: UA

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 14, 2020 8:13 am

Seems like 10 bit limit for ProRes is due FFmpeg limitation. It was discussed here https://trac.ffmpeg.org/ticket/7163
BMMCC/BMMSC Rigs Collection https://bmmccrigs.tumblr.com
My custom made accessories for BMMCC/BMMSC https://lavky.com/radioproektor/
Offline

Andrew Kolakowski

  • Posts: 9206
  • Joined: Tue Sep 11, 2012 10:20 am
  • Location: Poland

Re: VapourSynth + QTGMC Deinterlace + Hybrid FAQ for macOS

PostTue Apr 14, 2020 8:53 am

10bit limit for 444 mode in ffmpeg was there for long time, but it was removed good few months ago. Definitely for decoding, not sure about encoding.

You have to be careful even with Hybrid as some filtering paths may not preserve 10bit. This is why 'pure' vs+ffmpeg is much better as then you know what exactly is happening in your processing chain.
Handbrake internal precision was always 8bit which was mentioned already few times.
Next

Return to Post Production

Who is online

Users browsing this forum: No registered users and 15 guests