shebbe wrote:...for the OP the question to begin with is if the monitor is HDR. VLC would auto convert to SDR if not.
In Resolve, it would probably be best to use Resolve Color Managed in HDR Rec.2020 Intermediate mode with the output set to Rec.2020 ST2084 1000nits. (or the one without the nits if you have a reason to not limit it)
In the system prefs of Resolve, use 10bit and use HDR viewers need to be enabled.
My 2022 MacBook Pro 16 with a 1600-nit XDR screen displays Rec.2020 HLG content from an iPhone 15 Pro (HEVC or ProRes) OK in Resolve Studio 19.1.4. That's with RCM enabled, color processing mode = HDR, Output Color Space = HLG, and HDR Mastering for 1,000 nits. Preferences>General was set to "Use Mac display color profiles for viewers" and MacOS System Settings>Displays set to the 1600-bit XDR preset.
I compared it side-by-side to FCP 11.1 on the same machine, and they both looked similar.
I don't think VLC handles HDR properly (at least on MacOS). I tried various VLC settings but nothing worked.
The OP needs to provide the following info:
(1) Windows or Mac, and what version
(2) Hardware details
(3) Monitor type, including make and model
(4) Monitor interconnect, e.g, HDMI, DeckLink, etc.
(5) Full metadata on the HDR video captured by OBS. Use MediaInfo, File>Export, type=text, post that here.
(6) If Mac, what display preset or profile is listed in System Settings>Displays.