Thanks for your continuing interest in this...
Resolve 15.3.1
RTX 2080 TI
So if I render an H.265 out of Resolve using the Nvidia render option (there doesn’t seem to be a native H.265 option) who is responsible for ticking the correct boxes in the header?
I hate intermediate renders as they take time and real estate.
Hybrid? Is that an engine like Handbrake?
I am not using Vimeo for critical evaluation but wasn’t expecting such chrominance.
It was the first 10 bit I have put up there.
Interesting to see that the H.264 UHD 8 bit was about 67gig but the H.265 10 bit was only about 11 gig.
I can not tell how much Vimeo governs the bitrate. I can certainly see when it is very low. At home we are only getting about 11 meg per sec. I tell you this because even at what looks to be highest quality stream, the subtitles have considerable artifacting around them.
It's up to encoder to set correct flagging. It's rather bit important these days as we have more option than mainly just Rec.709.
If there is no flag then you simply have no idea what your video is and any needed conversion is pure guess based on other parameters like frame size.
For example on Mac when you watch mp4 which is not flagged at all how do you meant to adjust your video to P3 wide gamut screen? If your file is Rec.709 you need to properly process it to P3 gamut or it will look crazy saturated if passed as is.
Things get even more complicated as you have 2 places for flagging: container level and h264/5 private headers. Some app are happy with just container level, but others (like HDR TVs) need private headers flagging. If you made sure grading setup is correct you can't stop there. You need correct export as well otherwise it's bit wasted work.
Resolve 16 has flagging added, so it's all going in good direction. You have to export high bitrate though to compensate for weaker quality encoder encoder compared to x264/5.
I assume project took you some time, so even if exporting intermediate files is annoying it's not going to take days and it's worth the hassle. It's also import to understand how things work, so next time knowledge is already there.
Don't give up so easily
Yes, Hybrid is a GUI like Handbrake.
For Handbrake add extra options to make sure file is flagged:
colorprim=1:transfer=1:colormatrix=1
for Rec.709.
Also set framerate to Constant. Have no idea why it keeps defaulting to VBR fps.