Lauri Astala wrote:@Mads, well, I need the file for an exhibition projection, and (in this case) I need to play the file from a player. Players have bitrate limits, and I need to maximise the quality.
Dear Lauri, are you completely sure about the player having some "limits" and what exactly the limit is? From my experience, in the last 10+ years, you can play virtually anything in FHD resolution on any FHD-capable device, no matter what the codec and bandwidth are. Though I am not familiar with UHD-capable players, do you really have one there? But Okay, let's suppose there really is a limit. Then,
Lauri Astala wrote:Therefore, to maximise the quality, I need to have constant bitrate that is set close to the max bit rate of the player.
Nope. Actually, to maximize the quality you need just...
to maximize the quality! (within the given bitrate limit).
So my bet is you don't need CBR but the CQ mode is your way to go instead. I'd suggest starting with the delivery of the master original of your video into one of the "good" codecs (ProRes or DNxHR) in "good" quality, think DNxHR HQ or maybe even HQX profile.
The next step is to use the transcoding software (ffmpeg or Handbrake or whatever) and transcode your master into H.265 VBR with the CQ level fixed to i.e. 18. Look at what was produced, check the size and bitrate.
If the bitrate has some window to increase inside your limit, try a smaller CQ level value, say 10 and see if the bitrate still fits. If the resulting bitrate exceeds the limit, then try a larger CQ level value, say 23. Note: CQ is a floating-point number so you can try values with a decimal point for it.
After a few try-and-fail attempts, you will get the best quality possible which still fits your bitrate limit.