bentheanimator wrote:Wow! You really did go down the rabbit hole!
Is that something positive or negative?
bentheanimator wrote:I'd say your just going to have to split the video into chunks. I don't think you're going to get any differences between the transition points from one sequence to the next. Just blend them together of you need to. I've only used comfy but you can use StableXL for higher detail but I'm not sure about the control net output saving out with the XL. It should work but I haven't done it.
You can also try using Nuke. They have a Diffusion system that you can get a little more detailed with and allows different Checkpoints to be used. They call the set up Copy Cat and the checkpoints Catteries. It won't be faster than what you're doing now, but it might be more accurate.
Yeah, after your advice, I did cut them in 3 minutes pieces. Isn't there a way in Davinci Resolve to do that semi-automatically? Now, I had to input "+30000", do a cut (ctrl+< as I'm on Azerty) each time, making sure I didn't mess up.
I switched from Midas to Depth Anything on recommendation from someone on AVS-forum in Stable Diffusion (once I got Depth Anything working, as it was some 'special case'). And I got to say, night and day differenct!! It has the right details, much more than Davinci Resolves depthmap, and it doesn't flicker as much as Midas-model did. It still has some issues here and there, but it's an improvement on all the lines.
With Depth Anything though, I have to cut the movie into 2 minute pieces instead of 3 minutes (and manually generate each file seperatly).
But now I'm facing another problem. Took me a few days to figure out where the problem was occuring. As Stable Diffusion Depth creates an AVI which isn't able to be imported into any video-editor. So I convert them to MP4 with Handbrake. Then I import them into Davinci Resolve to stitch together and render.
Lining it out with the original video, I noticed a desynch between the movie and deptmap. Every now and then, there was apparently a frame missing.
First I thought it was the AVI file. I opened it up with Losslesscut, as it was the only app I seem to be able to open the AVI to check framecount. I found out the missing frames where in there. So the next thing I thought was that something went wrong with the conversion from AVI to MP4. Even if I stitch the parts I have with losslesscut and converted them to MP4, it had random frames missing, this time different ones than with the 2 minute parts.
So I opened up the MP4 in LosslessCut. And yet, all the frames are there.
So something is going wrong in Davinci Resolve, that it loses frames when importing the file. But I don't know what. Is there a setting I'm missing?Cheers.