Projection node - help with distorted floor

Hi Everyone! I need your help(

I have a peculiar problem with the projection node that I don't understand. I'm trying to classically transform a 2D image into a 3D space to show gentle camera pans with correct perspective. No large movements, just a bit to the right, a bit to the left. I've already made an image with several "3D ImagePlanes" into a 3D image, but this image had no floor, only vertical "Planes". That worked wonderfully. Now, I've tried it with a room that has a floor and it's not working at all. When I move the camera just a tiny bit to the right or left, the projection distorts so excessively that it can never be correct, perspective-wise. I've already spent the whole day trying to understand the problem. I've set up the scene from both far away and up close. I've moved the camera, used the exact camera settings (BMPCC 6k with 17mm), and I've also tried completely different settings. Always with the same result: The projection on the floor plane looks completely distorted, even when moving the camera only a few units.

Can someone please help me figure out what I'm doing wrong? A thousand thanks for any tips!

IMG_0954.jpeg (811.56 KiB) Viewed 1042 times

IMG_0955.jpeg (881.26 KiB) Viewed 1042 times

Have you tried using the Camera3D for the projection instead of the Projector3D?

Also, You might want to try just using Shape3D nodes set as planes as the surfaces to project onto.

You don't have enough geometry in your scene. What you have there isn't a back wall and a floor. It's a back wall; a side wall (just barely visible in the corner); two foreground walls, one with a cut out; a pendulum light, and what looks like a floor lamp. Each of those things will need to have a model and the texture projected onto them in order for the space to appear properly when the camera is moved. And you'll probably need to do some in-painting for areas that are revealed by parallax when the camera position changes.

edit: I'm assuming you'll paint out the microphone in the foreground

Hey Xunile!

Thank you very much. No, I wasn't aware of that. I'll try it right away. Is there a tutorial that you can recommend? I haven't found one on YouTube.

I'm really desperate...

I would follow Bryan's advice.

Here are some videos on projection.

Ah, see, almost same answers as I wrote in the other post you made...

You don't have enough geometry in your scene.

Hey Bryan, I'm absolutely aware of that. But I wanted to do a basic perspective test before I get into the details.

I'm assuming you'll paint out the microphone in the foreground

Of course, Bryan! I would never give it out like that!
Axxx... Thank you very much, I didn't have them on my radar yet, I'll have a look right away!

Ah, see, almost same answers as I wrote in the other post!

Sorry about that Sam, yes I posted in the general Black Magic forum at first by mistake. I'll see if I can delete it

Have you tried using the Camera3D for the projection instead of the Projector3D?

I tried it immediately and it looks much better straight away. If I move the camera slightly to the right, the distortion is accurate as far as I can see.

Bildschirmfoto 2024-03-19 um 17.15.21.jpg (747.54 KiB) Viewed 940 times

I will have a look at the videos before I start building the complete room, also the hint with the shapes Reese has been very helpful, brand new. But I see that the colors of the video are changed a lot. Is there any trick for this?

@all: hey Guys, 1000 thanks. I was getting desperate. You don't know how much you help other people with your answers. Thumbs up!

Hey

Don't apologize, just saying I tried to figure out what you want to achieve (in the other post).

Now I think I understood and you're not in the right tracks : if you want to build the room and move forward (meaning 'have the cam progress') in the room, or for example in this hallway where the cat sits (let's take this example), then you'd better :

1/ pipe your clip into 4 different shape3D, and then merge them in the merge3D, along withe a camera3D. Put this latter in a position where it can "see" every sides and enable the target > put the camera target past the middle of the brown door in the BG
Now, resize every shape in order to make them project only the parts that they are supposed to (so no floor on the wall etc etc). When all is ok, lock this cam node.
In the end, put another camera3D in the merge3D (or another one after) and animate this one to progress...

2/ other option, which depends on the clip : you may want to use a displace3D node with the right polygon node from which you extract what will represent the depth map... This technique is what you use to move into a single image distorted to mimic a 3D scene, and though it's not so difficult, it would for me to explain all the steps (particularly the double D icon to use to reach the goal, don't know the right name )

So, folks!

Thank you very much, Sam, Bryan, and Xunile. With your help, I managed to nail this really complicated scene. The perspective works very well.

Here, projected with - of course - super cool - camera as a projector. Works!

Bildschirmfoto 2024-03-19 um 22.23.34.jpg (826.17 KiB) Viewed 887 times

and then a bit to the right. Perspective-wise, a solid one.

Bildschirmfoto 2024-03-19 um 22.26.19.jpg (813.21 KiB) Viewed 887 times

The only question that remains is how to fill in the missing information on the right wall. If I move the camera head to the right, it comes into view. Is there a way to fill in that information there? I can go into the room and take photos, but that obviously has not much to do with the projection. I've thought about distorting the existing information – that would work here, since the wall is white anyway and the skirting board is made of wood. I believe it wouldn't be noticeably visible. However, since this is a projection, it can't be distorted, right?

You're welcome and I am glad you have made good progress with it.

Thank you)

There’s no way right?((

Can't see remotely but if there's a gap, then it's likely one shape or image plane is not set correctly to surround what would be needed from the scene...