Even before I watched it, I sort of gathered from the name that this was going to be some sort of performance art thrown onto a screen by a projector. But… whoa.
I read the wiki page on PM, but I still can’t quite figure out how they managed to prevent the guy from casting shadows onto the flat projection surfaces when he walks in front of them. And how come there isn’t all kinds of incidental light from the projector spilling over onto the back of the studio?
When you watch this, you really have to keep reminding yourself that those are flat planes being moved around by giant robot arms.
That was fantastic. I am guessing that they are projecting on the screens from behind (within the dolly-bots). This requires a static (or pre-known) observer position to keep the perspectives correct. I do not think this would work for a general audience.
Doesn’t the motion have to be carefully planned as well? Is the camera controlled by another one of those robots? I don’t think it can be done by a human holding it.
Looks impressive, but like those 3D chalk drawings, only does so from one very specific viewpoint.
I could see this kind of technology being used in advanced theme park rides, if it isn’t already. Maybe this is the crude, flickering genesis of the holodeck.
Also, those aren’t flat screen TVs. They’re just flat surfaces being projected onto. That’s why the floor is able to interact with them as part of the performance.
If they were using TVs this wouldn’t have anything to do with projection mapping, so I think we can assume that the robots are holding normal boards, probably painted black with some kind of IR LEDS on the corners.
I’m having trouble finding a good video, but here’s a normal guy with a normal projector going through the steps required for some simple projection mapping onto a couple of white boxes.
In this case, an IR receiver mounted to the camera can identify the location and orientation of the boards. Software then determines the shape of the projection required so that the projected image only shows up on the boards, and with the right perspective (since the receiver is mounted to the camera it knows where the camera is in relation to the boards).
If you were standing in the room a few feet away from the camera, it wouldn’t look right. Also, with this method there’s no reason for the camera to be on a robot itself.
I thought Disney was doing something like this with their haunted house but maybe not. If you google “projection mapping Disney” they are definitely using it at their theme parks already!
Well if I’m wrong about the IR emitters on the projection surfaces, it may just be doing visual tracking. If so, it can track the location and shape of his arm and stop projecting over that area in real-time.
If that’s what’s happening, that’s an impressive response rate.