One of the biggest challenges in projection mapping projects is that the video content needs to fit the mapped subject closely. That makes the content produced essentially a one-off, not a scalable process, and contributes significantly to the high costs of these projects.

Back in 2023, we explored creative uses of AI in video production, and projection mapping was one of the cases that intrigued us. With our background in real-time video pipelines, it was exciting to be able to produce perfectly matching content almost instantly.

A key challenge was guiding AI generative systems to achieve the desired aesthetics, but back then, ComfyUI wasn’t the fully-fledged generative art studio that it is today.

Apart from a few projects from psytrance festivals we’ve seen, this technique doesn’t seem widely adopted. Considering the recent progress in artificial intelligence, we would now approach projection mapping projects from that angle. The problem of temporal inconsistency (aka flickering) seems to be largely resolved with the abundance of new models.