Thirsty Puppy
Generative Media
2025

Wine Tasting Mat

ArUco marker tracking experiment

Creative Technologist  ·  TouchDesigner / ArUco / iPad / iPhone

The iPad was the tasting mat with a generated scene running on the screen with ArUco markers embedded in the layout. Pointing an iPhone camera at it triggered an AR overlay in real time, with text and information spatially anchored to the markers on the iPad surface. Because the markers are the registration points, the overlay tracks as you move the iPhone.

What made it technically interesting was understanding what ArUco needs to maintain a stable lock: the markers have to be large enough relative to the viewing distance, the iPad screen brightness has to be consistent enough for the detector to read them reliably, and the generated scene on the iPad had to be designed around the marker positions from the start rather than placed on top afterwards.