The Constant Gardeners is a robotic installation inspired by the Japanese Zen Gardens. The installation was live in Ueno Park, Tokyo during the 2021 Olympic Games.
Design
The installation comprised of four industrial robots that were repurposed and reused, taking over the role of a fully coordinated zen garden artist. The patterns the robots raked were inspired by the motion of athletes in the various olympic sports. Carefully selected olympic footage was analysed and the characterictic movement of each sport was abstracted and transformed into drawings fully aligned with the harmony and aesthetic quality of zen gardens.
The video analysis was based on a combination of computer vision and machine learning algorithms. More specifically, optical flow analysis allowed the extraction of figure outlines that were then combined with various other techniques to develop the final drawings. Alternatively, pose estimation analysis provided the inputs in order to use limbs as brushes/actuators of various generative algorithms.
Role
- Video based pose-estimation using Mediapipe.
- Workflow development from Python to Unity.
- Development of procedural drawing system using limbs as brushes/inputs to generative algorithms.
- Development of generative algorithms to produce procedural drawings.
- Workflow development to transform drawings into plotted points that could be sent to the robots using ROS.
- Development of ROS digital twin in Unity to test the look and feel of drawings.