The Constant Gardeners

July - August 2021

The Constant Gardeners is a robotic installation inspired by the Japanese Zen Gardens. The installation was live in Ueno Park, Tokyo during the 2021 Olympic Games.



Image

Image

Image

Project Description

Design

The installation comprised of four industrial robots that were repurposed and reused, taking over the role of a fully coordinated zen garden artist. The patterns the robots raked were inspired by the motion of athletes in the various olympic sports. Carefully selected olympic footage was analysed and the characterictic movement of each sport was abstracted and transformed into drawings fully aligned with the harmony and aesthetic quality of zen gardens.

The video analysis was based on a combination of computer vision and machine learning algorithms. More specifically, optical flow analysis allowed the extraction of figure outlines that were then combined with various other techniques to develop the final drawings. Alternatively, pose estimation analysis provided the inputs in order to use limbs as brushes/actuators of various generative algorithms.

Project Info

Role

- Video based pose-estimation using Mediapipe.
- Workflow development from Python to Unity.
- Development of procedural drawing system using limbs as brushes/inputs to generative algorithms.
- Development of generative algorithms to produce procedural drawings.
- Workflow development to transform drawings into plotted points that could be sent to the robots using ROS.
- Development of ROS digital twin in Unity to test the look and feel of drawings.