This project is an interactive digital project that explores how body movement can be used to control particles and generate visual patterns. Inspired by Chladni patterns, where particles move in response to different frequencies to form intricate shapes, the project uses p5.js to recreate this phenomenon through hand movement.
The experience works by using a webcam to track the user's hand and translate its movement into an input for the particle system. After exploring different body-tracking libraries, we chose ml5.js for its ability to reliably track points on the hand. This allowed the user to directly influence the movement of thousands of particles and shape the patterns in real time. Each resulting pattern is also paired with a piece of music, creating an audiovisual response to the interaction.
One of the main learnings from the project was how classes can be used to create and manage large particle systems. Producing complete Chladni-inspired patterns required between 3,000 and 5,000 particles, which introduced challenges in structuring and managing the system. We also learned how body tracking can be connected to a visual system to turn physical movement into a digital input.
.png)
