Digital artist
A documentation page of rambling and experimenting.
@jessiehaseyes
jessiejiranzhai@gmail.com
Digital artist
A documentation page of rambling and experimenting.
@jessiehaseyes
jessiejiranzhai@gmail.com
NOC Final
Water Mirror
water surface that reflect imagesFinal
(mouse press canvas to start)
Inspiration
Olafur Eliasson’s Beauty is a visual inspiration for this project. The work features bands of coloured light shimmer in a curtain of mist. This apparition depends on the light projected from a precisely angled spotlight, as refracted and reflected by the water droplets, meeting the eye of the viewer.
And of course Danny Rozin’ mechanical mirrors with video cameras and motors that instantly reflects the image of the person standing in front on its surface.
Process
My initial plan is to use p5.js webcam to allow pixels to fall down vertically, with two projections one on top and one on the side to create a 3D sculpture of the person’s face, almost like these pin art toys.I want to create two sketches, the one on top that reflects webcam image, the one on the side triggers random walkers or particles at facial key points that travels from top to bottom.
I started with creating raindrops with P5.js, letting them fall down and creating puddles at the botom of the canvas. I set the transparency to 20 so the raidnrops could have a trail effect. I then added the face mesh model, drawing every keypoints with the same color index as the raindrops so they blend better together.
I added collison an gravity to the raindrops, having the raindrops collide with the facemesh keypoints only once so they don‘t bounce around between the keypoints.
I chose not to display the facemesh so it feels a bit more magical visually. However, I felt that it didn’t really feel complete. So I wanted to represent the human body in a different way.
I started experimenting with the body segmentation mask in order to make the figure glowing, I layered two segmentation layers together so I could paint one of them completely white, and I used the add effect to make it bloom.
Sice the body segmentation mask does not have keypoints and the bodypix model thhat was using only have skeleton keypoints, I tried to draw a red square around the face, taking the middle point from both ear keypoints and make the raindrops collide with it, but it was not very succesful.
In the end, I went with my orginal method, still having the raindrops collide with the facemesh model. Although it does not really achieve the full body collision that I was hoping for, I got to learn a lot about the different types of the ML5 Models.