Description
MossPillow is a biodesign installation that can help people deep breathing and regulate their memory and emotions. By detecting experiencer’s different movements and blinking, the music will automatically change to provide a better interaction for people to breathe deeply. In this project, I want people to temporarily put down their phones and feel the positive impact of breathing.
Machine Learning Part
Using PoseNet to detect the cross finger gesture → play music from Plantwave library
Using FaceMesh to detect the open or close eyes → play natural sounds
Using Webcam to capture user’s facial expressions and hand movements
Moss Pillow Installtion
Using Spanish Moss to make the mat of the pillow, and using mushroom to make inner supports
