A Secret Forest
Collaborator: Enrique Garacia Alcala
A Secret Forest for musical co-creation of nature-inspired music by connecting user's minds and bodies on a shared performance, bringing the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
A Secret Forest is conceived as a way for exploring the web browser as a musical instrument, integrating different technologies, allowing real-time connection for video which is analyzed with a pose detection machine learning model translating body position to sound.
// Concept and thinking process
The theme of sound has always been one of interest to Enrique and me, and we've also noticed that people have to be isolated from home or telecommuting and studying because of the epidemic.
In this new era of online life, we began to think about how this will change the performance of sound.
We have also noticed that people's body awareness becomes lower and emotional anxiety increased due to this isolated lifestyle.
Therefore, we also want to explore how the screen interaction experience can improve people's body awareness under this lifestyle, as well as create an emotional support atmosphere.
In the end, we decided to design the interaction that would introduce the body and the behavior to create sound, to create a transcendent relationship between the performer and the viewer, the performer and the performer.
// Technology strategy
Secret Forest is an interactive webpage that can be used for a collaborative networked performance, for it's building there were many technologies explored. Web RTC and WebSockets were used for allowing multiple people to share the video across the internet, this protocol is used in many modern real-time communication applications. On the other side a machine learning model called PoseNet was implemented for having face posing detection and allowing the users to perform with their bodies.
Secret Forest brings the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
Website:
https://a-secret-forest.glitch.me/
A Secret Forest for musical co-creation of nature-inspired music by connecting user's minds and bodies on a shared performance, bringing the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
A Secret Forest is conceived as a way for exploring the web browser as a musical instrument, integrating different technologies, allowing real-time connection for video which is analyzed with a pose detection machine learning model translating body position to sound.
// Concept and thinking process
The theme of sound has always been one of interest to Enrique and me, and we've also noticed that people have to be isolated from home or telecommuting and studying because of the epidemic.
In this new era of online life, we began to think about how this will change the performance of sound.
We have also noticed that people's body awareness becomes lower and emotional anxiety increased due to this isolated lifestyle.
Therefore, we also want to explore how the screen interaction experience can improve people's body awareness under this lifestyle, as well as create an emotional support atmosphere.
In the end, we decided to design the interaction that would introduce the body and the behavior to create sound, to create a transcendent relationship between the performer and the viewer, the performer and the performer.
// Technology strategy
Secret Forest is an interactive webpage that can be used for a collaborative networked performance, for it's building there were many technologies explored. Web RTC and WebSockets were used for allowing multiple people to share the video across the internet, this protocol is used in many modern real-time communication applications. On the other side a machine learning model called PoseNet was implemented for having face posing detection and allowing the users to perform with their bodies.
Secret Forest brings the participants to a virtual instrument which merges electronic with nature sounds, allowing to play in collaboration with someone else around the world in a common virtual space.
Website:
https://a-secret-forest.glitch.me/
