[AI Times] Rio Jang of Emotionwave CEO: "We aim to become a metaverse killer content that allows anyone to be a singer"

Launching 'StageCloud,' combining generative AI and the metaverse

Rio Jang, CEO of Emotionwave

Emotionwave (CEO Rio Jang) has recently drawn attention at domestic and international exhibitions as a metaverse music platform equipped with artificial intelligence (AI) technology.
When singing while musical instruments like pianos and drums are playing automatically, the scene is transmitted via a metaverse. This is a combination of 'RIMA,' a technology that combines AI with AIoT (Intelligent Internet of Things) and robotics, and 'MUTA,' a metaverse technology that combines avatars and live streaming. Furthermore, by utilizing 'AIMPLE,' an NFT-based metaverse digital agency, one can also create and release digital albums.
While there were places that offered individual services such as AI music generation, instrument performance combined with robotics, live performances using the metaverse, and NFT album releases, it was rare to find a place that gathered all these experiences together. Emotionwave's service can be called a 'high-tech comprehensive art experience.'

Overview of Emotionwave's booth at the 'Korea Metaverse Festival 2023' last October (Photo=Emotionwave)

However, Emotionwave has a goal beyond simply combining technologies. CEO Rio Jang said, "Our goal is to increase the depth and choice of experience by combining AI and art."

The AI music creation function included in the platform is a prime example.
CEO Jang pointed out, "In fact, most currently available AI generation services are strong on 'interest,'" adding that "it is difficult to accurately reflect the user's intention because the results are produced through prompt input during the generation and creation process."
Furthermore, since music is completed by layering various elements such as melody, beat, and chorus, it is difficult to increase the level of completion. He explained that "music is even harder to receive good evaluations for compared to paintings, and the public standard is also strict."
In other words, he conveyed that years of research and preparation were necessary to create music that 'sounds at a certain good level' to people.
Emotionwave was established in 2013 and has been fusing technology and music for about ten years. Since 2017, it has presented performances such as the AI-applied jazz performance 'Jazz Mechatronica.' To date, through 500 on- and offline performances, it has recorded a cumulative visitor count of 10 million people, and has released about 40 AI albums and over 50 web and app services.
Among these, the company has consistently participated in various events and received good evaluations from those around it. On the 18th, they performed a collaboration with artists using AI instruments at the '2023 Yeosu AI Music Concert,' and last month, they showcased an AIoT concert zone system at the '2023 Japan IT Week Autumn,' Japan's largest IT exhibition.
And next year, we are preparing to launch 'StageCloud,' a metaverse music platform that combines the technological capabilities accumulated so far with entertainment operation expertise. Through this, we plan not only to support artists' performances, broadcasts, and album production but also services for general people who have dreamed of becoming singers.
We put a lot of effort into generative AI to enhance musical completeness. We built our own music generation tool by focusing on AI model research, data acquisition, and fine-tuning.
Although we improved usability with a prompt method like other music generation AIs, it does not deliver the final result all at once. We made it possible to modify the music as intended by adding musical elements in between, along with additional prompts and controls.
This focus on musical completeness stems from the fact that CEO Jang majored in both computer science and music. He explained, "No matter how excellent the technology is, if it cannot create content that evokes empathy, it is useless," adding, "Above all, we focused on this point."
Furthermore, he stated that this technology will provide opportunities for everyone who has a dream of being a singer but was not familiar with music. They also plan to build a metaverse where comprehensive experiences such as communication with the audience, simultaneous performances, and co-creation are possible. In short, it can realize content like large-scale concerts or broadcast stages in a metaverse space.

Metaverse singing experience of StageCloud (Photo=Emotionwave)

Who hasn't dreamed of being a 'real singer'—making music with their own hands, performing for an audience on stage, and even earning income from popularity? Rio Jang explained that StageCloud, which Emotionwave will release next year, will be the tool that makes this possible.
He emphasized, "StageCloud will be a tool that pioneers a new market where it can realize the dream of being a singer not only for existing artists but for anyone," and "We will make it establish itself as a 'killer content' in the metaverse field that has not yet appeared."
Source: AI Times Reporter Jang Se-min