[Fact Economy Newspaper] Virtual Musicians that Play and Communicate Themselves, AI Concert Right Before Your Eyes

Emotionwave, Metaverse Artificial Intelligence Live Concert

Controls sound with extended reality for specialized musicians in genres

▲ Three digital musicians who appeared at 'Future Show 2021' (from left) ROA, Hanul, Shift66

Music performances utilizing Artificial Intelligence (AI) are rapidly developing through convergence with the metaverse, digital human technology, etc.
Emotionwave (CEO Rio Jang) showcased a highly developed 'Metaverse AI Live Concert' at 'Future Show 2021,' held at Siheung Avenue France from the 7th to the 10th.
This performance was a technology that garnered attention at 'Future Show 2021,' hosted by Gyeonggi Province and organized by the Gyeonggi Contents Agency. Following the 'RIMA AI Concert' incorporating AR volumetric artists at 'Future Show 2020' last year, Emotionwave unveiled a culmination of even more advanced technology.
Through this performance, named 'Metaverse AI Live Concert, Avenue RIMA,' it was possible to see Siheung citizens interacting in real-time with virtual digital musicians.
The three digital musicians born from Emotionwave's 'AIMPLE Project' provided a live music experience that moved emotions by communicating in real time through a music metaverse crossing between the real and virtual worlds to citizens using the Siheung Avenue France commercial district over four days.
The Metaverse AI Live Concert, Avenue RIMA, which was held as a walking-through event at an outdoor booth, received high praise for recreating street busking, which is currently difficult to experience due to COVID-19, with virtual digital musicians through jazz music, thereby enhancing the prestige of the Siheung Avenue France commercial district and providing unique enjoyment to participating citizens.
Hanul, who has already officially released the digital singles 'Green Spirits' and 'Sweet Serenade' through Naver Vibe and FLO, is Korea's first digital new age musician pursuing naturalism.
After completing its first showcase at the Grand Hyatt Hotel BTC Conference, Hanul communicates with the public through beautiful piano pieces.
Hanul's music consists mainly of sound sources with gentle melodies that provide peace to mind and body, including background music for yoga, meditation, and Pilates, as well as theme songs for celebrations like the recently released second single 'Sweet Serenade.' It is evaluated as being specialized for the ground-level commercial area of Siheung Avenue France, which concentrates on women and kids.

▲ 'Rima Public', a 5G-based AI concert service developed by Emotionwave for the first time in the world

The representative for Avenue RIMA said, "At this metaverse AI live concert in Abunewu RIMA, the core event is communication between digital musicians of the electronic genre, Shift66, and citizens." This suggests that metaverse musicians, who were thought to exist only digitally, are now communicating with real people, promoting commercial areas, and setting a new standard for retail tech in the era of digital transformation.
Shift66 is the third digital musician born from Emotionwave's AIMPLE project. With a cheerful and free-spirited personality, it can immediately communicate with strangers and exhibit realistic reactions even in real-time live streaming environments.
The digital musicians of AIMPLE have created entirely new characters with unique traits and characteristics using Unreal Engine-based live visual expression technology. They have established an official process that generates the most suitable music for these characters through deep learning-based genre composition and release.
Currently, the AIMPLE project is proceeding with the goal of leading future metaverse entertainment by utilizing the characteristics and musical tendencies of these digital musicians through a management business model, thereby implementing new concepts in retail marketing.
Emotionwave has built solid technological capabilities in this area. In August, they attracted high interest by unveiling 'RIMA PUBLIC 2021,' the world's first AI-based entertainment IoT system. 'Rima Public' is a customized AI music concert service for public and multi-cultural spaces. It was created by combining machine learning and deep learning technologies to learn over 100,000 songs with genre and performer characteristics, and it can be applied to various instruments such as piano, drums, guitar, bass, marimba, percussion, and kalimba using AI technology and robotics control technology.

▲ Emotionwave also launched MuLearn, a non-face-to-face VR music education solution combining music and virtual reality technology, receiving great interest.

'Rima Public 2021' is an upgraded version of the existing Rima Public service that can also be applied to hotels. The 4K-class media streaming service provided by Rima Public has been upgraded to 8K-class media streaming, allowing users to enjoy enhanced immersive media through digital signage, and it enables real-time communication with digital musicians linked to the digital signage. Furthermore, Extended Reality (XR) technology is utilized to increase on-site immersion for visitors and add rich soundscapes.
Additionally, it has been set up so that the franchise headquarters can monitor and control the entire system based on IoT. Customers can request the music they want through a smartphone app, and the AI recommends music repertoires or generates new music suitable for the space by device and area.
The Rima Public service can operate autonomously for 24 hours as long as it is connected to the internet, making it useful for various applications such as unmanned concerts and live music streaming. It also provides an integrated sound solution linked with artificial intelligence-based on-site acoustics that should be considered when designing hotel interiors and architecture.
Meanwhile, Emotionwave plans to develop Avenue RIMA, a metaverse AI live concert that will be showcased at Future Show 2021, into a platform utilizing customized metaverse marketing for commercial areas and personal musician producing services in 2022.
Original article: https://www.facten.co.kr/news/articleView.html?idxno=207996