A robot-AI fusion jazz concert, 'Jazzmechatronica,' will be held in Siheung, Gyeonggi Province starting from November 25th.
The robot-AI fusion jazz concert 'Jazzmechatronica' will be held in Siheung, Gyeonggi Province starting from November 25th.

A vibrant performance showcasing the innovative harmony between humans and automatic performance robots—where automated performance robots utilizing TensorFlow machine learning technology interact with a jazz band—'Jazzmechatronica' will take place in Siheung, Gyeonggi Province in November and December.
The performance for this Siheung Art Convergence Project, hosted by Siheung City Hall, planned/produced by the art specialized group Emotionwave Arts, directed by Rio Jang, and sponsored by Korea Polytechnic University, will be held at KPU Art Center on Saturday, November 25th, at 5 PM and 7 PM; at Siheung City Hall Neumnae Hall on Saturday, December 2nd, at 6 PM; and at ABC Happy Learning Town on Sunday, December 17th, at 6 PM.

<'Jazzmechatronica' Composed/Arranged by Kim Dong-sung, Pianist Choi Jeong-yeon, Bassist Kang Min-soo. Photo=Provided by Emotionwave Arts>
Four types of automatic performance instruments created through collaborative research and development between Emotionwave Arts, Emotionwave, and Korea Polytechnic University are scheduled to showcase a concert where humans and robots interact for the first time in Korea, along with JM Project Band and guitarist Han Hyun.

<'Jazzmechatronica' Jazz Guitarist Han Hyun. Photo=Provided by Emotionwave Arts>
This performance was planned by carefully selecting pop-jazz original songs that emphasize the familiar melodies of traditional jazz and popular arrangements, such as standard jazz and creative music from JM Project Band, for the year-end. It is expected to be a 'generation-empathy concert' that covers all generations and classes, allowing the whole family to enjoy it through the advanced technology of automatic performance instruments and the collaboration of skilled professional musicians.

<'Jazz Mechatronica' Automatic Performance Robot DRUM Part. Photo=Provided by Emotionwave Arts>
The automatically performing instrument specially created for this performance includes drums, percussion, marimba, electric bass, and acoustic guitar. Among these, the drum and percussive automatic performance parts were developed with MCU (Micro Controller Unit) applied to a total of 34 channels of instruments, controlled in real-time by motors connected to a computer, enabling detailed and specific performances.

<'Jazz Mechatronica' Automatic Performance Robot Percussion Part. Photo=Provided by Emotionwave Arts>
The acoustic guitar was developed using pneumatic solenoid techniques and 6 servo motors to play all strings of the acoustic guitar quickly and smoothly. The electric bass robot applies a unique technique utilizing a 2-axis CNC precision module based on GCODE, which is used in the latest 3D printers, enabling faster, quicker performance and the execution of deep and impactful bass sounds.

<'Jazz Mechatronica' Automatic Performance Robot Marimba Part. Photo=Provided by Emotionwave Arts>
Furthermore, a high-difficulty live demonstration is scheduled where an automatic performance robot will spontaneously respond to the performance of a pianist playing in real time, applying Google's Magenta and Tensorflow technologies—which are among the machine learning technologies applied to the JM (Jazz Mechatronica) artificial intelligence system.

<'Jazz Mechatronica' Automatic Performance Robot Electric Bass Part. Photo=Provided by Emotionwave Arts>
In addition to the previously created robotic instruments, automatic playing marimba robots and vocal robots are scheduled to be included in live performances to present more diverse and varied music.
The Jazz Mechatronica project was created inspired by Pat Metheny's Orchestrion Project in 2010. It is an art project created with the expectation of harmony between humans, machines, and artificial intelligence, and a bright future, by adding IT artificial intelligence technology to past motor-based robotics technology to break down the boundary between humans and technology through music, preceding the historical flow entering the Fourth Industrial Revolution.

<'Jazz Mechatronics' Automatic Playing Robot Acoustic Guitar Part. Photo=Provided by Emotionwave Arts>
This project performance was selected as a work in the 2017 Siheung City Culture and Arts Support Project, and it plans to express the social goal of art through the fusion of high-level technology and art, including regional art vitalization, in a concert. It is sponsored by the Korea Polytechnic University Engineering Education Innovation Center and the Art Center. Pre-registration is possible from the Emotionwave Arts website starting November 1st.
Reporter Cheon Sang-wook (lovelich9@rpm9.com)
Electronics News - http://www.etnews.com/20171028000012