Music
-
KAIST Research Team Breaks Down Musical Instincts with AI
Music, often referred to as the universal language, is known to be a common component in all cultures. Then, could ‘musical instinct’ be something that is shared to some degree despite the extensive environmental differences amongst cultures?
On January 16, a KAIST research team led by Professor Hawoong Jung from the Department of Physics announced to have identified the principle by which musical instincts emerge from the human brain without special learning using an artificial neural network model.
Previously, many researchers have attempted to identify the similarities and differences between the music that exist in various different cultures, and tried to understand the origin of the universality. A paper published in Science in 2019 had revealed that music is produced in all ethnographically distinct cultures, and that similar forms of beats and tunes are used. Neuroscientist have also previously found out that a specific part of the human brain, namely the auditory cortex, is responsible for processing musical information.
Professor Jung’s team used an artificial neural network model to show that cognitive functions for music forms spontaneously as a result of processing auditory information received from nature, without being taught music. The research team utilized AudioSet, a large-scale collection of sound data provided by Google, and taught the artificial neural network to learn the various sounds. Interestingly, the research team discovered that certain neurons within the network model would respond selectively to music. In other words, they observed the spontaneous generation of neurons that reacted minimally to various other sounds like those of animals, nature, or machines, but showed high levels of response to various forms of music including both instrumental and vocal.
The neurons in the artificial neural network model showed similar reactive behaviours to those in the auditory cortex of a real brain. For example, artificial neurons responded less to the sound of music that was cropped into short intervals and were rearranged. This indicates that the spontaneously-generated music-selective neurons encode the temporal structure of music. This property was not limited to a specific genre of music, but emerged across 25 different genres including classic, pop, rock, jazz, and electronic.
< Figure 1. Illustration of the musicality of the brain and artificial neural network (created with DALL·E3 AI based on the paper content) >
Furthermore, suppressing the activity of the music-selective neurons was found to greatly impede the cognitive accuracy for other natural sounds. That is to say, the neural function that processes musical information helps process other sounds, and that ‘musical ability’ may be an instinct formed as a result of an evolutionary adaptation acquired to better process sounds from nature.
Professor Hawoong Jung, who advised the research, said, “The results of our study imply that evolutionary pressure has contributed to forming the universal basis for processing musical information in various cultures.” As for the significance of the research, he explained, “We look forward for this artificially built model with human-like musicality to become an original model for various applications including AI music generation, musical therapy, and for research in musical cognition.” He also commented on its limitations, adding, “This research however does not take into consideration the developmental process that follows the learning of music, and it must be noted that this is a study on the foundation of processing musical information in early development.”
< Figure 2. The artificial neural network that learned to recognize non-musical natural sounds in the cyber space distinguishes between music and non-music. >
This research, conducted by first author Dr. Gwangsu Kim of the KAIST Department of Physics (current affiliation: MIT Department of Brain and Cognitive Sciences) and Dr. Dong-Kyum Kim (current affiliation: IBS) was published in Nature Communications under the title, “Spontaneous emergence of rudimentary music detectors in deep neural networks”.
This research was supported by the National Research Foundation of Korea.
2024.01.23 View 3559 -
KAIST Offers Hope to Musicians with Dystonia
< Photo 1. Conductor and Pianist João Carlos Martins before the Recital at the Carnegie Hall preparing with his bionic gloves >
KAIST’s neuroscientist and professor, Dr. Daesoo Kim attended the “Conference for Musicians with Dystonia” supported by the World Health Organization (WHO) and the Carnegie Hall concert of legendary pianist João Carlos Martins, who is also a dystonia patient, to announce his team’s recent advancements toward finding a cure for dystonia.
On November 19, 2022, a “miracle concert” was held in Carnegie Hall. João Carlos Martins was a renowned world-class pianist in the 70s and 80s, but he had to put an end to his musical career due to focal dystonia in his fingers. But in 2020, he began using a bionic glove developed by industrial designer Ubiratã Bizarro Costa and after years of hard work he was back in Carnegie Hall as an 82-year-old man.
During the concert, he conducted the NOVUS NY orchestra in a performance of Bach, and later even played the piano himself. In particular, between his performances, he gave shout-outs to scientists studying dystonia including KAIST Professor Daesoo Kim, asking them to continue working towards curing rare diseases for musicians.
< Photo 2. Professor Daesoo Kim with Conductor and Pianist João Carlos Martins >
Musician’s dystonia affects 1-3% of musicians around the world and musicians make up approximately 5% of the total number of dystonia patients. Musicians who are no longer able to practice music due to the disease often experience stress and depression, which may even lead to suicide in extreme cases. Musicians are known to be particularly prone to such diseases due to excessive practice regimens, perfectionism, and even genetics. Currently, botulinum toxin (Botox) is used to suppress abnormal muscles, but muscle function suppression ultimately means that the musician is no longer able to play the instrument. João Carlos Martins himself underwent several Botox procedures and three brain surgeries, but saw no therapeutic results. This is why a new treatment was necessary.
Professor Daesoo Kim’s research team at KAIST took note of the fact that abnormal muscle tension is caused by excessive stress, and developed NT-1, a treatment that blocks the development of the symptoms of dystonia from the brain, allowing patients to use their muscles as they normally would. The research team published their findings in Science Advances in 2021, and João Carlos Martins invited Professor Daesoo Kim to the UN conference and his concert after reading this paper.
< Photo 3. Professor Daesoo Kim (3rd from the left) photographed with other guests at the recital including Dr. Dévora Kestel, the Director of the Mental Health and Substance Use at WHO, sharing the center with Conductor and Pianist João Carlos Martins >
During the UN conference held the day prior to the Carnegie Hall concert, Dr. Dévora Kestel, Director of the Mental Health and Substance Use at WHO, said, “Although dystonia is not as well-known, it is a common disease around the world, and needs our society’s attention and the devotion of many researchers.” Professor Daesoo Kim said, “NT-1 is a drug that blocks the cause of dystonia in the brain, and will allow musicians to continue practicing music. We aim to attain clinical approval in Korea by 2024.”
NT-1 is currently under development by NeuroTobe, a faculty-led start-up company at KAIST, headed by Professor Daesoo Kim as the CEO. The synthesis of the drug for clinical testing has been successfully completed, and it has shown excellent efficacy and safety through various rounds of animal testing. Unlike Botox, which takes a few days to show its therapeutic effects after receiving the procedure from a hospital, NT-1 shows its therapeutic effects within an hour after taking it. As a so-called “edible Botox”, it is expected to help treat various muscular diseases and ailments.
2022.12.27 View 8293 -
Research Finds Digital Music Streaming Consumption Dropped as a Result of Covid-19 and Lockdowns
Decline in human mobility has stunning consequences for content streaming
The Covid-19 pandemic and lockdowns significantly reduced the consumption of audio music streaming in many countries as people turned to video platforms. On average, audio music consumption decreased by 12.5% after the World Health Organization’s (WHO) pandemic declaration in March 2020.
Music streaming services were an unlikely area hit hard by the Covid-19 pandemic. New research in Marketing Science found that the drop in people’s mobility during the pandemic significantly reduced the consumption of audio music streaming. Instead, people turned more to video platforms.
“On average, audio music consumption decreased by more than 12% after the World Health Organization’s (WHO) pandemic declaration on March 11, 2020. As a result, during the pandemic, Spotify lost 838 million dollars of revenue in the first three quarters of 2020,” said Jaeung Sim, a PhD candidate in management engineering at KAIST and one of the authors of the research study on this phenomenon. “Our results showed that human mobility plays a much larger role in the audio consumption of music than previously thought.”
The study, “Frontiers: Virus Shook the Streaming Star: Estimating the Covid-19 Impact on Music Consumption,” conducted by Sim and Professor Daegon Cho of KAIST, Youngdeok Hwang of City University of New York, and Rahul Telang of Carnegie Mellon University, looked at online music streaming data for top songs for two years in 60 countries, as well as Covid-19 cases, lockdown statistics, and daily mobility data, to determine the nature of the changes.
The study showed how the pandemic adversely impacted music streaming services despite the common expectation that the pandemic would universally benefit online medias platforms. This implies that the substantially changing media consumption environment can place streaming music in fiercer competition with other media forms that offer more dynamic and vivid experiences to consumers.
The researchers found that music consumption through video platforms was positively associated with the severity of Covid-19, lockdown policies, and time spent at home.
-PublicationJaeung Sim, Daegon Cho, Youngdeok Hwang, and Rahul Telang,“Frontiers: Virus Shook the Streaming Star: Estimating the Covid-19 Impact on Music Consumption,” November 30 in Marketing Science online (doi.org/10.1287/mksc.2021.1321)
-Profile Professor Daegon ChoGraduate School of Information and Media ManagementCollege of BusinessKAIST
2022.02.15 View 7405 -
Fusion performing arts, called space musical, 'NARO' performed at KAIST
In commemoration of the 6th anniversary of the establishment of the Graduate School of Cultural Technology, KAIST organized an English musical show on space at the Auditorium on the 29th and 30th of September. The name of the musical was NARO.
The musical was funded by the ‘NaDa Center’ operated by KAIST’s Graduate School of Cultural Technology. The musical was created with participation from adolescents, which told a tale about a genius boy Naro’s journey in space.
The musical was composed of two parts, and the basic storyline was about Naro who conducts research based on space, and his friends went on a time travel to the constellation Scorpios; more specifically, it was a Korean traditional children’s story about a brother and sister who became the sun and the moon. Naro and his friends prevent the plot of Tyran, a villan, who plans on destroying the space and Earth by inducing a red giant star, Antares.
In preparation for the musical, NaDa Center selected 14 students ranging from elementary to high school students during March of 2011. The selected students met every Saturday and Sunday from March to September for practice; a gargantuan commitment.
The theme of the musical is space, the future, and hope, and it does not utilize any stage settings. Instead, it attempts the incorporation of high technology into the stage by using interactive video, laser art, and specially built props. In addition, the entire process from script to performance and advertisement was utilized as an education model to suggest a good fusion between science and technology and cultural arts.
The musical ‘NARO’ is a collective effort. Professor Won Kwan Yeon who pioneered the field of Cultural Technology directed the musical, Professor Koo Bon Chul was in charge of the script and music composition, acting was charged to Lee Min Ho, choreography was charged to Han Eun Kyung, astrological reference was charged to Park Seok Jae among other students in the Graduate School of Cultural Technology. Members of the KAIST Acting Club ‘Lee Bak Teo’, Jeong Soo Han, Son Sharon and graduate of Chung Nam National University with vocal music major Yang Su Ji also made appearances. The Space Musical ‘NARO’ was funded by the Korea Astronomy and Space Science Institute, Korea Aerospace Research Institute, and LG School of Multi Culture.
2011.10.10 View 9827 -
Int'l Telematic Music Concert for Peace to Take Place on Nov. 20
Renowned musicians in five international locations perform new contemporary music works for peace through a real-time performance on the internet. Local audiences in Seoul, Banff, New York, San Diego and Belfast will also have a chance to hear a program.
In Seoul, the "International Telematic Music Concert for Peace" will be held at the LeeHaeRang Art Theater, Dongguk University, in Seoul on Nov. 20 at 9:30 a.m., under the presentation of KAIST"s Graduate School of Culture Technology and MARTE Lab, Dongguk University. Telematic music is real-time performance via the internet by musicians in different geographic locations.
The program of the concert includes "Hope"s Dream" by Mark Dresser and Sarah Weaver; "Disparate Bodies" by Pedro Rebelo, "Rock, Paper, Scissors" by Chris Chafe. The Korean act to be performed is "Green-colored Harmony" by Jun Kim.
In addition to the two Korean universities, the World Association of Former United Nations Internes and Fellows (WAFUNIF), University of California San Diego, the Banff Center of Canada and Queen"s University in Belfast are participating in the project.
The performance will take place on high-bandwidth internet with JackTrip audio software developed by Chris Chafe and Access Grid video software developed at Argonne National Laboratory.
"Connecting the five different cities together through super-speed Internet network and transmitting sound and images in real time is challenging technically. But, we also expect that more exciting results will be created in the course of transforming the sound into visual images," said Woon-Seung Yeo, a professor of the Graduate School of Culture Technology, who was responsible for visuals in the project.
2009.11.19 View 12338 -
KAIST Cultural Event - Eugene Park & La Speranza Performance
KAIST Cultural Event & Eugene Park & La Speranza Performance
■ Performer: Eugene Park & La Speranza
■ Title: Eugene Park & La Speranza ‘Nostalgia Fall Story"
■ Genre: Electric Music & Popera
■ Date: 19:30 p.m. Thursday, September 14, 2006
■ Venue: KAIST Auditorium
■ Contents
A stage that offers a beautiful musical emotion by the encounter of electronic violin playing spreading modern and polished feeling and beautiful melody of popera. Korea’s renowned electronic violinist Eugene Park, a graduate of Juilliard school of music, will heat his stage with his gifted musicality, and Korea’s first male popera quartet ‘La Speranza’ will present refined intimate music by exquisite combining of pop and opera.
La Speranza, Italian having a meaning of ‘hope’, is composed of four vocal singers and will present music of high musicality.
■ Profile
<Eugene Park>
- Entrance to Juilliard’s Pre-College Division (Age of 8)
- Joint performance with Wayne Symphony Orchestra (Age of 10)
- Joint performance at Lincoln center (Age of 13)
- Graduation from Juilliard School of Music in 1996
- Music performance for New York Radio City
- Congratulatory performance at the eve of the Superball, First place in Juilliard contest
- First place in ISO competition
- First place in six contests including Aspen music school competition, etc.
- Participation in Summer Jazz Festival (Sejong Center/ July 1997)
- Performance (Hoam Art Hall/ November 1997, Sejong Center/ January 24, 1998)
- Performance (Dongsoong Art Center/ March 8, 1998)
- Performance (Seoul Arts Center/ February 20, 1999), etc.
<La Speranza>
Korea’s first popera male quartet composed of vocal singers
Present popera music comprising popularity and musicality
■ Program
- La Speranza: Confession, Right this moment, On a beautiful October day, Phantom of the Opera, All I ask of you, Impossible Dream
- Eugene Park: One step, Winter, Great ball, Elvis, One step beyond, Winter, Shake and rattle in rose
KAIST Cultural Event ? Eugene Park & La Speranza Performance
■ Performer: Eugene Park & La Speranza
■ Title: Eugene Park & La Speranza ‘Nostalgia Fall Story"
■ Genre: Electric Music & Popera
■ Date: 19:30 p.m. Thursday, September 14, 2006
■ Venue: KAIST Auditorium
■ Contents
A stage that offers a beautiful musical emotion by the encounter of electronic violin playing spreading modern and polished feeling and beautiful melody of popera. Korea’s renowned electronic violinist Eugene Park, a graduate of Juilliard school of music, will heat his stage with his gifted musicality, and Korea’s first male popera quartet ‘La Speranza’ will present refined intimate music by exquisite combining of pop and opera.
La Speranza, Italian having a meaning of ‘hope’, is composed of four vocal singers and will present music of high musicality.
■ Profile
<Eugene Park>
- Entrance to Juilliard’s Pre-College Division (Age of 8)
- Joint performance with Wayne Symphony Orchestra (Age of 10)
- Joint performance at Lincoln center (Age of 13)
- Graduation from Juilliard School of Music in 1996
- Music performance for New York Radio City
- Congratulatory performance at the eve of the Superball, First place in Juilliard contest
- First place in ISO competition
- First place in six contests including Aspen music school competition, etc.
- Participation in Summer Jazz Festival (Sejong Center/ July 1997)
- Performance (Hoam Art Hall/ November 1997, Sejong Center/ January 24, 1998)
- Performance (Dongsoong Art Center/ March 8, 1998)
- Performance (Seoul Arts Center/ February 20, 1999), etc.
<La Speranza>
Korea’s first popera male quartet composed of vocal singers
Present popera music comprising popularity and musicality
■ Program
- La Speranza: Confession, Right this moment, On a beautiful October day, Phantom of the Opera, All I ask of you, Impossible Dream
- Eugene Park: One step, Winter, Great ball, Elvis, One step beyond, Winter, Shake and rattle in rose
2006.09.13 View 13040 -
KAIST Cultural Festival - the 2nd rocklassic
KAIST Cultural Festival - the 2nd rocklassic
- Unique music festival by KAIST students mixed with creation, performance, and science
- Result of creative classes - All activities from performance planning to strings manufacturing will be carried out by students themselves
- At the outdoor theater in KAIST, 7:30 p.m. Sunday, September 10
Crossover music festival pursuing balanced mixture of Rock and Classic will be held by KAIST students.
KAIST (President Nam-Pyo Suh) will open ‘KAIST Cultural Festival - the 2nd rocKlassic’ at the outdoor theater, 7:30 p.m. Sunday, September 10.
This performance can be considered as a new attempt that provides opportunities of experiencing the vital topic of industry in the 21st century - fusion of culture and technology. Performance planning, arrangement, and playing are all carried out by students themselves, and musical instruments manufactured by students during classes will be used for the performance. This performance is the result of creative classes such as chamber music, strings manufacturing, performance planning, and business management, which have been newly attempted in KAIST since 2002.
In the performance subtitled as ‘Einstein’s Violin’, KAIST-graduated bandoneonist Sangji Ko will play the bandoneon (musical instrument which is composed of rectangular side faces and wrinkled box, and played by pushing buttons) as a special guest, and total 40 players including members of KAIST student music club ‘Adlib’, ‘KAIST orchestra’, and ‘MUSIKA’, which is making active performances outside KAIST, will attend to make the concert the biggest music project of KAIST.
General director Jeongjin Kim (Professor of KAIST Graduate School of Culture and Technology) said, “In order to enjoy the concert with neighborhood, the outdoor theater capable of 3,000 people will be fully opened, and there is no charge for it. I am sure the passion and talent toward music emitting from KAIST students will startle the audience.”
■ Program
<1st stage>
- The song of life - Adlib, KAIST orchestra
- Flying - Adlib, KAIST orchestra
- From between calm and passion - Chulho Kim, KAIST orchestra
- Propose - Yeoseotjul
- As my wish - Yeoseotjul, Adlib
- I lay my love on you - Yeoseotjul
- Rachmaninov/ Rhapsody on Theme of Paganini Op. 43: Var. 18 Piano - Chulho Kim, KAIST orchestra
- Chaser - Adlib
- Walk this way - Adlib
- Girl’s period - Adlib
- Sweep away - Adlib, KAIST orchestra
<2nd stage>
- Beethoven Virus - Adlib, KAIST orchestra
- Simple symphony - KAIST orchestra
- Cinema paradiso - KAIST orchestra
- Piano trio by Mendelssohn - Daehyun Wie (Piano), Wontae Song (Violin), Hongje Chang (Cello)
- Tango Pugata - Sangji Ko (Bandoneonist), etc.
- Vuelvo al sur - Youngsan Lee, etc.
- La Cumparsita - Sangji Ko, etc.
- Libertango - Sangji Ko, etc.
- Dramatic Funk - Wontae Song, Adlib
- Cavalleria rusticana intermezzo - Sangji Ko, KAIST orchestra
- Hurricane 2000 - Adlib, KAIST orchestra, Yeoseotjul
2006.09.11 View 14746