computing
-
KAIST & CMU Unveils Amuse, a Songwriting AI-Collaborator to Help Create Music
Wouldn't it be great if music creators had someone to brainstorm with, help them when they're stuck, and explore different musical directions together? Researchers of KAIST and Carnegie Mellon University (CMU) have developed AI technology similar to a fellow songwriter who helps create music.
KAIST (President Kwang-Hyung Lee) has developed an AI-based music creation support system, Amuse, by a research team led by Professor Sung-Ju Lee of the School of Electrical Engineering in collaboration with CMU. The research was presented at the ACM Conference on Human Factors in Computing Systems (CHI), one of the world’s top conferences in human-computer interaction, held in Yokohama, Japan from April 26 to May 1. It received the Best Paper Award, given to only the top 1% of all submissions.
< (From left) Professor Chris Donahue of Carnegie Mellon University, Ph.D. Student Yewon Kim and Professor Sung-Ju Lee of the School of Electrical Engineering >
The system developed by Professor Sung-Ju Lee’s research team, Amuse, is an AI-based system that converts various forms of inspiration such as text, images, and audio into harmonic structures (chord progressions) to support composition.
For example, if a user inputs a phrase, image, or sound clip such as “memories of a warm summer beach”, Amuse automatically generates and suggests chord progressions that match the inspiration.
Unlike existing generative AI, Amuse is differentiated in that it respects the user's creative flow and naturally induces creative exploration through an interactive method that allows flexible integration and modification of AI suggestions.
The core technology of the Amuse system is a generation method that blends two approaches: a large language model creates music code based on the user's prompt and inspiration, while another AI model, trained on real music data, filters out awkward or unnatural results using rejection sampling.
< Figure 1. Amuse system configuration. After extracting music keywords from user input, a large language model-based code progression is generated and refined through rejection sampling (left). Code extraction from audio input is also possible (right). The bottom is an example visualizing the chord structure of the generated code. >
The research team conducted a user study targeting actual musicians and evaluated that Amuse has high potential as a creative companion, or a Co-Creative AI, a concept in which people and AI collaborate, rather than having a generative AI simply put together a song.
The paper, in which a Ph.D. student Yewon Kim and Professor Sung-Ju Lee of KAIST School of Electrical and Electronic Engineering and Carnegie Mellon University Professor Chris Donahue participated, demonstrated the potential of creative AI system design in both academia and industry. ※ Paper title: Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations DOI: https://doi.org/10.1145/3706598.3713818
※ Research demo video: https://youtu.be/udilkRSnftI?si=FNXccC9EjxHOCrm1
※ Research homepage: https://nmsl.kaist.ac.kr/projects/amuse/
Professor Sung-Ju Lee said, “Recent generative AI technology has raised concerns in that it directly imitates copyrighted content, thereby violating the copyright of the creator, or generating results one-way regardless of the creator’s intention. Accordingly, the research team was aware of this trend, paid attention to what the creator actually needs, and focused on designing an AI system centered on the creator.”
He continued, “Amuse is an attempt to explore the possibility of collaboration with AI while maintaining the initiative of the creator, and is expected to be a starting point for suggesting a more creator-friendly direction in the development of music creation tools and generative AI systems in the future.”
This research was conducted with the support of the National Research Foundation of Korea with funding from the government (Ministry of Science and ICT). (RS-2024-00337007)
2025.05.07 View 603 -
KAIST Develops Neuromorphic Semiconductor Chip that Learns and Corrects Itself
< Photo. The research team of the School of Electrical Engineering posed by the newly deveoped processor. (From center to the right) Professor Young-Gyu Yoon, Integrated Master's and Doctoral Program Students Seungjae Han and Hakcheon Jeong and Professor Shinhyun Choi >
- Professor Shinhyun Choi and Professor Young-Gyu Yoon’s Joint Research Team from the School of Electrical Engineering developed a computing chip that can learn, correct errors, and process AI tasks
- Equipping a computing chip with high-reliability memristor devices with self-error correction functions for real-time learning and image processing
Existing computer systems have separate data processing and storage devices, making them inefficient for processing complex data like AI. A KAIST research team has developed a memristor-based integrated system similar to the way our brain processes information. It is now ready for application in various devices including smart security cameras, allowing them to recognize suspicious activity immediately without having to rely on remote cloud servers, and medical devices with which it can help analyze health data in real time.
KAIST (President Kwang Hyung Lee) announced on the 17th of January that the joint research team of Professor Shinhyun Choi and Professor Young-Gyu Yoon of the School of Electrical Engineering has developed a next-generation neuromorphic semiconductor-based ultra-small computing chip that can learn and correct errors on its own.
< Figure 1. Scanning electron microscope (SEM) image of a computing chip equipped with a highly reliable selector-less 32×32 memristor crossbar array (left). Hardware system developed for real-time artificial intelligence implementation (right). >
What is special about this computing chip is that it can learn and correct errors that occur due to non-ideal characteristics that were difficult to solve in existing neuromorphic devices. For example, when processing a video stream, the chip learns to automatically separate a moving object from the background, and it becomes better at this task over time.
This self-learning ability has been proven by achieving accuracy comparable to ideal computer simulations in real-time image processing. The research team's main achievement is that it has completed a system that is both reliable and practical, beyond the development of brain-like components.
The research team has developed the world's first memristor-based integrated system that can adapt to immediate environmental changes, and has presented an innovative solution that overcomes the limitations of existing technology.
< Figure 2. Background and foreground separation results of an image containing non-ideal characteristics of memristor devices (left). Real-time image separation results through on-device learning using the memristor computing chip developed by our research team (right). >
At the heart of this innovation is a next-generation semiconductor device called a memristor*. The variable resistance characteristics of this device can replace the role of synapses in neural networks, and by utilizing it, data storage and computation can be performed simultaneously, just like our brain cells.
*Memristor: A compound word of memory and resistor, next-generation electrical device whose resistance value is determined by the amount and direction of charge that has flowed between the two terminals in the past.
The research team designed a highly reliable memristor that can precisely control resistance changes and developed an efficient system that excludes complex compensation processes through self-learning. This study is significant in that it experimentally verified the commercialization possibility of a next-generation neuromorphic semiconductor-based integrated system that supports real-time learning and inference.
This technology will revolutionize the way artificial intelligence is used in everyday devices, allowing AI tasks to be processed locally without relying on remote cloud servers, making them faster, more privacy-protected, and more energy-efficient.
“This system is like a smart workspace where everything is within arm’s reach instead of having to go back and forth between desks and file cabinets,” explained KAIST researchers Hakcheon Jeong and Seungjae Han, who led the development of this technology. “This is similar to the way our brain processes information, where everything is processed efficiently at once at one spot.”
The research was conducted with Hakcheon Jeong and Seungjae Han, the students of Integrated Master's and Doctoral Program at KAIST School of Electrical Engineering being the co-first authors, the results of which was published online in the international academic journal, Nature Electronics, on January 8, 2025.
*Paper title: Self-supervised video processing with self-calibration on an analogue computing platform based on a selector-less memristor array ( https://doi.org/10.1038/s41928-024-01318-6 )
This research was supported by the Next-Generation Intelligent Semiconductor Technology Development Project, Excellent New Researcher Project and PIM AI Semiconductor Core Technology Development Project of the National Research Foundation of Korea, and the Electronics and Telecommunications Research Institute Research and Development Support Project of the Institute of Information & communications Technology Planning & Evaluation.
2025.01.17 View 4576 -
KAIST Develops Insect-Eye-Inspired Camera Capturing 9,120 Frames Per Second
< (From left) Bio and Brain Engineering PhD Student Jae-Myeong Kwon, Professor Ki-Hun Jeong, PhD Student Hyun-Kyung Kim, PhD Student Young-Gil Cha, and Professor Min H. Kim of the School of Computing >
The compound eyes of insects can detect fast-moving objects in parallel and, in low-light conditions, enhance sensitivity by integrating signals over time to determine motion. Inspired by these biological mechanisms, KAIST researchers have successfully developed a low-cost, high-speed camera that overcomes the limitations of frame rate and sensitivity faced by conventional high-speed cameras.
KAIST (represented by President Kwang Hyung Lee) announced on the 16th of January that a research team led by Professors Ki-Hun Jeong (Department of Bio and Brain Engineering) and Min H. Kim (School of Computing) has developed a novel bio-inspired camera capable of ultra-high-speed imaging with high sensitivity by mimicking the visual structure of insect eyes.
High-quality imaging under high-speed and low-light conditions is a critical challenge in many applications. While conventional high-speed cameras excel in capturing fast motion, their sensitivity decreases as frame rates increase because the time available to collect light is reduced.
To address this issue, the research team adopted an approach similar to insect vision, utilizing multiple optical channels and temporal summation. Unlike traditional monocular camera systems, the bio-inspired camera employs a compound-eye-like structure that allows for the parallel acquisition of frames from different time intervals.
< Figure 1. (A) Vision in a fast-eyed insect. Reflected light from swiftly moving objects sequentially stimulates the photoreceptors along the individual optical channels called ommatidia, of which the visual signals are separately and parallelly processed via the lamina and medulla. Each neural response is temporally summed to enhance the visual signals. The parallel processing and temporal summation allow fast and low-light imaging in dim light. (B) High-speed and high-sensitivity microlens array camera (HS-MAC). A rolling shutter image sensor is utilized to simultaneously acquire multiple frames by channel division, and temporal summation is performed in parallel to realize high speed and sensitivity even in a low-light environment. In addition, the frame components of a single fragmented array image are stitched into a single blurred frame, which is subsequently deblurred by compressive image reconstruction. >
During this process, light is accumulated over overlapping time periods for each frame, increasing the signal-to-noise ratio. The researchers demonstrated that their bio-inspired camera could capture objects up to 40 times dimmer than those detectable by conventional high-speed cameras.
The team also introduced a "channel-splitting" technique to significantly enhance the camera's speed, achieving frame rates thousands of times faster than those supported by the image sensors used in packaging. Additionally, a "compressed image restoration" algorithm was employed to eliminate blur caused by frame integration and reconstruct sharp images.
The resulting bio-inspired camera is less than one millimeter thick and extremely compact, capable of capturing 9,120 frames per second while providing clear images in low-light conditions.
< Figure 2. A high-speed, high-sensitivity biomimetic camera packaged in an image sensor. It is made small enough to fit on a finger, with a thickness of less than 1 mm. >
The research team plans to extend this technology to develop advanced image processing algorithms for 3D imaging and super-resolution imaging, aiming for applications in biomedical imaging, mobile devices, and various other camera technologies.
Hyun-Kyung Kim, a doctoral student in the Department of Bio and Brain Engineering at KAIST and the study's first author, stated, “We have experimentally validated that the insect-eye-inspired camera delivers outstanding performance in high-speed and low-light imaging despite its small size. This camera opens up possibilities for diverse applications in portable camera systems, security surveillance, and medical imaging.”
< Figure 3. Rotating plate and flame captured using the high-speed, high-sensitivity biomimetic camera. The rotating plate at 1,950 rpm was accurately captured at 9,120 fps. In addition, the pinch-off of the flame with a faint intensity of 880 µlux was accurately captured at 1,020 fps. >
This research was published in the international journal Science Advances in January 2025 (Paper Title: “Biologically-inspired microlens array camera for high-speed and high-sensitivity imaging”).
DOI: https://doi.org/10.1126/sciadv.ads3389
This study was supported by the Korea Research Institute for Defense Technology Planning and Advancement (KRIT) of the Defense Acquisition Program Administration (DAPA), the Ministry of Science and ICT, and the Ministry of Trade, Industry and Energy (MOTIE).
2025.01.16 View 5132 -
“Cross-Generation Collaborative Labs” for Semiconductor, Chemistry, and Computer Science Opened
< Photo of Professor Hoi-Jun Yoo (center) of the School of Electrical Engineering at the signboard unveiling ceremony >
KAIST held a ceremony to mark the opening of three additional ‘Cross-Generation Collaborative Labs’ on the morning of January 7th, 2025.
The “Next-Generation AI Semiconductor System Lab” by Professor Hoi-Jun Yoo of the School of Electrical Engineering, the “Molecular Spectroscopy and Chemical Dynamics Lab” by Professor Sang Kyu Kim of the Department of Chemistry, and the “Advanced Data Computing Lab” by Professor Sue Bok Moon of the School of Computer Science are the three new labs given the honored titled of the “Cross-Generation Collaborative Lab”.
The Cross-Generation Collaborative Lab is KAIST’s unique system that was set up to facilitate the collaboration between retiring professors and junior professors to continue the achievements and know-how the elders have accumulated over their academic career. Since its introduction in 2018, nine labs have been named to be the Cross-Generation Labs, and this year’s new addition brings the total up to twelve.
The ‘Next-Generation AI Semiconductor System Lab’ led by Professor Hoi-Jun Yoo will be operated by Professor Joo-Young Kim of the same school.
Professor Hoi-Jun Yoo is a world-renowned scholar with outstanding research achievements in the field of on-device AI semiconductor design. Professor Joo-Young Kim is an up-and-coming researcher studying large language models and design of AI semiconductors for server computers, and is currently researching technologies to design PIM (Processing-in-Memory), a core technology in the field of AI semiconductors.
Their research goal is to systematically collaborate and transfer next-generation AI semiconductor design technology, including brain-mimicking AI algorithms such as deep neural networks and generative AI, to integrate core technologies, and to maximize the usability of R&D outputs, thereby further solidifying the position of Korean AI semiconductor companies in the global market.
Professor Hoi-Jun Yoo said, “I believe that, we will be able to present a development direction of for the next-generation AI semiconductors industries at home and abroad through collaborative research and play a key role in transferring and expanding global leadership.”
< Professor Sang Kyu Kim of the Department of Chemistry (middle), at the signboard unveiling ceremony for his laboratory >
The “Molecular Spectroscopy and Chemical Dynamics Laboratory”, where Professor Sang Kyu Kim of the Department of Chemistry is in charge, will be operated by Professor Tae Kyu Kim of the same department, and another professor in the field of spectroscopy and dynamics will join in the future.
Professor Sang Kyu Kim has secured technologies for developing unique experimental equipment based on ultrashort lasers and supersonic molecular beams, and is a world leader who has been creatively pioneering new fields of experimental physical chemistry.
The research goal is to describe chemical reactions and verify from a quantum mechanical perspective and introduce new theories and technologies to pursue a complete understanding of the principles of chemical reactions. In addition, the accompanying basic scientific knowledge will be applied to the design of new materials.
Professor Sang Kyu Kim said, “I am very happy to be able to pass on the research infrastructure to the next generation through this system, and I will continue to nurture it to grow into a world-class research lab through trans-generational collaborative research.”
< Photo of Professor Sue Bok Moon (center) at the signboard unveiling ceremony by the School of Computing >
Lastly, the “Advanced Data Computing Lab” led by Professor Sue Bok Moon is joined by Professor Mee Young Cha of the same school and Professor Wonjae Lee of the Graduate School of Culture Technology.
Professor Sue Bok Moon showed the infinite possibilities of large-scale data-based social network research through Cyworld, YouTube, and Twitter, and had a great influence on related fields beyond the field of computer science.
Professor Mee Young Cha is a data scientist who analyzes difficult social issues such as misinformation, poverty, and disaster detection using big data-based AI. She is the first Korean to be recognized for her achievements as the director of the Max Planck Institute in Germany, a world-class basic science research institute. Therefore, there is high expectation for synergy effects from overseas collaborative research and technology transfer and sharing among the participating professors of the collaborative research lab. Professor Wonjae Lee is researching dynamic interaction analysis between science and technology using structural topic models.
They plan to conduct research aimed at improving the analysis and understanding of negative influences occurring online, and in particular, developing a hateful precursor detection model using emotions and morality to preemptively block hateful expressions.
Professor Sue Bok Moon said, “Through this collaborative research lab, we will play a key role in conducting in-depth collaborative research on unexpected negative influences in the AI era so that we can have a high level of competitiveness worldwide.”
The ceremonies for the unveiling of the new Cross-Generation Collaborative Lab signboard were held in front of each lab from 10:00 AM on the 7th, in the attendance of President Kwang Hyung Lee, Senior Vice President for Research Sang Yup Lee, and other key officials of KAIST and the new staff members to join the laboratories.
2025.01.07 View 2737 -
KAIST Professor Uichin Lee Receives Distinguished Paper Award from ACM
< Photo. Professor Uichin Lee (left) receiving the award >
KAIST (President Kwang Hyung Lee) announced on the 25th of October that Professor Uichin Lee’s research team from the School of Computing received the Distinguished Paper Award at the International Joint Conference on Pervasive and Ubiquitous Computing and International Symposium on Wearable Computing (Ubicomp / ISWC) hosted by the Association for Computing Machinery (ACM) in Melbourne, Australia on October 8.
The ACM Ubiquitous Computing Conference is the most prestigious international conference where leading universities and global companies from around the world present the latest research results on ubiquitous computing and wearable technologies in the field of human-computer interaction (HCI).
The main conference program is composed of invited papers published in the Proceedings of the ACM (PACM) on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), which covers the latest research in the field of ubiquitous and wearable computing.
The Distinguished Paper Award Selection Committee selected eight papers among 205 papers published in Vol. 7 of the ACM Proceedings (PACM IMWUT) that made outstanding and exemplary contributions to the research community. The committee consists of 16 prominent experts who are current and former members of the journal's editorial board which made the selection after a rigorous review of all papers for a period that stretched over a month.
< Figure 1. BeActive mobile app to promote physical activity to form active lifestyle habits >
The research that won the Distinguished Paper Award was conducted by Dr. Junyoung Park, a graduate of the KAIST Graduate School of Data Science, as the 1st author, and was titled “Understanding Disengagement in Just-in-Time Mobile Health Interventions”
Professor Uichin Lee’s research team explored user engagement of ‘Just-in-Time Mobile Health Interventions’ that actively provide interventions in opportune situations by utilizing sensor data collected from health management apps, based on the premise that these apps are aptly in use to ensure effectiveness.
< Figure 2. Traditional user-requested digital behavior change intervention (DBCI) delivery (Pull) vs. Automatic transmission (Push) for Just-in-Time (JIT) mobile DBCI using smartphone sensing technologies >
The research team conducted a systematic analysis of user disengagement or the decline in user engagement in digital behavior change interventions. They developed the BeActive system, an app that promotes physical activities designed to help forming active lifestyle habits, and systematically analyzed the effects of users’ self-control ability and boredom-proneness on compliance with behavioral interventions over time.
The results of an 8-week field trial revealed that even if just-in-time interventions are provided according to the user’s situation, it is impossible to avoid a decline in participation. However, for users with high self-control and low boredom tendency, the compliance with just-in-time interventions delivered through the app was significantly higher than that of users in other groups.
In particular, users with high boredom proneness easily got tired of the repeated push interventions, and their compliance with the app decreased more quickly than in other groups.
< Figure 3. Just-in-time Mobile Health Intervention: a demonstrative case of the BeActive system: When a user is identified to be sitting for more than 50 mins, an automatic push notification is sent to recommend a short active break to complete for reward points. >
Professor Uichin Lee explained, “As the first study on user engagement in digital therapeutics and wellness services utilizing mobile just-in-time health interventions, this research provides a foundation for exploring ways to empower user engagement.” He further added, “By leveraging large language models (LLMs) and comprehensive context-aware technologies, it will be possible to develop user-centered AI technologies that can significantly boost engagement."
< Figure 4. A conceptual illustration of user engagement in digital health apps. Engagement in digital health apps consists of (1) engagement in using digital health apps and (2) engagement in behavioral interventions provided by digital health apps, i.e., compliance with behavioral interventions. Repeated adherences to behavioral interventions recommended by digital health apps can help achieve the distal health goals. >
This study was conducted with the support of the 2021 Biomedical Technology Development Program and the 2022 Basic Research and Development Program of the National Research Foundation of Korea funded by the Ministry of Science and ICT.
< Figure 5. A conceptual illustration of user disengagement and engagement of digital behavior change intervention (DBCI) apps. In general, user engagement of digital health intervention apps consists of two components: engagement in digital health apps and engagement in behavioral interventions recommended by such apps (known as behavioral compliance or intervention adherence). The distinctive stages of user can be divided into adoption, abandonment, and attrition. >
< Figure 6. Trends of changes in frequency of app usage and adherence to behavioral intervention over 8 weeks, ● SC: Self-Control Ability (High-SC: user group with high self-control, Low-SC: user group with low self-control) ● BD: Boredom-Proneness (High-BD: user group with high boredom-proneness, Low-BD: user group with low boredom-proneness). The app usage frequencies were declined over time, but the adherence rates of those participants with High-SC and Low-BD were significantly higher than other groups. >
2024.10.25 View 5054 -
KAIST researchers developed a novel ultra-low power memory for neuromorphic computing
A team of Korean researchers is making headlines by developing a new memory device that can be used to replace existing memory or used in implementing neuromorphic computing for next-generation artificial intelligence hardware for its low processing costs and its ultra-low power consumption.
KAIST (President Kwang-Hyung Lee) announced on April 4th that Professor Shinhyun Choi's research team in the School of Electrical Engineering has developed a next-generation phase change memory* device featuring ultra-low-power consumption that can replace DRAM and NAND flash memory.
☞ Phase change memory: A memory device that stores and/or processes information by changing the crystalline states of materials to be amorphous or crystalline using heat, thereby changing its resistance state.
Existing phase change memory has the problems such as expensive fabrication process for making highly scaled device and requiring substantial amount of power for operation. To solve these problems, Professor Choi’s research team developed an ultra-low power phase change memory device by electrically forming a very small nanometer (nm) scale phase changeable filament without expensive fabrication processes. This new development has the groundbreaking advantage of not only having a very low processing cost but also of enabling operating with ultra-low power consumption.
DRAM, one of the most popularly used memory, is very fast, but has volatile characteristics in which data disappears when the power is turned off. NAND flash memory, a storage device, has relatively slow read/write speeds, but it has non-volatile characteristic that enables it to preserve the data even when the power is cut off.
Phase change memory, on the other hand, combines the advantages of both DRAM and NAND flash memory, offering high speed and non-volatile characteristics. For this reason, phase change memory is being highlighted as the next-generation memory that can replace existing memory, and is being actively researched as a memory technology or neuromorphic computing technology that mimics the human brain.
However, conventional phase change memory devices require a substantial amount of power to operate, making it difficult to make practical large-capacity memory products or realize a neuromorphic computing system. In order to maximize the thermal efficiency for memory device operation, previous research efforts focused on reducing the power consumption by shrinking the physical size of the device through the use of the state-of-the-art lithography technologies, but they were met with limitations in terms of practicality as the degree of improvement in power consumption was minimal whereas the cost and the difficulty of fabrication increased with each improvement.
In order to solve the power consumption problem of phase change memory, Professor Shinhyun Choi’s research team created a method to electrically form phase change materials in extremely small area, successfully implementing an ultra-low-power phase change memory device that consumes 15 times less power than a conventional phase change memory device fabricated with the expensive lithography tool.
< Figure 1. Illustrations of the ultra-low power phase change memory device developed through this study and the comparison of power consumption by the newly developed phase change memory device compared to conventional phase change memory devices. >
Professor Shinhyun Choi expressed strong confidence in how this research will span out in the future in the new field of research saying, "The phase change memory device we have developed is significant as it offers a novel approach to solve the lingering problems in producing a memory device at a greatly improved manufacturing cost and energy efficiency. We expect the results of our study to become the foundation of future electronic engineering, enabling various applications including high-density three-dimensional vertical memory and neuromorphic computing systems as it opened up the possibilities to choose from a variety of materials.” He went on to add, “I would like to thank the National Research Foundation of Korea and the National NanoFab Center for supporting this research.”
This study, in which See-On Park, a student of MS-PhD Integrated Program, and Seokman Hong, a doctoral student of the School of Electrical Engineering at KAIST, participated as first authors, was published on April 4 in the April issue of the renowned international academic journal Nature. (Paper title: Phase-Change Memory via a Phase-Changeable Self-Confined Nano-Filament)
This research was conducted with support from the Next-Generation Intelligent Semiconductor Technology Development Project, PIM AI Semiconductor Core Technology Development (Device) Project, Excellent Emerging Research Program of the National Research Foundation of Korea, and the Semiconductor Process-based Nanomedical Devices Development Project of the National NanoFab Center.
2024.04.04 View 6881 -
KAIST Holds 2023 Commencement Ceremony
< Photo 1. On the 17th, KAIST held the 2023 Commencement Ceremony for a total of 2,870 students, including 691 doctors. >
KAIST held its 2023 commencement ceremony at the Sports Complex of its main campus in Daejeon at 2 p.m. on February 27. It was the first commencement ceremony to invite all its graduates since the start of COVID-19 quarantine measures.
KAIST awarded a total of 2,870 degrees including 691 PhD degrees, 1,464 master’s degrees, and 715 bachelor’s degrees, which adds to the total of 74,999 degrees KAIST has conferred since its foundation in 1971, which includes 15,772 PhD, 38,360 master’s and 20,867 bachelor’s degrees.
This year’s Cum Laude, Gabin Ryu, from the Department of Mechanical Engineering received the Minister of Science and ICT Award. Seung-ju Lee from the School of Computing received the Chairman of the KAIST Board of Trustees Award, while Jantakan Nedsaengtip, an international student from Thailand received the KAIST Presidential Award, and Jaeyong Hwang from the Department of Physics and Junmo Lee from the Department of Industrial and Systems Engineering each received the President of the Alumni Association Award and the Chairman of the KAIST Development Foundation Award, respectively.
Minister Jong-ho Lee of the Ministry of Science and ICT awarded the recipients of the academic awards and delivered a congratulatory speech.
Yujin Cha from the Department of Bio and Brain Engineering, who received a PhD degree after 19 years since his entrance to KAIST as an undergraduate student in 2004 gave a speech on behalf of the graduates to move and inspire the graduates and the guests.
After Cha received a bachelor’s degree from the Department of Nuclear and Quantum Engineering, he entered a medical graduate school and became a radiation oncology specialist. But after experiencing the death of a young patient who suffered from osteosarcoma, he returned to his alma mater to become a scientist. As he believes that science and technology is the ultimate solution to the limitations of modern medicine, he started as a PhD student at the Department of Bio and Brain Engineering in 2018, hoping to find such solutions.
During his course, he identified the characteristics of the decision-making process of doctors during diagnosis, and developed a brain-inspired AI algorithm. It is an original and challenging study that attempted to develop a fundamental machine learning theory from the data he collected from 200 doctors of different specialties.
Cha said, “Humans and AI can cooperate by humans utilizing the unique learning abilities of AI to develop our expertise, while AIs can mimic us humans’ learning abilities to improve.” He added, “My ultimate goal is to develop technology to a level at which humans and machines influence each other and ‘coevolve’, and applying it not only to medicine, but in all areas.”
Cha, who is currently an assistant professor at the KAIST Biomedical Research Center, has also written Artificial Intelligence for Doctors in 2017 to help medical personnel use AI in clinical fields, and the book was selected as one of the 2018 Sejong Books in the academic category.
During his speech at this year’s commencement ceremony, he shared that “there are so many things in the world that are difficult to solve and many things to solve them with, but I believe the things that can really broaden the horizons of the world and find fundamental solutions to the problems at hand are science and technology.”
Meanwhile, singer-songwriter Sae Byul Park who studied at the KAIST Graduate School of Culture Technology will also receive her PhD degree.
Natural language processing (NLP) is a field in AI that teaches a computer to understand and analyze human language that is actively being studied. An example of NLP is ChatGTP, which recently received a lot of attention. For her research, Park analyzed music rather than language using NLP technology.
To analyze music, which is in the form of sound, using the methods for NLP, it is necessary to rebuild notes and beats into a form of words or sentences as in a language. For this, Park designed an algorithm called Mel2Word and applied it to her research.
She also suggested that by converting melodies into texts for analysis, one would be able to quantitatively express music as sentences or words with meaning and context rather than as simple sounds representing a certain note.
Park said, “music has always been considered as a product of subjective emotion, but this research provides a framework that can calculate and analyze music.”
Park’s study can later be developed into a tool to measure the similarities between musical work, as well as a piece’s originality, artistry and popularity, and it can be used as a clue to explore the fundamental principles of how humans respond to music from a cognitive science perspective.
Park began her Ph.D. program in 2014, while carrying on with her musical activities as well as public and university lectures alongside, and dealing with personally major events including marriage and childbirth during the course of years. She already met the requirements to receive her degree in 2019, but delayed her graduation in order to improve the level of completion of her research, and finally graduated with her current achievements after nine years.
Professor Juhan Nam, who supervised Park’s research, said, “Park, who has a bachelor’s degree in psychology, later learned to code for graduate school, and has complete high-quality research in the field of artificial intelligence.” He added, “Though it took a long time, her attitude of not giving up until the end as a researcher is also excellent.”
Sae Byul Park is currently lecturing courses entitled Culture Technology and Music Information Retrieval at the Underwood International College of Yonsei University.
Park said, “the 10 or so years I’ve spent at KAIST as a graduate student was a time I could learn and prosper not only academically but from all angles of life.” She added, “having received a doctorate degree is not the end, but a ‘commencement’. Therefore, I will start to root deeper from the seeds I sowed and work harder as a both a scholar and an artist.”
< Photo 2. From left) Yujin Cha (Valedictorian, Medical-Scientist Program Ph.D. graduate), Saebyeol Park (a singer-songwriter, Ph.D. graduate from the Graduate School of Culture and Technology), Junseok Moon and Inah Seo (the two highlighted CEO graduates from the Department of Management Engineering's master’s program) >
Young entrepreneurs who dream of solving social problems will also be wearing their graduation caps. Two such graduates are Jun-seok Moon and Inah Seo, receiving their master’s degrees in social entrepreneurship MBA from the KAIST College of Business.
Before entrance, Moon ran a café helping African refugees stand on their own feet. Then, he entered KAIST to later expand his business and learn social entrepreneurship in order to sustainably help refugees in the blind spots of human rights and welfare.
During his master’s course, Moon realized that he could achieve active carbon reduction by changing the coffee alone, and switched his business field and founded Equal Table. The amount of carbon an individual can reduce by refraining from using a single paper cup is 10g, while changing the coffee itself can reduce it by 300g.
1kg of coffee emits 15kg of carbon over the course of its production, distribution, processing, and consumption, but Moon produces nearly carbon-neutral coffee beans by having innovated the entire process. In particular, the company-to-company ESG business solution is Moon’s new start-up area. It provides companies with carbon-reduced coffee made by roasting raw beans from carbon-neutral certified farms with 100% renewable energy, and shows how much carbon has been reduced in its making. Equal Table will launch the service this month in collaboration with SK Telecom, its first partner.
Inah Seo, who also graduated with Moon, founded Conscious Wear to start a fashion business reducing environmental pollution. In order to realize her mission, she felt the need to gain the appropriate expertise in management, and enrolled for the social entrepreneurship MBA.
Out of the various fashion industries, Seo focused on the leather market, which is worth 80 trillion won. Due to thickness or contamination issues, only about 60% of animal skin fabric is used, and the rest is discarded. Heavy metals are used during such processes, which also directly affects the environment.
During the social entrepreneurship MBA course, Seo collaborated with SK Chemicals, which had links through the program, and launched eco-friendly leather bags. The bags used discarded leather that was recycled by grinding and reprocessing into a biomaterial called PO3G. It was the first case in which PO3G that is over 90% biodegradable was applied to regenerated leather. In other words, it can reduce environmental pollution in the processing and disposal stages, while also reducing carbon emissions and water usage by one-tenth compared to existing cowhide products.
The social entrepreneurship MBA course, from which Moon and Seo graduated, will run in integration with the Graduate School of Green Growth as an Impact MBA program starting this year. KAIST plans to steadily foster entrepreneurs who will lead meaningful changes in the environment and society as well as economic values through innovative technologies and ideas.
< Photo 3. NYU President Emeritus John Sexton (left), who received this year's honorary doctorate of science, poses with President Kwang Hyung Lee >
Meanwhile, during this day’s commencement ceremony, KAIST also presented President Emeritus John Sexton of New York University with an honorary doctorate in science. He was recognized for laying the foundation for the cooperation between KAIST and New York University, such as promoting joint campuses.
< Photo 4. At the commencement ceremony of KAIST held on the 17th, President Kwang Hyung Lee is encouraging the graduates with his commencement address. >
President Kwang Hyung Lee emphasized in his commencement speech that, “if you can draw up the future and work hard toward your goal, the future can become a work of art that you create with your own hands,” and added, “Never stop on the journey toward your dreams, and do not give up even when you are met with failure. Failure happens to everyone, all the time. The important thing is to know 'why you failed', and to use those elements of failure as the driving force for the next try.”
2023.02.20 View 18350 -
Professor Shinhyun Choi’s team, selected for Nature Communications Editors’ highlight
[ From left, Ph.D. candidates See-On Park and Hakcheon Jeong, along with Master's student Jong-Yong Park and Professor Shinhyun Choi ]
See-On Park, Hakcheon Jeong, Jong-Yong Park - a team of researchers under the leadership of Professor Shinhyun Choi of the School of Electrical Engineering, developed a highly reliable variable resistor (memristor) array that simulates the behavior of neurons using a metal oxide layer with an oxygen concentration gradient, and published their work in Nature Communications. The study was selected as the Nature Communications' Editor's highlight, and as the featured article posted on the main page of the journal's website.
Link : https://www.nature.com/ncomms/
[ Figure 1. The featured image on the main page of the Nature Communications' website introducing the research by Professor Choi's team on the memristor for artificial neurons ]
Thesis title: Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing.
( https://doi.org/10.1038/s41467-022-30539-6 )
At KAIST, their research was introduced on the 2022 Fall issue of Breakthroughs, the biannual newsletter published by KAIST College of Engineering.
This research was conducted with the support from the Samsung Research Funding & Incubation Center of Samsung Electronics.
2022.11.01 View 8366 -
See-through exhibitions using smartphones: KAIST develops the AR magic lens, WonderScope
WonderScope shows what’s underneath the surface of an object through an augmented reality technology.
< Photo 1. Demonstration at ACM SIGGRAPH >
- A KAIST research team led by Professor Woohun Lee from the Department of Industrial Design and Professor Geehyuk Lee from the School of Computing have developed a smartphone “appcessory” called WonderScope that can easily add an augmented reality (AR) perspective to the surface of exhibits
- The research won an Honorable Mention for Emerging Technologies Best in Show at ACM SIGGRAPH, one of the largest international conferences on computer graphics and interactions
- The technology was improved and validated through real-life applications in three special exhibitions including one at the Geological Museum at the Korea Institute of Geoscience and Mineral Resources (KIGAM) held in 2020, and two at the National Science Museum each in 2021 and 2022
- The technology is expected to be used for public science exhibitions and museums as well as for interactive teaching materials to stimulate children’s curiosity
A KAIST research team led by Professor Woohun Lee from the Department of Industrial Design and Professor Geehyuk Lee from the School of Computing developed a novel augmented reality (AR) device, WonderScope, which displays the insides of an object directly from its surface. By installing and connecting WonderScope to a mobile device through Bluetooth, users can see through exhibits as if looking through a magic lens.
Many science museums nowadays have incorporated the use of AR apps for mobile devices. Such apps add digital information to the exhibition, providing a unique experience. However, visitors must watch the screen from a certain distance away from the exhibited items, often causing them to focus more on the digital contents rather than the exhibits themselves. In other words, the distance and distractions that exist between the exhibit and the mobile device may actually cause the visitors to feel detached from the exhibition. To solve this problem, museums needed a magic AR lens that could be used directly from the surface of the item.
To accomplish this, smartphones must know exactly where on the surface of an object it is placed. Generally, this would require an additional recognition device either on the inside or on the surface of the item, or a special pattern printed on its surface. Realistically speaking, these are impractical solutions, as exhibits would either appear overly complex or face spatial restrictions.
WonderScope, on the other hand, uses a much more practical method to identify the location of a smartphone on the surface of an exhibit. First, it reads a small RFID tag attached to the surface of an object, and calculates the location of the moving smartphone by adding its relative movements based on the readings from an optical displacement sensor and an acceleration sensor. The research team also took into consideration the height of the smartphone, and the characteristics of the surface profile in order to calculate the device’s position more accurately. By attaching or embedding RFID tags on exhibits, visitors can easily experience the effects of a magic AR lens through their smartphones.
For its wider use, WonderScope must be able to locate itself from various types of exhibit surfaces. To this end, WoderScope uses readings from an optical displacement sensor and an acceleration sensor with complementary characteristics, allowing stable locating capacities on various textures including paper, stone, wood, plastic, acrylic, and glass, as well as surfaces with physical patterns or irregularities. As a result, WonderScope can identify its location from a distance as close as 4 centimeters from an object, also enabling simple three-dimensional interactions near the surface of the exhibits.
The research team developed various case project templates and WonderScope support tools to allow the facile production of smartphone apps that use general-purpose virtual reality (VR) and the game engine Unity. WonderScope is also compatible with various types of devices that run on the Android operating system, including smartwatches, smartphones, and tablets, allowing it to be applied to exhibitions in many forms.
< Photo 2. Human body model showing demonstration >
< Photo 3. Demonstration of the underground mineral exploration game >
< Photo 4. Demonstration of Apollo 11 moon exploration experience >
The research team developed WonderScope with funding from the science and culture exhibition enhancement support project by the Ministry of Science and ICT. Between October 27, 2020 and February 28, 2021, WonderScope was used to observe underground volcanic activity and the insides of volcanic rocks at “There Once was a Volcano”, a special exhibition held at the Geological Museum in the Korea institute of Geoscience and Mineral Resources (KIGAM). From September 28 to October 3, 2021, it was used to observe the surface of Jung-moon-kyung (a bronze mirror with fine linear design) at the special exhibition “A Bronze Mirror Shines on Science” at the National Science Museum. And from August 2 to October 3, 2022 it was applied to a moon landing simulation at “The Special Exhibition on Moon Exploration”, also at the National Science Museum. Through various field demonstrations over the years, the research team has improved the performance and usability of WonderScope.
< Photo 5. Observation of surface corrosion of the main gate >
The research team demonstrated WonderScope at the Emerging Technologies forum during ACM SIGGRAPH 2022, a computer graphics and interaction technology conference that was held in Vancouver, Canada between August 8 and 11 this year. At this conference, where the latest interactive technologies are introduced, the team won an Honorable Mention for Best in Show. The judges commented that “WonderScope will be a new technology that provides the audience with a unique joy of participation during their visits to exhibitions and museums.”
< Photo 6. Cover of Digital Creativity >
WonderScope is a cylindrical “appcessory” module, 5cm in diameter and 4.5cm in height. It is small enough to be easily attached to a smartphone and embedded on most exhibits. Professor Woohun Lee from the KAIST Department of Industrial Design, who supervised the research, said, “WonderScope can be applied to various applications including not only educational, but also industrial exhibitions, in many ways.” He added, “We also expect for it to be used as an interactive teaching tool that stimulates children’s curiosity.”
Introductory video of WonderScope: https://www.youtube.com/watch?v=X2MyAXRt7h4&t=7s
2022.10.24 View 9528 -
An AI-based, Indoor/Outdoor-Integrated (IOI) GPS System to Bring Seismic Waves in the Terrains of Positioning Technology
KAIST breaks new grounds in positioning technology with an AI-integrated GPS board that works both indoors and out
KAIST (President Kwang Hyung Lee) announced on the 8th that Professor Dong-Soo Han's research team (Intelligent Service Integration Lab) from the School of Computing has developed a GPS system that works both indoors and outdoors with quality precision regardless of the environment.
This Indoor/Outdoor-Integrated GPS System, or IOI GPS System, for short, uses the GPS signals outdoors and estimates locations indoors using signals from multiple sources like an inertial sensor, pressure sensors, geomagnetic sensors, and light sensors. To this end, the research team developed techniques to detect environmental changes such as entering a building, and methods to detect entrances, ground floors, stairs, elevators and levels of buildings by utilizing artificial intelligence techniques. Various landmark detecting techniques were also incorporated with pedestrian dead reckoning (PDR), a navigation tool for pedestrians, to devise the so-called “Sensor-Fusion Positioning Algorithm”.
To date, it was common to estimate locations based on wireless LAN signals or base station signals in a space where the GPS signal could not reach. However, the IOI GPS enables positioning even in buildings without signals nor indoor maps.
The algorithm developed by the research team can provide accurate floor information within a building where even big tech companies like Google and Apple's positioning services do not provide. Unlike other positioning methods that rely on visual data, geomagnetic positioning techniques, or wireless LAN, this system also has the advantage of not requiring any prior preparation. In other words, the foundation to enable the usage of a universal GPS system that works both indoors and outdoors anywhere in the world is now ready.
The research team also produced a circuit board for the purpose of operating the IOI GPS System, mounted with chips to receive and process GPS, Wi-Fi, and Bluetooth signals, along with an inertial sensor, a barometer, a magnetometer, and a light sensor. The sensor-fusion positioning algorithm the lab has developed is also incorporated in the board.
When the accuracy of the IOI GPS board was tested in the N1 building of KAIST’s main campus in Daejeon, it achieved an accuracy of about 95% in floor estimation and an accuracy of about 3 to 6 meters in distance estimation. As for the indoor/outdoor transition, the navigational mode change was completed in about 0.3 seconds. When it was combined with the PDR technique, the estimation accuracy improved further down to a scope of one meter.
The research team is now working on assembling a tag with a built-in positioning board and applying it to location-based docent services for visitors at museums, science centers, and art galleries. The IOI GPS tag can be used for the purpose of tracking children and/or the elderly, and it can also be used to locate people or rescue workers lost in disaster-ridden or hazardous sites. On a different note, the sensor-fusion positioning algorithm and positioning board for vehicles are also under development for the tracking of vehicles entering indoor areas like underground parking lots.
When the IOI GPS board for vehicles is manufactured, the research team will work to collaborate with car manufacturers and car rental companies, and will also develop a sensor-fusion positioning algorithm for smartphones. Telecommunication companies seeking to diversify their programs in the field of location-based services will also be interested in the use the IOI GPS.
Professor Dong-Soo Han of the School of Computing, who leads the research team, said, “This is the first time to develop an indoor/outdoor integrated GPS system that can pinpoint locations in a building where there is no wireless signal or an indoor map, and there are an infinite number of areas it can be applied to. When the integration with the Korea Augmentation Satellite System (KASS) and the Korean GPS (KPS) System that began this year, is finally completed, Korea can become the leader in the field of GPS both indoors and outdoors, and we also have plans to manufacture semi-conductor chips for the IOI GPS System to keep the tech-gap between Korea and the followers.”
He added, "The guidance services at science centers, museums, and art galleries that uses IOI GPS tags can provide a set of data that would be very helpful for analyzing the visitors’ viewing traces. It is an essential piece of information required when the time comes to decide when to organize the next exhibit. We will be working on having it applied to the National Science Museum, first.”
The projects to develop the IOI GPS system and the trace analysis system for science centers were supported through Science, Culture, Exhibits and Services Capability Enhancement Program of the Ministry of Science and ICT.
Profile: Dong-Soo Han, Ph.D.Professorddsshhan@kaist.ac.krhttp://isilab.kaist.ac.kr
Intelligent Service Integration Lab.School of Computing
http://kaist.ac.kr/en/
Korea Advanced Institute of Science and Technology (KAIST)Daejeon, Republic of Korea
2022.07.13 View 10922 -
KAIST & LG U+ Team Up for Quantum Computing Solution for Ultra-Space 6G Satellite Networking
KAIST quantum computer scientists have optimized ultra-space 6G Low-Earth Orbit (LEO) satellite networking, finding the shortest path to transfer data from a city to another place via multi-satellite hops.
The research team led by Professor June-Koo Kevin Rhee and Professor Dongsu Han in partnership with LG U+ verified the possibility of ultra-performance and precision communication with satellite networks using D-Wave, the first commercialized quantum computer.
Satellite network optimization has remained challenging since the network needs to be reconfigured whenever satellites approach other satellites within the connection range in a three-dimensional space. Moreover, LEO satellites orbiting at 200~2000 km above the Earth change their positions dynamically, whereas Geo-Stationary Orbit (GSO) satellites do not change their positions. Thus, LEO satellite network optimization needs to be solved in real time.
The research groups formulated the problem as a Quadratic Unconstrained Binary Optimization (QUBO) problem and managed to solve the problem, incorporating the connectivity and link distance limits as the constraints.
The proposed optimization algorithm is reported to be much more efficient in terms of hop counts and path length than previously reported studies using classical solutions. These results verify that a satellite network can provide ultra-performance (over 1Gbps user-perceived speed), and ultra-precision (less than 5ms end-to-end latency) network services, which are comparable to terrestrial communication.
Once QUBO is applied, “ultra-space networking” is expected to be realized with 6G. Researchers said that an ultra-space network provides communication services for an object moving at up to 10 km altitude with an extreme speed (~ 1000 km/h). Optimized LEO satellite networks can provide 6G communication services to currently unavailable areas such as air flights and deserts.
Professor Rhee, who is also the CEO of Qunova Computing, noted, “Collaboration with LG U+ was meaningful as we were able to find an industrial application for a quantum computer. We look forward to more quantum application research on real problems such as in communications, drug and material discovery, logistics, and fintech industries.”
2022.06.17 View 8663 -
Neuromorphic Memory Device Simulates Neurons and Synapses
Simultaneous emulation of neuronal and synaptic properties promotes the development of brain-like artificial intelligence
Researchers have reported a nano-sized neuromorphic memory device that emulates neurons and synapses simultaneously in a unit cell, another step toward completing the goal of neuromorphic computing designed to rigorously mimic the human brain with semiconductor devices.
Neuromorphic computing aims to realize artificial intelligence (AI) by mimicking the mechanisms of neurons and synapses that make up the human brain. Inspired by the cognitive functions of the human brain that current computers cannot provide, neuromorphic devices have been widely investigated. However, current Complementary Metal-Oxide Semiconductor (CMOS)-based neuromorphic circuits simply connect artificial neurons and synapses without synergistic interactions, and the concomitant implementation of neurons and synapses still remains a challenge. To address these issues, a research team led by Professor Keon Jae Lee from the Department of Materials Science and Engineering implemented the biological working mechanisms of humans by introducing the neuron-synapse interactions in a single memory cell, rather than the conventional approach of electrically connecting artificial neuronal and synaptic devices.
Similar to commercial graphics cards, the artificial synaptic devices previously studied often used to accelerate parallel computations, which shows clear differences from the operational mechanisms of the human brain. The research team implemented the synergistic interactions between neurons and synapses in the neuromorphic memory device, emulating the mechanisms of the biological neural network. In addition, the developed neuromorphic device can replace complex CMOS neuron circuits with a single device, providing high scalability and cost efficiency.
The human brain consists of a complex network of 100 billion neurons and 100 trillion synapses. The functions and structures of neurons and synapses can flexibly change according to the external stimuli, adapting to the surrounding environment. The research team developed a neuromorphic device in which short-term and long-term memories coexist using volatile and non-volatile memory devices that mimic the characteristics of neurons and synapses, respectively. A threshold switch device is used as volatile memory and phase-change memory is used as a non-volatile device. Two thin-film devices are integrated without intermediate electrodes, implementing the functional adaptability of neurons and synapses in the neuromorphic memory.
Professor Keon Jae Lee explained, "Neurons and synapses interact with each other to establish cognitive functions such as memory and learning, so simulating both is an essential element for brain-inspired artificial intelligence. The developed neuromorphic memory device also mimics the retraining effect that allows quick learning of the forgotten information by implementing a positive feedback effect between neurons and synapses.”
This result entitled “Simultaneous emulation of synaptic and intrinsic plasticity using a memristive synapse” was published in the May 19, 2022 issue of Nature Communications.
-Publication:Sang Hyun Sung, Tae Jin Kim, Hyera Shin, Tae Hong Im, and Keon Jae Lee (2022) “Simultaneous emulation of synaptic and intrinsic plasticity using a memristive synapse,” Nature Communications May 19, 2022 (DOI: 10.1038/s41467-022-30432-2)
-Profile:Professor Keon Jae Leehttp://fand.kaist.ac.kr
Department of Materials Science and EngineeringKAIST
2022.05.20 View 13283