KAIST Develops Semiconductor Neuron That Tunes Noise to Selectively Process Signals
In electronic devices, irregular fluctuations in signals are generally referred to as “noise.” Because noise interferes with accurate information processing, conventional semiconductor technology has mainly treated it as something to be reduced or eliminated. However, neurons in the human brain do not respond in exactly the same way every time, even to the same stimulus. Tiny internal variations in neurons change when and how often neurons are fired, and this probabilistic operation is one of the brain’s key information-processing features. Inspired by this, KAIST researchers have developed a next-generation semiconductor technology that does not remove current noise generated in memristors, but instead tunes it to a desired level and uses it to process different types of signals.
KAIST (President Choongsik Bae) announced on the August 16 that a research team led by Professor Kyung Min Kim from the Department of Materials Science and Engineering has developed a new neuromorphic neuron technology that uses noise generated in semiconductor devices for information processing, enabling selective encoding of time-series signals across different frequency bands.
※ Neuromorphic technology: A technology that processes information by mimicking the way the human brain and neurons operate.
In general, noise generated in semiconductors is regarded as an obstacle to accurate signal processing. For this reason, most electronic devices are designed to reduce or eliminate noise as much as possible. The human brain, however, works differently. Neurons, the nerve cells of the brain, do not always respond in the same way to the same stimulus because of internal probabilistic fluctuations. This irregularity actually helps the brain flexibly respond to a wide range of situations and sensory signals.
The research team used a memristor in this study. A memristor is a semiconductor device that changes its resistance state in response to electrical stimulation and remembers that state. Until now, current noise generated in memristors has mainly been used for random number generation, which creates unpredictable numbers, or for probabilistic computing.
However, previous studies have largely focused on using the inherent randomness of memristors as it is. Technologies that can tune probabilistic response characteristics according to need had not been sufficiently realized.
The key insight of this study is that when the resistance state of a memristor is changed, the magnitude and behavior of its current noise also change. By presetting the resistance state of the memristor, the probability of spike generation and the response range can vary even under the same input. Using this principle, the research team implemented a “programmable probabilistic neuron (PPN)” that treats noise not simply as instability, but as an information-processing resource that can be tuned in a desired way.
This neuron can be configured to respond differently depending on how rapidly an input signal changes, in other words, its frequency. By changing only the resistance state of the memristor, the same circuit can be switched to respond sensitively to slow human activity signals in the hertz (Hz) range or fast speech signals in the kilohertz (kHz) range. Hz and kHz are units that indicate how many times a signal repeats per second, with 1 kHz equal to 1,000 Hz.
In simple terms, a single artificial neuron can be reconfigured according to the speed of the signal it needs to process. When processing slowly changing signals such as human movement, it can operate in a way suited to slow variations; when processing rapidly changing signals such as speech, it can be adjusted to capture short and fast changes effectively.
The research team verified the technology using signals with different frequency ranges. The system encoded and classified human activity signals in the Hz range and speech signals in the kHz range, achieving accuracies of 94.8% in human activity recognition and 95.0% in speech recognition.
Professor Kyung Min Kim said, “The significance of this study lies in demonstrating that memristor noise can be harnessed as a tunable information-processing resource, rather than simply treated as an error or instability,” adding, “Because the same hardware can be reconfigured for signals of different speeds and frequencies, it could be used as a signal-processing technology for future low-power edge neuromorphic systems.”
This study was led by Dr. Do Hoon Kim from the Department of Materials Science and Engineering as first author, and was published in the internationally renowned materials science journal Advanced Materials on August 05.
Paper title: Noise-Tunable Memristor Enabling Programmable Probabilistic Neurons for Frequency-Selective Time-Series Signal Encoding,
DOI: https://doi.org/10.1002/adma.74529
This research was supported by the Basic Research Program in Science and Engineering and the PIM Artificial Intelligence Semiconductor Core Technology Development Program of the Ministry of Science and ICT and the National Research Foundation of Korea.
KAIST Develops Neuromorphic Semiconductor Chip that Learns and Corrects Itself
< Photo. The research team of the School of Electrical Engineering posed by the newly deveoped processor. (From center to the right) Professor Young-Gyu Yoon, Integrated Master's and Doctoral Program Students Seungjae Han and Hakcheon Jeong and Professor Shinhyun Choi >
- Professor Shinhyun Choi and Professor Young-Gyu Yoon’s Joint Research Team from the School of Electrical Engineering developed a computing chip that can learn, correct errors, and process AI tasks
- Equipping a computing chip with high-reliability memristor devices with self-error correction functions for real-time learning and image processing
Existing computer systems have separate data processing and storage devices, making them inefficient for processing complex data like AI. A KAIST research team has developed a memristor-based integrated system similar to the way our brain processes information. It is now ready for application in various devices including smart security cameras, allowing them to recognize suspicious activity immediately without having to rely on remote cloud servers, and medical devices with which it can help analyze health data in real time.
KAIST (President Kwang Hyung Lee) announced on the 17th of January that the joint research team of Professor Shinhyun Choi and Professor Young-Gyu Yoon of the School of Electrical Engineering has developed a next-generation neuromorphic semiconductor-based ultra-small computing chip that can learn and correct errors on its own.
< Figure 1. Scanning electron microscope (SEM) image of a computing chip equipped with a highly reliable selector-less 32×32 memristor crossbar array (left). Hardware system developed for real-time artificial intelligence implementation (right). >
What is special about this computing chip is that it can learn and correct errors that occur due to non-ideal characteristics that were difficult to solve in existing neuromorphic devices. For example, when processing a video stream, the chip learns to automatically separate a moving object from the background, and it becomes better at this task over time.
This self-learning ability has been proven by achieving accuracy comparable to ideal computer simulations in real-time image processing. The research team's main achievement is that it has completed a system that is both reliable and practical, beyond the development of brain-like components.
The research team has developed the world's first memristor-based integrated system that can adapt to immediate environmental changes, and has presented an innovative solution that overcomes the limitations of existing technology.
< Figure 2. Background and foreground separation results of an image containing non-ideal characteristics of memristor devices (left). Real-time image separation results through on-device learning using the memristor computing chip developed by our research team (right). >
At the heart of this innovation is a next-generation semiconductor device called a memristor*. The variable resistance characteristics of this device can replace the role of synapses in neural networks, and by utilizing it, data storage and computation can be performed simultaneously, just like our brain cells.
*Memristor: A compound word of memory and resistor, next-generation electrical device whose resistance value is determined by the amount and direction of charge that has flowed between the two terminals in the past.
The research team designed a highly reliable memristor that can precisely control resistance changes and developed an efficient system that excludes complex compensation processes through self-learning. This study is significant in that it experimentally verified the commercialization possibility of a next-generation neuromorphic semiconductor-based integrated system that supports real-time learning and inference.
This technology will revolutionize the way artificial intelligence is used in everyday devices, allowing AI tasks to be processed locally without relying on remote cloud servers, making them faster, more privacy-protected, and more energy-efficient.
“This system is like a smart workspace where everything is within arm’s reach instead of having to go back and forth between desks and file cabinets,” explained KAIST researchers Hakcheon Jeong and Seungjae Han, who led the development of this technology. “This is similar to the way our brain processes information, where everything is processed efficiently at once at one spot.”
The research was conducted with Hakcheon Jeong and Seungjae Han, the students of Integrated Master's and Doctoral Program at KAIST School of Electrical Engineering being the co-first authors, the results of which was published online in the international academic journal, Nature Electronics, on January 8, 2025.
*Paper title: Self-supervised video processing with self-calibration on an analogue computing platform based on a selector-less memristor array ( https://doi.org/10.1038/s41928-024-01318-6 )
This research was supported by the Next-Generation Intelligent Semiconductor Technology Development Project, Excellent New Researcher Project and PIM AI Semiconductor Core Technology Development Project of the National Research Foundation of Korea, and the Electronics and Telecommunications Research Institute Research and Development Support Project of the Institute of Information & communications Technology Planning & Evaluation.
KAIST Team Develops an Insect-Mimicking Semiconductor to Detect Motion
The recent development of an “intelligent sensor” semiconductor that mimics the optic nerve of insects while operating at ultra-high speeds and low power offers extensive expandability into various innovative technologies. This technology is expected to be applied to various fields including transportation, safety, and security systems, contributing to both industry and society.
On February 19, a KAIST research team led by Professor Kyung Min Kim from the Department of Materials Science and Engineering (DMSE) announced the successful developed an intelligent motion detector by merging various memristor* devices to mimic the visual intelligence** of the optic nerve of insects.
*Memristor: a “memory resistor” whose state of resistance changes depending on the input signal
**Visual intelligence: the ability to interpret visual information and perform calculations within the optic nerve
With the recent advances in AI technology, vision systems are being improved by utilizing AI in various tasks such as image recognition, object detection, and motion analysis. However, existing vision systems typically recognize objects and their behaviour from the received image signals using complex algorithms. This method requires a significant amount of data traffic and higher power consumption, making it difficult to apply in mobile or IoT devices.
Meanwhile, insects are known to be able to effectively process visual information through an optic nerve circuit called the elementary motion detector, allowing them to detect objects and recognize their motion at an advanced level. However, mimicking this pathway using conventional silicon integrated circuit (CMOS) technology requires complex circuits, and its implementation into actual devices has thus been limited.
< Figure 1. Working principle of a biological elementary motion detection system. >
Professor Kyung Min Kim’s research team developed an intelligent motion detecting sensor that operates at a high level of efficiency and ultra-high speeds. The device has a simple structure consisting of only two types of memristors and a resistor developed by the team. The two different memristors each carry out a signal delay function and a signal integration and ignition function, respectively. Through them, the team could directly mimic the optic nerve of insects to analyze object movement.
< Figure 2. (Left) Optical image of the M-EMD device in the left panel (scale bar 200 μm) and SEM image of the device in the right panel (scale bar: 20 μm). (Middle) Responses of the M-EMD in positive direction. (Right) Responses of the M-EMD in negative direction. >
To demonstrate its potential for practical applications, the research team used the newly developed motion detector to design a neuromorphic computing system that can predict the path of a vehicle. The results showed that the device used 92.9% less energy compared to existing technology and predicted motion with more accuracy.
< Figure 3. Neuromorphic computing system configuration based on motion recognition devices >
Professor Kim said, “Insects make use of their very simple visual intelligence systems to detect the motion of objects at a surprising high speed. This research is significant in that we could mimic the functions of a nerve using a memristor device.” He added, “Edge AI devices, such as AI-topped mobile phones, are becoming increasingly important. This research can contribute to the integration of efficient vision systems for motion recognition, so we expect it to be applied to various fields such as autonomous vehicles, vehicle transportation systems, robotics, and machine vision.”
This research, conducted by co-first authors Hanchan Song and Min Gu Lee, both Ph.D. candidates at KAIST DMSE, was published in the online issue of Advanced Materials on January 29.
This research was supported by the Mid-Sized Research Project by the National Research Foundation of Korea, the Next-Generation Intelligent Semiconductor Technology Development Project, the PIM Artificial Intelligence Semiconductor Core Technology Development Project, the National Nano Fab Center, and the Leap Research Project by KAIST.
Professor Shinhyun Choi’s team, selected for Nature Communications Editors’ highlight
[ From left, Ph.D. candidates See-On Park and Hakcheon Jeong, along with Master's student Jong-Yong Park and Professor Shinhyun Choi ]
See-On Park, Hakcheon Jeong, Jong-Yong Park - a team of researchers under the leadership of Professor Shinhyun Choi of the School of Electrical Engineering, developed a highly reliable variable resistor (memristor) array that simulates the behavior of neurons using a metal oxide layer with an oxygen concentration gradient, and published their work in Nature Communications. The study was selected as the Nature Communications' Editor's highlight, and as the featured article posted on the main page of the journal's website.
Link : https://www.nature.com/ncomms/
[ Figure 1. The featured image on the main page of the Nature Communications' website introducing the research by Professor Choi's team on the memristor for artificial neurons ]
Thesis title: Experimental demonstration of highly reliable dynamic memristor for artificial neuron and neuromorphic computing.
( https://doi.org/10.1038/s41467-022-30539-6 )
At KAIST, their research was introduced on the 2022 Fall issue of Breakthroughs, the biannual newsletter published by KAIST College of Engineering.
This research was conducted with the support from the Samsung Research Funding & Incubation Center of Samsung Electronics.
Energy-Efficient AI Hardware Technology Via a Brain-Inspired Stashing System
Researchers demonstrate neuromodulation-inspired stashing system for the energy-efficient learning of a spiking neural network using a self-rectifying memristor array
Researchers have proposed a novel system inspired by the neuromodulation of the brain, referred to as a ‘stashing system,’ that requires less energy consumption. The research group led by Professor Kyung Min Kim from the Department of Materials Science and Engineering has developed a technology that can efficiently handle mathematical operations for artificial intelligence by imitating the continuous changes in the topology of the neural network according to the situation. The human brain changes its neural topology in real time, learning to store or recall memories as needed. The research group presented a new artificial intelligence learning method that directly implements these neural coordination circuit configurations.
Research on artificial intelligence is becoming very active, and the development of artificial intelligence-based electronic devices and product releases are accelerating, especially in the Fourth Industrial Revolution age. To implement artificial intelligence in electronic devices, customized hardware development should also be supported. However most electronic devices for artificial intelligence require high power consumption and highly integrated memory arrays for large-scale tasks. It has been challenging to solve these power consumption and integration limitations, and efforts have been made to find out how the human brain solves problems.
To prove the efficiency of the developed technology, the research group created artificial neural network hardware equipped with a self-rectifying synaptic array and algorithm called a ‘stashing system’ that was developed to conduct artificial intelligence learning. As a result, it was able to reduce energy by 37% within the stashing system without any accuracy degradation. This result proves that emulating the neuromodulation in humans is possible.
Professor Kim said, "In this study, we implemented the learning method of the human brain with only a simple circuit composition and through this we were able to reduce the energy needed by nearly 40 percent.”
This neuromodulation-inspired stashing system that mimics the brain’s neural activity is compatible with existing electronic devices and commercialized semiconductor hardware. It is expected to be used in the design of next-generation semiconductor chips for artificial intelligence.
This study was published in Advanced Functional Materials in March 2022 and supported by KAIST, the National Research Foundation of Korea, the National NanoFab Center, and SK Hynix.
-Publication:
Woon Hyung Cheong, Jae Bum Jeon†, Jae Hyun In, Geunyoung Kim, Hanchan Song, Janho An, Juseong Park, Young Seok Kim, Cheol Seong Hwang, and Kyung Min Kim (2022)
“Demonstration of Neuromodulation-inspired Stashing System for Energy-efficient Learning of Spiking Neural Network using a Self-Rectifying Memristor Array,” Advanced FunctionalMaterials March 31, 2022 (DOI: 10.1002/adfm.202200337)
-Profile:
Professor Kyung Min Kimhttp://semi.kaist.ac.kr https://scholar.google.com/citations?user=BGw8yDYAAAAJ&hl=ko
Department of Materials Science and EngineeringKAIST
Leon Chua, the founder of the circuit theory called "memristor," gave a talk at KAIST
Dr. Leon Ong Chua is a circuit theorist and professor in the Department of Electrical Engineering and Computer Sciences at the University of California, Berkeley. He visited KAIST on April 16, 2014 and gave a talk entitled “Memristor: New Device with Intelligence.”
Dr. Chua contributed to the development of nonlinear circuit theory and cellular neural networks (CNN). He was also the first to conceive of memristor which combines the characteristics of memory and resistor. Memristor is a type of resistor, remembering the direction and charge of electrical current that has previously flowed through the resistor. In other words, memristor can retain memory without power. Today, memristor is regarded as the fourth fundamental circuit element, together with capacitors, inductors, and resistors.
In 2008, researchers at Hewlett-Packard (HP) Labs developed the first working model of memristor, which was reported in Nature (May 1st , 2008).
In addition, Dr. Chua is an IEEE fellow and has received numerous awards including the IEEE Kirchhoff Award, the IEEE Neural Network Pioneer Award, the IEEE Third Millennium Medal, and the Top 15 Most Cited Author in Engineering Award.