Ki-Hun+Jeong
-
AI Light-Field Camera Reads 3D Facial Expressions
Machine-learned, light-field camera reads facial expressions from high-contrast illumination invariant 3D facial images
A joint research team led by Professors Ki-Hun Jeong and Doheon Lee from the KAIST Department of Bio and Brain Engineering reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.
Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smart phone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.
However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.
The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54% of image reconstruction errors. Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.
Through this technique, the team could overcome the limitations of existing light-field cameras and was able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.
The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85% accuracy – a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.
Professor Ki-Hun Jeong said, “The sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyze the facial expressions and emotions of humans.” To highlight the significance of this research, he added, “It could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions.”
This research was published in Advanced Intelligent Systems online on December 16, under the title, “Machine-Learned Light-field Camera that Reads Facial Expression from High-Contrast and Illumination Invariant 3D Facial Images.” This research was funded by the Ministry of Science and ICT and the Ministry of Trade, Industry and Energy.
-Publication“Machine-learned light-field camera that reads fascial expression from high-contrast and illumination invariant 3D facial images,” Sang-In Bae, Sangyeon Lee, Jae-Myeong Kwon, Hyun-Kyung Kim. Kyung-Won Jang, Doheon Lee, Ki-Hun Jeong, Advanced Intelligent Systems, December 16, 2021 (doi.org/10.1002/aisy.202100182)
ProfileProfessor Ki-Hun JeongBiophotonic LaboratoryDepartment of Bio and Brain EngineeringKAIST
Professor Doheon LeeDepartment of Bio and Brain EngineeringKAIST
2022.01.21 View 9642 -
Ultrafast, on-Chip PCR Could Speed Up Diagnoses during Pandemics
A rapid point-of-care diagnostic plasmofluidic chip can deliver result in only 8 minutes
Reverse transcription-polymerase chain reaction (RT-PCR) has been the gold standard for diagnosis during the COVID-19 pandemic. However, the PCR portion of the test requires bulky, expensive machines and takes about an hour to complete, making it difficult to quickly diagnose someone at a testing site. Now, researchers at KAIST have developed a plasmofluidic chip that can perform PCR in only about 8 minutes, which could speed up diagnoses during current and future pandemics.
The rapid diagnosis of COVID-19 and other highly contagious viral diseases is important for timely medical care, quarantining and contact tracing. Currently, RT-PCR uses enzymes to reverse transcribe tiny amounts of viral RNA to DNA, and then amplifies the DNA so that it can be detected by a fluorescent probe. It is the most sensitive and reliable diagnostic method.
But because the PCR portion of the test requires 30-40 cycles of heating and cooling in special machines, it takes about an hour to perform, and samples must typically be sent away to a lab, meaning that a patient usually has to wait a day or two to receive their diagnosis.
Professor Ki-Hun Jeong at the Department of Bio and Brain Engineering and his colleagues wanted to develop a plasmofluidic PCR chip that could quickly heat and cool miniscule volumes of liquids, allowing accurate point-of-care diagnoses in a fraction of the time. The research was reported in ACS Nano on May 19.
The researchers devised a postage stamp-sized polydimethylsiloxane chip with a microchamber array for the PCR reactions. When a drop of a sample is added to the chip, a vacuum pulls the liquid into the microchambers, which are positioned above glass nanopillars with gold nanoislands. Any microbubbles, which could interfere with the PCR reaction, diffuse out through an air-permeable wall. When a white LED is turned on beneath the chip, the gold nanoislands on the nanopillars quickly convert light to heat, and then rapidly cool when the light is switched off.
The researchers tested the device on a piece of DNA containing a SARS-CoV-2 gene, accomplishing 40 heating and cooling cycles and fluorescence detection in only 5 minutes, with an additional 3 minutes for sample loading. The amplification efficiency was 91%, whereas a comparable conventional PCR process has an efficiency of 98%. With the reverse transcriptase step added prior to sample loading, the entire testing time with the new method could take 10-13 minutes, as opposed to about an hour for typical RT-PCR testing. The new device could provide many opportunities for rapid point-of-care diagnostics during a pandemic, the researchers say.
-Publication
Ultrafast and Real-Time Nanoplasmonic On-Chip Polymerase Chain Reaction for Rapid and Quantitative Molecular Diagnostics
ACS Nano (https://doi.org/10.1021/acsnano.1c02154)
-Professor
Ki-Hun Jeong
Biophotonics Laboratory
https://biophotonics.kaist.ac.kr/
Department of Bio and Brain Engineeinrg
KAIST
2021.06.08 View 8367 -
KAIST Showcases Healthcare Technologies at K-Hospital Fair 2020
KAIST Pavilion showcased its innovative medical and healthcare technologies and their advanced applications at the K-Hospital Fair 2020. Five KAIST research groups who teamed up for the Post-COVID-19 New Deal R&D Initiative Project participated in the fair held in Seoul last week.
The K-Hospital Fair is a yearly event organized by the Korean Hospital Association to present the latest research and practical innovations to help the medical industry better serve the patients. This year, 120 healthcare organizations participated in the fair and operated 320 booths.
At the fair, a research group led by Professor Il-Doo Kim from the Department of Materials Science and Engineering demonstrated the manufacturing process of orthogonal nanofibers used to develop their ‘recyclable nano-fiber filtered face mask’ introduced in March of this year. This mask has garnered immense international attention for maintaining its sturdy frame and filtering function even after being washed more than 20 times. Professor Kim is now extending his facilities for the mass production of this mask at his start-up company. While awaiting final approval from the Ministry of Food and Drug Safety to bring his product into the market, Professor Kim is developing other mask variations such as eco-friendly biodegradable masks and transparent masks to aid the hearing-impaired who rely on lip reading to communicate.
The team working under Professor Wonho Choe from the Department of Nuclear and Quantum Engineering presented two low-temperature plasma sterilizers for medical use, co-developed with Plasmapp, a start-up company founded by a KAIST alumnus. Their sterilizers are the first ones that can sterilize medical devices by diffusing hydrogen peroxide vapor into the pouch. They rapidly sterilize medical instruments and materials in just seven minutes without leaving toxic residue, while reducing sterilization time and costs by 90%.
Professor Hyung-Soon Park and his researchers from the Department of Mechanical Engineering introduced a smart protective suit ventilation system that features high cooling capacity and a slimmed-down design. For comfortable use, the suit is equipped with a technique that monitors its inner temperature and humidity and automatically controls its inner circulation accordingly. The group also presented a new system that helps a person in a contaminated suit undress without coming into contact with the contaminated outer part of the suit.
Professor Jong Chul Ye's group from the Department of Bio and Brain Engineering demonstrated AI software that can quickly diagnose an infectious disease based on chest X-ray imaging. The technique compares the differences in the severity of pneumonia in individual patients to distinguish whether their conditions fall under viral pneumonia including COVID-19, bacterial pneumonia, tuberculosis, other diseases, or normal conditions. The AI software visualizes the basis of its reasoning for each of the suspected diseases and provides them as information that can be utilized by medical personnel.
Finally, researchers of Professor Ki-Hun Jeong’s team from the Department of Bio and Brain Engineering demonstrated their ultra-high-speed sub-miniature molecular diagnostic system for the on-site diagnosis of diseases. The existing Polymerase Chain Reaction (PCR) diagnostic usually takes from 30 minutes to an hour to provide results, but their new technique using an LED light source can present results within just three minutes and it is expected to be used actively for on-site diagnosis.
Professor Choongsik Bae, the Director of the Post-COVID-19 New Deal R&D Initiative Project, said, “KAIST will build a healthy relationship amongst researchers, enterprises, and hospitals to contribute to the end of COVID-19 and build a new paradigm of Korean disease prevention and control.”
KAIST launched the Post-COVID-19 New Deal R&D Initiative in July with the support of the Ministry of Science and ICT of Korea. This unit was created to overcome the pandemic crisis by using science and technology, and to contribute to economic development by creating a new antiviral drug industry. The unit is comprised of 464 KAIST members including professors, researchers, and students as well as 503 professionals from enterprises, hospitals, and research centers.
(END)
2020.10.26 View 11890 -
Ultrathin but Fully Packaged High-Resolution Camera
- Biologically inspired ultrathin arrayed camera captures super-resolution images. -
The unique structures of biological vision systems in nature inspired scientists to design ultracompact imaging systems. A research group led by Professor Ki-Hun Jeong have made an ultracompact camera that captures high-contrast and high-resolution images. Fully packaged with micro-optical elements such as inverted micro-lenses, multilayered pinhole arrays, and gap spacers on the image sensor, the camera boasts a total track length of 740 μm and a field of view of 73°.
Inspired by the eye structures of the paper wasp species Xenos peckii, the research team completely suppressed optical noise between micro-lenses while reducing camera thickness. The camera has successfully demonstrated high-contrast clear array images acquired from tiny micro lenses. To further enhance the image quality of the captured image, the team combined the arrayed images into one image through super-resolution imaging.
An insect’s compound eye has superior visual characteristics, such as a wide viewing angle, high motion sensitivity, and a large depth of field while maintaining a small volume of visual structure with a small focal length. Among them, the eyes of Xenos peckii and an endoparasite found on paper wasps have hundreds of photoreceptors in a single lens unlike conventional compound eyes. In particular, the eye structures of an adult Xenos peckii exhibit hundreds of photoreceptors on an individual eyelet and offer engineering inspiration for ultrathin cameras or imaging applications because they have higher visual acuity than other compound eyes.
For instance, Xenos peckii’s eye-inspired cameras provide a 50 times higher spatial resolution than those based on arthropod eyes. In addition, the effective image resolution of the Xenos peckii’s eye can be further improved using the image overlaps between neighboring eyelets. This unique structure offers higher visual resolution than other insect eyes.
The team achieved high-contrast and super-resolution imaging through a novel arrayed design of micro-optical elements comprising multilayered aperture arrays and inverted micro-lens arrays directly stacked over an image sensor. This optical component was integrated with a complementary metal oxide semiconductor image sensor.
This is first demonstration of super-resolution imaging which acquires a single integrated image with high contrast and high resolving power reconstructed from high-contrast array images. It is expected that this ultrathin arrayed camera can be applied for further developing mobile devices, advanced surveillance vehicles, and endoscopes.
Professor Jeong said, “This research has led to technological advances in imaging technology. We will continue to strive to make significant impacts on multidisciplinary research projects in the fields of microtechnology and nanotechnology, seeking inspiration from natural photonic structures.”
This work was featured in Light Science & Applications last month and was supported by the National Research Foundation (NRF) of and the Ministry of Health and Welfare (MOHW) of Korea.
Image credit: Professor Ki-Hun Jeong, KAIST
Image usage restrictions: News organizations may use or redistribute this image, with proper attribution, as part of news coverage of this paper only.
Publication:
Kisoo Kim, Kyung-Won Jang, Jae-Kwan Ryu, and Ki-Hun Jeong. (2020) “Biologically inspired ultrathin arrayed camera for high-contrast and high-resolution imaging”. Light Science & Applications. Volume 9. Article 28. Available online at https://doi.org/10.1038/s41377-020-0261-8
Profile:
Ki-Hun Jeong
Professor
kjeong@kaist.ac.kr
http://biophotonics.kaist.ac.kr/
Department of Bio and Brain Engineering
KAIST
Profile:
Kisoo Kim
Ph.D. Candidate
kisoo.kim1@kaist.ac.kr
http://biophotonics.kaist.ac.kr/
Department of Bio and Brain Engineering
KAIST
(END)
2020.03.23 View 15195