art
-
AI to Determine When to Intervene with Your Driving
(Professor Uichin Lee (left) and PhD candidate Auk Kim)
Can your AI agent judge when to talk to you while you are driving? According to a KAIST research team, their in-vehicle conservation service technology will judge when it is appropriate to contact you to ensure your safety.
Professor Uichin Lee from the Department of Industrial and Systems Engineering at KAIST and his research team have developed AI technology that automatically detects safe moments for AI agents to provide conversation services to drivers.
Their research focuses on solving the potential problems of distraction created by in-vehicle conversation services. If an AI agent talks to a driver at an inopportune moment, such as while making a turn, a car accident will be more likely to occur.
In-vehicle conversation services need to be convenient as well as safe. However, the cognitive burden of multitasking negatively influences the quality of the service. Users tend to be more distracted during certain traffic conditions. To address this long-standing challenge of the in-vehicle conversation services, the team introduced a composite cognitive model that considers both safe driving and auditory-verbal service performance and used a machine-learning model for all collected data.
The combination of these individual measures is able to determine the appropriate moments for conversation and most appropriate types of conversational services. For instance, in the case of delivering simple-context information, such as a weather forecast, driver safety alone would be the most appropriate consideration. Meanwhile, when delivering information that requires a driver response, such as a “Yes” or “No,” the combination of driver safety and auditory-verbal performance should be considered.
The research team developed a prototype of an in-vehicle conversation service based on a navigation app that can be used in real driving environments. The app was also connected to the vehicle to collect in-vehicle OBD-II/CAN data, such as the steering wheel angle and brake pedal position, and mobility and environmental data such as the distance between successive cars and traffic flow.
Using pseudo-conversation services, the research team collected a real-world driving dataset consisting of 1,388 interactions and sensor data from 29 drivers who interacted with AI conversational agents. Machine learning analysis based on the dataset demonstrated that the opportune moments for driver interruption could be correctly inferred with 87% accuracy.
The safety enhancement technology developed by the team is expected to minimize driver distractions caused by in-vehicle conversation services. This technology can be directly applied to current in-vehicle systems that provide conversation services. It can also be extended and applied to the real-time detection of driver distraction problems caused by the use of a smartphone while driving.
Professor Lee said, “In the near future, cars will proactively deliver various in-vehicle conversation services. This technology will certainly help vehicles interact with their drivers safely as it can fairly accurately determine when to provide conversation services using only basic sensor data generated by cars.”
The researchers presented their findings at the ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp’19) in London, UK. This research was supported in part by Hyundai NGV and by the Next-Generation Information Computing Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT.
(Figure: Visual description of safe enhancement technology for in-vehicle conversation services)
2019.11.13 View 14792 -
Image Analysis to Automatically Quantify Gender Bias in Movies
Many commercial films worldwide continue to express womanhood in a stereotypical manner, a recent study using image analysis showed. A KAIST research team developed a novel image analysis method for automatically quantifying the degree of gender bias in films.
The ‘Bechdel Test’ has been the most representative and general method of evaluating gender bias in films. This test indicates the degree of gender bias in a film by measuring how active the presence of women is in a film. A film passes the Bechdel Test if the film (1) has at least two female characters, (2) who talk to each other, and (3) their conversation is not related to the male characters.
However, the Bechdel Test has fundamental limitations regarding the accuracy and practicality of the evaluation. Firstly, the Bechdel Test requires considerable human resources, as it is performed subjectively by a person. More importantly, the Bechdel Test analyzes only a single aspect of the film, the dialogues between characters in the script, and provides only a dichotomous result of passing the test, neglecting the fact that a film is a visual art form reflecting multi-layered and complicated gender bias phenomena. It is also difficult to fully represent today’s various discourse on gender bias, which is much more diverse than in 1985 when the Bechdel Test was first presented.
Inspired by these limitations, a KAIST research team led by Professor Byungjoo Lee from the Graduate School of Culture Technology proposed an advanced system that uses computer vision technology to automatically analyzes the visual information of each frame of the film. This allows the system to more accurately and practically evaluate the degree to which female and male characters are discriminatingly depicted in a film in quantitative terms, and further enables the revealing of gender bias that conventional analysis methods could not yet detect.
Professor Lee and his researchers Ji Yoon Jang and Sangyoon Lee analyzed 40 films from Hollywood and South Korea released between 2017 and 2018. They downsampled the films from 24 to 3 frames per second, and used Microsoft’s Face API facial recognition technology and object detection technology YOLO9000 to verify the details of the characters and their surrounding objects in the scenes.
Using the new system, the team computed eight quantitative indices that describe the representation of a particular gender in the films. They are: emotional diversity, spatial staticity, spatial occupancy, temporal occupancy, mean age, intellectual image, emphasis on appearance, and type and frequency of surrounding objects.
Figure 1. System Diagram
Figure 2. 40 Hollywood and Korean Films Analyzed in the Study
According to the emotional diversity index, the depicted women were found to be more prone to expressing passive emotions, such as sadness, fear, and surprise. In contrast, male characters in the same films were more likely to demonstrate active emotions, such as anger and hatred.
Figure 3. Difference in Emotional Diversity between Female and Male Characters
The type and frequency of surrounding objects index revealed that female characters and automobiles were tracked together only 55.7 % as much as that of male characters, while they were more likely to appear with furniture and in a household, with 123.9% probability.
In cases of temporal occupancy and mean age, female characters appeared less frequently in films than males at the rate of 56%, and were on average younger in 79.1% of the cases. These two indices were especially conspicuous in Korean films.
Professor Lee said, “Our research confirmed that many commercial films depict women from a stereotypical perspective. I hope this result promotes public awareness of the importance of taking prudence when filmmakers create characters in films.”
This study was supported by KAIST College of Liberal Arts and Convergence Science as part of the Venture Research Program for Master’s and PhD Students, and will be presented at the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) on November 11 to be held in Austin, Texas.
Publication:
Ji Yoon Jang, Sangyoon Lee, and Byungjoo Lee. 2019. Quantification of Gender Representation Bias in Commercial Films based on Image Analysis. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). ACM, New York, NY, USA, Article 198, 29 pages. https://doi.org/10.1145/3359300
Link to download the full-text paper:
https://files.cargocollective.com/611692/cscw198-jangA--1-.pdf
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Ji Yoon Jang, M.S.
yoone3422@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Sangyoon Lee, M.S. Candidate
sl2820@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
(END)
2019.10.17 View 22666 -
Object Identification and Interaction with a Smartphone Knock
(Professor Lee (far right) demonstrate 'Knocker' with his students.)
A KAIST team has featured a new technology, “Knocker”, which identifies objects and executes actions just by knocking on it with the smartphone. Software powered by machine learning of sounds, vibrations, and other reactions will perform the users’ directions.
What separates Knocker from existing technology is the sensor fusion of sound and motion. Previously, object identification used either computer vision technology with cameras or hardware such as RFID (Radio Frequency Identification) tags. These solutions all have their limitations. For computer vision technology, users need to take pictures of every item. Even worse, the technology will not work well in poor lighting situations. Using hardware leads to additional costs and labor burdens.
Knocker, on the other hand, can identify objects even in dark environments only with a smartphone, without requiring any specialized hardware or using a camera. Knocker utilizes the smartphone’s built-in sensors such as a microphone, an accelerometer, and a gyroscope to capture a unique set of responses generated when a smartphone is knocked against an object. Machine learning is used to analyze these responses and classify and identify objects.
The research team under Professor Sung-Ju Lee from the School of Computing confirmed the applicability of Knocker technology using 23 everyday objects such as books, laptop computers, water bottles, and bicycles. In noisy environments such as a busy café or on the side of a road, it achieved 83% identification accuracy. In a quiet indoor environment, the accuracy rose to 98%.
The team believes Knocker will open a new paradigm of object interaction. For instance, by knocking on an empty water bottle, a smartphone can automatically order new water bottles from a merchant app. When integrated with IoT devices, knocking on a bed’s headboard before going to sleep could turn off the lights and set an alarm. The team suggested and implemented 15 application cases in the paper, presented during the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2019) held in London last month.
Professor Sung-Ju Lee said, “This new technology does not require any specialized sensor or hardware. It simply uses the built-in sensors on smartphones and takes advantage of the power of machine learning. It’s a software solution that everyday smartphone users could immediately benefit from.” He continued, “This technology enables users to conveniently interact with their favorite objects.”
The research was supported in part by the Next-Generation Information Computing Development Program through the National Research Foundation of Korea funded by the Ministry of Science and ICT and an Institute for Information & Communications Technology Promotion (IITP) grant funded by the Ministry of Science and ICT.
Figure: An example knock on a bottle. Knocker identifies the object by analyzing a unique set of responses from the knock, and automatically launches a proper application or service.
2019.10.02 View 25336 -
Distinguished Professor Sukbok Chang Donates His Prize Money
The honoree of the 2019 Korea Best Scientist and Technologist Award, Distinguished Professor Sukbok Chang donated his prize money of one hundred million KRW to the Chemistry Department Scholarship Fund and the Lyu Keun-Chul Sports Complex Management Fund during a donation ceremony last week.
Professor Chang won the award last month in recognition of his pioneering achievements and lifetime contributions to the development of carbon-hydrogen activation strategies, especially for carbon-carbon, carbon-nitrogen, and carbon-oxygen formations. Professor Chang, a world renowned chemist, has been recognized for his highly selective catalytic systems, allowing the controlled defunctionalization of bio-derived platform substrates under mild conditions and opening a new avenue for the utilization of biomass-derived platform chemicals.
“All my achievements are the results of my students’ hard work and dedication. I feel very fortunate to have such talented team members. I want to express my sincere gratitude for such a great research environment that we have worked together in so far,” said Professor Chang at the ceremony.
KAIST President Sung-Chul Shin said, “Not only will Professor Chang’s donation make a significant contribution to the Department of Chemistry, but also to the improvement of the Lyu Keun-Chul Sports Complex’s management, which directly links to the health and welfare of the KAIST community.”
Professor Chang currently holds the position of distinguished professor at KAIST and director of the Center for Catalytic Hydrocarbon Functionalizations in the Institute for Basic Science (IBS). He previously received the Kyung-Ahm Academic Award in 2013 and the Korea Toray Science Award in 2018. All these prize money also went to the school.
(END)
2019.08.26 View 6824 -
Artificial Muscles Bloom, Dance, and Wave
Wearing a flower brooch that blooms before your eyes sounds like magic. KAIST researchers have made it real with robotic muscles.
Researchers have developed an ultrathin, artificial muscle for soft robotics. The advancement, recently reported in the journal Science Robotics, was demonstrated with a robotic blooming flower brooch, dancing robotic butterflies and fluttering tree leaves on a kinetic art piece.
The robotic equivalent of a muscle that can move is called an actuator. The actuator expands, contracts or rotates like muscle fibers using a stimulus such as electricity. Engineers around the world are striving to develop more dynamic actuators that respond quickly, can bend without breaking, and are very durable. Soft, robotic muscles could have a wide variety of applications, from wearable electronics to advanced prosthetics.
The team from KAIST’s Creative Research Initiative Center for Functionally Antagonistic Nano-Engineering developed a very thin, responsive, flexible and durable artificial muscle. The actuator looks like a skinny strip of paper about an inch long. They used a particular type of material called MXene, which is class of compounds that have layers only a few atoms thick.
Their chosen MXene material (T3C2Tx) is made of thin layers of titanium and carbon compounds. It was not flexible by itself; sheets of material would flake off the actuator when bent in a loop. That changed when the MXene was “ionically cross-linked” — connected through an ionic bond — to a synthetic polymer. The combination of materials made the actuator flexible, while still maintaining strength and conductivity, which is critical for movements driven by electricity.
Their particular combination performed better than others reported. Their actuator responded very quickly to low voltage, and lasted for more than five hours moving continuously.
To prove the tiny robotic muscle works, the team incorporated the actuator into wearable art: an origami-inspired brooch mimics how a narcissus flower unfolds its petals when a small amount of electricity is applied. They also designed robotic butterflies that move their wings up and down, and made the leaves of a tree sculpture flutter.
“Wearable robotics and kinetic art demonstrate how robotic muscles can have fun and beautiful applications,” said Il-Kwon Oh, lead paper author and professor of mechanical engineering. “It also shows the enormous potential for small, artificial muscles for a variety of uses, such as haptic feedback systems and active biomedical devices.”
The team next plans to investigate more practical applications of MXene-based soft actuators and other engineering applications of MXene 2D nanomaterials.
2019.08.22 View 23736 -
Three Professors Receive Han Sung Science Awards
Three KAIST professors swept the 2nd Han Sung Science Awards. Professor Bum-Ki Min from the Departments of Mechanical Engineering and Physics, Professor Sun-Kyu Han from the Department of Chemistry, and Professor Seung-Jae Lee from the Department of Biological Sciences won all three awards presented by the Han Sung Scholarship Foundation, which recognizes promising mid-career scientists in the fields of physics, chemistry, and biological sciences. The awards ceremony will take place on August 16 in Hwaseong.
Professor Min was declared as the winner of the physics field in recognition of his outstanding research activities including searching for new application areas for metamaterials and investigating their unexplored functionalities. The metamaterials with a high index of refraction developed by Professor Min’s research team have caught the attention of scientists worldwide, as they can help develop high-resolution imaging systems and ultra-small, hyper-sensitive optical devices.
The chemistry field winner, Professor Han, is the youngest awardee so far at 36 years of age. He is often described as one of the most promising next-generation Korean scientists in the field of the total synthesis of complex natural products. Given the fact that this field takes very long-term research, he is making unprecedented research achievements. He is focusing on convergent and flexible synthetic approaches that enable access to not only a single target but various natural products with structural and biosynthetic relevance as well as unnatural products with higher biological potency.
Professor Lee was recognized for his contributions to the advancement of biological sciences, especially in aging research. Professor Lee’s team is taking a novel approach by further investigating complex interactions between genetic and environmental factors that affect aging, and identifying genes that mediate the effects. The team has been conducting large-scale gene discovery efforts by employing RNA sequencing analysis, RNAi screening, and chemical mutagenesis screening. They are striving to determine the functional significance of candidate genes obtained from these experiments and mechanistically characterize these genes.
(END)
2019.07.03 View 7866 -
Engineered Microbial Production of Grape Flavoring
(Image 1: Engineered bacteria that produce grape flavoring.)
Researchers report a microbial method for producing an artificial grape flavor. Methyl anthranilate (MANT) is a common grape flavoring and odorant compound currently produced through a petroleum-based process that uses large volumes of toxic acid catalysts.
Professor Sang-Yup Lee’s team at the Department of Chemical and Biomolecular Engineering demonstrated production of MANT, a naturally occurring compound, via engineered bacteria. The authors engineered strains of Escherichia coli and Corynebacetrium glutamicum to produce MANT through a plant-based engineered metabolic pathway.
The authors tuned the bacterial metabolic pathway by optimizing the levels of AAMT1, the key enzyme in the process. To maximize production of MANT, the authors tested six strategies, including increasing the supply of a precursor compound and enhancing the availability of a co-substrate. The most productive strategy proved to be a two-phase extractive culture, in which MANT was extracted into a solvent. This strategy produced MANT on the scale of 4.47 to 5.74 grams per liter, a significant amount, considering that engineered microbes produce most natural products at a scale of milligrams or micrograms per liter.
According to the authors, the results suggest that MANT and other related molecules produced through industrial processes can be produced at scale by engineered microbes in a manner that would allow them to be marketed as natural one, instead of artificial one.
This study, featured at the Proceeding of the National Academy of Sciences of the USA on May 13, was supported by the Technology Development Program to Solve Climate Changes on Systems Metabolic Engineering for Biorefineries from the Ministry of Science and ICT.
(Image 2. Overview of the strategies applied for the microbial production of grape flavoring.)
2019.05.15 View 52747 -
Education Innovation Day Reaffirms Rewarding of Excellence
Professors Tae-Eog Lee and Il-Chul Moon from the Department of Industrial & Systems Engineering received the Linkgenesis Best Teacher Award and the Soo-Young Lee Teaching Innovation Award on May 10. They were each awarded with 10 million KRW in prize money during the Education Innovation Day ceremony held at the Chung Kun-mo conference hall.
The award was endowed by KAIST Alumni Scholarship Chairman Hyung-Kyu Lim and KAIST Foundation Chairman Soo-Young Lee to support the innovation initiative and acknowledge faculty members who made significant contributions to educational innovation and benefited the general public though their innovations.
“KAIST’s vision for excellence and commitment to innovation is a game changer. Educational innovation is one of five pillars of Vision 2031, and it is our priority to foster critical and creative thinking students,” said President Sung-Chul Shin at the ceremony. All the awardees made presentation on their innovative projects and shared their ideas on better pedagogical methodology for next generation.
Professor Lee, dean of the KAIST Academy and the head of the Center for Excellence in Learning & Teaching was recognized for his contribution to enhancing educational quality through innovative learning and teaching methodology development. He has set up an Education 3.0 Initiative, an online education platform for flipped learning at KAIST.
Professor Moon also upgraded the online education platform to the 4.0 version and extended KAIST’s massive online courses through KOOC framework. This open platform offers more than 62 courses, with more than 170 thousand users registered since 2014.
Professor Song-Hong Park from the Department of Bio and Brain Engineering and Professor Jae-Woo Lee from the Department of Chemical and Biomolecular Engineering also won the Excellence Award.
2019.05.10 View 7116 -
KAIST-KU Joint Research Center for Smart Healthcare & Transportation
(President Shin shakes hands with KU acting Presidedent Arif Al Hammdi at the KAIST-KU Joint Research Center opening ceremony on April 8.)
KAIST opened the KAIST-Khalifa University Joint Research Center with Khalifa University on April 8. The opening ceremony was held at Khalifa University and was attended by President Sung-Chul Shin and Khalifa University Acting President Arif Al Hammadi.
The new research center reflects the evolution of the long-established partnership between the two institutions. The two universities have already made very close collaborations in research and education in the fields of nuclear and quantum engineering.
The launch of this center expanded their fields of collaboration to smart healthcare and smart transportation, key emerging sectors in the Fourth Industrial Revolution. President Shin signed an MOU with the UAE Minister of State for Advanced Science Sarah Amiri and Khalifa University to expand mutual collaboration in technology development and fostering human capital last year.
The center will conduct research and education on autonomous vehicles, infrastructure for autonomous vehicle operation, wireless charging for electric vehicles, and infrastructure for electric autonomous vehicles. As for smart healthcare, the center will focus on healthcare robotics as well as sensors and wearable devices for personal healthcare services.
President Shin, who accompanied a research team from the Graduate School of Green Transportation, said, “We are very delighted to enter into this expanded collaboration with KU. This partnership justifies our long-standing collaboration in the areas of emerging technologies in the Fourth Industrial Revolution while fostering human capital.”
KU Acting President Arif Al Hammadi added, “The outcome of these research projects will establish the status of both institutions as champions of the Fourth Industrial Revolution, bringing benefits to our communities. We believe the new research center will further consolidate our status as a globally active, research-intensive academic institution, developing international collaborations that benefit the community in general.”
2019.04.09 View 6797 -
Unravelling Inherent Electrocatalysis to Improve the Performance of Hydrogen Fuel Cells
(Figure 1. Electrode structure for the precise evaluation of the metal nanoparticles’ electrochemical catalytic characteristics at a high temperature.)
A KAIST team presented an ideal electrode design to enhance the performance of high-temperature fuel cells. The new analytical platform with advanced nanoscale patterning method quantitatively revealed the electrochemical value of metal nanoparticles dispersed on the oxide electrode, thus leading to electrode design directions that can be used in a variety of eco-friendly energy technologies.
The team, working under Professor WooChul Jung and Professor Sang Ouk Kim at the Department of Materials Science and Engineering, described an accurate analysis of the reactivity of oxide electrodes boosted by metal nanoparticles, where all particles participate in the reaction. They identified how the metal catalysts activate hydrogen electro-oxidation on the ceria-based electrode surface and quantify how rapidly the reaction rate increases with the proper choice of metals.
Metal nanoparticles with diameters of 10 nanometers or less have become a key component in high-performance heterogeneous catalysts, primarily serving as a catalytic activator. Recent experimental and theoretical findings suggest that the optimization of the chemical nature at the metal and support interfaces is essential for performance improvement.
However, the high cost associated with cell fabrication and operation as well as poorer stability of metal nanoparticles at high temperatures have been a long-standing challenge. To solve this problem, the team utilized a globally recognized metal nano patterning technology that uses block copolymer self-assembled nano templates and succeeded in uniformly synthesizing metal particles 10 nanometers in size on the surface of oxide fuel cell electrodes. They also developed a technology to accurately analyze the catalyst characteristics of single particles at high temperatures and maximize the performance of a fuel cell with minimal catalyst use.
The research team confirmed that platinum, which is a commonly used metal catalyst, could boost fuel cell performance by as much as 21 times even at an amount of 300 nanograms, which only costs about 0.015 KRW.
The team quantitatively identified and compared the characteristics of widely used metal catalysts other than platinum, such as palladium, gold, and cobalt, and also elucidated the precise principle of catalyst performance through theoretical analysis.
(Figure 2. Comparison of the electrochemical catalytic characteristics for various 10nm metal nanoparticles (platinum, palladium, cobalt, gold) at a high temperature.)
Professor Jung said, "We have broken the conventional methods of increasing the amount of catalyst which have deemed inefficient and expensive. Our results suggest a clear idea for high performance fuel cells using very small amounts of nanoparticles. This technology can be applied to many different industrial fields, advancing the commercialization of eco-friendly energy technologies such as fuel cells that generate electricity and electrolytic cells that produce hydrogen from water.”
The research has been published as the cover article of Nature Nanotechnology in the March issue. This research was carried out with support from the Nano-Material Technology Development Program through the National Research Foundation of Korea.
2019.03.28 View 29338 -
President Shin Speaks on Closing the Skills Gap at the WEF
(President Shin poses (far right) with the National University of Singapore President Tan Eng Chye (center) along with Distinguished Professor Sang Yup Lee in Davos last week.)
President Sung-Chul Shin shared his ideas on how reskilling is a critical element of growth, dynamism, and competitiveness for countries during a session titled “Closing the Skills Gap: Creating a Reskilling Revolution” at the World Economic Forum on January 24 in Davos.
While discussing a reskilling imperative alongside French Labor Minister Muriel Penicaud, he presented how the Korean government and KAIST are responding to the socio-economic transformation of workforces in the Fourth Industrial Revolution. After their presentation, Minister of Economy and Enterprise of Spain Nadia Calvirno Santamaria, Minister of Commerce and Industry of Oman Ali bin Masoud bin Ali Al Sunaidy, and Minister of Petroleum and Natural Gas, Skill Development, and Entrepreneurship of India Dharmendra Pradhan shared their views on the course of decision making regarding the proactive practices and policies they have applied for closing the gaps from their countries’ perspectives.
President Shin presented how to upskill and reskill SMEs and startups, the real players who will jumpstart the economy in the Fourth Industrial Revolution. He explained that the government is striving to change the existing structure of the economy, which is dominated by a few giant conglomerates. He added that the Korean government is trying to support SMEs and startups in terms of both funding and technology reskilling in order to rejuvenate the economy.
To better align itself with the government’s efforts, KAIST has introduced SME 4.0. SME 4.0 proposes to innovate the production process through the creation of a partnered platform between KAIST and SMEs across the country. With this platform, KAIST assists local SMEs for standardizing and systemizing all their processes of production, delivery, and management with enterprise resources planning (ERP) and manufacturing execution systems (MES). In addition, SME 4.0 offers retraining and re-tooling programs by linking the data generated through this platform in real time to better facilitate SMEs’ smart business.
(President Shin shakes hands with H.E.Mohammed Al-Tuwairi, Minister of Economy and Planning of Saudi Arabia before holding a bilaterla meeting in Davos.)
President Shin also explained about upskilling the leading corporations’ technological competitiveness, partnering with major leading corporations for upskilling their advanced technologies.
He also held a series of bilateral meetings with dignitaries attending the WEF annual meeting to discuss partnerships and collaborations. He also attended the Global University Leaders Forum (GULF), a community composed of 28 presidents from the world’s top universities on January 23. President Shin, who is on the advisory board of the Center for Fourth Industrial Revolution (C4IR), also participated in the board meeting and discussed the upcoming launching of the Korea C4IR, which will open at KAIST in March.
2019.01.28 View 6141 -
Sound-based Touch Input Technology for Smart Tables and Mirrors
(from left: MS candidate Anish Byanjankar, Research Assistant Professor Hyosu Kim and Professor Insik Shin)
Time passes so quickly, especially in the morning. Your hands are so busy brushing your teeth and checking the weather on your smartphone. You might wish that your mirror could turn into a touch screen and free up your hands. That wish can be achieved very soon. A KAIST team has developed a smartphone-based touch sound localization technology to facilitate ubiquitous interactions, turning objects like furniture and mirrors into touch input tools.
This technology analyzes touch sounds generated from a user’s touch on a surface and identifies the location of the touch input. For instance, users can turn surrounding tables or walls into virtual keyboards and write lengthy e-mails much more conveniently by using only the built-in microphone on their smartphones or tablets. Moreover, family members can enjoy a virtual chessboard or enjoy board games on their dining tables.
Additionally, traditional smart devices such as smart TVs or mirrors, which only provide simple screen display functions, can play a smarter role by adding touch input function support (see the image below).
Figure 1.Examples of using touch input technology: By using only smartphone, you can use surrounding objects as a touch screen anytime and anywhere.
The most important aspect of enabling the sound-based touch input method is to identify the location of touch inputs in a precise manner (within about 1cm error). However, it is challenging to meet these requirements, mainly because this technology can be used in diverse and dynamically changing environments. Users may use objects like desks, walls, or mirrors as touch input tools and the surrounding environments (e.g. location of nearby objects or ambient noise level) can be varied. These environmental changes can affect the characteristics of touch sounds.
To address this challenge, Professor Insik Shin from the School of Computing and his team focused on analyzing the fundamental properties of touch sounds, especially how they are transmitted through solid surfaces.
On solid surfaces, sound experiences a dispersion phenomenon that makes different frequency components travel at different speeds. Based on this phenomenon, the team observed that the arrival time difference (TDoA) between frequency components increases in proportion to the sound transmission distance, and this linear relationship is not affected by the variations of surround environments.
Based on these observations, Research Assistant Professor Hyosu Kim proposed a novel sound-based touch input technology that records touch sounds transmitted through solid surfaces, then conducts a simple calibration process to identify the relationship between TDoA and the sound transmission distance, finally achieving accurate touch input localization.
The accuracy of the proposed system was then measured. The average localization error was lower than about 0.4 cm on a 17-inch touch screen. Particularly, it provided a measurement error of less than 1cm, even with a variety of objects such as wooden desks, glass mirrors, and acrylic boards and when the position of nearby objects and noise levels changed dynamically. Experiments with practical users have also shown positive responses to all measurement factors, including user experience and accuracy.
Professor Shin said, “This is novel touch interface technology that allows a touch input system just by installing three to four microphones, so it can easily turn nearby objects into touch screens.”
The proposed system was presented at ACM SenSys, a top-tier conference in the field of mobile computing and sensing, and was selected as a best paper runner-up in November 2018.
(The demonstration video of the sound-based touch input technology)
2018.12.26 View 7597