Global+Singularity+Research
-
Deep Learning Framework to Enable Material Design in Unseen Domain
Researchers propose a deep neural network-based forward design space exploration using active transfer learning and data augmentation
A new study proposed a deep neural network-based forward design approach that enables an efficient search for superior materials far beyond the domain of the initial training set. This approach compensates for the weak predictive power of neural networks on an unseen domain through gradual updates of the neural network with active transfer learning and data augmentation methods.
Professor Seungwha Ryu believes that this study will help address a variety of optimization problems that have an astronomical number of possible design configurations. For the grid composite optimization problem, the proposed framework was able to provide excellent designs close to the global optima, even with the addition of a very small dataset corresponding to less than 0.5% of the initial training data-set size. This study was reported in npj Computational Materials last month.
“We wanted to mitigate the limitation of the neural network, weak predictive power beyond the training set domain for the material or structure design,” said Professor Ryu from the Department of Mechanical Engineering.
Neural network-based generative models have been actively investigated as an inverse design method for finding novel materials in a vast design space. However, the applicability of conventional generative models is limited because they cannot access data outside the range of training sets. Advanced generative models that were devised to overcome this limitation also suffer from weak predictive power for the unseen domain.
Professor Ryu’s team, in collaboration with researchers from Professor Grace Gu’s group at UC Berkeley, devised a design method that simultaneously expands the domain using the strong predictive power of a deep neural network and searches for the optimal design by repetitively performing three key steps.
First, it searches for few candidates with improved properties located close to the training set via genetic algorithms, by mixing superior designs within the training set. Then, it checks to see if the candidates really have improved properties, and expands the training set by duplicating the validated designs via a data augmentation method. Finally, they can expand the reliable prediction domain by updating the neural network with the new superior designs via transfer learning. Because the expansion proceeds along relatively narrow but correct routes toward the optimal design (depicted in the schematic of Fig. 1), the framework enables an efficient search.
As a data-hungry method, a deep neural network model tends to have reliable predictive power only within and near the domain of the training set. When the optimal configuration of materials and structures lies far beyond the initial training set, which frequently is the case, neural network-based design methods suffer from weak predictive power and become inefficient.
Researchers expect that the framework will be applicable for a wide range of optimization problems in other science and engineering disciplines with astronomically large design space, because it provides an efficient way of gradually expanding the reliable prediction domain toward the target design while avoiding the risk of being stuck in local minima. Especially, being a less-data-hungry method, design problems in which data generation is time-consuming and expensive will benefit most from this new framework.
The research team is currently applying the optimization framework for the design task of metamaterial structures, segmented thermoelectric generators, and optimal sensor distributions. “From these sets of on-going studies, we expect to better recognize the pros and cons, and the potential of the suggested algorithm. Ultimately, we want to devise more efficient machine learning-based design approaches,” explained Professor Ryu.This study was funded by the National Research Foundation of Korea and the KAIST Global Singularity Research Project.
-Publication
Yongtae Kim, Youngsoo, Charles Yang, Kundo Park, Grace X. Gu, and Seunghwa Ryu, “Deep learning framework for material design space exploration using active transfer learning and data augmentation,” npj Computational Materials (https://doi.org/10.1038/s41524-021-00609-2)
-Profile
Professor Seunghwa Ryu
Mechanics & Materials Modeling Lab
Department of Mechanical Engineering
KAIST
2021.09.29 View 9642 -
Observing Individual Atoms in 3D Nanomaterials and Their Surfaces
Atoms are the basic building blocks for all materials. To tailor functional properties, it is essential to accurately determine their atomic structures. KAIST researchers observed the 3D atomic structure of a nanoparticle at the atom level via neural network-assisted atomic electron tomography.
Using a platinum nanoparticle as a model system, a research team led by Professor Yongsoo Yang demonstrated that an atomicity-based deep learning approach can reliably identify the 3D surface atomic structure with a precision of 15 picometers (only about 1/3 of a hydrogen atom’s radius). The atomic displacement, strain, and facet analysis revealed that the surface atomic structure and strain are related to both the shape of the nanoparticle and the particle-substrate interface.
Combined with quantum mechanical calculations such as density functional theory, the ability to precisely identify surface atomic structure will serve as a powerful key for understanding catalytic performance and oxidation effect.
“We solved the problem of determining the 3D surface atomic structure of nanomaterials in a reliable manner. It has been difficult to accurately measure the surface atomic structures due to the ‘missing wedge problem’ in electron tomography, which arises from geometrical limitations, allowing only part of a full tomographic angular range to be measured. We resolved the problem using a deep learning-based approach,” explained Professor Yang.
The missing wedge problem results in elongation and ringing artifacts, negatively affecting the accuracy of the atomic structure determined from the tomogram, especially for identifying the surface structures. The missing wedge problem has been the main roadblock for the precise determination of the 3D surface atomic structures of nanomaterials.
The team used atomic electron tomography (AET), which is basically a very high-resolution CT scan for nanomaterials using transmission electron microscopes. AET allows individual atom level 3D atomic structural determination.
“The main idea behind this deep learning-based approach is atomicity—the fact that all matter is composed of atoms. This means that true atomic resolution electron tomogram should only contain sharp 3D atomic potentials convolved with the electron beam profile,” said Professor Yang.
“A deep neural network can be trained using simulated tomograms that suffer from missing wedges as inputs, and the ground truth 3D atomic volumes as targets. The trained deep learning network effectively augments the imperfect tomograms and removes the artifacts resulting from the missing wedge problem.”
The precision of 3D atomic structure can be enhanced by nearly 70% by applying the deep learning-based augmentation. The accuracy of surface atom identification was also significantly improved.
Structure-property relationships of functional nanomaterials, especially the ones that strongly depend on the surface structures, such as catalytic properties for fuel-cell applications, can now be revealed at one of the most fundamental scales: the atomic scale.
Professor Yang concluded, “We would like to fully map out the 3D atomic structure with higher precision and better elemental specificity. And not being limited to atomic structures, we aim to measure the physical, chemical, and functional properties of nanomaterials at the 3D atomic scale by further advancing electron tomography techniques.”
This research, reported at Nature Communications, was funded by the National Research Foundation of Korea and the KAIST Global Singularity Research M3I3 Project.
-Publication
Juhyeok Lee, Chaehwa Jeong & Yongsoo Yang
“Single-atom level determination of 3-dimensional surface atomic structure via neural network-assisted atomic electron tomography”
Nature Communications
-Profile
Professor Yongsoo Yang
Department of Physics
Multi-Dimensional Atomic Imaging Lab (MDAIL)
http://mdail.kaist.ac.kr
KAIST
2021.05.12 View 9810 -
Streamlining the Process of Materials Discovery
The materials platform M3I3 reduces the time for materials discovery by reverse engineering future materials using multiscale/multimodal imaging and machine learning of the processing-structure-properties relationship
Developing new materials and novel processes has continued to change the world. The M3I3 Initiative at KAIST has led to new insights into advancing materials development by implementing breakthroughs in materials imaging that have created a paradigm shift in the discovery of materials. The Initiative features the multiscale modeling and imaging of structure and property relationships and materials hierarchies combined with the latest material-processing data.
The research team led by Professor Seungbum Hong analyzed the materials research projects reported by leading global institutes and research groups, and derived a quantitative model using machine learning with a scientific interpretation. This process embodies the research goal of the M3I3: Materials and Molecular Modeling, Imaging, Informatics and Integration.
The researchers discussed the role of multiscale materials and molecular imaging combined with machine learning and also presented a future outlook for developments and the major challenges of M3I3. By building this model, the research team envisions creating desired sets of properties for materials and obtaining the optimum processing recipes to synthesize them.
“The development of various microscopy and diffraction tools with the ability to map the structure, property, and performance of materials at multiscale levels and in real time enabled us to think that materials imaging could radically accelerate materials discovery and development,” says Professor Hong.
“We plan to build an M3I3 repository of searchable structural and property maps using FAIR (Findable, Accessible, Interoperable, and Reusable) principles to standardize best practices as well as streamline the training of early career researchers.”
One of the examples that shows the power of structure-property imaging at the nanoscale is the development of future materials for emerging nonvolatile memory devices. Specifically, the research team focused on microscopy using photons, electrons, and physical probes on the multiscale structural hierarchy, as well as structure-property relationships to enhance the performance of memory devices.
“M3I3 is an algorithm for performing the reverse engineering of future materials. Reverse engineering starts by analyzing the structure and composition of cutting-edge materials or products. Once the research team determines the performance of our targeted future materials, we need to know the candidate structures and compositions for producing the future materials.”
The research team has built a data-driven experimental design based on traditional NCM (nickel, cobalt, and manganese) cathode materials. With this, the research team expanded their future direction for achieving even higher discharge capacity, which can be realized via Li-rich cathodes.
However, one of the major challenges was the limitation of available data that describes the Li-rich cathode properties. To mitigate this problem, the researchers proposed two solutions: First, they should build a machine-learning-guided data generator for data augmentation. Second, they would use a machine-learning method based on ‘transfer learning.’ Since the NCM cathode database shares a common feature with a Li-rich cathode, one could consider repurposing the NCM trained model for assisting the Li-rich prediction. With the pretrained model and transfer learning, the team expects to achieve outstanding predictions for Li-rich cathodes even with the small data set.
With advances in experimental imaging and the availability of well-resolved information and big data, along with significant advances in high-performance computing and a worldwide thrust toward a general, collaborative, integrative, and on-demand research platform, there is a clear confluence in the required capabilities of advancing the M3I3 Initiative.
Professor Hong said, “Once we succeed in using the inverse “property−structure−processing” solver to develop cathode, anode, electrolyte, and membrane materials for high energy density Li-ion batteries, we will expand our scope of materials to battery/fuel cells, aerospace, automobiles, food, medicine, and cosmetic materials.”
The review was published in ACS Nano in March. This study was conducted through collaborations with Dr. Chi Hao Liow, Professor Jong Min Yuk, Professor Hye Ryung Byon, Professor Yongsoo Yang, Professor EunAe Cho, Professor Pyuck-Pa Choi, and Professor Hyuck Mo Lee at KAIST, Professor Joshua C. Agar at Lehigh University, Dr. Sergei V. Kalinin at Oak Ridge National Laboratory, Professor Peter W. Voorhees at Northwestern University, and Professor Peter Littlewood at the University of Chicago (Article title: Reducing Time to Discovery: Materials and Molecular Modeling, Imaging, Informatics, and Integration).This work was supported by the KAIST Global Singularity Research Program for 2019 and 2020.
Publication:
“Reducing Time to Discovery: Materials and Molecular Modeling, Imaging, Informatics and Integration,” S. Hong, C. H. Liow, J. M. Yuk, H. R. Byon, Y. Yang, E. Cho, J. Yeom, G. Park, H. Kang, S. Kim, Y. Shim, M. Na, C. Jeong, G. Hwang, H. Kim, H. Kim, S. Eom, S. Cho, H. Jun, Y. Lee, A. Baucour, K. Bang, M. Kim, S. Yun, J. Ryu, Y. Han, A. Jetybayeva, P.-P. Choi, J. C. Agar, S. V. Kalinin, P. W. Voorhees, P. Littlewood, and H. M. Lee, ACS Nano 15, 3, 3971–3995 (2021) https://doi.org/10.1021/acsnano.1c00211
Profile:
Seungbum Hong, PhD
Associate Professor
seungbum@kaist.ac.kr
http://mii.kaist.ac.kr
Department of Materials Science and Engineering
KAIST
(END)
2021.04.05 View 11429 -
Singularity Professors Represent the Future of Research at KAIST
KAIST will launch a Singularity Professor track, which gives more freedom to researchers for pursuing their research goal. This more flexible and creative research environment institutionally supports researchers as they dive deeper into their research for a longer period of time without any strings attached.
The track was established in an effort to ensure more competitive researchers who can lead the way for new advances in science and technology. This innovative research initiative is part of KAIST’s expansive effort to envision and position itself to build global research competitiveness in the wake of its 50th anniversary in 2021 and beyond.
From this year, KAIST will select two to three research faculty for this special track with full-scale funding for 10 years. Singularity Professors will have their annual performance evaluations waived for 10 years. Instead, their research will be reviewed in their fifth year. The professors in this track will not participate in government-funded R&D projects and be fully funded by KAIST’s endowment.
In addition to those newly hired into this track, Singularity Professorships are opens to existing faculty members. The selection criteria are very simple but highly demanding: one who can pivot an existing academic paradigm or invent a new discipline by presenting a novel scientific theory.
KAIST recently hosted a briefing session for current faculty members and encouraged them to apply for the new track. As part of the selection criteria, the research topic’s innovativeness, feasibility, and appropriateness will be major factors for this track. Employment under this track will continue for up to 20 years. After receiving an evaluation of Very Satisfactory at the end of first ten-year contract, another ten years will be added.
President Sung-Chul Shin, who has pushed for this system since he took office in 2017, said during the briefing session, “It takes quite a long time to bear fruit in academics, especially in science. I am very delighted that KAIST is paving the way for building a longer-term research environment which allows full and longer commitments for research that the faculty is excited to try. That’s the first step to sow the seeds for bearing fruit in academics, especially in science.”
This is a paradigm shift to embrace transformation in a new era. The new institutional strategy supports the change from a fast follower to a first mover during these technologically turbulent times. Under its Global Singularity Research Projects initiative, KAIST already selected focus research topics in the most challenging as well as most creative fields of neuro-rehabilitation, new materials, and molecular optogenetics.
“Especially in the post-COVID era, we have a very clear mission for the world. Our knowledge should translate into global value that can benefit those suffering from this pandemic, and mitigate the inequity coming from the digital discrepancies,” President Shin added.
(END)
2020.07.21 View 7583 -
Highly Uniform and Low Hysteresis Pressure Sensor to Increase Practical Applicability
< Professor Steve Park (left) and the First Author Mr. Jinwon Oh (right) >
Researchers have designed a flexible pressure sensor that is expected to have a much wider applicability. A KAIST research team fabricated a piezoresistive pressure sensor of high uniformity with low hysteresis by chemically grafting a conductive polymer onto a porous elastomer template.
The team discovered that the uniformity of pore size and shape is directly related to the uniformity of the sensor. The team noted that by increasing pore size and shape variability, the variability of the sensor characteristics also increases.
Researchers led by Professor Steve Park from the Department of Materials Science and Engineering confirmed that compared to other sensors composed of randomly sized and shaped pores, which had a coefficient of variation in relative resistance change of 69.65%, their newly developed sensor exhibited much higher uniformity with a coefficient of variation of 2.43%. This study was reported in Small as the cover article on August 16.
Flexible pressure sensors have been actively researched and widely applied in electronic equipment such as touch screens, robots, wearable healthcare devices, electronic skin, and human-machine interfaces. In particular, piezoresistive pressure sensors based on elastomer‐conductive material composites hold significant potential due to their many advantages including a simple and low-cost fabrication process.
Various research results have been reported for ways to improve the performance of piezoresistive pressure sensors, most of which have been focused on increasing the sensitivity. Despite its significance, maximizing the sensitivity of composite-based piezoresistive pressure sensors is not necessary for many applications. On the other hand, sensor-to-sensor uniformity and hysteresis are two properties that are of critical importance to realize any application.
The importance of sensor-to-sensor uniformity is obvious. If the sensors manufactured under the same conditions have different properties, measurement reliability is compromised, and therefore the sensor cannot be used in a practical setting.
In addition, low hysteresis is also essential for improved measurement reliability. Hysteresis is a phenomenon in which the electrical readings differ depending on how fast or slow the sensor is being pressed, whether pressure is being released or applied, and how long and to what degree the sensor has been pressed. When a sensor has high hysteresis, the electrical readings will differ even under the same pressure, making the measurements unreliable.
Researchers said they observed a negligible hysteresis degree which was only 2%. This was attributed to the strong chemical bonding between the conductive polymer and the elastomer template, which prevents their relative sliding and displacement, and the porosity of the elastomer that enhances elastic behavior.
“This technology brings forth insight into how to address the two critical issues in pressure sensors: uniformity and hysteresis. We expect our technology to play an important role in increasing practical applications and the commercialization of pressure sensors in the near future,” said Professor Park.
This work was conducted as part of the KAIST‐funded Global Singularity Research Program for 2019, and also supported by the KUSTAR‐KAIST Institute.
Figure 1. Image of a porous elastomer template with uniform pore size and shape (left), Graph showing high uniformity in the sensors’ performance (right).
Figure 2. Hysteresis loops of the sensor at different pressure levels (left), and after a different number of cycles (right).
Figure 3. The cover page of Small Journal, Volume 15, Issue 33.
Publication:
Jinwon Oh, Jin‐Oh Kim, Yunjoo Kim, Han Byul Choi, Jun Chang Yang, Serin Lee, Mikhail Pyatykh, Jung Kim, Joo Yong Sim, and Steve Park. 2019. Highly Uniform and Low Hysteresis Piezoresistive Pressure Sensors Based on Chemical Grafting of Polypyrrole on Elastomer Template with Uniform Pore Size. Small. Wiley-VCH Verlag GmbH & Co. KgaA, Weinheim, Germany, Volume No. 15, Issue No. 33, Full Paper No. 201901744, 8 pages. https://doi.org/10.1002/smll.201901744
Profile: Prof. Steve Park, MS, PhD
stevepark@kaist.ac.kr
http://steveparklab.kaist.ac.kr/
Assistant Professor
Organic and Nano Electronics Laboratory
Department of Materials Science and Engineering
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr
Daejeon 34141, Korea
Profile: Mr. Jinwon Oh, MS
jwoh1701@gmail.com
http://steveparklab.kaist.ac.kr/
Researcher
Organic and Nano Electronics Laboratory
Department of Materials Science and Engineering
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Prof. Jung Kim, MS, PhD
jungkim@kaist.ac.kr
http://medev.kaist.ac.kr/
Professor
Biorobotics Laboratory
Department of Mechanical Engineering
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Joo Yong Sim, PhD
jsim@etri.re.kr
Researcher
Bio-Medical IT Convergence Research Department
Electronics and Telecommunications Research Institute (ETRI)
https://www.etri.re.krDaejeon 34129, Korea
(END)
2019.08.19 View 25855