school+of+computing
-
See-through exhibitions using smartphones: KAIST develops the AR magic lens, WonderScope
WonderScope shows what’s underneath the surface of an object through an augmented reality technology.
< Photo 1. Demonstration at ACM SIGGRAPH >
- A KAIST research team led by Professor Woohun Lee from the Department of Industrial Design and Professor Geehyuk Lee from the School of Computing have developed a smartphone “appcessory” called WonderScope that can easily add an augmented reality (AR) perspective to the surface of exhibits
- The research won an Honorable Mention for Emerging Technologies Best in Show at ACM SIGGRAPH, one of the largest international conferences on computer graphics and interactions
- The technology was improved and validated through real-life applications in three special exhibitions including one at the Geological Museum at the Korea Institute of Geoscience and Mineral Resources (KIGAM) held in 2020, and two at the National Science Museum each in 2021 and 2022
- The technology is expected to be used for public science exhibitions and museums as well as for interactive teaching materials to stimulate children’s curiosity
A KAIST research team led by Professor Woohun Lee from the Department of Industrial Design and Professor Geehyuk Lee from the School of Computing developed a novel augmented reality (AR) device, WonderScope, which displays the insides of an object directly from its surface. By installing and connecting WonderScope to a mobile device through Bluetooth, users can see through exhibits as if looking through a magic lens.
Many science museums nowadays have incorporated the use of AR apps for mobile devices. Such apps add digital information to the exhibition, providing a unique experience. However, visitors must watch the screen from a certain distance away from the exhibited items, often causing them to focus more on the digital contents rather than the exhibits themselves. In other words, the distance and distractions that exist between the exhibit and the mobile device may actually cause the visitors to feel detached from the exhibition. To solve this problem, museums needed a magic AR lens that could be used directly from the surface of the item.
To accomplish this, smartphones must know exactly where on the surface of an object it is placed. Generally, this would require an additional recognition device either on the inside or on the surface of the item, or a special pattern printed on its surface. Realistically speaking, these are impractical solutions, as exhibits would either appear overly complex or face spatial restrictions.
WonderScope, on the other hand, uses a much more practical method to identify the location of a smartphone on the surface of an exhibit. First, it reads a small RFID tag attached to the surface of an object, and calculates the location of the moving smartphone by adding its relative movements based on the readings from an optical displacement sensor and an acceleration sensor. The research team also took into consideration the height of the smartphone, and the characteristics of the surface profile in order to calculate the device’s position more accurately. By attaching or embedding RFID tags on exhibits, visitors can easily experience the effects of a magic AR lens through their smartphones.
For its wider use, WonderScope must be able to locate itself from various types of exhibit surfaces. To this end, WoderScope uses readings from an optical displacement sensor and an acceleration sensor with complementary characteristics, allowing stable locating capacities on various textures including paper, stone, wood, plastic, acrylic, and glass, as well as surfaces with physical patterns or irregularities. As a result, WonderScope can identify its location from a distance as close as 4 centimeters from an object, also enabling simple three-dimensional interactions near the surface of the exhibits.
The research team developed various case project templates and WonderScope support tools to allow the facile production of smartphone apps that use general-purpose virtual reality (VR) and the game engine Unity. WonderScope is also compatible with various types of devices that run on the Android operating system, including smartwatches, smartphones, and tablets, allowing it to be applied to exhibitions in many forms.
< Photo 2. Human body model showing demonstration >
< Photo 3. Demonstration of the underground mineral exploration game >
< Photo 4. Demonstration of Apollo 11 moon exploration experience >
The research team developed WonderScope with funding from the science and culture exhibition enhancement support project by the Ministry of Science and ICT. Between October 27, 2020 and February 28, 2021, WonderScope was used to observe underground volcanic activity and the insides of volcanic rocks at “There Once was a Volcano”, a special exhibition held at the Geological Museum in the Korea institute of Geoscience and Mineral Resources (KIGAM). From September 28 to October 3, 2021, it was used to observe the surface of Jung-moon-kyung (a bronze mirror with fine linear design) at the special exhibition “A Bronze Mirror Shines on Science” at the National Science Museum. And from August 2 to October 3, 2022 it was applied to a moon landing simulation at “The Special Exhibition on Moon Exploration”, also at the National Science Museum. Through various field demonstrations over the years, the research team has improved the performance and usability of WonderScope.
< Photo 5. Observation of surface corrosion of the main gate >
The research team demonstrated WonderScope at the Emerging Technologies forum during ACM SIGGRAPH 2022, a computer graphics and interaction technology conference that was held in Vancouver, Canada between August 8 and 11 this year. At this conference, where the latest interactive technologies are introduced, the team won an Honorable Mention for Best in Show. The judges commented that “WonderScope will be a new technology that provides the audience with a unique joy of participation during their visits to exhibitions and museums.”
< Photo 6. Cover of Digital Creativity >
WonderScope is a cylindrical “appcessory” module, 5cm in diameter and 4.5cm in height. It is small enough to be easily attached to a smartphone and embedded on most exhibits. Professor Woohun Lee from the KAIST Department of Industrial Design, who supervised the research, said, “WonderScope can be applied to various applications including not only educational, but also industrial exhibitions, in many ways.” He added, “We also expect for it to be used as an interactive teaching tool that stimulates children’s curiosity.”
Introductory video of WonderScope: https://www.youtube.com/watch?v=X2MyAXRt7h4&t=7s
2022.10.24 View 1240 -
An AI-based, Indoor/Outdoor-Integrated (IOI) GPS System to Bring Seismic Waves in the Terrains of Positioning Technology
KAIST breaks new grounds in positioning technology with an AI-integrated GPS board that works both indoors and out
KAIST (President Kwang Hyung Lee) announced on the 8th that Professor Dong-Soo Han's research team (Intelligent Service Integration Lab) from the School of Computing has developed a GPS system that works both indoors and outdoors with quality precision regardless of the environment.
This Indoor/Outdoor-Integrated GPS System, or IOI GPS System, for short, uses the GPS signals outdoors and estimates locations indoors using signals from multiple sources like an inertial sensor, pressure sensors, geomagnetic sensors, and light sensors. To this end, the research team developed techniques to detect environmental changes such as entering a building, and methods to detect entrances, ground floors, stairs, elevators and levels of buildings by utilizing artificial intelligence techniques. Various landmark detecting techniques were also incorporated with pedestrian dead reckoning (PDR), a navigation tool for pedestrians, to devise the so-called “Sensor-Fusion Positioning Algorithm”.
To date, it was common to estimate locations based on wireless LAN signals or base station signals in a space where the GPS signal could not reach. However, the IOI GPS enables positioning even in buildings without signals nor indoor maps.
The algorithm developed by the research team can provide accurate floor information within a building where even big tech companies like Google and Apple's positioning services do not provide. Unlike other positioning methods that rely on visual data, geomagnetic positioning techniques, or wireless LAN, this system also has the advantage of not requiring any prior preparation. In other words, the foundation to enable the usage of a universal GPS system that works both indoors and outdoors anywhere in the world is now ready.
The research team also produced a circuit board for the purpose of operating the IOI GPS System, mounted with chips to receive and process GPS, Wi-Fi, and Bluetooth signals, along with an inertial sensor, a barometer, a magnetometer, and a light sensor. The sensor-fusion positioning algorithm the lab has developed is also incorporated in the board.
When the accuracy of the IOI GPS board was tested in the N1 building of KAIST’s main campus in Daejeon, it achieved an accuracy of about 95% in floor estimation and an accuracy of about 3 to 6 meters in distance estimation. As for the indoor/outdoor transition, the navigational mode change was completed in about 0.3 seconds. When it was combined with the PDR technique, the estimation accuracy improved further down to a scope of one meter.
The research team is now working on assembling a tag with a built-in positioning board and applying it to location-based docent services for visitors at museums, science centers, and art galleries. The IOI GPS tag can be used for the purpose of tracking children and/or the elderly, and it can also be used to locate people or rescue workers lost in disaster-ridden or hazardous sites. On a different note, the sensor-fusion positioning algorithm and positioning board for vehicles are also under development for the tracking of vehicles entering indoor areas like underground parking lots.
When the IOI GPS board for vehicles is manufactured, the research team will work to collaborate with car manufacturers and car rental companies, and will also develop a sensor-fusion positioning algorithm for smartphones. Telecommunication companies seeking to diversify their programs in the field of location-based services will also be interested in the use the IOI GPS.
Professor Dong-Soo Han of the School of Computing, who leads the research team, said, “This is the first time to develop an indoor/outdoor integrated GPS system that can pinpoint locations in a building where there is no wireless signal or an indoor map, and there are an infinite number of areas it can be applied to. When the integration with the Korea Augmentation Satellite System (KASS) and the Korean GPS (KPS) System that began this year, is finally completed, Korea can become the leader in the field of GPS both indoors and outdoors, and we also have plans to manufacture semi-conductor chips for the IOI GPS System to keep the tech-gap between Korea and the followers.”
He added, "The guidance services at science centers, museums, and art galleries that uses IOI GPS tags can provide a set of data that would be very helpful for analyzing the visitors’ viewing traces. It is an essential piece of information required when the time comes to decide when to organize the next exhibit. We will be working on having it applied to the National Science Museum, first.”
The projects to develop the IOI GPS system and the trace analysis system for science centers were supported through Science, Culture, Exhibits and Services Capability Enhancement Program of the Ministry of Science and ICT.
Profile: Dong-Soo Han, Ph.D.Professorddsshhan@kaist.ac.krhttp://isilab.kaist.ac.kr
Intelligent Service Integration Lab.School of Computing
http://kaist.ac.kr/en/
Korea Advanced Institute of Science and Technology (KAIST)Daejeon, Republic of Korea
2022.07.13 View 2412 -
CLKIP Bearing Fruit in China
The Chongqing Liangjiang KAIST International Program (CLKIP) is rapidly gaining steam in China. CLKIP, an educational program operated in Chongqing internationally by KAIST since 2015, offers two majors, Electronic Information Engineering and Computer Science and Technology, applying the same curriculum as at KAIST.
To operate the program, KAIST assigns professors from the School of Electrical Engineering and the School of Computing to the program every year. They are in charge of one-third of the major courses, and transfer KAIST’s educational curriculum and know-how.
A total of 13 professors from Chongqing University of Technology (CQUT) have received or are receiving training on advanced education methodologies and technical know-how, including an on and offline integrated learning program, called Education 4.0 and large-scale internet open learning.As CLKIP is gaining in popularity, the number of students for its undergraduate courses keeps increasing, from 66 in 2015 to 172 in 2016 and 200 students in 2017, achieving the student volume for enrollment annually.
CLKIP selected seven exchange undergraduate students and five dual-degree students this fall, and they are currently studying in KAIST for either one semester or one full year.
CLKIP is located in Chongqing, one of the major direct-controlled municipalities and a focal point for notable government projects. The Korea-China industrial zone is also located in this area.
Considering its location, CLKIP is more than just an international programs for educational cooperation. The program will provide opportunities to cooperate with Korean enterprises including Hyundai, SK Hynix, LG Chem and Hankook Tire. While cooperating in research and development as well as technical assistance, KAIST hopes that these enterprises will play a bridging role for KAIST alumni entering the Chinese market.
President Sung-Chul Shin said, “The success of CLKIP shows that KAIST programs for fostering future manpower and developing cutting-edge technologies do work in other countries. Based on this case, KAST will put more effort into transferring our innovative education systems abroad. We are also pushing ahead to establish a joint institute between KAIST and CQUT by 2018, which will become a foundation for facilitating the entry of KAIST’s cutting-edge technologies into the Chinese market.”
“KAIST aims to become an entrepreneurial university that creates value through technology commercialization. In this sense, KAIST plans to transfer advanced technologies to domestic and international companies located in the Liangjiang district,” he added.
2017.12.12 View 4905 -
KAIST Professors Sweep the Best Science and Technology Award
(Distinguished Professors Sang Yup Lee (left) and Kyu-Young Whang)
Distinguished Professors Sang Yup Lee from the Department of Chemical and Biomolecular Engineering and Kyu-Young Whang of the College of Computing were selected as the winners of the "2017 Korea Best Science and Technology Award" by the Ministry of Science, ICT and Future Planning (MSIP) and the Korea Federation of Science and Technology Societies.
The award, which was established in 2003, is the highest honor bestowed to the two most outstanding scientists in Korea annually. This is the first time that KAIST faculty members have swept the award since its founding.
Distinguished Professor Lee is renowned for his pioneering studies of system metabolic engineering, which produces useful chemicals by utilizing microorganisms. Professor Lee has developed a number of globally-recognized original technologies such as gasoline production using micro-organisms, a bio-butanol production process, microbes for producing nylon and plastic raw materials, and making native-like spider silk produced in metabolically engineering bacterium which is stronger than steel but finer than human hair.
System metabolism engineering was also selected as one of the top 10 promising technologies in the world in 2016 by the World Economic Forum. Selected as one of the world’s top 20 applied bioscientists in 2014 by Nature Biotechnology, he has many ‘first’ titles in his academic and research careers. He was the first Asian to win the James Bailey Award (2016) and Marvin Johnson Award (2012), the first Korean elected to both the US National Academy of Science (NAS) and the National Academy of Engineering (NAE) this year. He is the dean of KAIST institutes, a multi and interdisciplinary research institute at KAIST. He serves as co-chair of the Global Council on Biotechnology and as a member of the Global Future Council on the Fourth Industrial Revolution at the World Economic Forum.
Distinguished Professor Whang, the first recipient in the field of computer science in this award, has been recognized for his lifetime achievement and contributions to the development of the software industry and the spreading of information culture. He has taken a pioneering role in presenting novel theories and innovative technologies in the field of database systems such as probabilistic aggregation, multidimensional indexing, query, and database and information retrieval. The Odysseus database management system Professor Hwang developed has been applied in many diverse fields of industry, while promoting the domestic software industry and its technical independence.
Professor Hwang is a fellow at the American Computer Society (ACM) and life fellow at IEEE. Professor Whang received the ACM SIGMOD Contributions Award in 2014 for his work promoting database research worldwide, the PAKDD Distinguished Contributions Award in 2014, and the DASFAA Outstanding Contributions Award in 2011 for his contributions to database and data mining research in the Asia-Pacific region. He is also the recipient of the prestigious Korea (presidential) Engineering Award in 2012.
2017.07.03 View 4470 -
A KAIST startup, YBrain, builds a wearable device to cure Alzheimer's
A group of KAIST graduates from the Departments of Bio and Brain Engineering, Computer Science, Materials Science Engineering, and Industrial Design created a startup called YBrain (http://ybrain.com/). YBrain develops a wearable neuroscience technology to treat or reduce the symptoms of degenerative brain diseases such as dementia and Alzheimer’s. Their recent technological developments were covered in e27, one of the leading blogs based in Singapore. The blog covers topics like the latest technology innovation, startups, and entrepreneurship in Asia. A news article follows below:
e27, June 24, 2014
“This wearable tech may be able to combat effects of Alzheimer’s”
http://e27.co/this-wearable-tech-may-be-able-combat-effects-of-alzheimers-20140624/
2014.06.25 View 7581 -
Successful Development of Excavation System of Biomarkers containing Protein Decomposition Control Enzyme Information
A Korean team of researchers successfully developed a biomarker excavation system named E3Net that excavates biomarkers containing information of the enzymes that control the decomposition of proteins. The development of the system paved the possibility of development of new high quality biomarkers.
*Biomarker: Molecular information of unique patterns derived from genes and proteins that allow the monitoring of physical changes from genetic or environmental causes.
Professor Lee Kwan Soo’s team (Department of Biological Sciences) composed of Doctorate candidate Han Young Woong, Lee Ho Dong Ph.D. and Professor Park Jong Chul published a dissertation in the April edition of Molecular and Cellular Proteomics. (Dissertation Title: A system for exploring E3-mediated regulatory networks of cellular functions).
Professor Lee’s team compiled all available information of the enzyme that controls protein decomposition (E3 enzyme) and successfully compiled the inter-substrate network by extracting information from 20,000 biology related data base dissertations. The result was the development of the E3Net system that analyzes the related cell function and disease.
Cells have a system that produces, destroys, and recycles proteins in response to the ever changing environmental conditions. Error in these processes leads to disease.
Therefore finding the relationship between E3 enzymes that control the decomposition of proteins and the substrates will allow disease curing and prevention to become much easier. E3 enzyme is responsible for 80% of the protein decomposition and is therefore predicted to be related to various diseases.
However the information on E3 enzyme and inter-substrate behavior are spread out among numerous dissertations and data bases which prevented methodological analysis of the role of the related cells and characteristics of the disease itself.
Professor Lee’s team was successful in creating the E3Net that compiled 2,201 pieces of E3 substrate information, 4,896 pieces of substrate information, and 1,671 pieces of inter-substrate relationship information. This compilation allows for the systematic analysis of cells and diseases.
The newly created network is 10 times larger than the existing network and is the first case where it is possible to accurately find the cell function and related diseases.
It is anticipated that the use of the E3Net will allow the excavation of new biomarkers for the development of personalized drug systems.
The research team applied the E3Net to find tens of new candidate biomarkers related to the major modern diseases like diabetes and cancer.
2012.05.30 View 8413