racing
-
KAIST develops 'MetaVRain' that realizes vivid 3D real-life images
KAIST (President Kwang Hyung Lee) is a high-speed, low-power artificial intelligence (AI: Artificial Intelligent) semiconductor* MetaVRain, which implements artificial intelligence-based 3D rendering that can render images close to real life on mobile devices.
* AI semiconductor: Semiconductor equipped with artificial intelligence processing functions such as recognition, reasoning, learning, and judgment, and implemented with optimized technology based on super intelligence, ultra-low power, and ultra-reliability
The artificial intelligence semiconductor developed by the research team makes the existing ray-tracing*-based 3D rendering driven by GPU into artificial intelligence-based 3D rendering on a newly manufactured AI semiconductor, making it a 3D video capture studio that requires enormous costs. is not needed, so the cost of 3D model production can be greatly reduced and the memory used can be reduced by more than 180 times. In particular, the existing 3D graphic editing and design, which used complex software such as Blender, is replaced with simple artificial intelligence learning, so the general public can easily apply and edit the desired style.
* Ray-tracing: Technology that obtains images close to real life by tracing the trajectory of all light rays that change according to the light source, shape and texture of the object
This research, in which doctoral student Donghyun Han participated as the first author, was presented at the International Solid-State Circuit Design Conference (ISSCC) held in San Francisco, USA from February 18th to 22nd by semiconductor researchers from all over the world.
(Paper Number 2.7, Paper Title: MetaVRain: A 133mW Real-time Hyper-realistic 3D NeRF Processor with 1D-2D Hybrid Neural Engines for Metaverse on Mobile Devices (Authors: Donghyeon Han, Junha Ryu, Sangyeob Kim, Sangjin Kim, and Hoi-Jun Yoo))
Professor Yoo's team discovered inefficient operations that occur when implementing 3D rendering through artificial intelligence, and developed a new concept semiconductor that combines human visual recognition methods to reduce them. When a person remembers an object, he has the cognitive ability to immediately guess what the current object looks like based on the process of starting with a rough outline and gradually specifying its shape, and if it is an object he saw right before. In imitation of such a human cognitive process, the newly developed semiconductor adopts an operation method that grasps the rough shape of an object in advance through low-resolution voxels and minimizes the amount of computation required for current rendering based on the result of rendering in the past.
MetaVRain, developed by Professor Yu's team, achieved the world's best performance by developing a state-of-the-art CMOS chip as well as a hardware architecture that mimics the human visual recognition process. MetaVRain is optimized for artificial intelligence-based 3D rendering technology and achieves a rendering speed of up to 100 FPS or more, which is 911 times faster than conventional GPUs. In addition, as a result of the study, the energy efficiency, which represents the energy consumed per video screen processing, is 26,400 times higher than that of GPU, opening the possibility of artificial intelligence-based real-time rendering in VR/AR headsets and mobile devices.
To show an example of using MetaVRain, the research team developed a smart 3D rendering application system together, and showed an example of changing the style of a 3D model according to the user's preferred style. Since you only need to give artificial intelligence an image of the desired style and perform re-learning, you can easily change the style of the 3D model without the help of complicated software. In addition to the example of the application system implemented by Professor Yu's team, it is expected that various application examples will be possible, such as creating a realistic 3D avatar modeled after a user's face, creating 3D models of various structures, and changing the weather according to the film production environment. do.
Starting with MetaVRain, the research team expects that the field of 3D graphics will also begin to be replaced by artificial intelligence, and revealed that the combination of artificial intelligence and 3D graphics is a great technological innovation for the realization of the metaverse.
Professor Hoi-Jun Yoo of the Department of Electrical and Electronic Engineering at KAIST, who led the research, said, “Currently, 3D graphics are focused on depicting what an object looks like, not how people see it.” The significance of this study was revealed as a study that enabled efficient 3D graphics by borrowing the way people recognize and express objects by imitating them.” He also foresaw the future, saying, “The realization of the metaverse will be achieved through innovation in artificial intelligence technology and innovation in artificial intelligence semiconductors, as shown in this study.”
Figure 1. Description of the MetaVRain demo screen
Photo of Presentation at the International Solid-State Circuits Conference (ISSCC)
2023.03.13 View 4551 -
KAIST’s unmanned racing car to race in the Indy Autonomous Challenge @ CES 2023 as the only contender representing Asia
- Professor David Hyunchul Shim of the School of Electrical Engineering, is at the Las Vegas Motor Speedway in Las Vegas, Nevada with his students of the Unmanned Systems Research Group (USRG), participating in the Indy Autonomous Challenge (IAC) @ CES as the only Asian team in the race.
Photo 1. Nine teams that competed at the first Indy Autonomous Challenge on October 23, 2021. (KAIST team is the right most team in the front row)
- The EE USRG team won the slot to race in the IAC @ CES 2023 rightly as the semifinals entree of the IAC @ CES 2022’ held in January of last year
- Through the partnership with Hyundai Motor Company, USRG received support to participate in the competition, and is to share the latest developments and trends of the technology with the company researchers
- With upgrades from last year, USRG is to race with a high-speed Indy racing car capable of driving up to 300 km/h and the technology developed in the process is to be used in further advancement of the high-speed autonomous vehicle technology of the future.
KAIST (President Kwang Hyung Lee) announced on the 5th that it will participate in the “Indy Autonomous Challenge (IAC) @ CES 2023”, an official event of the world's largest electronics and information technology exhibition held every year in Las Vegas, Nevada, of the United States from January 5th to 8th.
Photo 2. KAIST Racing Team participating in the Indy Autonomous Challenge @ CES 2023 (Team Leader: Sungwon Na, Team Members: Seongwoo Moon, Hyunwoo Nam, Chanhoe Ryu, Jaeyoung Kang)
“IAC @ CES 2023”, which is to be held at the Las Vegas Motor Speedway (LVMS) on January 7, seeks to advance technology developed as the result of last year's competition to share the results of such advanced high-speed autonomous vehicle technology with the public.
This competition is the 4th competition following the “Indy Autonomous Challenge (IAC)” held for the first time in Indianapolis, USA on October 23, 2021. At the IAC @ CES 2022 following the first IAC competition, the Unmmaned Systems Research Group (USRG) team led by Professor David Hyunchul Shim advanced to the semifinals out of a total of nine teams and won a spot to participate in CES 2023. As a result, the USRG comes into the challenge as the only Asian team to compete with other teams comprised of students and researchers of American and European backgrounds where the culture of motorsports is more deep-rooted.
For CES 2022, Professor David Hyunchul Shim’s research team was able to successfully develop a software that controlled the racing car to comply with the race flags and regulations while going up to 240 km/h all on its on.
Photo 3. KAIST Team’s vehicle on Las Vegas Motor Speedway during the IAC @ CES 2022
In the IAC @ CES 2023, the official racing vehicle AV-23, is a converted version of IL-15, the official racing car for Indy 500, fully automated while maintaining the optimal design for high-speed racing, and was upgraded from the last year’s competition taking up the highest speed up to 300 km/h.
This year’s competition, will develop on last year’s head-to-head autonomous racing and take the form of the single elimination tournament to have the cars overtake the others without any restrictions on the driving course, which would have the team that constantly drives at the fastest speed will win the competition.
Photo 4. KAIST Team’s vehicle overtaking the Italian team, PoliMOVE’s vehicle during one of the race in the IAC @ CES 2022
Professor Shim's team further developed on the CES 2022 certified software to fine tune the external recognition mechanisms and is now focused on precise positioning and driving control technology that factors into maintaining stability even when driving at high speed.
Professor Shim's research team won the Autonomous Driving Competition hosted by Hyundai Motor Company in 2021. Starting with this CES 2023 competition, they signed a partnership contract with Hyundai to receive financial support to participate in the CES competition and share the latest developments and trends of autonomous driving technology with Hyundai Motor's research team.
During CES 2023, the research team will also participate in other events such as the exhibition by the KAIST racing team at the IAC’s official booth located in the West Hall.
Professor David Hyunchul Shim said, “With these competitions being held overseas, there were many difficulties having to keep coming back, but the students took part in it diligently, for which I am deeply grateful. Thanks to their efforts, we were able to continue in this competition, which will be a way to verify the autonomous driving technology that we developed ourselves over the past 13 years, and I highly appreciate that.”
“While high-speed autonomous driving technology is a technology that is not yet sought out in Korea, but it can be applied most effectively for long-distance travel in the Korea,” he went on to add. “It has huge advantages in that it does not require constructions for massive infrastructure that costs enormous amount of money such as high-speed rail or urban aviation and with our design, it is minimally affected by weather conditions.” he emphasized.
On a different note, the IAC @ CES 2023 is co-hosted by the Consumer Technology Association (CTA) and Energy Systems Network (ESN), the organizers of CES. Last year’s IAC winner, Technische Universität München of Germany, and MIT-PITT-RW, a team of Massachusetts Institute of Technology (Massachusetts), University of Pittsburgh (Pennsylvania), Rochester Institute of Technology (New York), University of Waterloo (Canada), with and the University of Waterloo, along with TII EuroRacing - University of Modena and Reggio Emilia (Italy), Technology Innovation Institute (United Arab Emirates), and five other teams are in the race for the win against KAIST.
Photo 5. KAIST Team’s vehicle on the track during the IAC @ CES 2022
The Indy Autonomous Challenge is scheduled to hold its fifth competition at the Monza track in Italy in June 2023 and the sixth competition at CES 2024.
2023.01.05 View 7122 -
Hanmaeum Education Corps Invites Multicultural Families
About 100 graduates from the Multicultural Mother Schools and their families visited the KAIST campus on October 29 at the invitation of the Hanmaeum Education Corps of KAIST. The Hanmanum Education Corps is a volunteering organization composed of KAIST faculty and students. Many retired KAIST faculties are also members of the corps. Byong Kyu Choi, an Emeritus Professor from the Department of Industrial and Systems Engineering, is the director of the corps and has been leading the event since 2015.
With the support of a KAIST educational volunteering organization called SEED(Social Education Embracing Diversity), this year’s event offered various activities including a treasure hunt and convergent science programs. Participants had the opportunity to experience KAIST’s educational environment and enjoyed the perfect autumn weather during outdoor activities with student volunteers.
Children enjoyed making illumination-music stickers with the KAIST students, even though it was tough to learn at first.
While the children engaged themselves in the science program, parents visited the chrysanthemum fair and some of KAIST’s cafeterias.
Hanmaeum Education Corps opened the Multicultural Mother Schools to support multicultural mothers so that they can have more interest in and help their children more with their education. Since its establishment in 2015, the Multicultural Mother Schools have been expanding throughout the country.
The corporation hopes that visiting a renowned university will encourage children from multicultural families to study hard in addition to offering self-enrichment opportunities through career exploration and science activities.
2017.10.30 View 4319