conference
-
Image Analysis to Automatically Quantify Gender Bias in Movies
Many commercial films worldwide continue to express womanhood in a stereotypical manner, a recent study using image analysis showed. A KAIST research team developed a novel image analysis method for automatically quantifying the degree of gender bias in films.
The ‘Bechdel Test’ has been the most representative and general method of evaluating gender bias in films. This test indicates the degree of gender bias in a film by measuring how active the presence of women is in a film. A film passes the Bechdel Test if the film (1) has at least two female characters, (2) who talk to each other, and (3) their conversation is not related to the male characters.
However, the Bechdel Test has fundamental limitations regarding the accuracy and practicality of the evaluation. Firstly, the Bechdel Test requires considerable human resources, as it is performed subjectively by a person. More importantly, the Bechdel Test analyzes only a single aspect of the film, the dialogues between characters in the script, and provides only a dichotomous result of passing the test, neglecting the fact that a film is a visual art form reflecting multi-layered and complicated gender bias phenomena. It is also difficult to fully represent today’s various discourse on gender bias, which is much more diverse than in 1985 when the Bechdel Test was first presented.
Inspired by these limitations, a KAIST research team led by Professor Byungjoo Lee from the Graduate School of Culture Technology proposed an advanced system that uses computer vision technology to automatically analyzes the visual information of each frame of the film. This allows the system to more accurately and practically evaluate the degree to which female and male characters are discriminatingly depicted in a film in quantitative terms, and further enables the revealing of gender bias that conventional analysis methods could not yet detect.
Professor Lee and his researchers Ji Yoon Jang and Sangyoon Lee analyzed 40 films from Hollywood and South Korea released between 2017 and 2018. They downsampled the films from 24 to 3 frames per second, and used Microsoft’s Face API facial recognition technology and object detection technology YOLO9000 to verify the details of the characters and their surrounding objects in the scenes.
Using the new system, the team computed eight quantitative indices that describe the representation of a particular gender in the films. They are: emotional diversity, spatial staticity, spatial occupancy, temporal occupancy, mean age, intellectual image, emphasis on appearance, and type and frequency of surrounding objects.
Figure 1. System Diagram
Figure 2. 40 Hollywood and Korean Films Analyzed in the Study
According to the emotional diversity index, the depicted women were found to be more prone to expressing passive emotions, such as sadness, fear, and surprise. In contrast, male characters in the same films were more likely to demonstrate active emotions, such as anger and hatred.
Figure 3. Difference in Emotional Diversity between Female and Male Characters
The type and frequency of surrounding objects index revealed that female characters and automobiles were tracked together only 55.7 % as much as that of male characters, while they were more likely to appear with furniture and in a household, with 123.9% probability.
In cases of temporal occupancy and mean age, female characters appeared less frequently in films than males at the rate of 56%, and were on average younger in 79.1% of the cases. These two indices were especially conspicuous in Korean films.
Professor Lee said, “Our research confirmed that many commercial films depict women from a stereotypical perspective. I hope this result promotes public awareness of the importance of taking prudence when filmmakers create characters in films.”
This study was supported by KAIST College of Liberal Arts and Convergence Science as part of the Venture Research Program for Master’s and PhD Students, and will be presented at the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) on November 11 to be held in Austin, Texas.
Publication:
Ji Yoon Jang, Sangyoon Lee, and Byungjoo Lee. 2019. Quantification of Gender Representation Bias in Commercial Films based on Image Analysis. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). ACM, New York, NY, USA, Article 198, 29 pages. https://doi.org/10.1145/3359300
Link to download the full-text paper:
https://files.cargocollective.com/611692/cscw198-jangA--1-.pdf
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Ji Yoon Jang, M.S.
yoone3422@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Sangyoon Lee, M.S. Candidate
sl2820@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
(END)
2019.10.17 View 25583 -
Object Identification and Interaction with a Smartphone Knock
(Professor Lee (far right) demonstrate 'Knocker' with his students.)
A KAIST team has featured a new technology, “Knocker”, which identifies objects and executes actions just by knocking on it with the smartphone. Software powered by machine learning of sounds, vibrations, and other reactions will perform the users’ directions.
What separates Knocker from existing technology is the sensor fusion of sound and motion. Previously, object identification used either computer vision technology with cameras or hardware such as RFID (Radio Frequency Identification) tags. These solutions all have their limitations. For computer vision technology, users need to take pictures of every item. Even worse, the technology will not work well in poor lighting situations. Using hardware leads to additional costs and labor burdens.
Knocker, on the other hand, can identify objects even in dark environments only with a smartphone, without requiring any specialized hardware or using a camera. Knocker utilizes the smartphone’s built-in sensors such as a microphone, an accelerometer, and a gyroscope to capture a unique set of responses generated when a smartphone is knocked against an object. Machine learning is used to analyze these responses and classify and identify objects.
The research team under Professor Sung-Ju Lee from the School of Computing confirmed the applicability of Knocker technology using 23 everyday objects such as books, laptop computers, water bottles, and bicycles. In noisy environments such as a busy café or on the side of a road, it achieved 83% identification accuracy. In a quiet indoor environment, the accuracy rose to 98%.
The team believes Knocker will open a new paradigm of object interaction. For instance, by knocking on an empty water bottle, a smartphone can automatically order new water bottles from a merchant app. When integrated with IoT devices, knocking on a bed’s headboard before going to sleep could turn off the lights and set an alarm. The team suggested and implemented 15 application cases in the paper, presented during the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2019) held in London last month.
Professor Sung-Ju Lee said, “This new technology does not require any specialized sensor or hardware. It simply uses the built-in sensors on smartphones and takes advantage of the power of machine learning. It’s a software solution that everyday smartphone users could immediately benefit from.” He continued, “This technology enables users to conveniently interact with their favorite objects.”
The research was supported in part by the Next-Generation Information Computing Development Program through the National Research Foundation of Korea funded by the Ministry of Science and ICT and an Institute for Information & Communications Technology Promotion (IITP) grant funded by the Ministry of Science and ICT.
Figure: An example knock on a bottle. Knocker identifies the object by analyzing a unique set of responses from the knock, and automatically launches a proper application or service.
2019.10.02 View 28069 -
Flexible User Interface Distribution for Ubiquitous Multi-Device Interaction
< Research Group of Professor Insik Shin (center) >
KAIST researchers have developed mobile software platform technology that allows a mobile application (app) to be executed simultaneously and more dynamically on multiple smart devices. Its high flexibility and broad applicability can help accelerate a shift from the current single-device paradigm to a multiple one, which enables users to utilize mobile apps in ways previously unthinkable.
Recent trends in mobile and IoT technologies in this era of 5G high-speed wireless communication have been hallmarked by the emergence of new display hardware and smart devices such as dual screens, foldable screens, smart watches, smart TVs, and smart cars. However, the current mobile app ecosystem is still confined to the conventional single-device paradigm in which users can employ only one screen on one device at a time. Due to this limitation, the real potential of multi-device environments has not been fully explored.
A KAIST research team led by Professor Insik Shin from the School of Computing, in collaboration with Professor Steve Ko’s group from the State University of New York at Buffalo, has developed mobile software platform technology named FLUID that can flexibly distribute the user interfaces (UIs) of an app to a number of other devices in real time without needing any modifications. The proposed technology provides single-device virtualization, and ensures that the interactions between the distributed UI elements across multiple devices remain intact.
This flexible multimodal interaction can be realized in diverse ubiquitous user experiences (UX), such as using live video steaming and chatting apps including YouTube, LiveMe, and AfreecaTV. FLUID can ensure that the video is not obscured by the chat window by distributing and displaying them separately on different devices respectively, which lets users enjoy the chat function while watching the video at the same time.
In addition, the UI for the destination input on a navigation app can be migrated into the passenger’s device with the help of FLUID, so that the destination can be easily and safely entered by the passenger while the driver is at the wheel.
FLUID can also support 5G multi-view apps – the latest service that allows sports or games to be viewed from various angles on a single device. With FLUID, the user can watch the event simultaneously from different viewpoints on multiple devices without switching between viewpoints on a single screen.
PhD candidate Sangeun Oh, who is the first author, and his team implemented the prototype of FLUID on the leading open-source mobile operating system, Android, and confirmed that it can successfully deliver the new UX to 20 existing legacy apps.
“This new technology can be applied to next-generation products from South Korean companies such as LG’s dual screen phone and Samsung’s foldable phone and is expected to embolden their competitiveness by giving them a head-start in the global market.” said Professor Shin.
This study will be presented at the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019) October 21 through 25 in Los Cabos, Mexico. The research was supported by the National Science Foundation (NSF) (CNS-1350883 (CAREER) and CNS-1618531).
Figure 1. Live video streaming and chatting app scenario
Figure 2. Navigation app scenario
Figure 3. 5G multi-view app scenario
Publication: Sangeun Oh, Ahyeon Kim, Sunjae Lee, Kilho Lee, Dae R. Jeong, Steven Y. Ko, and Insik Shin. 2019. FLUID: Flexible User Interface Distribution for Ubiquitous Multi-device Interaction. To be published in Proceedings of the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019). ACM, New York, NY, USA. Article Number and DOI Name TBD.
Video Material:
https://youtu.be/lGO4GwH4enA
Profile: Prof. Insik Shin, MS, PhD
ishin@kaist.ac.kr
https://cps.kaist.ac.kr/~ishin
Professor
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Sangeun Oh, PhD Candidate
ohsang1213@kaist.ac.kr
https://cps.kaist.ac.kr/
PhD Candidate
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Prof. Steve Ko, PhD
stevko@buffalo.edu
https://nsr.cse.buffalo.edu/?page_id=272
Associate Professor
Networked Systems Research Group
Department of Computer Science and Engineering
State University of New York at Buffalo
http://www.buffalo.edu/ Buffalo 14260, USA
(END)
2019.07.20 View 39924 -
Professor Ji-Hyun Lee Awarded the Sasada Prize
Professor Ji-Hyun Lee from the Graduate School of Culture Technology was awarded the Sasada Prize during the 24th annual Conference of Computer-Aided Architectural Design Research in Asia (CAADRIA) held in Wellington, New Zealand on April 15.
The Sasada Award honors the late Professor Tsuyoshi Sasada (1941-2005), the former Professor of Osaka University and co-founder and fellow of CAADRIA. It is given to an individual who has contributed to the next generation of researchers and academics, to the wider profession and practice in computer-aided design and research, and has earned recognition in the academic community.
Professor Lee was recognized for her development of CAAD (Computer-Aided Architectural Design) through her research work on the land price precision system using case-based reasoning. Her research team proposed a model for estimating the average apartment price in an administrative district after collecting 40 variables from the six major Korean cities, excluding Seoul and Ulsan. Their follow-up studies showed the possibility of replacing existing experts’ predictions.
Professor Lee has been steadily researching for 20 years on case-based reasoning (CBR), a field of artificial intelligence, and has published more than 40 papers in the field of CBR. Meanwhile, the CAAD Future 2019 event will be held at KAIST in June.
2019.04.23 View 7074 -
First Korean Member of OceanObs' Organizing Committee
Professor Sung Yong Kim from the Department of Mechanical Engineering became the first Korean to be elected as an organizing committee member of the international conference OceanObs’19’, specializing in the ocean observing field.
Professor Kim has been actively engaged in advisory panels, technical committees, and working groups for the North Pacific Marine Science Organization (PICES). Through numerous activities, he was recognized for his professionalism and academic achievements, which led him to be appointed as a member of the organizing committee.
The organizing committee is comprised of leading scholars and researchers from 20 countries, and Professor Kim will be the first Korean scientist to participate on the committee.
Since 1999, the conference has been held every decade. Global experts specializing in oceanic observation gather to discuss research directions for the next ten years by monitoring physical, biological, and chemical variables in regional, national, and global oceans and applying marine engineering.
This year, approximately 20 institutes including NASA’s Jet Propulsion Laboratory (JPL), the National Science Foundation, the National Oceanic and Atmospheric Administration, and the European Space Agency will support funds as well as high-tech equipment to the conference.
This year’s conference theme is the governance of global ocean observing systems such as underwater gliders, unmanned vehicles, remote sensing, and observatories. The conference will hold discussions on monitoring technology and information systems to ensure human safety as well as to develop and preserve food resources. Additionally, participants will explore ways to expand observational infrastructures and carry out multidisciplinary approaches.
There will also be collaborations with the Global Ocean Observing System (GOOS) and the Partnership for Observation of the Global Oceans (POGO) to organize ocean observing programs and discuss priorities.
Finally, they will set a long-term plan for solving major scientific issues, such as climate change, ocean acidification, energy, and marine pollution.
Professor Kim said, “Based on the outcomes drawn from the conference, I will carry out research on natural disasters and climate change monitoring by using unmanned observing systems. I will also encourage more multidisciplinary research in this field.”
2019.01.25 View 11407 -
Center for Industrial Future Strategy Takes Off at KAIST
(Professor Wonjoon Kim from the School of Business and Technology Management)
Professors from KAIST and major international universities launched a mega-scale research center focusing on the Fourth Industrial Revolution, named the Center for Industrial Future Strategy (CIFS).
This center is funded by the National Research Foundation Korea and will receive 2.25 billion KRW over four years.
Directed by Professor Wonjoon Kim from the School of Business and Technology Management, the center is comprised of ten top-tier researchers and four research associates, including Professor Hawoon Jeong (KAIST), Professor Scott Stern (MIT), Professor Aaron Chatterji (Duke University), Dr. Yong Suk Lee (Stanford University) and Professor Hyejin Youn (Northwestern University).
The center will conduct research on technical, social, and economic changes derived by a new paradigm of technological innovation.
Moreover, they will study policies and strategies in relation to innovation in the corporate and government sectors to achieve economic growth in a sustainable manner. The center will also propose policies and strategies in a variety of economic and industrial settings to establish a sustainable and global innovation ecosystem.
To carry out these studies successfully, CIFS will further expand the AIEA-NBER Conference with the Asia Innovation and Entrepreneurship Association (AIEA) and the National Bureau of Economic Research (NBER) in which numerous Nobel Laureates in Economics are affiliated. They will also comprise thematic research teams with co-founding universities to build stronger cooperation with one another.
Besides the academic cooperation, the center will also build partnerships with international organizations, including the Asian Development Bank and the Inter-American Development Bank to carry out their missions at multilateral levels.
Their research topics include changes to value chains in a new paradigm of technological innovation, labor market changes in the Fourth Industrial Revolution, sharing economies and social interests, big data, artificial intelligence & privacy policy, and innovation & ethical and institutional countermeasures to AI technology.
Professor Kim said, “The new paradigm of technological innovation is evolving social, economic, and industrial structures, such as R&D, industry, technology, labor, finance, and institutions. The Center will contribute to proposing policies and strategies so that Korea, as well as the international community, can take appropriate measures to these big changes.”
2018.09.11 View 10785 -
Professor YongKeun Park Wins the 2018 Fumio Okano Award
(Professor Park)
Professor YongKeun Park from the Department of Physics won the 2018 Fumio Okano Award in recognition of his contributions to 3D display technology development during the annual conference of the International Society for Optics and Photonics (SPIE) held last month in Orlando, Florida in the US.
The Fumio Okano Best 3D Paper Prize is presented annually in memory of Dr. Fumio Okano, a pioneer and innovator of 3D displays who passed away in 2013, for his contributions to the field of 3D TVs and displays. The award is sponsored by NHK-ES.
Professor Park and his team are developing novel technology for measuring and visualizing 3D images by applying random light scattering. He has published numerous papers on 3D holographic camera technology and 3000x enhanced performance of 3D holographic displays in renowned international journals such as Nature Photonics, Nature Communications, and Science Advances. His technology has drawn international attention from renowned media outlets including Newsweek and Forbes.
He has established two startups to commercialize his technology. Tomocube specializes in 3D imaging microscopes using holotomographic technology and the company exports their products to several countries including the US and Japan. The.Wave.Talk is exploring technology for examining pre-existing bacteria anywhere and anytime.
Professor Park’s innovations have already been recognized in and out of KAIST. In February, he was selected as the KAISTian of the Year for his outstanding research, commercialization, and startups. He was also decorated with the National Science Award in April by the Ministry of Science and ICT and the Hong Jin-Ki Innovation Award later in May by the Yumin Cultural Foundation.
Professor Park said, “3D holography is emerging as a significant technology with growing potential and positive impacts on our daily lives. However, the current technology lags far behind the levels displayed in SF movies. We will do our utmost to reach this level with more commercialization."
2018.05.31 View 11058 -
Seong-Tae Kim Wins Robert-Wagner All-Conference Best Paper Award
(Ph.D. candidate Seong-Tae Kim)
Ph.D. candidate Seong-Tae Kim from the School of Electrical Engineering won the Robert Wagner All-Conference Best Student Paper Award during the 2018 International Society for Optics and Photonics (SPIE) Medical Imaging Conference, which was held in Houston last month.
Kim, supervised by Professor Yong Man Ro, received the award for his paper in the category of computer-aided diagnosis. His paper, titled “ICADx: Interpretable Computer-Aided Diagnosis of Breast Masses”, was selected as the best paper out of 900 submissions. The conference selects the best paper in nine different categories. His research provides new insights on diagnostic technology to detect breast cancer powered by deep learning.
2018.03.15 View 10789 -
Professor Dong Ho Cho Awarded at the Haedong Conference 2017
Professor Dong Ho Cho of the School of Electrical Engineering at KAIST received an award at the 13th Haedong Conference 2017 in Seoul on the first of December.
The Korean Institute of Communications and Information Sciences recognized Professor Cho for his significant contributions in the field of mobile communication networks. He has carried out groundbreaking research on mobile systems, including architecture, protocols, algorithms, optimization, and efficiency analysis.
As a result, he has produced 73 papers in renowned international journals, 138 papers at international conferences, and filed 52 international patents and 121 domestic patents. In addition, he transferred 14 of the patents he filed to Korean and international companies.
2017.12.07 View 6770 -
Professor Dai Gil Lee Recognized by the ICCS
Emeritus Professor Dai Gil Lee, from the School of Mechanical and Aerospace Engineering at KAIST, received a special achievement award from the 20th International Conference on Composite Structures (ICCS).
ICCS is a renowned conference in the field of applied composite structures, which highlights the practicality of composite structures. This year, the conference was held at the Conservatoire National des Arts et Métiers (CNAM), Paris, France from September 4 to 7. Approximately 650 papers were presented from 45 countries.
Especially, the conference honored Emeritus Professor Lee, who has been engaged in ICCS since 1993 and received best paper award twice. The ICCS recognized him for serving with distinction in science and technology in the fields of composite materials and structures. As a member of the Editorial Board for many years, he gave significant support to the journal Composite Structures. At the conference, he gave a special lecture titled ‘Lightweight Carbon Composite Proton Exchange Membrane Fuel Cells’.
Professor Lee said, “I will dedicate myself to innovate Vanadium Redox Flow Battery-ESS (VRFB) based on the research findings announced at the conference and related patents. I am hoping that these efforts will contribute to solving energy issues around the world.”
2017.10.19 View 8183 -
Sangeun Oh Recognized as a 2017 Google Fellow
Sangeun Oh, a Ph.D. candidate in the School of Computing was selected as a Google PhD Fellow in 2017. He is one of 47 awardees of the Google PhD Fellowship in the world.
The Google PhD Fellowship awards students showing outstanding performance in the field of computer science and related research. Since being established in 2009, the program has provided various benefits, including scholarships worth $10,000 USD and one-to-one research discussion with mentors from Google.
His research work on a mobile system that allows interactions among various kinds of smart devices was recognized in the field of mobile computing. He developed a mobile platform that allows smart devices to share diverse functions, including logins, payments, and sensors. This technology provides numerous user experiences that existing mobile platforms could not offer. Through cross-device functionality sharing, users can utilize multiple smart devices in a more convenient manner. The research was presented at The Annual International Conference on Mobile Systems, Applications, and Services (MobiSys) of the Association for Computing Machinery in July, 2017.
Oh said, “I would like to express my gratitude to my advisor, the professors in the School of Computing, and my lab colleagues. I will devote myself to carrying out more research in order to contribute to society.”
His advisor, Insik Shin, a professor in the School of Computing said, “Being recognized as a Google PhD Fellow is an honor to both the student as well as KAIST. I strongly anticipate and believe that Oh will make the next step by carrying out good quality research.”
2017.09.27 View 12314 -
Professor Jin Woo Kim Wins the 14th Macrogen Scientist Award
Professor Jin Woo Kim of the Department of Biological Sciences at KAIST received the 14th Macrogen Scientist Award at the 2017 KSMCB International Conference held in COEX on September 12, 2017.
The award is given by the Korean Society for Molecular and Cellular Biology (KSMCB) and sponsored by Macrogen, a service provider of genome research. The award was established in 2004 to recognize biological scientists who have accomplished excellent performance in the field of basic life sciences.
Professor Kim has achieved outstanding research performances on nerve development, such as identifying the cause of senile retinal degenerative disease and finding retinal nerve cells that distinguish light and darkness in dark conditions.
Recently, he discovered intercellular communication, which controls the development of retinal neurons. His findings have contributed to addressing the principles of maintenance and regeneration of retinal neurons.
Since joining KAIST, he has presented approximately 20 papers and published in numerous international journals including Cell Reports, Genes and Development, and EMBO Journal. Moreover, he delivered special lectures at international conferences, universities, and institutes around the world.
2017.09.14 View 9124