Human-Computer+Interaction
-
Image Analysis to Automatically Quantify Gender Bias in Movies
Many commercial films worldwide continue to express womanhood in a stereotypical manner, a recent study using image analysis showed. A KAIST research team developed a novel image analysis method for automatically quantifying the degree of gender bias in films.
The ‘Bechdel Test’ has been the most representative and general method of evaluating gender bias in films. This test indicates the degree of gender bias in a film by measuring how active the presence of women is in a film. A film passes the Bechdel Test if the film (1) has at least two female characters, (2) who talk to each other, and (3) their conversation is not related to the male characters.
However, the Bechdel Test has fundamental limitations regarding the accuracy and practicality of the evaluation. Firstly, the Bechdel Test requires considerable human resources, as it is performed subjectively by a person. More importantly, the Bechdel Test analyzes only a single aspect of the film, the dialogues between characters in the script, and provides only a dichotomous result of passing the test, neglecting the fact that a film is a visual art form reflecting multi-layered and complicated gender bias phenomena. It is also difficult to fully represent today’s various discourse on gender bias, which is much more diverse than in 1985 when the Bechdel Test was first presented.
Inspired by these limitations, a KAIST research team led by Professor Byungjoo Lee from the Graduate School of Culture Technology proposed an advanced system that uses computer vision technology to automatically analyzes the visual information of each frame of the film. This allows the system to more accurately and practically evaluate the degree to which female and male characters are discriminatingly depicted in a film in quantitative terms, and further enables the revealing of gender bias that conventional analysis methods could not yet detect.
Professor Lee and his researchers Ji Yoon Jang and Sangyoon Lee analyzed 40 films from Hollywood and South Korea released between 2017 and 2018. They downsampled the films from 24 to 3 frames per second, and used Microsoft’s Face API facial recognition technology and object detection technology YOLO9000 to verify the details of the characters and their surrounding objects in the scenes.
Using the new system, the team computed eight quantitative indices that describe the representation of a particular gender in the films. They are: emotional diversity, spatial staticity, spatial occupancy, temporal occupancy, mean age, intellectual image, emphasis on appearance, and type and frequency of surrounding objects.
Figure 1. System Diagram
Figure 2. 40 Hollywood and Korean Films Analyzed in the Study
According to the emotional diversity index, the depicted women were found to be more prone to expressing passive emotions, such as sadness, fear, and surprise. In contrast, male characters in the same films were more likely to demonstrate active emotions, such as anger and hatred.
Figure 3. Difference in Emotional Diversity between Female and Male Characters
The type and frequency of surrounding objects index revealed that female characters and automobiles were tracked together only 55.7 % as much as that of male characters, while they were more likely to appear with furniture and in a household, with 123.9% probability.
In cases of temporal occupancy and mean age, female characters appeared less frequently in films than males at the rate of 56%, and were on average younger in 79.1% of the cases. These two indices were especially conspicuous in Korean films.
Professor Lee said, “Our research confirmed that many commercial films depict women from a stereotypical perspective. I hope this result promotes public awareness of the importance of taking prudence when filmmakers create characters in films.”
This study was supported by KAIST College of Liberal Arts and Convergence Science as part of the Venture Research Program for Master’s and PhD Students, and will be presented at the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) on November 11 to be held in Austin, Texas.
Publication:
Ji Yoon Jang, Sangyoon Lee, and Byungjoo Lee. 2019. Quantification of Gender Representation Bias in Commercial Films based on Image Analysis. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). ACM, New York, NY, USA, Article 198, 29 pages. https://doi.org/10.1145/3359300
Link to download the full-text paper:
https://files.cargocollective.com/611692/cscw198-jangA--1-.pdf
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Ji Yoon Jang, M.S.
yoone3422@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Sangyoon Lee, M.S. Candidate
sl2820@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
(END)
2019.10.17 View 22586 -
Play Games With No Latency
One of the most challenging issues for game players looks to be resolved soon with the introduction of a zero-latency gaming environment. A KAIST team developed a technology that helps game players maintain zero-latency performance. The new technology transforms the shapes of game design according to the amount of latency.
Latency in human-computer interactions is often caused by various factors related to the environment and performance of the devices, networks, and data processing. The term ‘lag’ is used to refer to any latency during gaming which impacts the user’s performance.
Professor Byungjoo Lee at the Graduate School of Culture Technology in collaboration with Aalto University in Finland presented a mathematical model for predicting players' behavior by understanding the effects of latency on players. This cognitive model is capable of predicting the success rate of a user when there is latency in a 'moving target selection' task which requires button input in a time constrained situation.
The model predicts the players’ task success rate when latency is added to the gaming environment. Using these predicted success rates, the design elements of the game are geometrically modified to help players maintain similar success rates as they would achieve in a zero-latency environment. In fact, this research succeeded in modifying the pillar heights of the Flappy Bird game, allowing the players to maintain their gaming performance regardless of the added latency.
Professor Lee said, "This technique is unique in the sense that it does not interfere with a player's gaming flow, unlike traditional methods which manipulate the game clock by the amount of latency. This study can be extended to various games such as reducing the size of obstacles in the latent computing environment.”
This research, in collaboration with Dr. Sunjun Kim from Aalto University and led by PhD candidate Injung Lee, was presented during the 2019 CHI Conference on Human Factors in Computing Systems last month in Glasgow in the UK.
This research was supported by the National Research Foundation of Korea (NRF) (2017R1C1B2002101, 2018R1A5A7025409), and the Aalto University Seed Funding Granted to the GamerLab respectively.
Figure 1. Overview of Geometric Compensation
Publication:
Injung Lee, Sunjun Kim, and Byungjoo Lee. 2019. Geometrically Compensating Effect of End-to-End Latency in Moving-Target Selection Games. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI’19) . ACM, New York, NY, USA, Article 560, 12 pages. https://doi.org/10.1145/3290605.3300790
Video Material:
https://youtu.be/TTi7dipAKJs
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Injung Lee, PhD Candidate
edndn@kaist.ac.kr
PhD Candidate
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr
Daejeon 34141, Korea
Profile: Postdoc. Sunjun Kim, MD, PhD
kuaa.net@gmail.com
Postdoctoral Researcher
User Interfaces Group
Aalto University
https://www.aalto.fi Espoo 02150, Finland
(END)
2019.06.11 View 44734 -
KAIST Hosts the Wearable Computer Contest 2015
Deadlines for Prototype Contest by May 30, 2015 and August 15 for Idea Contest
KAIST will hold the Wearable Computer Contest 2015 in November, which will be sponsored by Samsung Electronics Co., Ltd.
Wearable computers have emerged as next-generation mobile devices, and are gaining more popularity with the growth of the Internet of Things. KAIST has introduced wearable devices such as K-Glass 2, a smart glass with augmented reality embedded. The Glass also works on commands by blinking eyes.
This year’s contest with the theme of “Wearable Computers for Internet of Things” is divided into two parts: the Prototype Competition and Idea Contest.
With the fusion of information technology (IT) and fashion, contestants are encouraged to submit prototypes of their ideas by May 30, 2015. The ten teams that make it to the finals will receive a wearable computer platform and Human-Computer Interaction (HCI) education, along with a prize of USD 1,000 for prototype production costs. The winner of the Prototype Contest will receive a prize of USD 5,000 and an award from the Minister of Science, ICT and Future Planning (MSIP) of the Republic of Korea.
In the Idea Contest, posters containing ideas and concepts of wearable devices should be submitted by August 15, 2015. The teams that make it to the finals will have to display a life-size mockup in the final stage. The winner of the contest will receive a prize of USD 1,000 and an award from the Minister of MSIP.
Any undergraduate or graduate student in Korea can enter the Prototype Competition and anyone can participate in the Idea Contest.
The chairman of the event, Hoi-Jun Yoo, a professor of the Department of Electrical Engineering at KAIST, noted:
“There is a growing interest in wearable computers in the industry. I can easily envisage that there will be a new IT world where wearable computers are integrated into the Internet of Things, healthcare, and smart homes.”
More information on the contest can be found online at http://www.ufcom.org.
Picture: Finalists in the last year’s contest
2015.05.11 View 7161 -
A magnetic pen for smartphones adds another level of conveniences
Utilizing existing features on smartphones, the MagPen provides users with a compatible and simple input tool regardless of the type of phones they are using.
A doctoral candidate at the Korea Advanced Institute of Science and Technology (KAIST) developed a magnetically driven pen interface that works both on and around mobile devices. This interface, called the MagPen, can be used for any type of smartphones and tablet computers so long as they have magnetometers embedded in.
Advised by Professor Kwang-yun Wohn of the Graduate School of Culture Technology (GSCT) at KAIST, Sungjae Hwang, a Ph.D. student, created the MagPen in collaboration with Myung-Wook Ahn, a master"s student at the GSCT of KAIST, and Andrea Bianchi, a professor at Sungkyunkwan University.
Almost all mobile devices today provide location-based services, and magnetometers are incorporated in the integrated circuits of smartphones or tablet PCs, functioning as compasses. Taking advantage of built-in magnetometers, Hwang"s team came up with a technology that enabled an input tool for mobile devices such as a capacitive stylus pen to interact more sensitively and effectively with the devices" touch screen. Text and command entered by a stylus pen are expressed better on the screen of mobile devices than those done by human fingers.
The MagPen utilizes magnetometers equipped with smartphones, thus there is no need to build an additional sensing panel for a touchscreen as well as circuits, communication modules, or batteries for the pen. With an application installed on smartphones, it senses and analyzes the magnetic field produced by a permanent magnet embedded in a standard capacitive stylus pen.
Sungjae Hwang said, "Our technology is eco-friendly and very affordable because we are able to improve the expressiveness of the stylus pen without requiring additional hardware beyond those already installed on the current mobile devices. The technology allows smartphone users to enjoy added convenience while no wastes generated."
The MagPen detects the direction at which a stylus pen is pointing; selects colors by dragging the pen across smartphone bezel; identifies pens with different magnetic properties; recognizes pen-spinning gestures; and estimates the finger pressure applied to the pen.
Notably, with its spinning motion, the MagPen expands the scope of input gestures recognized by a stylus pen beyond its existing vocabularies of gestures and techniques such as titling, hovering, and varying pressures. The tip of the pen switches from a pointer to an eraser and vice versa when spinning. Or, it can choose the thickness of the lines drawn on a screen by spinning.
"It"s quite remarkable to see that the MagPen can understand spinning motion. It"s like the pen changes its living environment from two dimensions to three dimensions. This is the most creative characteristic of our technology," added Sungjae Hwang.
Hwang"s initial research result was first presented at the International Conference on Intelligent User Interfaces organized by the Association for Computing Machinery and held on March 19-22 in Santa Monica, the US.
In the next month of August, the research team will present a paper on the MagPen technology, entitled "MagPen: Magnetically Driven Pen Interaction On and Around Conventional Smartphones" and receive an Honorable Mention Award at the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2013) to be held in Germany.
In addition to the MagPen, Hwang and his team are conducting other projects to develop different types of magnetic gadgets (collectively called "MagGetz") that include the Magnetic Marionette, a magnetic cover for a smartphone, which offers augmented interactions with the phone, as well as magnetic widgets such as buttons and toggle interface.
Hwang has filed ten patents for the MagGetz technology.
Youtube Links: http://www.youtube.com/watch?v=NkPo2las7wc, http://www.youtube.com/watch?v=J9GtgyzoZmM
2013.07.25 View 9887 -
KAIST shocks the world with its creativity
Researchers at KAIST yielded great results at the world’s leading international Human Computer Interaction Society.
Professor Lee Gi Hyuk’s (Department of Computer Sciences) and Professor Bae Seok Hyung’ (Department of Industrial Design) respective teams received awards in two criteria in student innovation contest and was the only domestic university that presented their thesis at the ACM Symposium on User Interface Software.
The ACM UIST holds a student innovation contest prior to its opening. This year’s topic was the pressure sensing multi touch pad of Synaptics and involved 27 prestigious universities including MIT and CMU.
The KAIST team (Ki Son Joon Ph.D. candidate, Son Jeong Min M.A. candidate of Department of Computer Sciences and Woo Soo Jin M.A. candidate of Department of Industrial Design) designed a system that allows modulated control by attaching a simple structure to the pressure sensing multi touch pad.
The second KAIST team (Huh Seong Guk Ph.D. candidate, Han Jae Hyun Ph.D. candidate, Koo Ji Sung Ph.D. candidate at the Department of Computer Sciences, and Choi Ha Yan M.A. candidate at Department of Industrial Design) designed a system that utilizes a highly elastic fiber to allow the sensing of lateral forces. They also created a slingshot game application which was the second most popular system.
In the thesis session Professor Bae’s team (Lee DaWhee Ph.D. candidate, Son Kyung Hee Ph.D. candidate, Lee Joon Hyup M.A. candidate at Department of Industrial Design) presented a thesis that dealt with the technology that innovated the table pen for displays.
The new ‘phantom pen’ solved the issue arising from the hiding effect of the pen’s contact point and the display error due to the thickness of the display. In addition the ‘phantom pen’ has the ability to show the same effects as crayons or markers in a digital environment.
2012.11.29 View 9673 -
KAIST Undergraduates Open Four-Day International Conference
The ICISTS-KAIST, an annual international conference organized by KAIST undergraduate students, opened on Thursday (Aug. 20) at the KAIST"s main campus in Daejeon.
The 2009 ICISTS (International Conference for the Integration of Science and Technology into Society) drew around 200 experts and students from 44 countries. Since its inception in 2005 to promote discourse on important science and technology issues affecting modern society, the conference has served as an opportunity for academic networking among students in various parts of the world.
The four-day conference consists of lectures, open discussions among lecturers and students, field trips to help students to understand actual applications, and team projects.
This year"s conference offers three workshops under the themes of "Climate Change: Merging Technology and Policy for Green Solutions"; "Human-Computer Interaction: Designing Computer System for Intuitive Human Access"; and "Nano Clinic: Breakthrough in Conquering Disease."
Lectures by invited experts in various scientific fields will help broaden students" perspectives particularly from interdisciplinary viewpoints, said an organizer of the conference.
2009.08.28 View 13507