research
< Research Group of Professor Insik Shin (center) >
KAIST researchers have developed mobile software platform technology that allows a mobile application (app) to be executed simultaneously and more dynamically on multiple smart devices. Its high flexibility and broad applicability can help accelerate a shift from the current single-device paradigm to a multiple one, which enables users to utilize mobile apps in ways previously unthinkable.
Recent trends in mobile and IoT technologies in this era of 5G high-speed wireless communication have been hallmarked by the emergence of new display hardware and smart devices such as dual screens, foldable screens, smart watches, smart TVs, and smart cars. However, the current mobile app ecosystem is still confined to the conventional single-device paradigm in which users can employ only one screen on one device at a time. Due to this limitation, the real potential of multi-device environments has not been fully explored.
A KAIST research team led by Professor Insik Shin from the School of Computing, in collaboration with Professor Steve Ko’s group from the State University of New York at Buffalo, has developed mobile software platform technology named FLUID that can flexibly distribute the user interfaces (UIs) of an app to a number of other devices in real time without needing any modifications. The proposed technology provides single-device virtualization, and ensures that the interactions between the distributed UI elements across multiple devices remain intact.
This flexible multimodal interaction can be realized in diverse ubiquitous user experiences (UX), such as using live video steaming and chatting apps including YouTube, LiveMe, and AfreecaTV. FLUID can ensure that the video is not obscured by the chat window by distributing and displaying them separately on different devices respectively, which lets users enjoy the chat function while watching the video at the same time.
In addition, the UI for the destination input on a navigation app can be migrated into the passenger’s device with the help of FLUID, so that the destination can be easily and safely entered by the passenger while the driver is at the wheel.
FLUID can also support 5G multi-view apps – the latest service that allows sports or games to be viewed from various angles on a single device. With FLUID, the user can watch the event simultaneously from different viewpoints on multiple devices without switching between viewpoints on a single screen.
PhD candidate Sangeun Oh, who is the first author, and his team implemented the prototype of FLUID on the leading open-source mobile operating system, Android, and confirmed that it can successfully deliver the new UX to 20 existing legacy apps.
“This new technology can be applied to next-generation products from South Korean companies such as LG’s dual screen phone and Samsung’s foldable phone and is expected to embolden their competitiveness by giving them a head-start in the global market.” said Professor Shin.
This study will be presented at the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019) October 21 through 25 in Los Cabos, Mexico. The research was supported by the National Science Foundation (NSF) (CNS-1350883 (CAREER) and CNS-1618531).
< 20190720013941_34189_1203743741.jpg >
Figure 1. Live video streaming and chatting app scenario
< 20190720014000_86567_1135039187.jpg >
Figure 2. Navigation app scenario
< 20190720014026_10648_1001202444.jpg >
Figure 3. 5G multi-view app scenario
Publication:
Sangeun Oh, Ahyeon Kim, Sunjae Lee, Kilho Lee, Dae R. Jeong, Steven Y. Ko, and Insik Shin. 2019. FLUID: Flexible User Interface Distribution for Ubiquitous Multi-device Interaction. To be published in Proceedings of the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019). ACM, New York, NY, USA. Article Number and DOI Name TBD.
Video Material:
https://youtu.be/lGO4GwH4enA
Profile: Prof. Insik Shin, MS, PhD
ishin@kaist.ac.kr
https://cps.kaist.ac.kr/~ishin
Professor
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr
Daejeon 34141, Korea
Profile: Sangeun Oh, PhD Candidate
ohsang1213@kaist.ac.kr
https://cps.kaist.ac.kr/
PhD Candidate
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr
Daejeon 34141, Korea
Profile: Prof. Steve Ko, PhD
stevko@buffalo.edu
https://nsr.cse.buffalo.edu/?page_id=272
Associate Professor
Networked Systems Research Group
Department of Computer Science and Engineering
State University of New York at Buffalo
http://www.buffalo.edu/
Buffalo 14260, USA
(END)
-
research KAIST develops an artificial muscle device that produces force 34 times its weight
- Professor IlKwon Oh’s research team in KAIST’s Department of Mechanical Engineering developed a soft fluidic switch using an ionic polymer artificial muscle that runs with ultra-low power to lift objects 34 times greater than its weight. - Its light weight and small size make it applicable to various industrial fields such as soft electronics, smart textiles, and biomedical devices by controlling fluid flow with high precision, even in narrow spaces. Soft robots, medical devic
2024-01-11 -
research The cause of disability in aged brain meningeal membranes identified
Due to the increase in average age, studies on changes in the brain following general aging process without serious brain diseases have also become an issue that requires in-depth studies. Regarding aging research, as aging progresses, ‘sugar’ accumulates in the body, and the accumulated sugar becomes a causative agent for various diseases such as aging-related inflammation and vascular disease. In the end, “surplus” sugar molecules attach to various proteins in the body
2023-03-15 -
research Nanoscale Self-Assembling Salt-Crystal ‘Origami’ Balls Envelop Liquids
Mechanical engineers have devised a ‘crystal capillary origami’ technique where salt crystals spontaneously encapsulate liquid droplets Researchers have developed a technique whereby they can spontaneously encapsulate microscopic droplets of water and oil emulsion in a tiny sphere made of salt crystals—sort of like a minute, self-constructing origami soccer ball filled with liquid. The process, which they are calling ‘crystal capillary origami,’ could be used in a
2021-11-04 -
research Wearable Device to Monitor Sweat in Real Time
An on-skin platform for the wireless monitoring of flow rate, cumulative loss, and temperature of sweat in real time An electronic patch can monitor your sweating and check your health status. Even more, the soft microfluidic device that adheres to the surface of the skin, captures, stores, and performs biomarker analysis of sweat as it is released through the eccrine glands. This wearable and wireless electronic device developed by Professor Kyeongha Kwon and her collaborators is a digital
2021-06-25 -
research Ultrafast, on-Chip PCR Could Speed Up Diagnoses during Pandemics
A rapid point-of-care diagnostic plasmofluidic chip can deliver result in only 8 minutes Reverse transcription-polymerase chain reaction (RT-PCR) has been the gold standard for diagnosis during the COVID-19 pandemic. However, the PCR portion of the test requires bulky, expensive machines and takes about an hour to complete, making it difficult to quickly diagnose someone at a testing site. Now, researchers at KAIST have developed a plasmofluidic chip that can perform PCR in only about 8 minut
2021-06-08