ElaStick, a handheld variable stiffness display, renders the dynamic haptic response of a flexible object
Haptic controllers play an important role in providing rich and immersive virtual reality experiences. Professor Andrea Bianchi’s team in the Department of Industrial Design recreated the haptic response of flexible objects made of different materials and with different shapes by changing the stiffness of a custom-controller – ElaStick.
ElaStick is a portable hand-held force-feedback controller that is capable of rendering the illusion of how flexible and deformable objects feel when held in the hand. This VR haptic controller can change its stiffness in two directions independently and continuously. Since providing haptic feedback enhances the VR experience, researchers have suggested numerous approaches for rendering the physical properties of virtual objects - such as weights, the movement of mass, impacts, and damped oscillations.
The research team designed a new mechanism based on a quaternion joint and four variable-stiffness tendons. The quaternion joint is a two-DoF bending joint that enables ElaStick to bend and oscillate in any direction using a pair of tendons with varying stiffness. In fact, each tendon around the joint is made of a series of elastic rubber bands and inelastic fishing lines and can vary its stiffness by changing the proportion of the two materials. Thanks to these structures, each pair of tendons can behave independently, controlling the anisotropic characteristics of the entire device.
“The main challenge was to implement the mechanism to control the stiffness while maintaining independence between deformations in two perpendicular directions,” said Professor Bianchi.
The research team successfully measured the relative threshold of human perception on the stiffness of a handheld object. The results showed that the just-noticeable difference (JND) of human perception of stiffness is at most about 30% of the change from the initial value. It also found that appropriate haptic responses significantly enhance the quality of the VR experience. The research team surveyed the perceived realism, immersion, and enjoyment of participants after they played with various flexible objects in VR.
“It is meaningful that the haptic feedback of a flexible object was mechanically reproduced and its effectiveness in VR was proven. ElaStick has succeeded in implementing a novel mechanism to recreate the dynamic response of flexible objects that mimic real ones, suggesting a new category of haptic feedback that can be provided in VR,” explained Professor Bianchi.
The team plans to extend the ElaStick’s applications, from being used merely as a game controller to driving simulations, medical training, and many other digital contexts. This research, led by MS candidate Neung Ryu, won the Best Paper Award at the ACM UIST 2020 (the ACM Symposium on User Interface Software & Technology) last month.
-Profile
Professor Andrea Bianchi
Makinteract.kaist.ac.kr
Department of Industrial Design
KAIST
KAIST (President Kwang Hyung Lee) is a high-speed, low-power artificial intelligence (AI: Artificial Intelligent) semiconductor* MetaVRain, which implements artificial intelligence-based 3D rendering that can render images close to real life on mobile devices. * AI semiconductor: Semiconductor equipped with artificial intelligence processing functions such as recognition, reasoning, learning, and judgment, and implemented with optimized technology based on super intelligence, ultra-low power,
2023-03-13Professor Sang Su Lee from the Department of Industrial Design and his team’s five apps made in collaboration with NH Investment and Securities won iF Design Awards in the fields of UI, UX, service design, product design, and communication. These apps are now offered as NH Investment and Securities mobile applications. The iF Design Awards recognize top quality creativity in product design, communication, packaging, service design and concepts, and architecture and interior design, as w
2022-05-10The GSI Forum 2021 will explore the potential of new metaverse technologies that will change our daily lives KAIST will be hosting a live online international forum on Sept.8 at 9 am (KST) through its KAIST YouTube channel. The forum will explore global trends regarding metaverse technology innovations and applications and discuss how we can build a new technology ecosystem. Titled `Digital Big Bang, Metaverse Technology,' the Global Strategy Institute-International Forum 2021 will be the f
2021-09-07With the importance of non-contact environments growing due to COVID-19, tactile electronic devices using haptic technology are gaining traction as new mediums of communication. Haptic technology is being applied in a wide array of fields such as robotics or interactive displays. haptic gloves are being used for augmented information communication technology. Efficient piezoelectric materials that can convert various mechanical stimuli into electrical signals and vice versa are a prerequisit
2021-02-02A deep-learning powered single-strained electronic skin sensor can capture human motion from a distance. The single strain sensor placed on the wrist decodes complex five-finger motions in real time with a virtual 3D hand that mirrors the original motions. The deep neural network boosted by rapid situation learning (RSL) ensures stable operation regardless of its position on the surface of the skin. Conventional approaches require many sensor networks that cover the entire curvilinear surfac
2020-06-10