Micro-Gesture Interaction on the Gear Shift

Micro-Gesture Interaction on the Gear Shift

From the abstract: “Modern cars offer a wide variety of infotainment functionality, including music players, navigation systems and full-featured internet access. Traditional interaction methods using buttons and knobs have long reached their limits and the frequently used touch screens require the drivers visual attention reducing driving safety. Gestural interaction is a promising solution to cope with the complexity of modern in-vehicle information systems with less distraction. To further explore this idea, micro-gesture interaction on the gear shift is investigated in this thesis.

Therefore, a prototype for gesture recognition as well as for an infotainment system is developed. The sensing device to recognize the gestures is the depth image based Intel RealSense camera. Its comprehensive SDK can detect a predefined set of gestures and provides access to the hand tracking data to implement additional gestures. A suitable set of gestures for infotainment interaction is selected and implemented.

The infotainment system is designed for dual use with gesture interaction in combination with a head-up display as well as touchscreen interaction. It provides some of the most commonly found infotainment functions. The two independently working systems can interact by using a simple network protocol. Both can easily be customized and extended. The infotainment interaction using micro-gestures on the gear shift in combination with a head-up display has yet to be evaluated in an experimental user study. A detailed plan for a suitable user study is presented”.

Read the full thesis.