Making Sense of Doppler Effect for Multi-Modal Hand Motion Detection

Ruan, W, Sheng, Q, Xu, P, Yang, L, Gu, T and Shangguan, L 2018, 'Making Sense of Doppler Effect for Multi-Modal Hand Motion Detection', IEEE Transactions on Mobile Computing, vol. 17, no. 9, pp. 2087-2100.


Document type: Journal Article
Collection: Journal Articles

Title Making Sense of Doppler Effect for Multi-Modal Hand Motion Detection
Author(s) Ruan, W
Sheng, Q
Xu, P
Yang, L
Gu, T
Shangguan, L
Year 2018
Journal name IEEE Transactions on Mobile Computing
Volume number 17
Issue number 9
Start page 2087
End page 2100
Total pages 14
Publisher IEEE
Abstract Hand gesture is becoming an increasingly popular means of interacting with consumer electronic devices, such as mobile phones, tablets and laptops. In this paper, we present AudioGest, a device-free gesture recognition system that can accurately sense the hand in-air movement around user's devices. Compared to the state-of-the-art, AudioGest is superior in using only one pair of built-in speaker and microphone, without any extra hardware or infrastructure support and with no training, to achieve a multi-modal hand detection. Specifically, our system is not only able to accurately recognize various hand gestures, but also reliably estimate the hand in-air duration, average moving speed and waving range. We address various challenges including cleaning the noisy reflected sound signal, interpreting the echo spectrogram into hand gestures, decoding the Doppler frequency shifts into the hand waving speed and range, as well as being robust to the environmental motion and signal drifting. We extensively evaluate our system on three electronic deivces under four real-world scenarios using overall 3,900 hand gestures collected by five users for more than two weeks. Our results show that AudioGest detects six hand gestures with an accuracy up to 96%, and by distinguishing the gesture attributions, it can provide up to 162 control commands for various applications.
Subject Mobile Technologies
Networking and Communications
Ubiquitous Computing
DOI - identifier 10.1109/TMC.2017.2762677
Copyright notice © 2017 IEEE
ISSN 1536-1233
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 1 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 0 times in Scopus Article
Altmetric details:
Access Statistics: 4 Abstract Views  -  Detailed Statistics
Created: Thu, 31 Jan 2019, 11:26:00 EST by Catalyst Administrator
© 2014 RMIT Research Repository • Powered by Fez SoftwareContact us