September 30–October 4, Miami, FL, USA | Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel
WiSee is a novel gesture recognition system that leverages wireless signals, such as Wi-Fi, to enable whole-home sensing and recognition of human gestures. The system does not require line-of-sight or instrumentation of the human body with sensing devices, making it suitable for deployment in various environments. WiSee achieves this by detecting minute Doppler shifts and multi-path distortions in wireless signals caused by human motion. The system uses a proof-of-concept prototype implemented using USRP-N210s and evaluates its performance in an office environment and a two-bedroom apartment. The results show that WiSee can classify nine gestures with an average accuracy of 94%. The system addresses challenges such as capturing gesture information from wireless signals and dealing with multiple humans in the environment using MIMO capabilities and repetitive gestures as preambles. WiSee's performance is evaluated in various scenarios, including line-of-sight, non-line-of-sight, and through-the-wall, demonstrating its feasibility and robustness.WiSee is a novel gesture recognition system that leverages wireless signals, such as Wi-Fi, to enable whole-home sensing and recognition of human gestures. The system does not require line-of-sight or instrumentation of the human body with sensing devices, making it suitable for deployment in various environments. WiSee achieves this by detecting minute Doppler shifts and multi-path distortions in wireless signals caused by human motion. The system uses a proof-of-concept prototype implemented using USRP-N210s and evaluates its performance in an office environment and a two-bedroom apartment. The results show that WiSee can classify nine gestures with an average accuracy of 94%. The system addresses challenges such as capturing gesture information from wireless signals and dealing with multiple humans in the environment using MIMO capabilities and repetitive gestures as preambles. WiSee's performance is evaluated in various scenarios, including line-of-sight, non-line-of-sight, and through-the-wall, demonstrating its feasibility and robustness.