Solids on Soli: Millimetre-Wave Radar Sensing through Materials - Laboratoire Interdisciplinaire des Sciences du Numérique Access content directly
Journal Articles Proceedings of the ACM on Human-Computer Interaction Year : 2022

Solids on Soli: Millimetre-Wave Radar Sensing through Materials

Abstract

Gesture recognition with miniaturised radar sensors has received increasing attention as a novel interaction medium. The practical use of radar technology, however, often requires sensing through materials. Yet, it is still not well understood how the internal structure of materials impacts recognition performance. To tackle this challenge, we collected a large dataset of 14,090 radar recordings for 6 paradigmatic gesture classes sensed through a variety of everyday materials, performed by humans (6 materials) and a robot system (75 materials). Next, we developed a hybrid CNN+LSTM deep learning model and derived a robust indirect method to measure signal distortions, which we used to compile a comprehensive catalogue of materials for radar-based interaction. Among other findings, our experiments show that it is possible to estimate how different materials would affect gesture recognition performance of arbitrary classifiers by selecting just 3 reference materials. Our catalogue, software, models, data collection platform, and labeled datasets are publicly available.
Fichier principal
Vignette du fichier
soli-radar-materials.pdf (2.62 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04357827 , version 1 (21-12-2023)

Identifiers

Cite

Klen Čopič Pucihar, Nuwan Attygalle, Matjaz Kljun, Christian Sandor, Luis Leiva. Solids on Soli: Millimetre-Wave Radar Sensing through Materials. Proceedings of the ACM on Human-Computer Interaction , 2022, 6 (EICS), pp.1-19. ⟨10.1145/3532212⟩. ⟨hal-04357827⟩
16 View
9 Download

Altmetric

Share

Gmail Facebook X LinkedIn More