Fraunhofer researchers unveil gesture recognition using ultrasound

The components are extremely small and inexpensive to produce, allowing for high sound pressure, and provide a flexible frequency design for an optimal balance of distance and sensitivity.

Simple hand movements have become common place through the popularity of the smartphone buts these types of gesture controls require access to a touch screen. Contactless solutions for man-machine communications are required in cases where a touch screen is not available, or hands and fingers cannot be used. Systems assisting in speech recognition and interpretation in particular are already growing in popularity. However, these systems rely on quiet environments free from external noise disturbances and are sometimes unsuitable for use in public areas.

Fraunhofer IPMS researchers are working on an alternative approach to provide non-contact, three-dimensional recording of distance, movement and gesture for communication with robots as well as in surgical areas and household systems.

Scientists have developed a micro-chip architecture that can generate and receive ultrasound up to 300 kHz. Reflected sound waves are analysed by measuring, for example, how long it took the wave to travel between the sensor system and the reflecting object, or how frequencies shifted due to the Doppler effect.

Evaluation of the ultrasound provides a spatial resolution for natural movements and gestures in the sub-centimetre range at distances up to half a meter.

Fraunhofer IPMS representatives said that the ultrasonic transducer has advantages over competing optical sensor methods. According to group leader Sandro Koch, “Compared to camera-based systems, our ultrasonic sensors enable the construction of significantly cheaper electronic and software systems due to longer signal transit times. Our transducers are not susceptible to stray light and allow for reliable data acquisition on optically transparent surfaces as well. Our systems are CMOS-compatible, are considerably more compact, and can be inexpensively produced in mass quantities.”

Researchers are implementing a new class of electrostatic micro-electro-mechanical (MEMS) bending actuators which have been continuously further advanced for generating sound in micro-loudspeakers and use in micropumps since 2016.

The Fraunhofer IPMS proprietary nano-e-drive (NED) principle uses the high forces of electrostatic fields in nanometer-sized electrode gaps to allow for mechanical movements with displacements in ranges of several microns. The chip surface as well as the complete component volume is used for sound generation.

Koch explains, “Using the entire chip volume for sound generation enables us to produce very small components. Because hundreds of such devices can fit on a single wafer – and multiple wafers can be simultaneously processed in single process steps – the cost of manufacturing large volumes is potentially low.”

Fraunhofer researchers expect that high air volume flows that have been converted into high sound pressure will support further development to provide an increased signal-to-noise ratio for low-frequency ultrasonic transducers.The resonance frequency and thus the detection range and spatial resolution can then be defined by the geometry of the NED bending actuators.

Possible fields of applications for ultrasound-based non-contact motion detection include uses in automation, safety and medical technology as well as the automotive and entertainment and household electronics industries.