Global semiconductor supplier STMicroelectronics has launched a solution for touchless gesture-based controls in simple and cost-effective industrial and consumer applications.
The solution includes free engineering software for use with ST's VL53L5CX FlightSense multi-zone time-of-flight (ToF) range sensor. Gesture recognition with ToF sensors is an innovative technology that enables sophisticated interactions with a wide variety of devices.
Initially a feature of high-end vehicles, gesture-based interaction can enhance multiple types of equipment, including kitchen appliances, thermostats, smart home controls and smart lighting, laptops, AR/VR headsets, tablets, and smartphones.
Additionally, in today's world, user interfaces capable of interpreting touchless gestures can help prevent infections from spreading through equipment such as vending and ticketing machines, elevator controls, and interactive signage.
ST is now making gesture sensing simpler and more accessible for mass-market applications with this latest companion software for its VL53L5CX multi-zone ToF range sensor. Together, the sensor and software calculate the X/Y/Z coordinates of the hand in real time, allowing hand tracking and thus recognition of gestures such as tapping, swiping, level control and much more.
Conventional gesture recognition systems typically use more expensive and intrusive camera-based machine vision. ST's solution allows designers to build systems that benefit from greater user privacy and lower power consumption, and that operate in the dark without the need for external lighting, unlike vision-based solutions.
The lightweight gesture algorithm can run on a low-power microcontroller and requires minimal system resources, so it is easily integrated into an existing application.
“Current trends are driving so-called edge devices to become more affordable and energy efficient, as well as more advanced and powerful,” said Eric Aussedat, executive vice president of ST's GM imaging subgroup. “ST is setting the pace with technologies like our FlightSense imaging product portfolio, which now adds free, out-of-the-box software that helps integrate gesture sensing for touchless control across all types of industrial and consumer equipment. ”
The STSW-IMG035 software package is specially designed for the VL53L5CX multi-zone direct time-of-flight (dToF) range sensor and can be used with all STM32 microcontrollers. The VL53L5CX is ST's next-generation ToF sensor, providing 64 zones with high accuracy ranging up to 400cm with a wide, square 63° diagonal field of view.
The ST Imaging team will present a webinar on gesture recognition, covering the principles, benefits and real-life applications of gestures, on April 26th.
