STMicroelectronics, a global semiconductor supplier serving customers across the spectrum of electronics applications, has unveiled its latest FlightSense Time-of-Flight (ToF) multi-zone sensor. Delivered alongside a suite of valuable software algorithms, the combination provides an out-of-the-box solution for user detection, gesture recognition and intrusion alerting, specifically designed for the PC market.
ST's FlightSense multi-zone sensors continuously scan your field of view to map the scene and collect information without using a camera or recording images. By using ToF technology, sensors can detect and track multiple targets, calculating their X/Y/Z coordinates and movement at high speed.
The latest VL53L5CP FlightSense multi-zone sensor can detect multiple targets in 64 (8x8) zones within a wide 61-degree field of view. The sensor comes with Presence Premium PLUS, the third generation of ST's proprietary algorithms dedicated to PC applications, supporting its advanced and innovative features and enhancing data protection. Interacting with native aspects of the PC's hardware and operating system, this turnkey solution is certified at the highest level by Intel.
VL53L5CP and Presence Premium PLUS software are optimized for PC applications and supported on Windows 11. PC designers can thus implement innovative features including intelligent power management, enhanced security, and touchless user interaction.
ST's presence solution pioneered wake-on-approach and walk-away lock, which enable a seamless, “always on” user experience while maximizing battery power savings. Automatic and immediate blocking also prevents unauthorized access and protects data while the user is away.
Additionally, Multi-Human Sensing (MHD) detects other people in the field of view and analyzes their position and movements to assess security risks such as “shoulder surfing”. In relevant situations, the system alerts the user.
Another revolutionary innovation in the VL53L5CP is reliable touchless gesture detection, which allows the user to control PC applications without touching the screen, keyboard or mouse. The sensor can detect directional movements and touches, as well as level adjustments. With access to this information, developers can easily implement instructions such as next or previous slide/music/video, play/pause, and volume control.
Global PC and technology company Lenovo is integrating ST's presence solution into select laptops. ,
“Today’s mobile and flexible work lifestyles demand privacy and ease of use to maximize productivity,” said Zhaochun Ma, vice president of Lenovo’s Consumer and SMB Notebook Development Center, Smart Devices Group. “That's why we integrated ST's presence solution based on cameraless ToF detection into Lenovo PCs. From logging in and locking your device hands-free based on human presence detection to using hand gestures to swipe content, we are making Lenovo PCs smarter and more adaptable.”
ST's Presence Premium PLUS software also enables PC designers to develop custom AI applications on Windows, leveraging the VL53L5CP sensor's 8x8 multi-zone data to detect user intent, with continuous presence detection. Additionally, dynamic programming of the VL53L5CP's key parameters in Windows allows the end user to customize parameters such as lock/wake time and distances.
By enabling these features using non-vision-based ToF technology instead of the PC's webcam, the VL53L5CP enables superior differentiation in several aspects. Imageless eliminates any privacy concerns. The sensor is always on, hidden behind the frame, thus eliminating dependence on the position of the webcam shutter. Furthermore, the sensor integrates a 940 nm VCSEL infrared light emitter, invisible to human eyes, which guarantees full performance in the dark or in low light conditions. In contrast, cameras need a dedicated LED that consumes a lot of power to illuminate the scene.
ST's FlightSense technology outperforms many other techniques used for human detection. These include traditional infrared sensors, which do not measure distances and are affected by the color and reflectance of detected objects. Ultrasound is sensitive to noisy environments and can affect pets' hearing. Radar requires very complex software development in addition to energy-intensive signal processing.
“We continue to further unlock the extraordinary potential of our FlightSense ToF technology to enable imaginative capabilities across a full range of smart products,” said Eric Aussedat, executive vice president and general manager of ST's imaging subgroup. “Now entering its fourth generation, our latest ToF sensor enables PCs to understand their users, creating a stronger connection and a more rewarding ownership experience.”