Zeyuan Zhang and Xuechun Tao · CLIENT: Tick Design Labs (Shanghai)
Thermal Sense is a driver monitoring interface for cars. Thermal Sense replaces the usual in-car camera with a low-resolution thermal sensor that records only heat patterns, so no identifiable images are created. The sensor module measures 40 by 30 by 20 millimeters and is mounted on the rearview mirror for wide cabin coverage. Neural networks analyze eye closure rates and head movements to detect drowsiness, distraction and the presence of a child. Safety alerts are given in less than 100 milliseconds, and privacy is protected at the data level.
Press Kit
- Unique Properties
- With the increasing requirement for in-car cameras to monitor drivers and support assisted driving systems, Thermal Sense offers a groundbreaking alternative. It replaces traditional cameras with low-resolution thermal sensors, capturing only heat signatures to eliminate privacy risks. This system ensures data-level privacy while detecting drowsiness, distractions, and child presence using advanced machine learning. By prioritizing safety and privacy, Thermal Sense sets a new benchmark.
- Dimensions & Packaging
- The thermal sensor module measures 40mm x 30mm x 20mm and is mounted discreetly on the rearview mirror for optimal cabin coverage. It features a low-resolution array of 32x32 pixels with a thermal sensitivity of ± 0.1°C. The system operates in real-time with a latency of under 100ms, powered by a custom hardware platform integrating convolutional neural network architectures. The package is lightweight, energy-efficient, and optimized for seamless automotive integration.
- Tags
- thermal imaging, privacy monitoring, driver analysis, cabin safety, thermal sensors, non-invasive, AI
- Production Technology
- Thermal Sense integrates a thermal sensor at the rearview mirror for wide-angle cabin coverage. Sourced with customized original equipment manufacturer specifications, the sensor detects minute thermal variations, ensuring high sensitivity for monitoring physiological parameters. Advanced convolutional neural network process thermal data, analyzing key indicators like eye closure rates and head movements. A robust real-time pipeline enhances image quality, extracts features, and provides immediate safety alerts.
- Design Challenge
- Limited availability of high-quality, low-cost thermal sensors and real-time processing technology were overcome through iterative testing and collaboration with original equipment manufactures and artificial intelligence experts.
- Project Duration
- The project commenced in January 2023 in Shanghai, China, and was completed in October 2024. Research, development, and testing phases were conducted in collaboration with leading automotive technology innovation labs.
- Operation Flow
- Thermal Sense operates seamlessly in the background, using a thermal sensor to monitor the cabin without capturing identifiable images. Installed on the rearview mirror, it detects heat patterns to identify driver drowsiness, distractions, or child presence. The system provides real-time alerts, ensuring safety without compromising privacy. Its unobtrusive design and precise detection deliver reliable results, creating a safer and more privacy-conscious driving experience.
- Research
- Using an in-between method, we cross-compared the thermal sensor approach with traditional cameras for measuring driver behavior. Controlled experiments with 50 participants assessed drowsiness and distractions. Results showed no significant performance difference between the two methods. This demonstrates that the thermal approach is as effective as cameras while eliminating privacy concerns, making it a superior, privacy-conscious solution.
- Inspiration
- Inspired by advancements in thermal imaging and the need for privacy-focused solutions, Thermal Sense addresses mandatory driver monitoring requirements without compromising identity. Research shows the efficacy of thermal sensors in detecting behavior and ensuring safety. By eliminating human-identifiable color images, it prioritizes privacy while monitoring driver attention, passenger activity, and child presence.
- Image Credits
- All Image: Zeyuan Zhang
- Patents
- Copyrights belong to Zeyuan Zhang, and Tick Design Labs (Shanghai)
Press releases are available in 1 languages.