Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Aug 8;23(16):7025.
doi: 10.3390/s23167025.

Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles

Mona M Moussa  1 , Rasha Shoitan  1 , Young-Im Cho  2 , Mohamed S Abdallah  3   4
Affiliations

Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles

Mona M Moussa et al. Sensors (Basel). .

Abstract

Over the past several years, many children have died from suffocation due to being left inside a closed vehicle on a sunny day. Various vehicle manufacturers have proposed a variety of technologies to locate an unattended child in a vehicle, including pressure sensors, passive infrared motion sensors, temperature sensors, and microwave sensors. However, these methods have not yet reliably located forgotten children in the vehicle. Recently, visual-based methods have taken the attention of manufacturers after the emergence of deep learning technology. However, the existing methods focus only on the forgotten child and neglect a forgotten pet. Furthermore, their systems only detect the presence of a child in the car with or without their parents. Therefore, this research introduces a visual-based framework to reduce hyperthermia deaths in enclosed vehicles. This visual-based system detects objects inside a vehicle; if the child or pet are without an adult, a notification is sent to the parents. First, a dataset is constructed for vehicle interiors containing children, pets, and adults. The proposed dataset is collected from different online sources, considering varying illumination, skin color, pet type, clothes, and car brands for guaranteed model robustness. Second, blurring, sharpening, brightness, contrast, noise, perspective transform, and fog effect augmentation algorithms are applied to these images to increase the training data. The augmented images are annotated with three classes: child, pet, and adult. This research concentrates on fine-tuning different state-of-the-art real-time detection models to detect objects inside the vehicle: NanoDet, YOLOv6_1, YOLOv6_3, and YOLO7. The simulation results demonstrate that YOLOv6_1 presents significant values with 96% recall, 95% precision, and 95% F1.

Keywords: NanoDet; YOLO; child in vehicle; hyperthermia; in-cabin monitoring.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
The flowchart of the suggested visual-based child and pet in vehicle detection system.
Figure 2
Figure 2
Sample images from the proposed dataset.
Figure 3
Figure 3
The child- and pet-in-vehicle detection results for each model: (a) NanoDet; (b) YOLO6 v1; (c) YOLO6 v3; (d) YOLO7.
Figure 4
Figure 4
Common missed detections in the detection models.
Figure 5
Figure 5
Common false classifications in the detection models.
Figure 6
Figure 6
False-safe and false-dangerous examples: (a) NanoDet; (b) YOLO6 v1; (c) YOLO6 v3.
Figure 7
Figure 7
Confusion matrix for the detection models: (a) NanoDet; (b) YOLO6 v1; (c) YOLO6v3.
Figure 8
Figure 8
Sample frames from the DriverMVT dataset.
Figure 9
Figure 9
Effect of varying the illumination degree. First row: original image. Second row: decreasing illumination. Third row: increasing illumination.
See this image and copyright information in PMC

References

    1. Poon Y.-S., Lin C.-C., Liu Y.-H., Fan C.-P. YOLO-Based Deep Learning Design for In-Cabin Monitoring System with Fisheye-Lens Camera; Proceedings of the 2022 IEEE International Conference on Consumer Electronics (ICCE); Las Vegas, NV, USA. 7–9 January 2022.
    1. Miwata M., Tsuneyoshi M., Ikeda M., Barolli L. Performance Evaluation of an AI-Based Safety Driving Support System for Detecting Distracted Driving. Volume 496 LNNS. Springer International Publishing; Berlin/Heidelberg, Germany: 2022.
    1. Othman W., Kashevnik A., Ali A., Shilov N. DriverMVT: In-Cabin Dataset for Driver Monitoring Including Video and Vehicle Telemetry Information. Data. 2022;7:62. doi: 10.3390/data7050062. - DOI
    1. Eraqi H.M., Abouelnaga Y., Saad M.H., Moustafa M.N. Driver Distraction Identification with an Ensemble of Convolutional Neural Networks. J. Adv. Transp. 2019;2019:4125865. doi: 10.1155/2019/4125865. - DOI
    1. Khan S.S., Shen Z., Sun H., Patel A., Abedi A. Modified Supervised Contrastive Learning for Detecting Anomalous Driving Behaviours; Proceedings of the 2022 19th Conference on Robots and Vision (CRV); Toronto, ON, Canada. 31 May–2 June 2021.

LinkOut - more resources