Sea Horse Optimization-Deep Neural Network: A Medication Adherence Monitoring System Based on Hand Gesture Recognition

Abstract

Medication adherence is an essential aspect of healthcare for patients and is important for achieving medical objectives. However, the lack of standard techniques for measuring adherence is a global concern, making it challenging to accurately monitor and measure patient medication regimens. The use of sensor technology for medication adherence monitoring has received much attention lately since it makes it possible to continuously observe patients' medication adherence behavior. Sensor devices or smart wearables utilize state-of-the-art machine learning (ML) methods to analyze intricate data patterns and provide predictions accurately. The key aim of this work is to develop a sensor-based hand gesture recognition model to predict medication activities. In this research, a smart sensor device-based hand gesture prediction model is developed to recognize medication intake activities. The device includes a tri-axial gyroscope, geometric, and accelerometer sensors to sense and gather data from hand gestures. A smartphone application gathers hand gesture data from the sensor device, which is then stored in the cloud database in a .csv format. These data are collected, processed, and classified to recognize the medication intake activity using the proposed novel neural network model called Sea Horse Optimization-Deep Neural Network (SHO-DNN). The SHO technique is implemented to update the biases and weights and the number of hidden layers in the DNN model. By updating these parameters, the DNN model is improved in classifying the samples of hand gestures to identify the medication activities. The research model demonstrates impressive performance, with an accuracy of 98.59%, sensitivity of 97.82%, precision of 98.69%, and an F1 score of 98.48%. Hence, the proposed model outperformed the most available models in all the aforementioned aspects. The results indicate that this model is a promising approach for medication adherence monitoring in healthcare applications, instilling confidence in its effectiveness.

Keywords: hand gestures; machine learning; medication adherence; sensor; smart wearable.

Figure 1

Application of Wearable Sensor Device.

Figure 2

Pipeline of the Proposed Model.

Figure 3

Visual Specification of MetaMotionR Device.

Figure 4

Data Logging, Sensors Selection, and Data Collection using MetaBase App.

Figure 5

Patterns of DNN’s Spiral and Brownian Motions.

Figure 6

SHO Flowchart.

Figure 7

DNN Architecture.

Figure 8

Visualization of Data Collected from the Sensor Device.

Figure 9

Graphical Plot of SHO-DNN Model’s Accuracy.

Figure 10

Graphical Plot of SHO-DNN Model’s Sensitivity.

Figure 11

Graphical Plot of SHO-DNN Model’s Precision.

Figure 12

Graphical Plot of SHO-DNN Model’s F1-score.

Figure 13

Graphical Plot of Accuracy Comparison.

Figure 14

Graphical Plot of Sensitivity Comparison.

Figure 15

Graphical Plot of Precision Comparison.

Figure 16

Graphical Plot of F1-score Comparison.