Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 May;52(5):1227-1234.
doi: 10.1249/MSS.0000000000002221.

Free-living Evaluation of Laboratory-based Activity Classifiers in Preschoolers

Matthew N Ahmadi, Denise Brookes  1 , Alok Chowdhury  2 , Toby Pavey  3 , Stewart G Trost
Affiliations

Free-living Evaluation of Laboratory-based Activity Classifiers in Preschoolers

Matthew N Ahmadi et al. Med Sci Sports Exerc. 2020 May.

Abstract

Machine learning classification models for accelerometer data are potentially more accurate methods to measure physical activity in young children than traditional cut point methods. However, existing algorithms have been trained on laboratory-based activity trials, and their performance has not been investigated under free-living conditions.

Purpose: This study aimed to evaluate the accuracy of laboratory-trained hip and wrist random forest and support vector machine classifiers for the automatic recognition of five activity classes: sedentary (SED), light-intensity activities and games (LIGHT_AG), walking (WALK), running (RUN), and moderate to vigorous activities and games (MV_AG) in preschool-age children under free-living conditions.

Methods: Thirty-one children (4.0 ± 0.9 yr) were video recorded during a 20-min free-living play session while wearing an ActiGraph GT3X+ on their right hip and nondominant wrist. Direct observation was used to continuously code ground truth activity class and specific activity types occurring within each class using a bespoke two-stage coding scheme. Performance was assessed by calculating overall classification accuracy and extended confusion matrices summarizing class-level accuracy and the frequency of specific activities observed within each class.

Results: Accuracy values for the hip and wrist random forest algorithms were 69.4% and 59.1%, respectively. Accuracy values for hip and wrist support vector machine algorithms were 66.4% and 59.3%, respectively. Compared with the laboratory cross validation, accuracy decreased by 11%-15% for the hip classifiers and 19%-21% for the wrist classifiers. Classification accuracy values were 72%-78% for SED, 58%-79% for LIGHT_AG, 71%-84% for MV_AG, 9%-15% for WALK, and 66%-75% for RUN.

Conclusion: The accuracy of laboratory-based activity classifiers for preschool-age children was attenuated when tested on new data collected under free-living conditions. Future studies should train and test machine learning activity recognition algorithms using accelerometer data collected under free-living conditions.

PubMed Disclaimer

References

    1. Trost SG. Measurement of physical activity in children and adolescents. Am J Lifestyle Med. 2007;1(4):299–314.
    1. Cliff DP, Reilly JJ, Okely AD. Methodological considerations in using accelerometers to assess habitual physical activity in children aged 0–5 years. J Sci Med Sport. 2009;12(5):557–67.
    1. Janssen X, Cliff DP, Reilly JJ, et al. Predictive validity and classification accuracy of ActiGraph energy expenditure equations and cut-points in young children. PLoS One. 2013;8(11).
    1. Okely AD, Batterham MJ, Hinkley T, et al. Wrist acceleration cut-points for moderate-to-vigorous physical activity in youth. Med Sci Sport Exerc. 2018;50(3):609–16.
    1. Trost SG, Loprinzi PD, Moore R, Pfeiffer KA. Comparison of accelerometer cut points for predicting activity intensity in youth. Med Sci Sports Exerc. 2011;43(7):1360–8.

Publication types