Data fusion of body-worn accelerometers and heart rate to predict VO2max during submaximal running

Abstract

Maximal oxygen uptake (VO2max) is often used to assess an individual’s cardiorespiratory fitness. However, measuring this variable requires an athlete to perform a maximal exercise test which may be impractical, since this test requires trained staff and specialized equipment, and may be hard to incorporate regularly into training programs. The aim of this study is to develop a new model for predicting VO2max by exploiting its relationship to heart rate and accelerometer features extracted during submaximal running. To do so, we analyzed data collected from 31 recreational runners (15 men and 16 women) aged 19-26 years who performed a maximal incremental test on a treadmill. During this test, the subjects’ heart rate and acceleration at three locations (the upper back, the lower back and the tibia) were continuously measured. We extracted a wide variety of features from the measurements of the warm-up and the first three stages of the test and employed a data-driven approach to select the most relevant ones. Furthermore, we evaluated the utility of combining different types of features. Empirically, we found that combining heart rate and accelerometer features resulted in the best model with a mean absolute error of 2.33 ml ⋅ kg−1 ⋅ min−1 and a mean absolute percentage error of 4.92%. The model includes four features: gender, body mass, the inverse of the average heart rate and the inverse of the variance of the total tibia acceleration during the warm-up stage of the treadmill test. Our model provides a practical tool for recreational runners in the same age range to estimate their VO2max from submaximal running on a treadmill. It requires two body-worn sensors: a heart rate monitor and an accelerometer positioned on the tibia.

About the Authors:

Arne De Brabandere

Roles Conceptualization, Formal analysis, Methodology, Software, Validation, Visualization, Writing – original draft

* E-mail: [email protected]

Affiliation: Department of Computer Science, KU Leuven, Leuven, Belgium

ORCID logo http://orcid.org/0000-0002-1918-5805

Tim Op De Beéck

Roles Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing

Affiliation: Department of Computer Science, KU Leuven, Leuven, Belgium

Kurt H. Schütte

Roles Conceptualization, Data curation, Investigation, Project administration, Resources, Supervision, Validation, Writing – original draft

Affiliations Department of Movement Sciences, KU Leuven, Leuven, Belgium, Department of Sport Sciences, Stellenbosch University, Stellenbosch, South Africa

Wannes Meert

Roles Conceptualization, Methodology, Project administration, Supervision, Validation, Writing – review & editing

Affiliation: Department of Computer Science, KU Leuven, Leuven, Belgium

Benedicte Vanwanseele

Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing

Affiliation: Department of Movement Sciences, KU Leuven, Leuven, Belgium

Jesse Davis

Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Validation, Writing – review & editing

Affiliation: Department of Computer Science, KU Leuven, Leuven, Belgium

Introduction

In endurance sports such as distance running and cycling, there is a large interest among coaches and sports scientists to monitor the cardiorespiratory fitness of athletes for both inter- and intra-athlete comparison. This is often measured in terms of the maximal oxygen uptake (VO2max), which is defined as the maximal rate at which an individual can consume oxygen during exercise. VO2max is one of the primary determinants of endurance performance [1], alongside the fractional utilization of VO2max (lactate threshold), and economy of movement [2].

Typically, VO2max is measured by performing a maximal incremental running test on a treadmill. However, VO2max testing is often too expensive for non-elite athletes, since maximal exercise tests must be administered by trained staff in a lab set-up with specialized equipment. According to the ACSM guidelines on exercise testing [3], the staff should be capable of recognizing contraindications to performing maximal exercise tests and to interpret an electrocardiogram (ECG) as the participants exercise until volitional exhaustion. Moreover, for athletes who follow a training program, it may be hard to incorporate maximal tests regularly into their training plan, as these may interfere with the planned training sessions.

These limitations have motivated the development of models that can predict VO2max from submaximal exercise. An extensive overview by Abut et al. [4] compares various maximal, submaximal, and non-exercise models. We focus on the latter two since we are predicting VO2max from submaximal exercise. Typically, the models are constructed by viewing this as a regression problem. Thus the two key design choices are selecting the model class, and defining the relevant predictor variables. In terms of model class, most approaches use linear regression but some studies have considered support vector regression and artificial neural networks. The predictor variables (“features”) used in existing models fall in two categories: non-exercise features and features collected during submaximal exercise.

In Abut et al.’s overview, all models included non-exercise features such as gender, age, body mass, height, and BMI. Some studies also considered features based on questionnaire responses such as the perceived functional ability [5–8] (i.e., a person’s self-reported ability to walk, jog or run at a comfortable pace for 1 mile (1.609 km) and for 3 miles (4.828 km)), and physical activity rating [9] (i.e., a person’s self-rated physical activity level during the past 6 months).

Several studies have also included features collected during submaximal exercise [10–15] by measuring the average heart rate during walking or running, or the heart rate at the end of exercising for a set time or distance. Furthermore, these are often augmented with features such as the time needed to cover a set distance, the distance covered in a fixed time period [11–13], or features extracted from accelerometer signals [14, 15]. Weyand et al. [14] considered the average heart rate (HR) and the inverse of the foot-ground contact time () as measured by a specifically designed, non-commercial, foot-based accelerometer during running. Tönis et al. [15] considered heart rate and the “level of activity” during walking at two different velocities. The level of activity was defined as the sum of the integrals of the absolute value of the acceleration for the three accelerometer axes. Other studies have used the relation between heart rate and features derived from accelerometer data by monitoring subjects in free-living conditions. The accelerometer features in these studies included total acceleration [16], accelerometer counts [17, 18], step counts [19, 20], and walking speed derived from the acceleration signals [21].

The existing approaches for predicting VO2max have several limitations. Many of the models [5–8] rely on subjective features collected from questionnaires, and an individual’s poor or misleading answers may unduly affect the results. Including features derived from heart rate and accelerometer sensors overcomes this drawback, as these sensors are considered to be objective methods for monitoring physical activity [22, 23]. They have been used in previous studies based on submaximal running for several minutes [14], walking for a fixed duration [15], and free-living conditions where participants wore sensors throughout the day without adhering to a specific protocol [16–21]. Besides using objective measurements, these methods also allow estimating VO2max from daily activities. While most of these studies rely on data measured during a full day, or even multiple days, those by Weyand et al. [14] and Tönis et al. [15] only need several minutes of exercise. We argue that a short protocol offers the advantage of making it easier to incorporate VO2max estimation into exercise routines, since it only requires an individual to wear the sensors for a short amount of time instead of a full day. However, both of these studies have their limitations as well. Tönis et al. did not verify their model’s predictions using subjects’ true VO2max. Instead, they checked how well their model’s predictions correlated with a subject’s estimated VO2max as determined by a submaximal walking test [24]. Therefore, it is unclear how accurate their model is in practice. Weyand et al.’s model relies on using a specialized foot-based accelerometer to measure foot-ground contact time. This requires buying a specialized sensor with a high sampling rate, which recreational athletes may not want to do. Both Weyand et al. and Tönis et al. only included one or two hand-selected features in their model. Particularly when confronted with multi-sensor data, it is difficult for a domain expert to hand select all the relevant features that should be included in a model.

To address these limitations, this study considers descriptive features along with a large set of features constructed from heart rate and accelerometer measurements collected during submaximal running on a treadmill. Then, it employs a data-driven approach to select a small number of the most predictive features to include in a linear regression model for predicting VO2max. Furthermore, we evaluate how the performance is affected by combining heart rate features and accelerometer features compared to using these features separately.

Data collection

Subjects

A sample of convenience including 31 recreational runners (15 men and 16 women aged 19-26 years) volunteered to participate in this study. Subjects were recruited during March 2016 via local advertisements and flyers, and were invited to participate via e-mail correspondence if they met the inclusion-exclusion criteria of the study. Only subjects who had been running regularly and had prior experience with treadmill running were eligible to be included in the study. All subjects had no self-reported history of metabolic, neurological, pulmonary, or cardiovascular disease or surgery to the back or lower limbs. Furthermore, all were symptom-free of any lower extremity injury for at least six months prior to the study. All runners provided written informed consent prior to participation in accordance with the Declaration of Helsinki. The local ethics committee of Stellenbosch University approved the study (#SU-HSD-002032).

20 of the initial 31 who participated in the first VO2max test volunteered to participate in a second VO2max test after undergoing a supervised eight-week training intervention designed to improve the aerobic capacity of running. During this intervention, there were seven dropouts (five due to running-related injury and two due to lack of training adherence). Thus a total of 13 subjects (four men and nine women) were able to perform a second VO2max test post intervention. In our analysis, we included the first test of all participants, as well as the second one if it was performed. As a runner’s VO2max can change as a result of training activities, we tried to incorporate this type of variability in our dataset by including both tests.

Protocol

Each subject performed one or two maximal incremental running tests to exhaustion on a motorized treadmill (Saturn h/p/cosmos, Nussdorf-Traunstein, Germany). If two tests were performed, the second one always took place at least seven weeks after the first test. An example of the protocol is shown in Fig 1. The test began with a four minute warm-up, at a running speed of 8 km ⋅ hr−1 for women and 9 km ⋅ hr−1 for men. After the warm-up, the test proceeded with four minute stages, each of which was followed by one minute of rest, until volitional exhaustion. The first stage employed the same running speed used during the warm-up, and each new stage saw the treadmill speed increase discontinuously in increments of 1.5 km ⋅ hr−1. The treadmill gradient was fixed at 1% throughout the submaximal assessments to reflect the energetic cost of outdoor running [25]. Participants could run in their own relatively new (within three months of use) conventional shod running shoes. All tests were performed under similar laboratory conditions (20-25°C, 50-60% relative humidity, and an altitude of 130m). Participants were fitted with an adjustable safety harness during the entire treadmill test. Each subject reported a rating of perceived exertion score [26] immediately after each stage. Runners were considered to have achieved VO2max when at least two of the following criteria were fulfilled:

1. a plateau in the oxygen uptake (VO2) as defined by an increase of less than 1.5 ml ⋅ kg−1 ⋅ min−1 in two consecutive stages;

2. a respiratory exchange ratio (RER) > 1.15;

3. a maximal heart rate value (HRmax) > 95% of the age-predicted maximum (220 − age);

4. a rating of perceived exertion (RPE) ≥ 19 on the 6-20 Borg scale.

All tests were terminated by volitional exhaustion, and all subjects achieved VO2max by the set criteria. Specifically, all subjects met the first and second criteria (VO2 plateau; RER > 1.15), while three subjects failed to meet the third criterion (one with a faulty HR reading and two with a HRmax of 90% and 92% respectively), and two failed to meet the fourth criterion (RPE of 18 and 18.5 respectively).

[Figure omitted. See PDF.]

Fig 1. Example of the protocol for a male runner reaching stage 6.

https://doi.org/10.1371/journal.pone.0199509.g001

For the analysis, six treadmill tests were excluded from the dataset. The heart rate measurements of four tests showed an irregular pattern that was probably caused by a poorly connected heart rate strap. In two other tests, the accelerometer data failed to record. Table 1 shows the descriptive characteristics of the participants for the remaining treadmill tests.

[Figure omitted. See PDF.]

Table 1. Descriptive characteristics of the subjects.

Notation: mean ± SD.

https://doi.org/10.1371/journal.pone.0199509.t001

Measurements

In this section, we describe the data measured during the treadmill tests that will be used to calculate VO2max and the features for the prediction models.

Oxygen uptake.

The pulmonary gas exchange was recorded throughout the incremental test using a breath-by-breath metabolic analyzer (Cosmed Quark CPET, Rome, Italy). The gas analyzers were calibrated before each session to 16% O2, 4% CO2 balance N2 and the turbine flow meter was calibrated with a 3L calibration syringe before each test. Oxygen uptake (VO2) was calculated from the O2 measurements divided by body mass. For each treadmill test, the maximal oxygen uptake (VO2max) of the runner was calculated as the maximum value of the rolling average of the VO2 signal with a window length of 30 seconds.

Heart rate.

During each treadmill test, the subject’s heart rate (HR) was sampled breath-by-breath according to the gas exchange using a heart rate monitor (Cosmed Quark CPET, Rome, Italy). The samples were then averaged every 10 seconds. As the averaged signal was often still noisy, small fluctuations and sudden peaks were removed by smoothing the signal using a median filter, where each measurement xt was replaced by the median of {xt−3, …, xt, …, xt+3}.

Acceleration.

Acceleration was measured using wearable inertial measurement units (Shimmer3 wireless IMU, sampling rate 1024Hz, range ±16g, Dublin, Ireland) at four locations: upper back, lower back, and left and right tibia, as shown in Fig 2. The upper back accelerometer was aligned between the shoulder blades at the level of the C7-T2 spinal processes. The lower back accelerometer was aligned between the posterior superior iliac spines at the level of the L3-L5 spinal processes, and the tibial accelerometers were aligned on the antero-medial aspect of the distal tibia, 8cm above the medial malleolus. In two tests, one of the tibia accelerometers fell off. Therefore only data from one tibia accelerometer is used. The right one is used in the one trial where the left one fell off, and the left one is used for the remaining 40 trials.

[Figure omitted. See PDF.]

Fig 2. Locations of the accelerometers attached to the runners’ bodies.

For each location, an example signal of the total acceleration over three seconds is shown. Note that only one of the two tibia accelerometers is used in this study.

https://doi.org/10.1371/journal.pone.0199509.g002

The accelerometer measurements were sampled at 1024 Hz. To remove noise, the acceleration signals were filtered using a low-pass filter with a cut-off frequency of 50 Hz, which is high enough to capture characteristics of running patterns. To make sure that the axes of the accelerometers were rotated correctly, the Moe-Nilssen tilt correction method [27] was used to align the axes with the anterior-posterior, mediolateral, and vertical direction of the runners. This method also subtracts the static gravity component (1g) from the vertical acceleration.

Experiments

We perform two experiments on the data collected during the treadmill test. In the first experiment, we explore a data-driven approach to find a good feature set by comparing different combinations of descriptive, heart rate and accelerometer features. The best combination found in this experiment will serve as our final model. In the second experiment, we replicate Weyand et al.’s model [14] using the sensors available in our study and compare its performance to our best model.

Experiment 1: Our approach

Feature extraction.

Three types of features are used in this study: descriptive features, heart rate features and accelerometer features. Since the goal is to develop a model for predicting VO2max from submaximal exercise, the latter two types of features are extracted from the warm-up stage and the first three stages of the test only. The third stage was performed at 12 km ⋅ hr−1 for men and 11 km ⋅ hr−1 for women, and it was confirmed that it represented submaximal running by the respiratory exchange ratio being < 1. Table 2 summarizes the features, which are described in more detail next.

[Figure omitted. See PDF.]

Table 2. Overview of all features.

https://doi.org/10.1371/journal.pone.0199509.t002

All models listed in the overview of Abut et al. [4] use (a subset of) gender, body mass, length, BMI and age as descriptive features. This study considers two of these features: gender (G: 0 = male, 1 = female) and body mass (BM) in kg, which are known to be relevant for predicting VO2max. Given the relatively small age range of the subjects (19-26 years) and that VO2max decreases approximately 0.2-0.5 ml ⋅ kg−1 ⋅ min−1 per year [28], age is not considered.

From the heart rate measurements we calculate the average heart rate (HR) for each stage of the test. Like Weyand et al. [14], we also calculate the inverse of the average heart rate because of the inverse relation between heart rate and maximal oxygen uptake [29]. Because the heart rate dropped during the rest periods, the average is computed only over the last minute of each stage where the heart rate was more stable.

From the accelerometer data, the following five features are extracted from each stage: average (AVG), standard deviation (SD), variance (VAR), root mean square (RMS) and power (P). RMS is often used in studies related to running gait analysis [30, 31]. The other features are commonly used to describe movement patterns based on accelerometer measurements. Similarly to the heart rate features, we also compute the inverse of each feature, since the accelerometer features may have an inverse relation to VO2max as well. Each feature is calculated for the anterior-posterior (x), mediolateral (y), vertical (z) and total () acceleration signals measured at the upper back, lower back and left tibia (or right tibia if the accelerometer on the left tibia fell off). Because the treadmill accelerated and decelerated at the start and end of each stage, the first and last ten seconds of each stage are discarded.

Prediction method.

We employ a mixed-effects unpenalized linear regression model to predict VO2max. We chose a linear model because it offers reasonable interpretability. This is important for sports scientists, coaches and athletes who want to gain insight into which features influence the prediction. Moreover, linear models tend to offer more robustness against overfitting for small sample sizes, provided that a relatively small feature set is used, which we ensure by performing feature selection as described in the following section.

Some subjects performed two trials (before and after an intervention) while others completed only one trial. To account for the potential correlation between repeated observations, we use a mixed-effects model where the variable ‘Test’ (which has the value ‘pre’ or ‘post’ depending on whether the trial was performed before or after the intervention, respectively) is a random effect for the intercept. We use the lme4 package [32] in R and specify the regression formula as follows:where G, BM, … are the fixed-effect variables included in the model, which are selected using the feature selection method described in the next section.

Feature selection.

We combine the descriptive, heart rate and acceleration features (see Table 2) into one feature set. However, given that the sample size is 41 data points, including all 490 features in the model may result in overfitting. Therefore, we select a subset of the features using a variant of greedy forward selection [33]. Greedy forward selection is a wrapper-based approach that typically starts with an empty feature set. It then iteratively adds the single best feature from a candidate set to the feature set until some stopping criterion is satisfied.

Here, instead of starting from an empty feature set, we begin with a feature set F that contains the two descriptive features. All the heart rate and accelerometer features are added to the set of candidate features C. In each iteration, we assess the quality of each feature f ∈ C by learning a linear regression model M′ using the feature set F′ = F ∪ {f} as input. We evaluate f’s quality by using internal leave-one-subject-out cross-validation on the training data to calculate M′’s adjusted explained variance ():where n is the number of instances used to train the model and p is the number of features. We use instead of R2 because it corrects for the fact that F′ has a different number of features than F. In each iteration of the forward selection, the highest scoring feature fb is added to F (i.e., F = F ∪ {fb}) and removed from C (i.e., C = C \ {fb}) provided that adding fb to F results in an improvement of at least 0.05 in the . We use this improvement threshold as an additional countermeasure against overfitting. The selection process is terminated when no feature meets the improvement threshold.

Experimental set-up.

We compare four different combinations of descriptive features, heart rate features and accelerometer features:

1. F1: uses only the two descriptive features: gender and body mass;

2. F2: combines F1 with the heart rate features;

3. F3: combines F1 with the accelerometer features;

4. F4: combines F1 with both the heart rate and the accelerometer features.

Experiment 2: Replicating Weyand et al.’s model

Weyand et al. [14] proposed a model to predict VO2max based on the ratio , where tc is the foot-ground contact time and HR is the average heart rate as measured over several minutes of running. This study found that these variables show a linear and parallel increase as the running speed increases, and that the ratio is related to VO2max. In Weyand et al.’s study, contact time was measured via an accelerometer placed on the foot. Next, we describe how we compare to Weyand et al.’s model given that we do not have access to foot-based accelerometer data.

Feature extraction.

We employ Gaudino et al.’s method [34] for calculating the contact time from the vertical acceleration at the center of mass (COM). Since the lower back accelerometer is positioned close to the COM during running, we use this accelerometer to estimate contact time. The start and end of foot-ground contact is determined by detecting where the signal crosses zero, as shown in Fig 3. To identify these points, the signal is first smoothed using a 4th-order Butterworth low-pass filter with a cut-off frequency of 15Hz. For each of the first three stages of the treadmill test, we estimate the contact time () as the average over all steps within stage i. We also compute the average heart rate (HRi) from the last minute of stage i as previously described. We then calculate for each stage and average the three values to obtain the value of the final ratio feature.

[Figure omitted. See PDF.]

Fig 3. Calculation of contact time from the vertical lower back acceleration.

The green and red dots indicate respectively starts and ends of foot-ground contact.

https://doi.org/10.1371/journal.pone.0199509.g003

Some differences exist in the way we compute the ratio feature compared to Weyand et al.’s study. First, we compute the average contact time for each stage () using the complete stage. In Weyand et al.’s study, is computed using ≥ 20 consecutive steps at least 30 seconds into the stage. Second, we calculate the average heart rate (HRi) using the last minute of the stage whereas Weyand et al. compute HRi as the average of the heart rate values measured at 3.75, 4.75 and 5.25 minutes after the start of the stage. Because Weyand et al.’s protocol does not have a warm-up stage while our protocol does, we omit the data from the warm-up stage in this comparison.

Experimental set-up.

Weyand et al. proposed two approaches based on the ratio combined with the gender of the subjects. The first learned separate linear regression models for men and women, each of which used only as input. The second learned a single linear regression model using both gender and as inputs. We evaluate both approaches and compare the results to our method. Note that we employ a fixed-effects linear model here to keep the set-up similar to Weyand et al.’s study.

Evaluation

Given the small sample size, we use leave-one-subject-out cross-validation to evaluate the models. In this cross-validation scheme, the data of one subject (one or two treadmill tests) are used as test data while the data of the other subjects are used for selecting features and training the model. This means that the features of the model are selected separately for each subset. Hence, in the feature selection process, the values to evaluate features are computed using an inner cross-validation loop, while the models are evaluated using an outer cross-validation loop.

The predicted VO2max values are evaluated using the following metrics: the explained variance (R2) of the model, the mean absolute error (MAE) and the root mean squared error (RMSE) expressed in ml ⋅ kg−1 ⋅ min−1. We also report the mean absolute percentage error (MAPE) and the root mean squared relative error (RMSRE). These evaluation metrics are defined as follows:where y are the measured VO2max values (with average ) and are the predicted values for the N = 41 treadmill tests.

Results

Results for experiment 1: Data-driven model selection

Fig 4 shows how the predicted VO2max values fit the measured values for each of the four feature set combinations: F1, F2, F3 and F4. The VO2max values are predicted using leave-one-subject-out cross-validation, where in each fold we first select features using the training data, and then learn a mixed-effects linear regression model using the same training data again. The supporting tables (S1–S3 Tables) show the number of folds that each feature was selected in when using feature sets F2, F3 and F4, respectively. Note that no feature selection is used for F1: gender and body mass are always included.

[Figure omitted. See PDF.]

Fig 4. Measured vs predicted VO2max values.

D = descriptive features, HR = heart rate features, ACC = accelerometer features. Points that are closer to the orange line, on which the measured VO2max equals the predicted VO2max, correspond to more accurate predictions.

https://doi.org/10.1371/journal.pone.0199509.g004

Table 3 summarizes the results for each combination according to all five evaluation metrics. F4, the combination of descriptive features, heart rate and accelerometer features, results in a mean absolute error of 2.33 ml ⋅ kg−1 ⋅ min−1. In percentage terms, the average prediction error is 4.92%, meaning that the predicted VO2max is on average within 5% of the true VO2max value. Additionally, this model has an explained variance (R2) of 0.781, which is better than all other combinations. Regardless of the metric, the models are ranked in the same order: F4 > F2 > F1 > F3. This shows that the accelerometer data improve the predictions, but only if used in combination with the heart rate data.

[Figure omitted. See PDF.]

Table 3. Comparison of the four combinations.

https://doi.org/10.1371/journal.pone.0199509.t003

Table 4 shows the fixed-effect coefficients for each of the four combinations, inferred using the full dataset. In the best combination (F4) four features were selected: gender, body mass, the inverse of the average heart rate during the warm-up stage () and the inverse of the variance of the total tibia acceleration during the warm-up stage ().

[Figure omitted. See PDF.]

Table 4. Predictor functions.

Fixed-effect coefficients learned from the complete dataset.

https://doi.org/10.1371/journal.pone.0199509.t004

Results for experiment 2: Comparison to Weyand et al.

Table 5 shows the results for all five metrics for both models. The first method results in a MAE of 3.65 ml ⋅ kg−1 ⋅ min−1 (or relative terms 7.96%) and an explained variance (R2) of 0.441. Like in Weyand et al.’s study, the second method performs better with a MAE of 3.58 ml ⋅ kg−1 ⋅ min−1 (or relative terms 7.81%) and an R2 value of 0.467. The model fit for the second method is shown in Fig 5.

[Figure omitted. See PDF.]

Table 5. Comparison of the two methods of Weyand et al.

https://doi.org/10.1371/journal.pone.0199509.t005

[Figure omitted. See PDF.]

Fig 5. Evaluation of the second method of Weyand et al. using gender and as features.

https://doi.org/10.1371/journal.pone.0199509.g005

Discussion

Combining heart rate and accelerometer features

The results indicate that the data-driven approach employed in this study can be used to automatically find relevant features to predict VO2max. The comparison of the different models in Fig 4 shows that features derived from body-worn technology improve the predictions compared to only considering descriptive features. The integration of physiological and biomechanical systems further improves the model. While the related work by Weyand et al. [14] and Tönis et al. [15] is based on the same idea, we show that considering a broader set of features derived from accelerometer measurements may be beneficial for predicting VO2max.

The best prediction model found in this study is based on four features: gender, body mass, the inverse of the average heart rate of the warm-up stage () and the inverse of the variance of the total tibia acceleration in the warm-up stage (). The first two features are known to be related to VO2max and are used in most existing models. The third feature is the inverse of the average heart rate and represents the inverse relation between heart rate and VO2max [29]. The last feature is the inverse of the variance of the total tibia acceleration (). To gain insight into how to interpret this feature, we compare the total tibia acceleration in the warm-up stage of two subjects with the same gender, a similar body mass and a similar value for the feature. Fig 6 shows four seconds of each subject’s signals. The subject with the higher VO2max (subject 2) has a higher value of which corresponds to a lower variance of the total tibia acceleration signal. Since this signal includes the entire gait cycle, the 3D accelerations generated during both the swing phase (i.e., movement) and the contact phase (i.e., ground reaction forces) contribute to the value of the feature. As can be seen from this comparison, the difference in the variance is mainly caused by the height of the peaks generated during the contact phase. The relation of this feature to running VO2max is interesting as it has not been used before for the prediction of VO2max from submaximal running.

[Figure omitted. See PDF.]

Fig 6. Total tibia acceleration of two similar subjects.

The two subjects have the same gender (G = 1 = female), a similar body mass (BM = 71.8 kg for subject 1 and 68.5 kg for subject 2), and a similar inverse heart rate in the warm-up stage ( = 0.00559 for subject 1 and 0.00557 for subject 2). While the value of the feature is low for subject 1 (0.689), it is high for subject 2 (2.30). Consequently, subject 1 has a lower VO2max (33.14 ml ⋅ kg−1 ⋅ min−1) than subject 2 (41.71 ml ⋅ kg−1 ⋅ min−1).

https://doi.org/10.1371/journal.pone.0199509.g006

Replicating Weyand et al.’s model

Compared to Weyand et al.’s paper, we report a more comprehensive set of error metrics. According to all five metrics, our learned model using F4 results in more accurate predictions than using Weyand et al.’s model based on our available sensors. While our best model obtained a better R2 than either of Weyand et al.’s models as reported in their paper, our replication did result in lower R2 values than was reported in the original paper. There are several possible explanations for this. First, we use an accelerometer placed on the lower back instead of on the foot to estimate contact time. Calculating the contact time using a lower back accelerometer may be less accurate and hence these errors may negatively influence the predictions of the model. Second, all subjects of the present study are recreational runners of 19-26 years old, while some participants in Weyand et al.’s study [14] ran > 1 hour each day and the oldest runner was 47 years old. These differences may affect the generalizability of the model to new data. Third, our study used a different protocol. In Weyand et al.’s protocol [14], subjects ran in bouts of 5.5 min, with rest intervals of 3-5 min. In contrast, the subjects in our protocol ran in stages of 4 min with rest intervals of 1 min. These protocol differences affect heart rate due to recovery and thus the predictions as well.

Practical use of the model

Two sensors are required in the final model: a heart rate monitor and an accelerometer attached to the left or right tibia. While most runners currently use a sports watch equipped with a heart rate monitor, the use of the tibia accelerometer may be less practical. More specifically, three aspects should be considered. First, the tibia accelerometer should be firmly attached so that it does not fall off as occurred in one test in this study. A practical tool therefore needs a compact and lightweight device. Second, the accelerometer should be attached at the correct position, which is the antero-medial aspect of the distal tibia. One possibility is to embed the device in the clothing of the athlete. Third, commercially available accelerometers typically have a lower sampling rate than 1024 Hz, which was used in this study. The sample rate may affect the values of the features computed from the accelerometer signal, and hence the predictions of the model. To check the robustness of the predictions to this factor, we calculated the value of the tibia feature for each test example from a down-sampled acceleration signal. We then evaluated the model, which was trained using the 1024 Hz data, for the down-sampled data. Fig 7 shows the R2 when using F4 as a function of the sample rate. These results show that using commercially available accelerometers, which can usually sample accelerations at ≥ 50 Hz, will not decrease the model’s explained variance.

[Figure omitted. See PDF.]

Fig 7. Explained variance (R2) of F4 when down-sampling the tibia acceleration to different sample rates.

https://doi.org/10.1371/journal.pone.0199509.g007

Another practical aspect is the speed at which subjects need to run in order to compute the features extracted from the sensors. Since this study’s goal was to develop a submaximal exercise model, lower running speeds are preferred. Both the selected heart rate feature and the accelerometer feature are computed during the warm-up phase, which means that an individual’s VO2max could be predicted from only four minutes of running at a speed of 8 or 9 km ⋅ hr−1. As this is a low exercise intensity, athletes could regularly estimate their VO2max to closely monitor training adaptations.

A final practical consideration is that the model in this paper is based on running at fixed velocities on a treadmill. As most acceleration-based features are speed dependent, our model may not be applicable to data collected during outdoor running, where the running speed varies. However, the same data-driven approach presented in this paper could be applied to data from outdoor running to develop a model capable of predicting VO2max in that setting.

Generalizability

The use of leave-one-subject-out cross-validation means that the error estimates evaluate the model’s ability to generalize to unseen individuals who have similar characteristics to the subjects in our data sample. However, an unseen individual may differ in two important ways from the subjects in this study. First, all participants of this study were recreational runners. It is unclear how well this model would translate to elite athletes who have higher VO2max values. Additional research would be needed to ascertain if VO2max can be predicted accurately from submaximal effort for elite athletes. Second, all participants were between 19 and 26 years old. Given that VO2max decreases approximately 0.2-0.5 ml ⋅ kg−1 ⋅ min−1 per year [28], the quality of the model’s predictions will likely be lower for younger or older individuals. If the age range of a study’s participants is wider, then including age as a feature in the model may be valuable.

Conclusion and future work

In this study, we have shown that VO2max can be predicted from a combination of descriptive features, heart rate features and accelerometer features derived from data collected during submaximal running. We defined a large set of features based on the sensor data and employed a data-driven approach to select a small subset of them to include in a mixed-effects linear regression model. We evaluated the benefit of each category of features (descriptive, heart rate, and accelerometer) and found that considering all three types resulted in the best performance. The best model found in this paper had an explained variance of 0.781 and used four features: two descriptive features (gender and body mass), one heart rate feature () and one accelerometer feature (). This model can predict an individual’s VO2max from objective variables calculated from running on a treadmill at only 8 or 9 km ⋅ hr−1 for four minutes.

There are two limitations to the model. First, as the participants in our study were recreational runners between 19 and 26 years of age, the model is likely not applicable for elite runners and subjects outside of this age range. An interesting future direction would be developing models to predict the VO2max from elite athletes, as well as considering subjects with a wider range of ages. Second, our model is based on running activity on a treadmill. In future work, it would be interesting to investigate predicting VO2max based on outdoor running.

Supporting information

[Figure omitted. See PDF.]

S1 Table. Selected features for F2.

https://doi.org/10.1371/journal.pone.0199509.s001

(PDF)

S2 Table. Selected features for F3.

https://doi.org/10.1371/journal.pone.0199509.s002

(PDF)

S3 Table. Selected features for F4.

https://doi.org/10.1371/journal.pone.0199509.s003

(PDF)

Acknowledgments

The authors express gratitude to the Sport Physiology Laboratory of Stellenbosch University for their assistance with the data collection.

Citation: De Brabandere A, Op De Beéck T, Schütte KH, Meert W, Vanwanseele B, Davis J (2018) Data fusion of body-worn accelerometers and heart rate to predict VO2max during submaximal running. PLoS ONE 13(6): e0199509. https://doi.org/10.1371/journal.pone.0199509

References

1. Joyner MJ. Modeling: optimal marathon performance on the basis of physiological factors. Journal of Applied Physiology. 1991;70(2):683–687. pmid:2022559

2. Coyle EF. Integration of the physiological factors determining endurance performance ability. Exercise and Sport Sciences Reviews. 1995;23(1):25–64. pmid:7556353

3. ACSM’s resource manual for Guidelines for exercise testing and prescription. Wolters Kluwer; 2014.

4. Abut F, Akay MF, George J. Developing new VO2max prediction models from maximal, submaximal and questionnaire variables using support vector machines combined with feature selection. Computers in Biology and Medicine. 2016;79:182–192. pmid:27810624

5. George JD, Stone WJ, Burkett LN. Non-exercise VO2max estimation for physically active college students. Medicine and Science in Sports and Exercise. 1997;29(3):415–423. pmid:9139183

6. Bradshaw DI, George JD, Hyde A, LaMonte MJ, Vehrs PR, Hager RL, et al. An accurate VO2max nonexercise regression model for 18–65-year-old adults. Research Quarterly for Exercise and Sport. 2005;76(4):426–432. pmid:16739680

7. Akay MF, Inan C, Bradshaw DI, George JD. Support vector regression and multilayer feed forward neural networks for non-exercise prediction of VO2max. Expert Systems with Applications. 2009;36(6):10112–10119.

8. Shenoy S, Tyagi B, Sandhu J, Sengupta D. Development of non-exercise based VO2max prediction equation in college-aged participants in India. The Journal of Sports Medicine and Physical Fitness. 2012;52(5):465–473. pmid:22976732

9. George JD, Paul SL, Hyde A, Bradshaw DI, Vehrs PR, Hager RL, et al. Prediction of maximum oxygen uptake using both exercise and non-exercise data. Measurement in Physical Education and Exercise Science. 2009;13(1):1–12.

10. Akay MF, Zayid EIM, Aktürk E, George JD. Artificial neural network-based model for predicting VO2max from a submaximal exercise test. Expert Systems with Applications. 2011;38(3):2007–2010.

11. Acikkar M, Akay M, George J, Delil M, Aktürk E. Artificial neural network models for predicting maximum oxygen uptake from submaxiaml exercise involving walking, jogging or running. In: International Symposium on Electrical and Electronics Engineering and Computer Systems. Lefka, North Cyprus; 2012. p. 17–21.

12. Cao ZB, Miyatake N, Aoyama T, Higuchi M, Tabata I. Prediction of maximal oxygen uptake from a 3-minute walk based on gender, age, and body composition. Journal of Physical Activity and Health. 2013;10(2):280–287. pmid:22821953

13. Abut F, Akay MF, Yildiz I, George JD. Performance Comparison of Different Machine Learning Methods for Prediction of Maximal Oxygen Uptake from Submaximal Data; 2015. p. 367–370.

14. Weyand PG, Kelly M, Blackadar T, Darley JC, Oliver SR, Ohlenbusch NE, et al. Ambulatory estimates of maximal aerobic power from foot-ground contact times and heart rates in running humans. Journal of Applied Physiology. 2001;91(1):451–458. pmid:11408463

15. Tönis T, Gorter K, Vollenbroek-Hutten M, Hermens H. Comparing VO2max determined by using the relation between heart rate and accelerometry with submaximal estimated VO2max. The Journal of Sports Medicine and Physical Fitness. 2012;52(4):337–343. pmid:22828454

16. Ahn JW, Hwang SH, Yoon C, Lee J, Kim HC, Yoon HJ. Unobtrusive Estimation of Cardiorespiratory Fitness with Daily Activity in Healthy Young Men. Journal of Korean Medical Science. 2017;32(12):1947–1952. pmid:29115075

17. Plasqui G, Westerterp KR. Accelerometry and heart rate as a measure of physical fitness: proof of concept. Medicine and Science in Sports and Exercise. 2005;37(5):872–876. pmid:15870644

18. Plasqui G, Westerterp KR. Accelerometry and heart rate as a measure of physical fitness: cross-validation. Medicine and Science in Sports and Exercise. 2006;38(8):1510–1514. pmid:16888467

19. Cao ZB, Miyatake N, Higuchi M, Miyachi M, Ishikawa-Takata K, Tabata I. Predicting VO2max with an objectively measured physical activity in Japanese women. Medicine and Science in Sports and Exercise. 2010;42(1):179–186. pmid:20010115

20. Moy ML, Matthess K, Stolzmann K, Reilly J, Garshick E. Free-living physical activity in COPD: assessment with accelerometer and activity checklist. Journal of Rehabilitation Research and Development. 2009;46(2):277. pmid:19533541

21. Altini M, Casale P, Penders J, ten Velde G, Plasqui G, Amft O. Cardiorespiratory fitness estimation using wearable sensors: Laboratory and free-living analysis of context-specific submaximal heart rates. Journal of Applied Physiology. 2016;120(9):1082–1096. pmid:26940653

22. Freedson PS, Miller K. Objective monitoring of physical activity using motion sensors and heart rate. Research Quarterly for Exercise and Sport. 2000;71(sup2):21–29. pmid:25680009

23. Bassett DR Jr. Validity and reliability issues in objective monitoring of physical activity. Research Quarterly for Exercise and Sport. 2000;71(sup2):30–36.

24. Ebbeling CB, Ward A, Puleo EM, Widrick J, Rippe JM. Development of a single-stage submaximal treadmill walking test. Medicine and Science in Sports and Exercise. 1991;23(8):966–973. pmid:1956273

25. Jones AM, Doust JH. A 1% treadmill grade most accurately reflects the energetic cost of outdoor running. Journal of Sports Sciences. 1996;14(4):321–327. pmid:8887211

26. Borg GA. Psychophysical bases of perceived exertion. Medicine and Science in Sports and Exercise. 1982;14(5):377–381. pmid:7154893

27. Moe-Nilssen R. A new method for evaluating motor control in gait under real-life environmental conditions. Part 1: The instrument. Clinical Biomechanics. 1998;13(4-5):320–327. pmid:11415803

28. Buskirk E, Hodgson J. Age and aerobic power: the rate of change in men and women. In: Federation Proceedings. vol. 46; 1987. p. 1824–1829.

29. Rowell LB. Human circulation: regulation during physical stress. Oxford University Press, USA; 1986.

30. McGregor SJ, Busa MA, Yagie JA, Bollt EM. High resolution MEMS accelerometers to estimate VO2 and compare running mechanics between highly trained inter-collegiate and untrained runners. PLOS ONE. 2009;4(10). pmid:19806216

31. Schütte KH, Maas EA, Exadaktylos V, Berckmans D, Venter RE, Vanwanseele B. Wireless tri-axial trunk accelerometry detects deviations in dynamic center of mass motion due to running-induced fatigue. PLOS ONE. 2015;10(10):1–12.

32. Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software. 2015;67(1):1–48.

33. Kohavi R, John GH. Wrappers for feature subset selection. Artificial Intelligence. 1997;97(1-2):273–324.

34. Gaudino P, Gaudino C, Alberti G, Minetti AE. Biomechanics and predicted energetics of sprinting on sand: hints for soccer training. Journal of Science and Medicine in Sport. 2013;16(3):271–275. pmid:22883597