Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Concurrent validity of the Fitbit for assessing sedentary behavior and moderate-to-vigorous physical activity

BMC Medical Research Methodology volume 19, Article number: 29 (2019) Cite this article

Abstract

Background

Recent advances in sensor technologies have promoted the use of consumer-based accelerometers such as Fitbit Flex in epidemiological and clinical research; however, the validity of the Fitbit Flex in measuring sedentary behavior (SED) and physical activity (PA) has not been fully determined against previously validated research-grade accelerometers such as ActiGraph GT3X+. Therefore, the purpose of this study was to examine the concurrent validity of the Fitbit Flex against ActiGraph GT3X+ in a free-living condition.

Methods

A total of 65 participants (age: M = 42, SD = 14 years, female: 72%) each wore a Fitbit Flex and GT3X+ for seven consecutive days. After excluding sleep and non-wear time, time spent (min/day) in SED and moderate-to-vigorous PA (MVPA) were estimated using various cut-points for GT3X+ and brand-specific algorithms for Fitbit, respectively. Repeated measures one-way ANOVA and mean absolute percent errors (MAPE) served to examine differences and measurement errors in SED and MVPA estimates between Fitbit Flex and GT3X+, respectively. Pearson and Spearman correlations and Bland-Altman (BA) plots were used to evaluate the association and potential systematic bias between Fitbit Flex and GT3X+. PROC MIXED procedure in SAS was used to examine the equivalence (i.e., the 90% confidence interval with ±10% equivalence zone) between the devices.

Results

Fitbit Flex produced similar SED and low MAPE (mean difference [MD] = 37 min/day, P = .21, MAPE = 6.8%), but significantly higher MVPA and relatively large MAPE (MD = 59–77 min/day, P < .0001, MAPE = 56.6–74.3%) compared with the estimates from GT3X+ using three different cut-points. The correlations between Fitbit Flex and GT3X+ were consistently higher for SED (r = 0.90, ρ = 0.86, P < .01), but weaker for MVPA (r = 0.65–0.76, ρ = 0.69–0.79, P < .01). BA plots revealed that there is no apparent bias in estimating SED.

Conclusion

In comparison with the GT3X+ accelerometer, the Fitbit Flex provided comparatively accurate estimates of SED, but the Fitbit Flex overestimated MVPA under free-living conditions. Future investigations using the Fitbit Flex should be aware of present findings.

Peer Review reports

Background

Surveillance of physical activity (PA) is vital for better understanding the relationship between PA and specific health outcomes such as obesity, hypertension, and type 2 diabetes. Although limitations of self-report are evident, historically surveillance data have relied on subjective measures of PA such as self-reported questionnaires [1, 2]. Accelerometers are particularly appealing for PA monitoring in free-living conditions; several accelerometer-based devices have been used in PA research applications [3]. ActiGraph accelerometer is the most widely used to measure PA in research and surveillance systems [3, 4]. For example, due to its high validity and reliability [5,6,7,8], the ActiGraph GT3X+ (GT3X+) was the method of choice for measuring PA in many population-based epidemiological studies [9,10,11,12].

Researchers have used the strong relationships between accelerometer and indirect calorimetry (IC) output to establish count-based prediction models for PA outcomes such as minutes of PA in metabolic equivalent of task (MET) categories or energy expenditure (EE) [13, 14]. Using regression equations with accelerometer counts (i.e. counts/60 s) as a predictor, several activity count cut-points have been developed to estimate the amount of time spent in sedentary behavior (SED) as well as different intensities of PA, namely moderate-to-vigorous intensity PA (MVPA). Two sets of cut-points developed by Freedson et al., one using single axis data (Freedson) and the other vector magnitude data (VM3), and one set developed by Troiano et al. are widely utilized cut-points for estimating time spent in SED and varying intensities of PA including, light intensity PA and MVPA [13, 15, 16]. The cut-points defined SED and MVPA as follows: 1) < 100 counts and ≥ 1952 counts/60-s, 2) < 100 counts and ≥ 2020 counts/60-s, and 3) ≥2691 counts/60-s (for MVPA only) for the Freedson, Troiano, and VM3 cut-points respectively.

However, PA intensity estimates may significantly vary depending on cut-point criteria applied to accelerometer output, which is primarily caused by inconsistency in monitor placement and types of activities used to calibrate the cut-points [17, 18]. As such, there is no single cut-point criteria able to accurately classify accelerometer-based PA estimates across all intensity categories and activities [17]. Thus, studies investigating the validity of PA monitors with an accelerometer-based criterion may be limited by utilizing only one cut-point prediction model. Nonetheless, the Freedson cut-points have produced acceptable estimates of MVPA even when compared to more recent cut-points [15, 17, 18].

Fitbit, Inc. (San Francisco, CA) is a leading manufacturer of accelerometer-based PA monitors sold in the consumer electronics [19]. Fitbit has achieved the largest market share among numerous wearable activity trackers available on the market [20, 21]. Given the popularity of these consumer-based PA monitors, there may be an opportunity to use them as a research tool. Few studies have examined the validity of Fitbit monitors, but most used only hip-worn Fitbit models (i.e. Fitbit Ultra, Zip, One) in controlled settings [22, 23]. Fitbit Ultra and Fitbit One step estimates have demonstrated strong agreement with directly observed step counts across a wide range of walking speeds in both adult and elderly populations [24,25,26]. Group-level Fitbit (i.e. Fitbit Ultra, Zip, One) EE estimates have demonstrated strong correlations with IC-determined EE, but correlations were lower at the individual-level [22, 23]. An investigation of the accuracy of the hip-worn Fitbit “classic” suggest it overestimates EE for cycling, inclined treadmill walking, stair climbing, and chores such as laundry and yard raking, whereas it underestimated EE of walking while carrying an external load (i.e. groceries) [27]. However, the sum of overestimates and underestimates of individual activities may lend hip-worn Fitbit monitors to provide reasonably accurate PA estimates over a variety of activities. The previous study by Lee et al. demonstrated that hip-worn Fitbit Zip yields EE estimates within 10% of IC criterion during a 69-min protocol of 13 different activities, including over ground walking, treadmill walking and jogging, playing basketball or active video games, etc. [23]. Few studies have evaluated the accuracy of Fitbit’s wrist-worn PA monitors, namely the Fitbit Flex. Whereas Fitbit Flex underestimates steps compared to direct observation evidence suggests it overestimates EE compared to IC criterion during treadmill walking and jogging [28,29,30]. Similarly contrasting results exist regarding Fitbit Flex PA estimates while performing common household activities. One study found Fitbit Flex overestimates steps while folding laundry and playing a game on a tablet whereas a different study found no significant differences in step estimates compared to direct observation as well as EE estimates (IC criterion) for other household activities (e.g. sweeping, standing, picking-up items) [29, 30]. As with many PA monitors, Fitbit Flex may over- or underestimate PA for certain individual activities while yielding reasonably accurate daily PA estimates. However, in a lab-based protocol of treadmill walking or running and resistance training exercises using machines the combined over- and underestimates of Fitbit Flex EE estimates did not fall within 10% of IC-determined EE [28]. Therefore, the purpose of this study was to examine the concurrent validity of the wrist-worn Fitbit Flex compared to the hip-worn ActiGraph GT3X+ utilizing three different cut-point criteria in a free-living condition.

Methods

Participants

A convenience sample of 65 participants (age: 41.7 ± 14.3 years, Female: 72.3%) was recruited via email, posted fliers, and word-of-mouth. Participants who were under the age of 18, pregnant, physically disabled, or unable to engage in regular PA as recommended by a physician, were not eligible to be in the study. The North Dakota State University Institutional Review Board approved the study and all participants voluntarily provided consent to participate in the investigation.

Instruments

ActiGraph (ActiGraph Corp., Pensacola, FL) currently offers multiple models of tri-axial accelerometer-based devices. The ActiGraph GT3X+ is a lightweight (19 g), tri-axial accelerometer-based device with a dynamic range of −/+ 6 G. Users may choose sampling frequencies from 30 Hz to 100 Hz. We chose a sampling rate of 30 Hz (with one-minute epochs) as this range should adequately capture most accelerations due to human movement [29]. Data from GT3X+ accelerometer were downloaded and scored using ActiLife version 6.11.4 (ActiGraph Corp., Pensacola, FL).

The Fitbit Flex (Fitbit, Inc., San Francisco, CA), is a physical activity monitor that is 3.2 cm long and weighs less than 15 g (including wristband). It features a tri-axial accelerometer and continually acquires data and with onboard storage capacity for approximately seven days of data without syncing. Data is transferred via Bluetooth technology to the Fitbit application program interface (API) either through Fitbit’s mobile app or a Bluetooth dongle connected to a computer.

Procedures

Participants completed an orientation session and began the free-living protocol after voluntarily consenting to be in the study and completing a demographic questionnaire. Participants were instructed to simultaneously wear the Fitbit Flex and GT3X+ monitors for seven consecutive days during all waking and sleep hours except during bathing and recreational water activities (e.g. swimming). Participants wore a Fitbit Flex monitor on the dorsal aspect of the non-dominant wrist, similar to a watch, which is a standard placement site for PA measurement using wrist-worn accelerometer as well as in compliance with the manufacturer’s recommendation [9, 31, 32]. The GT3X+ monitor was worn on the dominant hip in-line with the midline of the thigh and the approximate peak of the iliac crest, which has been known as a standard placement site of the GT3X+ [7, 33,34,35,36]. Participants kept a log of any non-wear time during waking hours and daily sleep times. Participants were also instructed to note any days that included extraordinary amounts of PA that may appear unusually high for their typical routine (e.g. running a half-marathon). Data from activity/sleep logs and activity monitors were retrieved and downloaded respectively at the conclusion of the data collection period. All the GT3X+ and the Fitbit flex monitors used in this study were not donated by the manufacturers, but purchased by the investigative team using our own research funding.

Data reduction

Data from the GT3X+ was downloaded and converted into activity counts per 60-s epoch using the ActiLife software. The GT3X + ‘s activity counts data was then scored into daily time spent in SED and MVPA (min/day) by applying three different sets of cut-points: 1) Freedson [13], 2) Troiano [37], and VM3 (MVPA cut-point only) [5].

Since the Fitbit dashboard provides limited resolution of PA estimates (i.e., hourly summary), we chose to use a third-party research application program interface (API) called Fitabase (Small Steps Labs, LLC, San Diego, CA), which allows exporting the data from the Fitbit at 60-s sampling intervals. Unlike the GT3X+ accelerometer, using its proprietary algorithm, the Fitbit Flex converts raw acceleration data into activity counts in 60-s sampling intervals that define activity intensities as 0 = sedentary, 1 = light PA, 2 = moderate PA, and 3 = vigorous PA.

For the GT3X+, non-wear time and sleep time were defined using an algorithm developed by Choi et al. [38] and participants’ activity/sleep logs, respectively, and were excluded for further analysis. No participants noted any extraordinary PA during the study period. Similarly, Fitbit Flex wear time was validated by removing sleep and non-wear time from the participant activity/sleep log. After non-wear time validation procedures, minute-by-minute data from the GT3X+ and the Fitbit Flex were temporally aligned and merged into a single dataset, thus only valid wear time during waking hours that simultaneously recorded on both devices were included for statistical analysis.

Statistical analysis

Pearson’s and Spearman’s correlations were used to determine the relationship between PA and SED estimates from Fitbit Flex and those from GT3X+. Due to unequal variances, we used the Welch’s T-test to assess differences in daily PA and SED within gender (male and female) and BMI category (normal, overweight, and obese), respectively. To avoid committing a Type-I error with SED and MVPA comparisons, repeated measures one-way analysis of variance (ANOVA) served to examine differences in SED and MVPA estimates, comparing Fitbit Flex estimates and those from GTX+ using three different cut-points (only two cut-points used for SED comparisons). Significant overall ANOVA effects were followed by pairwise comparisons using Bonferroni adjustment. Mean absolute percent errors (MAPEs) were calculated to assess similarity of the estimates from the Fitbit Flex in comparison with the GT3X+. Bland-Altman (BA) plots were used to illustrate the agreement between the GT3X+ and the Fitbit Flex as well as evaluate any potential random biases in SED and MVPA estimates between two devices. Pitman’s Tests difference in variance were performed to determine the equality of the variances in SED and MVPA estimates between two devices. Equivalence tests were performed to determine the agreement between the GT3X+ and the Fitbit Flex. The specified equivalence zone (EZ) was defined as ±10% of the mean estimates from the GT3X+ and compared with the 90% confidence intervals (CI) of the estimates from the Fitbit Flex. The estimates from the GT3X+ and the Fitbit Flex are equivalent if the CIs of the Fitbit Flex completely fall within the equivalence zone. All data analyses were conducted using IBM SPSS 24.0 for Windows (SPSS, Armonk, NY) and the SAS statistical program, version 9.4 (SAS Institute, Cary, NC, USA). Alpha level of 0.05 was set to define significance for all statistical analyses.

Results

Subject characteristics are summarized in Table 1. The sample was relatively homogenous, mostly female, and non-Hispanic white. Participant ages and BMI ranged 20–70 years and 18.6–40, respectively. Daily minutes of MVPA and SED were presented separately for males and females (Table 2). Participants recorded an average of 5.8 valid wear days (14.9 h/day after removing sleep period) over the 7-day period. Participants spent the majority of waking hours in SED and least amount of waking hours in MVPA. We chose not to conduct a two-way multivariate analysis of variance (MANOVA) with sex and BMI as fixed factors due to lack of power to detect a difference due to a low number of participants in each stratum. However, Welch’s T-test results showed mean daily MVPA and SED did not significantly differ between males and females (Table 2). Similarly, we assessed differences in MVPA and SED between BMI categories (i.e. normal, overweight, and obese). Because there were few obese participants (n = 9), we combined the obese and overweight categories to avoid underpowered analysis. Welch’s T-test showed no significant differences in SED or MVPA between normal and overweight/obese groups (Table 2). Since no significant differences in MVPA and SED were observed between gender and BMI groups, and these comparisons were not integral to the intended analysis, we combined data from the entire sample (n = 65) for the remainder of the analysis.

Table 1 Participant characteristics by gender, Mean ± SD or percent
Full size table
Table 2 Mean valid wear days and mean daily minutes of MVPA and SED by gender and weight status, Mean ± SD
Full size table

We found strong correlations for SED estimates (r = .90, ρ = .86, all P < .01) between GT3X+ and Fitbit Flex (Table 3). For MVPA, the correlations between Fitbit Flex and GT3X+ were moderate across the ActiGraph cut-points applied (r = .65–.76, ρ = .69–.79, all P < .01). Results of one-way repeated measures ANOVA revealed that there were no significant differences in daily SED estimates between Fitbit Flex and GT3X+ (mean difference [MD] = 37 min/day, P = 0.21); however, the MVPA estimate from the Fitbit Flex was statistically significantly different when compared with the estimates from the GT3X+ based on three different cut-point criteria (MD = 59–77 min/day, P < .01) Significant differences remained only for MVPA pairwise comparisons (Table 4). Fitbit Flex significantly overestimated MVPA compared to all GT3X+ criteria by notably wide margins. The mean differences in MVPA estimates between Fitbit Flex and GT3X+ were 60 (VM3), 78 (Freedson), and 79 min/day (Troiano), respectively. The BA plots and Pitman’s Test revealed that there were no apparent bias for the agreement and variances in SED estimates (mean difference: − 37.36 min/day, limits of agreement [LOA]: − 119.73 to 45.01 min/day, R2 = 0.004, P = 0.61) between the two devices (Fig. 1). However, for MVPA, the mean differences (LOA) were − 77.67 min/day (LOA: − 126.15 to − 29.19 min/day) for Freedson, − 79.09 min/day (LOA: − 128.37 to − 29.81 min/day) Troiano, and − 59.64 (P < .05) VM3 cut-points, respectively. The results from the Pitman’s Test were R2 = 0.37 (P < .05) for Freedson, R2 = − 0.38 (P < .05) for Troiano, and R2 = − 0.16 (P < .05) for VM3 cut-points, suggesting that Fitbit Flex increasingly overestimates MVPA compared to GT3X+ as mean volume of MVPA increases. Results from the equivalent tests are presented in Fig. 2. The Fitbit Flex recorded equivalent estimates of SED (Mean (90% CI): 637.8 min/day (619.2–656.4)) as the GT3X+ (Mean (EZ): 600.4 min/day (540.4–660.4)). MVPA estimates from the GT3X+ (Freedson Mean (EZ): 30.1 min/day (27.1–33.1), Troiano Mean (EZ): 28.7 min/day (25.8–31.6), VM3 Mean (EZ): 48.1 min/day (43.3–52.9)) were not equivalent to the MVPA estimate from the Fitbit Flex (Mean (90% CI): 107.8 min/day (101.1–114.4)).

Table 3 Pearson (r) and Spearman (ρ) Correlations between Fitbit and GT3X+ SED and MVPA estimates
Full size table
Table 4 Mean differences (SE) and Mean Absolute Percent Errors of SED and MVPA between GT3X+ and Fitbit
Full size table
Fig. 1
figure 1

Bland-Altman plots illustrating level of agreement between GT3X+ and Fitbit. a) SED estimates (< 100 cpm); b) MVPA estimates (Freedson cut-points); c) MVPA estimates (Troiano cut-points); d) MVPA estimates (VM3 cut-points); Dashed lines show 95% limits of agreement (± 1.96 SD)

Full size image
Fig. 2
figure 2

Equivalence Testing for SED and MVPA. Solid line indicate the 90% confidence interval of the mean estimates from the Fitbit Flex and dash lines indicate equivalence zones of the GT3X+ (± 10% of the mean estimates from each cut-points)

Full size image

Discussion

This study examined the accuracy of the Fitbit Flex PA monitor against a previously validated accelerometer, the ActiGraph GT3X+, for classifying SED and MVPA in free-living settings. Our results demonstrated moderate to strong relationships between the Fitbit Flex and GT3X+ monitors for SED and MVPA estimates. The Fitbit Flex provided SED estimates that were equivalent to those from the SED cut-points for the GT3X+. However, MVPA estimates from the Fitbit Flex significantly differed from and were not equivalent to MVPA estimates from the GT3X+. The observed differences show there were greater discrepancies between Fitbit Flex-determined MVPA estimates and GT3X+ cut-point criteria developed from single axis regression equations (i.e. Freedson and Troiano cut-points). Nonetheless, relative to all the GTX+ cut-points used, Fitbit markedly overestimated mean daily MVPA. Furthermore, BA plots showed these differences increased as the volume of MVPA increased, suggesting that the Fitbit Flex may overestimate MVPA in active individuals compared to the GT3X+.

Previous research has shown strong correlations for EE, step, and MVPA estimates between hip-worn Fitbit models (i.e. Fitbit One, Ultra, Zip) and ActiGraph GT3X+ [22, 23, 39, 40]. Similarly, Fitbit Flex and GT3X+ MVPA estimates have strong correlations in studies of young adult and elderly populations, with moderate correlations for LPA reported also within the elderly populations [41, 42]. Our results show the MVPA correlations between Fitbit Flex and GT3X+ estimates fall between that of these two studies. Differences in methodologies may partially explain these differences. Sushames et al. used a protocol lasting less than 24 h, with a mix of scripted PA and free-living activity [42]. Alharbi and colleagues investigated free-living activity over a 4-day period in older adults in a clinical setting [41]. Our study collected free-living data over a longer period and with a more diverse age-range of healthy adults. Thus, the longer study protocol in our investigation may better represent the relationships between Fitbit Flex and GT3X+ in free-living conditions.

Though few studies have assessed the Fitbit Flex classification estimates for SED in free-living settings, recent studies suggest the wrist-worn Fitbit Flex SED estimates will be significantly lower than those of hip-worn GT3X+. A recent study by Reid et al. demonstrated Fitbit Flex significantly underestimated SED compared to GT3X+ with a mean bias of 76.8 (minutes/day) (p < .05) such that increasing time spent in SED produced greater discrepancies between the devices [43]. However, Rosenberger found GT3X+ and the hip-worn Fitbit One yielded equivalent estimates of SED during a free-living protocol involving 40 participants [44]. Both GT3X+ and Fitbit One systematically underestimated SED relative to AcitPal criterion, with very similar slopes (− 0.47 and − 0.34, respectively) and mean differences (48 min/day and 34 min/day, respectively). In our study, the estimated SED between GT3X+ and Fitbit Flex was not significantly different. Furthermore, our results show a strong correlation between Fitbit Flex and GT3X+. Dominick and colleagues also reported a significant though less strong correlation between Fitbit Flex and GT3X (r = .63) though the monitors produced significantly different daily SED estimates [45]. Previous research has shown accelerometers placed at the hip demonstrate less count variability than wrist and ankle placement over a wide range of sedentary and physical activities [7]. However, though neither the Fitbit Flex nor the GT3X+ are considered gold standard for monitoring SED in free-living conditions, the level of agreement between Fitbit Flex and GT3X+ suggests monitor placement may not be the leading factor influencing the accuracy of SED estimates and merits further investigation.

To the point, defining count-based criteria for SED is inconsistent and may be operationalized to include variables such as posture, a variable not captured by the Fitbit Flex [46]. The GT3X+ has the low-frequency option, allowing the user to increase the monitor’s sensitivity to movement by lowering the frequency threshold for recording accelerations. However, based on current evidence, it is unclear whether researchers should enable the low-frequency extension feature when initializing the ActiGraph if the goal is to specifically monitor SED [47], thus we did not apply the low-frequency extension in our study.

Though the Freedson and VM3 cut-points were derived from accelerometer output using different numbers of axis (i.e. vertical axis only versus vector magnitude of three axes), research has demonstrated that the equations perform similarly compared to IC-criterion [6, 16]. Furthermore, it is possible that PA classification estimates based on triaxial monitors may yield superior PA estimates compared to vertical axis output alone. Evidence suggests the magnitude of the differences depends on the regression equation utilized and the intensity of the activity being analyzed [15]. In our study the MVPA estimates were significantly different between Freedson and Troiano cut-points compared to VM3 cut-points. Regardless, Fitbit Flex MVPA estimates were consistently significantly higher than any GT3X+ estimates.

Our results show the Fitbit Flex and GT3X+ produce very different estimates of MVPA. Specifically, Fitbit Flex overestimated mean daily MVPA by nearly an hour, or more, compared to the ActiGraph GT3X+. The hip-worn Fitbit One has overestimated MVPA compared to GT3X+, with researchers reporting mean absolute percent errors of over 60% [44]. In our study the discrepancies may be exaggerated further due to the wrist placement of the Fitbit Flex.

Recently Nelson and colleagues found Fitbit Flex overestimated the metabolic cost of walking (3.3–4.6 METs) and jogging (7.0–7.9 METs) activities compared to IC criterion [30]. However, the activities were only performed for five minutes. In our study, participants averaged nearly 30 min/day of MVPA determined by GT3X+ accelerometer. Thus, we might expect the magnitude of the discrepancy in MVPA estimates between GT3X+ and Fitbit Flex to be much greater. In support of this explanation in our analysis of the BA plots of Fitbit Flex and GT3X+ MVPA, each data plot was below zero, indicating the Fitbit Flex overestimated mean daily MVPA for each participant. We also observed a negative slope for the fit line, suggesting that this discrepancy tends to increase as total mean daily MVPA volume increases. Other research has found similar systematic bias for Fitbit Flex step estimates, but not for EE estimates [28, 41, 42].

The strengths of this investigation include the length of the free-living protocol, the wide age range represented in the participant sample, and high number of valid wear days. Only two previous studies have investigated the wrist-worn Fitbit Flex in a protocol lasting at least seven days and those studies only included 22 or fewer participants between ages 19–37 [43, 45]. In addition, our investigation included a wrist-worn consumer-based accelerometer-based monitor, which are more popular [21] than hip worn models and may potentially increase compliance in future research studies. In contrast to previous investigations that have utilized only single cut-point criteria for estimating SED and MVPA from ActiGraph accelerometers [23, 40, 44], we evaluated the validity of the Fitbit Flex against the GT3X+ when applying three different previously validated cut-points indicating our results are not limited by the use of a single cut-point. Lastly, finding from this study can be applicable to studies using more recent models of Fitbit (i.e., Flex 2) because there was high inter-monitor reliability as evidenced by a high intra-correlation coefficient (ICC) value of 0.91 (data not presented in detail herein) when we tested the inter-monitor reliability between Fitbit Flex and Fitbit Flex 2 in a separate study.

Certain limitations of this study must be considered when interpreting our results. Fitbit does not currently have a wear time validation mechanism per se, though other researchers have applied typical validation approaches to minute-by-minute Fitbit data where 60 consecutive minutes of no PA during waking hours are assumed to be non-wear time [45]. Thus, it is not possible to truly know if such occurrences are due to non-wear time or extensive SED. Limitations of using ActiGraph for assessing SED have been reported; however, previous research has shown acceptable estimates of SED compared to ActivPAL and IC criterion [30]. Another limitation was that there was no true gold-standard method used to evaluate the validity of the Fitbit Flex, thus no inference can be made about the criterion validity of the Fitbit Flex. Lastly, both Fitbit Flex and GT3X+ are not completely waterproof therefore we were unable to capture activities such as swimming or bathing for this analysis.

Conclusions

In conclusion, our data suggest that the Fitbit Flex and GT3X+ were statistically equivalent to one another in assessing SED, but not MVPA; the MVPA estimates were significantly overestimated by the Fitbit Flex. On-going population surveillance will benefit from improved objective monitoring options that will maximize subject compliance and data accuracy. Improving the accuracy of MVPA monitoring is paramount to increasing population adherence to the Physical Activity Guidelines for Americans. Consumer-based PA monitors, such as the Fitbit Flex, show promise for promoting PA adherence to the general public by allowing individuals to self-monitor daily PA. However, if the Fitbit Flex overestimates MVPA, this may reduce the likelihood that an individual would meet the minimum recommended MVPA. Further research is needed to investigate the accuracy and precision of Fitbit Flex PA classification estimates in free-living settings.

Abbreviations

BA plot:

Bland-Altman plot

BMI:

Body mass index

EE:

Energy expenditure

EZ:

Equivalence zone

MAPE:

Mean absolute percent error

MVPA:

Moderate-to-vigorous physical activity

PA:

Physical activity

SED:

Sedentary behavior

References

  1. Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, Ainsworth BE, Pratt M, Ekelund U, Yngve A, Sallis JF, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35(8):1381–95.

    Article  Google Scholar 

  2. Carlson SA, Densmore D, Fulton JE, Yore MM, Kohl HW 3rd. Differences in physical activity prevalence and trends from 3 U.S. surveillance systems: NHIS, NHANES, and BRFSS. J Phys Act Health. 2009;6(Suppl 1):S18–27.

    Article  Google Scholar 

  3. Plasqui G, Bonomi AG, Westerterp KR. Daily physical activity assessment with accelerometers: new insights and validation studies. Obes Rev. 2013;14(6):451–62.

    Article  CAS  Google Scholar 

  4. Plasqui G, Westerterp KR. Physical activity assessment with accelerometers: an evaluation against doubly labeled water. Obesity (Silver Spring). 2007;15(10):2371–9.

    Article  Google Scholar 

  5. Sasaki JE, John D, Freedson PS. Validation and comparison of ActiGraph activity monitors. J Sci Med Sport. 2011;14(5):411–6.

    Article  Google Scholar 

  6. Santos-Lozano A, Santin-Medeiros F, Cardon G, Torres-Luque G, Bailon R, Bergmeir C, Ruiz JR, Lucia A, Garatachea N. Actigraph GT3X: validation and determination of physical activity intensity cut points. Int J Sports Med. 2013;34(11):975–82.

    Article  CAS  Google Scholar 

  7. Ozemek C, Kirschner MM, Wilkerson BS, Byun W, Kaminsky LA. Intermonitor reliability of the GT3X+ accelerometer at hip, wrist and ankle sites during activities of daily living. Physiol Meas. 2014;35(2):129–38.

    Article  Google Scholar 

  8. Aadland E, Ylvisaker E. Reliability of the Actigraph GT3X+ accelerometer in adults under free-living conditions. PLoS One. 2015;10(8):e0134606.

    Article  Google Scholar 

  9. NCHS: National Health and Nutrition Examination Survey (NHANES) Physical Activity Monitor (PAM) Procedures Manual. In. Hyattsville, MD: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention; 2011.

  10. Saint-Maurice PF, Kim Y, Hibbing P, Oh AY, Perna FM, Welk GJ. Calibration and validation of the youth activity profile: the FLASHE study. Am J Prev Med. 2017;52(6):880–7.

    Article  Google Scholar 

  11. Van Dyck D, Cerin E, De Bourdeaudhuij I, Hinckson E, Reis RS, Davey R, Sarmiento OL, Mitas J, Troelsen J, MacFarlane D, et al. International study of objectively measured physical activity and sedentary time with body mass index and obesity: IPEN adult study. Int J Obes. 2015;39(2):199–207.

    Article  Google Scholar 

  12. Lee IM, Shiroma EJ, Evenson KR, Kamada M, LaCroix AZ, Buring JE. Accelerometer-measured physical activity and sedentary behavior in relation to all-cause mortality: the Women's health study. Circulation. 2018;137(2):203–5.

    Article  Google Scholar 

  13. Freedson PS, Melanson E, Sirard J. Calibration of the computer science and applications, Inc. accelerometer. Med Sci Sports Exerc. 1998;30(5):777–81.

    Article  CAS  Google Scholar 

  14. Swartz AM, Strath SJ, Bassett DR Jr, O'Brien WL, King GA, Ainsworth BE. Estimation of energy expenditure using CSA accelerometers at hip and wrist sites. Med Sci Sports Exerc. 2000;32(9 Suppl):S450–6.

    Article  CAS  Google Scholar 

  15. Rothney MP, Schaefer EV, Neumann MM, Choi L, Chen KY. Validity of physical activity intensity predictions by ActiGraph, Actical, and RT3 accelerometers. Obesity (Silver Spring). 2008;16(8):1946–52.

    Article  Google Scholar 

  16. Kim Y, Welk GJ. Criterion validity of competing accelerometry-based activity monitoring devices. Med Sci Sports Exerc. 2015;47(11):2456–63.

    Article  Google Scholar 

  17. Crouter SE, Churilla JR, Bassett DR Jr. Estimating energy expenditure using accelerometers. Eur J Appl Physiol. 2006;98(6):601–12.

    Article  Google Scholar 

  18. Ham SA, Reis JP, Strath SJ, Dubose KD, Ainsworth BE. Discrepancies between methods of identifying objectively determined physical activity. Med Sci Sports Exerc. 2007;39(1):52–8.

    Article  Google Scholar 

  19. Comstock J. Report: Samsung and Fitbit currently leading wearables market. https://www.mobihealthnews.com/40640/report-samsung-and-fitbit-currently-leading-wearables-markets.

  20. IDC Research, Inc.: Worldwide Quarterly Wearable Device Tracker2017.

  21. iTechWearer: The Best Fitness Trackers in 2015: Best seller list 2015.

  22. Noah JA, Spierer DK, Gu J, Bronner S. Comparison of steps and energy expenditure assessment in adults of Fitbit tracker and ultra to the Actical and indirect calorimetry. J Medical Engineering & Technology. 2013;37(7):456–62.

    Article  Google Scholar 

  23. Lee J, Kim Y, Welk G. Validity of consumer-based physical activity monitors. Med Sci Sports Exerc. 2014;46(9):1840–8.

    Article  Google Scholar 

  24. Takacs J, Pollock CL, Guenther JR, Bahar M, Napier C, Hunt MA. Validation of the Fitbit one activity monitor device during treadmill walking. J Sci Med Sport. 2014;17(5):496–500.

    Article  Google Scholar 

  25. Fortune E, Lugade V, Morrow M, Kaufman K. Validity of using tri-axial accelerometers to measure human movement - part II: step counts at a wide range of gait velocities. Med Eng Phys. 2014;36(6):659–69.

    Article  Google Scholar 

  26. Fulk GD, Combs SA, Danks KA, Nirider CD, Raja B, Reisman DS. Accuracy of 2 activity monitors in detecting steps in people with stroke and traumatic brain injury. Phys Ther. 2014;94(2):222–9.

    Article  Google Scholar 

  27. Sasaki J, Hickey A, Mavilia M, Tedesco J, John D, Kozey Keadle S, Freedson P. Validation of the Fitbit wireless activity tracker® for prediction of energy expenditure. J Phys Act Health. 2014.

  28. Bai Y, Welk GJ, Nam YH, Lee JA, Lee JM, Kim Y, Meier NF, Dixon PM. Comparison of consumer and research monitors under Semistructured settings. Med Sci Sports Exerc. 2016;48(1):151–8.

    Article  Google Scholar 

  29. Chen KY, Bassett DR Jr. The technology of accelerometry-based activity monitors: current and future. Med Sci Sports Exerc. 2005;37(11 Suppl):S490–500.

    Article  Google Scholar 

  30. Nelson MB, Kaminsky LA, Dickin DC, Montoye AH. Validity of consumer-based physical activity monitors for specific activity types. Med Sci Sports Exerc. 2016;48(8):1619–28.

    Article  Google Scholar 

  31. Fitbit, Inc.: Fitbit Flex 2 User Manual version 1.2. In. https://help.fitbit.com/?p=flex_2; 2018.

  32. Fitbit, Inc.: Fitbit Flex Product Manual. In. https://help.fitbit.com/?p=flex; 2018.

  33. Ellis K, Kerr J, Godbole S, Lanckriet G, Wing D, Marshall S. A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers. Physiol Meas. 2014;35(11):2191–203.

    Article  Google Scholar 

  34. Hildebrand M, VT VANH, Hansen BH, Ekelund U. Age group comparability of raw accelerometer output from wrist- and hip-worn monitors. Med Sci Sports Exerc. 2014;46(9):1816–24.

    Article  Google Scholar 

  35. Stec MJ, Rawson ES. Estimation of resistance exercise energy expenditure using triaxial accelerometry. J Strength Cond Res. 2012;26(5):1413–22.

    Article  Google Scholar 

  36. Tudor-Locke C, Barreira TV, Schuna JM Jr. Comparison of step outputs for waist and wrist accelerometer attachment sites. Med Sci Sports Exerc. 2015;47(4):839–42.

    Article  Google Scholar 

  37. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40(1):181–8.

    Article  Google Scholar 

  38. Choi L, Liu Z, Matthews CE, Buchowski MS. Validation of accelerometer wear and nonwear time classification algorithm. Med Sci Sports Exerc. 2011;43(2):357–64.

    Article  Google Scholar 

  39. Gusmer R, Bosch T, Watkins A, Ostrem J, Dengel D. Comparison of FitBit® ultra to ActiGraph™ GT1M for assessment of physical activity in young adults during treadmill walking. Open Sports Medicine Journal. 2014;8:11–5.

    Article  Google Scholar 

  40. Ferguson T, Rowlands AV, Olds T, Maher C. The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study. Int J Behav Nutr Phys Act. 2015;12:42.

    Article  Google Scholar 

  41. Alharbi M, Bauman A, Neubeck L, Gallagher R. Validation of Fitbit-flex as a measure of free-living physical activity in a community-based phase III cardiac rehabilitation population. Eur J Prev Cardiol. 2016;23(14):1476–85.

    Article  Google Scholar 

  42. Sushames A, Edwards A, Thompson F, McDermott R, Gebel K. Validity and reliability of Fitbit flex for step count, moderate to vigorous physical activity and activity energy expenditure. PLoS One. 2016;11(9):e0161224.

    Article  Google Scholar 

  43. Reid RER, Insogna JA, Carver TE, Comptour AM, Bewski NA, Sciortino C, Andersen RE. Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. J Sci Med Sport. 2017;20(6):578–82.

    Article  Google Scholar 

  44. Rosenberger ME, Buman MP, Haskell WL, McConnell MV, Carstensen LL. 24 hours of sleep, sedentary behavior, and physical activity with nine wearable devices. Med Sci Sports Exerc. 2016;48(3):457–65.

    Article  Google Scholar 

  45. Dominick GM, Winfree KN, Pohlig RT, Papas MA. Physical activity assessment between consumer- and research-grade accelerometers: a comparative study in free-living conditions. JMIR Mhealth Uhealth. 2016;4(3):e110.

    Article  Google Scholar 

  46. Owen N, Healy GN, Matthews CE, Dunstan DW. Too much sitting: the population health science of sedentary behavior. Exerc Sport Sci Rev. 2010;38(3):105–13.

    Article  Google Scholar 

  47. Carr LJ, Mahar MT: Accuracy of intensity and inclinometer output of three activity monitors for identification of sedentary behavior and light-intensity activity. J Obes 2012, 2012:460271.

Download references

Acknowledgements

We thank all participants and research staff that participated in this investigation.

Funding

Not applicable.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the authors on reasonable request.

Author information

Authors and Affiliations

  1. Department of Health, Nutrition, and Exercise Sciences, North Dakota State University, Fargo, ND, 58108, USA

    Nicklaus Redenius

  2. Department of Health, Kinesiology, and Recreation, University of Utah, Salt Lake City, UT, 84112, USA

    Wonwoo Byun

  3. Division of Kinesiology, School of Public Health, The University of Hong Kong Li Ka Shing Faculty of Medicine, Room 301D 3/F, Jockey Club Building for Interdisciplinary Research, 5 Sassoon Road, Pokfulam, Hong Kong

    Youngwon Kim

  4. MRC Epidemiology Unit, University of Cambridge School of Medicine, Cambridge, Cambridgeshire, UK

    Youngwon Kim

Authors
  1. Nicklaus Redenius
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Youngwon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wonwoo Byun
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NR and WB equally contributed to the concept and design, statistical analysis, drafting, interpretation of the data, and supervision of the study. NR, YK, and WB contributed to refining the study hypothesis, data analyses, interpretation of the data, drafting the manuscript, and revising it through multiple drafts. All authors have read and submission of the manuscript.

Corresponding author

Correspondence to Wonwoo Byun.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was provided by the Institutional Review Board at the North Dakota State University. All participants provided written informed consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Redenius, N., Kim, Y. & Byun, W. Concurrent validity of the Fitbit for assessing sedentary behavior and moderate-to-vigorous physical activity. BMC Med Res Methodol 19, 29 (2019). https://doi.org/10.1186/s12874-019-0668-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-019-0668-1

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us