Comparison of two different physical activity monitors
© Paul et al; licensee BioMed Central Ltd. 2007
Received: 11 December 2006
Accepted: 25 June 2007
Published: 25 June 2007
Understanding the relationships between physical activity (PA) and disease has become a major area of research interest. Activity monitors, devices that quantify free-living PA for prolonged periods of time (days or weeks), are increasingly being used to estimate PA. A range of different activity monitors brands are available for investigators to use, but little is known about how they respond to different levels of PA in the field, nor if data conversion between brands is possible.
56 women and men were fitted with two different activity monitors, the Actigraph™ (Actigraph LLC; AGR) and the Actical™ (Mini-Mitter Co.; MM) for 15 days. Both activity monitors were fixed to an elasticized belt worn over the hip, with the anterior and posterior position of the activity monitors randomized. Differences between activity monitors and the validity of brand inter-conversion were measured by t-tests, Pearson correlations, Bland-Altman plots, and coefficients of variation (CV).
The AGR detected a significantly greater amount of daily PA (216.2 ± 106.2 vs. 188.0 ± 101.1 counts/min, P < 0.0001). The average difference between activity monitors expressed as a CV were 3.1 and 15.5% for log-transformed and raw data, respectively. When a conversion equation was applied to convert datasets from one brand to another, the differences were no longer significant, with CV's of 2.2 and 11.7%, log-transformed and raw data, respectively.
Although activity monitors predict PA on the same scale (counts/min), the results between these two brands are not directly comparable. However, the data are comparable if a conversion equation is applied, with better results for log-transformed data.
Despite the fact that physical activity (PA) is considered an important factor in the reduction of the risk of developing many chronic diseases [1–3], scientists have struggled with the complexities associated with quantitatively measuring PA . Due to the tendency of survey or self-report techniques to imprecisely estimate PA [4–7], the use of activity monitors (AM) as objective measures of PA has steadily increased since the 1980's . Activity monitors, or accelerometers, are small devices worn by human subjects (generally on the hip or wrist) that continuously measure the acceleration of bodily movements. The data from AMs are sometimes reported as independent measures of PA, minutes spent in PA of different exercise intensities, and/or converted into estimates of energy expenditure [9–11].
The selection of one of the many different brands of AMs is dependant on cost, size, weight, performance characteristics, and validity/reliability [5, 12, 13]. Due to these differences, it is unlikely that any single brand of AM will be universally adopted, bringing into question whether the results of studies using different brands of AMs produce comparable results. The raw data from AM's are an arbitrarily scaled measure called "counts", for which no standard currently exists between the different manufacturers (the magnitude of the counts depend on the different electrical and/or mechanical characteristics of the AM). One study comparing different brands of AMs using a mechanical set up (not placed on human subjects) demonstrated that count data are not comparable . However, this problem could be mitigated if data from one brand could be accurately converted to another, as long as the true relationship between PA and the counts from at least one AM brand was known.
In this investigation, we compared two of the most common AMs (Actigraph™ from Actigraph LLC and the Actical™ from the Mini-Mitter Co.) in 56 women and men that wore both AMs attached to the same belt over the course of 15 days. We wished to determine; (1) if the two brands produce different group mean predictions of PA (bias) and/or large within-subject differences (variance), and (2) if there are large biases and variance differences between the AMs, what is the result of converting the AM data from one brand to another?
The subjects were 28 women and 28 men, aged 30 to 60 yrs, with a BMI of 26.3 ± 4.2 (women) and 27.9 ± 4.9 kg·m-2 (men). The study protocol was approved by the Johns Hopkins University Bloomberg School of Public Health Committee on Human Research. Prior to participation, subjects provided written informed consent and received a medical evaluation by a physician that included measurement of blood pressure and analysis of fasting blood and urine samples to screen for presence of metabolic disease.
The AMs used in this comparison study were the Actigraph™ (AGR; Model 7164, Actigraph, LLC) and the Actical™ (MM; Mini-Mitter Co.). The AGR is a 51 × 41 × 15 mm uniaxial accelerometer that weights 43 g with a battery. The MM is a 28 × 27 × 10 mm omnidirectional accelerometer that weighs 17 g with a battery. More detailed information comparing the mechanical characteristics of the AMs is described elsewhere [12, 14]. To collect comparative data, both AMs were placed on the same snuggly-fitting belt worn over the right hip, with the MM attached to the belt with Velcro and the AGR directly looped through the belt. To minimize the effects variations in AM placement [13, 15], the position of each AM on the belt (anterior or posterior) was randomized. The AMs were set to read the data in 1-min intervals, with the internal timers of both AMs started at the exact same time. This procedure was carried out for 15 days, but the first and last days were discarded from the analysis because the subjects did not have the opportunity to wear the AMs for the entire 24 hr day (13 full days of data were used in the analysis). The AGR AMs were calibrated to the manufacturers specifications prior to being placed on the subjects; a calibration device for the MM was not available at the time of the study (however, these AMs were new from the manufacturer).
The minute-by-minute data were downloaded from each of the AMs individually, then the raw data were compiled into a master database using a custom computer program written in the SAS language  developed in our laboratory. To minimize the effect of zeroes produced due to AM removal, the only days accepted for analysis were those with a minimum of 14 hrs, assuming that sequences of 20 min of consecutive zeroes represented AM non-wear [17, 18]. The mean hours of AM wear in the database was 16.9 ± 2.4 hrs/day. Data were analyzed as daily means, with the mean number of days of data per subject being 10.7 (total of 600 days of data). AMs were rotated through the subjects so that 18 of the AGRs and 28 of the MMs were worn by two different subjects.
Mean values of PA for the two brands were compared using paired t-tests. The linear relationships between the brands of AMs were calculated using Pearson's correlation coefficient. Daily coefficients of variation (CV) were generated by dividing the standard deviation of (AGR - MM) by (AGR + MM)/2 times 100. The biases and variability between brands were also analyzed using Bland-Altman plots .
To inter-convert the data from the different AMs, one can develop correction factors based on the minute-by-minute data and/or the daily means. However, in order to generate a regression based on the minute-by-minute data, one must be certain that both AMs record PA at the same time. In other words, a "pulse" of PA from a subject must be detected in the same one minute interval by both AMs. Although both AMs were attached to the same belt (adjacent to each other) and the internal clocks were started at the same time, preliminary visual analyses indicated that pulses in PA were not being detected in the same one minute intervals as the collection period progressed. Thus, it appeared as though there was a "drift" in the time clocks of one or both of the AMs. To test the hypothesis that there was a drift in the internal clocks, a minute-by-minute CV was generated by dividing the standard deviation of (AGR - MM) by (AGR + MM)/2 times 100. These CV's were then averaged by day, and the differences between them were analyzed by a mixed model analysis of variance (Proc Mixed in SAS ). A Tukey's HSD test was used to detect post-hoc differences in the daily last squares means.
To develop a conversion equation for the daily means, slopes in the relationships between AM brands were measured in a mixed model analysis of variance (Proc Mixed). Other design effects such as AM position (which AM brand was placed anteriorly), AM ID (allowing individual AMs to have different intercepts), gender, and BMI were found not to be significant. Subject was modeled as a random effect. In turn, the slopes and intercepts estimated in the analysis were used to convert the data from one brand to the other. These estimates of PA were then compared using paired (by subject) t-tests. Analyses were performed on the daily raw count data, and when the daily data were log-transformed.
Comparisons between mean daily activity monitor data from the Actigraph and Actical, expressed as raw and log-transformed data (n = 56, total of 600 observation days).
Actigraph counts·min-1·day-1 mean (SD)
Actical counts·min-1·day-1 mean (SD)
Linear regressions representing the relationship between the AM brands for daily data produced the following equations:
Actigraph (counts·min-1·day-1) = 38.5168 + (0.9467 * Actical (counts·min-1·day-1))
log (Actigraph (counts·min-1·day-1)) = 0.9401 + (0.8470 * log (Actical (counts·min-1·day-1)))
Actical (counts·min-1·day-1) = -2.9883 + (0.8789 * Actigraph (counts·min-1·day-1))
log (Actical (counts·min-1·day-1)) = -0.0616 + (0.9808 *log (Actigraph (counts·min-1·day-1)))
Comparisons between mean daily activity monitor data from the Actigraph and Actical, with- and without conversion by a regression equation, expressed as raw and log-transformed data (n = 56, total of 600 observation days).
The principal finding of this investigation was that the output from the AGR and MM, both purportedly measuring PA, differed significantly. Although the raw data outputs from both AMs are "counts", these units of PA can differ between manufacturers, due to the A/D conversion, sensors, and amplification factors . Therefore, it is not surprising that a conversion equation was needed to make the brand means equivalent. Fortunately, the conversion of the daily PA data between AM brands (averaged over subjects), using the proposed conversion equations, produces estimates that are free of bias and with low variability (provided that the daily data are log-transformed prior to conversion). This means that converting between brands with the conversion equations will not only produce accurate group mean estimates of PA, but individual-subject data also can be converted successfully (CV of 2 – 3%).
Although it would be of interest to be able to convert the minute-by-minute data from one brand to another, the results of our analyses indicate this was not possible. The development of this type of a regression equation is dependent on a very close matching of the internal clocks between the AM brands. Figure 3 indicates this was not the case, and there was drift in the minute-by-minute time periods as the study progressed. Adapting our regression equations for minute-by-minute data is possible, but only if the internal clocks of both AM brands are accurate. Similarly, minute-by-minute regression equations from a mechanical set up carried over a short period of time (such as Esliger and Tremblay ) could be generated, but the accuracy of the conversions would be reduced over time unless the internal clocks were kept calibrated to each other. Drift is less of a problem when summing over long periods of time, since it is only pulses of activity near the end of the time period that may be incorrectly attributed to one of the two sequential time periods.
It is clear from Tables 1 and 2, and Figure 1 that these data are not normally distributed, and that a log-transformation will help satisfy the normality of residuals assumption of regression. Clearly the conversion bias is much less when working with log-transformed data. However, since a bias is introduced when back-transforming to the original scale, many investigators prefer to work with data on the original scale. We investigated a back-transforming procedure that includes a bias correction using the residual variance , but since the residual variances were small, there was only a negligible improvement on the back-transformed estimates of the daily means (CVs were still 11–12%). Therefore, we suggest using the data on the log-transformed scale when performing analyses.
This study confirms the findings of Esliger and Tremblay , who demonstrated that the PA data produced by the AGR and MM (using a mechanical setup, not placed on human subjects) are not comparable. However, we show that the daily AM counts from one brand of AM can readily be converted to another. Although the inter-conversion between AM brands appears to be reasonable, the approach must be carefully applied. First, we ensured that the subjects wore the AMs on a regular basis. We estimated that the subjects in this study wore the AM's approximately 17 hrs/day (all days with less than 14 hrs/day were discarded). If the conversion is applied to daily data where the adherence is much less than 17 hrs/day, it is likely that there will be more error when converting from one brand to another or estimating PA .
Given the feasibility of this approach, we hope that additional comparisons between other AM brands will be performed under similar free-living conditions in order better measure PA and thus better understand the relationships between PA and chronic disease.
Actigraph activity monitor
Actical activity monitor
coefficient of variation
- US Department of Health and Human Services: Physical activity and health. A report of the Surgeon General (Executive Summary). 1996, Pittsburgh, PAView Article
- Warburton DE, Nicol CW, Bredin SS: Health benefits of physical activity: the evidence. CMAJ. 2006, 174 (6): 801-809.PubMed CentralView ArticlePubMed
- Brooks GA, Butte NF, Rand WM, Flatt JP, Caballero B: Chronicle of the Institute of Medicine physical activity recommendation: how a physical activity recommendation came to be among dietary recommendations. Am J Clin Nutr. 2004, 79 (5): 921S-930S.PubMed
- Troiano RP, Macera CA, Ballard-Barbash R: Be physically active each day. How can we know?. J Nutr. 2001, 131 (2S-1): 451S-460S.PubMed
- Ward DS, Evenson KR, Vaughn A, Rodgers AB, Troiano RP: Accelerometer use in physical activity: best practices and research recommendations. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S582-8. 10.1249/01.mss.0000185292.71933.91.View ArticlePubMed
- Paul DR, Rhodes DG, Kramer M, Baer DJ, Rumpler WV: Validation of a food frequency questionnaire by direct measurement of habitual ad libitum food intake. Am J Epidemiol. 2005, 162 (8): 806-814. 10.1093/aje/kwi279.View ArticlePubMed
- Mahabir S, Baer DJ, Giffen C, Clevidence BA, Campbell WS, Taylor PR, Hartman TJ: Comparison of energy expenditure estimates from 4 physical activity questionnaires with doubly labeled water estimates in postmenopausal women. Am J Clin Nutr. 2006, 84 (1): 230-236.PubMed
- Troiano RP: A timely meeting: objective measurement of physical activity. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S487-9. 10.1249/01.mss.0000185473.32846.c3.View ArticlePubMed
- Masse LC, Fulton JE, Watson KL, Mahar MT, Meyers MC, Wong WW: Influence of body composition on physical activity validation studies using doubly labeled water. J Appl Physiol. 2004, 96 (4): 1357-1364. 10.1152/japplphysiol.00901.2003.View ArticlePubMed
- Dinger MK, Behrens TK: Accelerometer-determined physical activity of free-living college students. Med Sci Sports Exerc. 2006, 38 (4): 774-779. 10.1249/01.mss.0000210191.72081.43.View ArticlePubMed
- Chen KY, Sun M: Improving energy expenditure estimation by using a triaxial accelerometer. J Appl Physiol. 1997, 83 (6): 2112-2122.PubMed
- Chen KY, Bassett DR: The technology of accelerometry-based activity monitors: current and future. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S490-500. 10.1249/01.mss.0000185571.49104.82.View ArticlePubMed
- Welk GJ, Schaben JA, Morrow JR: Reliability of accelerometry-based activity monitors: a generalizability study. Med Sci Sports Exerc. 2004, 36 (9): 1637-1645.PubMed
- Esliger DW, Tremblay MS: Technical reliability assessment of three accelerometer models in a mechanical setup. Med Sci Sports Exerc. 2006, 38 (12): 2173-2181. 10.1249/01.mss.0000239394.55461.08.View ArticlePubMed
- Welk GJ: Principles of design and analyses for the calibration of accelerometry-based activity monitors. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S501-11. 10.1249/01.mss.0000185660.38335.de.View ArticlePubMed
- SAS Institute Inc: . Cary, NC, USA , Version 9.1
- Treuth MS, Sherwood NE, Baranowski T, Butte NF, Jacobs DR, McClanahan B, Gao S, Rochon J, Zhou A, Robinson TN, Pruitt L, Haskell W, Obarzanek E: Physical activity self-report and accelerometry measures from the Girls health Enrichment Multi-site Studies. Prev Med. 2004, 38 Suppl: S43-9. 10.1016/j.ypmed.2003.01.001.View ArticlePubMed
- Catellier DJ, Hannan PJ, Murray DM, Addy CL, Conway TL, Yang S, Rice JC: Imputation of missing data when measuring physical activity by accelerometry. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S555-S562. 10.1249/01.mss.0000185651.59486.4e.PubMed CentralView ArticlePubMed
- White H: A heteroskedastic-consistent covariance matrix estimator and a direct test of heteroskedasticity. Econometrica. 1980, 48: 817-838. 10.2307/1912934.View Article
- Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.View ArticlePubMed
- Miller DM: Reducing transformation bias in curve fitting. American Statistician. 1984, 38: 124-126. 10.2307/2683247.
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/7/26/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.