Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Reliability and validity of a sedentary behavior questionnaire for South American pediatric population: SAYCARE study

BMC Medical Research Methodology volume 20, Article number: 5 (2020) Cite this article

Abstract

Background

Multicenter studies from Europe and the United States have developed specifically standardized questionnaires for assessing and comparing sedentary behavior, but they cannot be directly applied for South American countries. The aim of this study was to assess the reliability and validity of the South American Youth Cardiovascular and Environmental (SAYCARE) sedentary behavior questionnaire.

Methods

Children and adolescents from seven South American cities were involved in the test-retest reliability (children: n = 55; adolescents: n = 106) and concurrent validity (children: n = 93; adolescents: n = 94) studies. The SAYCARE sedentary behavior questionnaire was administered twice with two-week interval and the behaviors were parent-reported for children and self-reported for adolescents. Questions included time spent watching television, using a computer, playing console games, passive playing (only in children) and studying (only in adolescents) over the past week. Accelerometer was used for at least 3 days, including at least one weekend day. We compared values of sedentary time, using accelerometers, by quartiles of reported sedentary behavior time and their sum.

Results

The reliability of sedentary behavior time was moderate for children (rho ≥0.45 and k ≥ 0.40) and adolescents (rho ≥0.30). Comparisons between the questionnaire and accelerometer showed a low overall agreement, with the questionnaire systematically underreporting sedentary time in children (at least, − 332.6 ± 138.5 min/day) and adolescents (at least, − 399.7 ± 105.0 min/day).

Conclusion

The SAYCARE sedentary behavior questionnaire has acceptable reliability in children and adolescents. However, the findings of current study indicate that SAYCARE questionnaire is not surrogate of total sedentary time.

Peer Review reports

Background

The majority of epidemiologic studies addressing sedentary behavior uses questionnaire to assess sedentary activities [1]. Questionnaires are low cost and easy to administer, and can therefore be easily used in large-scale studies [2]. Despite the increased number of sedentary behavior questionnaires worldwide, [1, 3] few have been appropriately validated using psychometric criteria, [4] and those validated questionnaires were mainly developed to evaluate European and American pediatric population [5]. In this sense, authors of a recent systematic review argue that tools to measure sedentary behavior should be developed for Brazilian children and adolescents [6].

Although valid tools to evaluate sedentary behavior in South American pediatric population are scarce, [3,4,5] a recent systematic review showed only one questionnaire assessing psychometric properties in comparison with objective measure [5]. In this sense, in children and adolescents, no self-report or proxy-report sedentary behavior questionnaires are available that are both valid and reliable [5]. Thus, high-quality research required into the measurement properties of measurement instruments of sedentary behavior [5, 7].

Additionally, prior literature suggests that ethnic and socioeconomic differences are observed in sedentary behavior trends [8]. One solution to this gap is to use standardized data from a multicenter approach [9]. In Europe, multicenter approaches are largely used to prepare questionnaires for epidemiological researches, regarding their design, feasibility, reliability and validity [10,11,12]. Conversely, in South American there is no sedentary behavior questionnaire with its reliability and validity tested in pediatric population with multicenter approach. The rationale behind the standardization using multicenter approach is based on transcultural adaptation focused in the equivalence of meaning and semantic of the questions among different languages and countries [13]. For this reason, an observational, multicenter feasibility study was developed to investigate health behaviors in a South American pediatric population [14]. For this study, a cross-cultural sedentary behavior questionnaire was developed and we assessed the reliability and validity of this questionnaire in South American children and adolescents.

Methods

Study design

The current study is part of the South American Youth Cardiovascular and Environmental (SAYCARE) study. A pilot feasibility multicenter study which collected data from 237 children (3–10 years) and 258 adolescents (11–18 years), totalizing 495 participants. The inclusion criteria were: i) age ranging from 3 to 18 years old, ii) informed written consent signed by a parent (or legal guardian) or by adolescent participants before enrollment and iii) provide information about sex and age. The exclusion criteria were: i) pregnancy, ii) inability to complete the questionnaires and iii) refusing to sign the informed consent. A detailed information about SAYCARE study can be found elsewhere [14].

The reliability of the sedentary behavior questionnaire was assessed through test-retest stability and the concurrent validity was assessed by comparisons between questionnaire and accelerometer. For the reliability study, we collected data from Buenos Aires (Argentina), Lima (Peru), Medellin (Colombia), Montevideo (Uruguay), Santiago (Chile), and Sao Paulo and Teresina (Brazil), while, for validity study, we collected data from Lima, Medellin, Teresina and São Paulo. These cities were selected based on the presence of specialized research centers with experience in this area of research and a population of more than 500,000 inhabitants. We aimed to survey populations across different geographic areas.

The study occurred during the 2015 and 2016 academic years.

Participants

We adopted assumptions of Nascimento-Ferreira et al. [15] for sample size estimation. The sample size for the reliability study was calculated using α-Cronbach = 0.75, α = 5% and β = 90%, [3, 16] while the parameters for the validity study were correlation coefficient = 0.40, α = 5% and β = 90% [3]. The estimated sample size was 136 participants for the reliability analysis, with a subsample of 65 participants randomly selected for the validity analysis. In each research center, at least 20 (10 children) and 16 participants (8 children) were selected for the reliability and validity analyses, respectively.

At the design level, participants from each center were equally distributed by sex (male and female) and school type (public and private). Accounting for potential sample losses, a 25% greater sample size was calculated, thereby involving a total of 170 participants in the reliability study and 81 participants in the validity study. In addition, anticipating a rejection rate of 40%, we invited 200 children and 200 adolescents for the reliability study and 110 children and 110 adolescents for the validity study, yielding a total of 400 participants to assess the reliability and validity of the SAYCARE sedentary behavior questionnaire.

Data collection

To coordinate and ensure the consistency of our methodology, seven fieldwork teams (one from each city) participated in a general training workshop in order to obtain required qualifications for conducting fieldwork. Regarding data collection, we selected conveniently-located schools and sent formal invitations with detailed information about the study. Students who accepted the invitation to participate were required to complete an informed written consent signed by a parent (or legal guardian) and by adolescent participants prior to enrollment.

Participants were excluded if they were pregnant or if their questionnaires were incomplete; as well as, the absence of informed consent from parents, guardians, and/or the individual himself. Besides, participants who reported mobility issues were excluded from data analysis.

Participants in the reliability study completed the questionnaire at home twice, with 2-week interval between the first (Q1) and second administration (Q2). For children, the questionnaire was parent-reported and for adolescents was self-reported. For the validity study, participants wore an accelerometer (model GT3X, Manufacturing Technology Inc., Fort Walton Beach, FL, USA) during the week immediately before the administration of Q1. The accelerometer was used for seven consecutive days, for at least eight hours per day [11]. Participants were instructed to attach the accelerometer to their waist each morning immediately after waking up and to remove it before going to sleep or during any aquatic activity [11]. In addition, participants (adolescents) or their parents/guardian (children) completed a record documenting the periods of accelerometer removal/replacement.

SAYCARE questionnaires

The SAYCARE sedentary behavior questionnaire was developed from questionnaires used in European multicenter studies [10, 11]. The questions were designed to assess screen time [3, 17]. In addition, questions about behaviors related to health outcomes in Brazilian pediatric population were included [6].

Based on varying cultural backgrounds, a cross-cultural questionnaire was adapted for all research centers (cities) in two versions/languages, Portuguese (for Brazilian cities) and Spanish (other cities), following the instructions for a tool design and development [1, 6]. In this sense, we performed a cross-cultural adaptation (with translation and back translation) from European Spanish to Brazilian Portuguese and South American Spanish languages in two steps i) meaning and ii) semantic equivalence which might be directly related with questions comprehension [13].

Sedentary behavior time was assessed in the previous week through questions about time expended in the following sedentary activities: watching television, using a computer, studying, and playing console games for adolescents; in children, time spent studying was replaced with passive play (e.g., playing with a toy or doll, painting). A total of 8 questions each for children and adolescents were asked.

The time spent in sedentary behavior was measured as the sum of all time reported (min/day) performing sedentary activities, separately for weekdays and weekend days. The total sedentary behavior time, for complete week, was calculated as follows: [11].

$$ \frac{\Big[\left(\mathrm{sedentary}\ \mathrm{behavior}\ \mathrm{on}\ \mathrm{weekdays}\ \mathrm{x}\ 5\right)+\left(\mathrm{sedentary}\ \mathrm{behavior}\ \mathrm{on}\ \mathrm{weekend}\ \mathrm{days}\ \mathrm{x}\ 2\right)}{7} $$

In addition, participants were classified as achieving or not achieving the recommended limit of less than 120 min/day (2 h/day) of sedentary behavior [18]. Demographic and socioeconomic information were also collected.

Accelerometers

The accelerometers were configured for a frequency of 30 Hz, an epoch of 5 s and one axis [11, 19]. Device data were only analyzed when valid measures were obtained for at least three days, including two weekdays and one weekend day [11]. Data from the days when the monitor was delivered and returned were excluded from the analysis. In addition, periods with 0 (zero) counts per minute (cpm) for more than 20 min were excluded as periods of non-use, [11] whereas periods with more than 20,000 cpm were excluded as a potential malfunction. Sedentary activity was defined as activity lower than 100 cpm [20]. We standardized the sedentary time each day correcting by accelerometer wearing time [21]. In this sense, sedentary time was expressed amount of time accumulated below 100 cpm during periods when the accelerometer was worn based on proportion of monitor-wearing time [11, 21]. Sedentary time (min/day) was assessed for weekdays and weekend days. Total sedentary time (for complete week) was calculated as follows: [11]

$$ \frac{\left(\mathrm{sedentary}\ \mathrm{time}\ \mathrm{on}\ \mathrm{weekdays}\ \mathrm{x}\ 5\right)+\left(\ \mathrm{sedentary}\ \mathrm{time}\ \mathrm{on}\ \mathrm{weekend}\ \mathrm{days}\ \mathrm{x}\ 2\right)}{7} $$

In addition, participants were classified as achieving or not achieving the recommended limit of less than 120 min/day (2 h/day) of sedentary time [18].

Statistical analysis

Analyses were conducted in Stata 14 software (StataCorp, College Station, TX, USA). Shapiro-Wilk was used to determine sample normality. Descriptive analyses of demographic and socioeconomic variables are presented. In the sensitivity analyses, we assessed differences between categorical variables using the Chi-square goodness-of-fit test. We measured the test–retest reliability, agreement between Q1 and Q2, using a Spearman correlation coefficient (rho) for continuous variables and Cohen’s kappa (k) agreement for categorical variables. We assessed unweighted k-coefficients to identify participants who followed the recommendations and weighted (quadratic) k-coefficient to compare objectively measured sedentary time by groups (quartiles) of self-reported sedentary behavior time.

To assess the validity, for agreement between Q1 and accelerometer, we used Spearman correlation coefficient and kappa agreement. A moderate Spearman correlation (rho ≥0.30) [22, 23] and kappa coefficient (k ≥ 0.40) [24] were considered acceptable agreements. Additionally, we used Bland-Altman analysis to assess disagreement between Q1 and accelerometer. The range of agreement was defined as the mean bias ±1.96 standard deviations (and 95% limits of agreement, LOA) and heteroscedasticity between the measures was checked using the Pitman (Trend) test [25]. Heteroscedasticity was examined to verify whether the absolute intermethods difference (bias) was associated with the magnitude of the mean of sedentary behavior measured (ie, intermethods mean) [25]. We considered a P value < 0.05 statistically significant.

Results

Altogether 495 participants met the general SAYCARE inclusion criteria (age range 3–18 years, signed an informed written consent and provided information about sex and age). Among these, 415 (at least 83.8%) completed sedentary behavior Q1. Thus, we have found incomplete (or missing in the Q1) information about sedentary behavior in 16.2% of the valid sample. For the reliability study, data from 161 participants were analyzed (Q2 response rate, 38.8%). For the validity analysis, data from 187 participants were analyzed (accelerometer response rate, 45.1%), most valid data (from the Q1 and accelerometer) came from the Brazilian cities (Table 1). Moreover, in the reliability study, our sample was composed by 9.3% of the participants from Buenos Aires, 23.0% from Lima, 36.6% from Medellin, 6.8% from Montevideo, 5.0% from Santiago, 17.4% from São Paulo and 1.9% from Teresina; while in the validity study, our sample was composed by 9.1% of the participants from Lima; 10.7% from Medellin; 47.6% from São Paulo and 32.6% from Teresina. The complete distribution of participants is shown in Additional file 1: Table S1. For total days, test-retest reliability of sedentary behavior time (min/day) for parent-report in children yielded a rho of 0.70; whereas, yielded a rho of 0.50 for self-report in adolescents. In addition, the reliability of quartile agreement and percentage of parent-report for children who followed the recommendations was k ≥ 0.40 (Table 2). The questionnaire showed low concurrent validity and bias between the questionnaire and the accelerometer was negative. Further analyses showed a wide LOA (Table 3).

Table 1 Distribution of sample in terms of demographic and socioeconomic variables of the SAYCARE general sample; and reliability and validity study samples
Full size table
Table 2 Reliability analysis (test–retest) of the SAYCARE sedentary behavior questionnaire
Full size table
Table 3 Validity analysis of the SAYCARE sedentary behavior questionnaire
Full size table

Discussion

The novelty of our study was to examine the reliability and validity of a sedentary behavior questionnaire in South American pediatric population from different cities using harmonized methodology for the first time. The main finding of this study was that the SAYCARE questionnaire showed acceptable reliability for sedentary behavior time in South American children and adolescents. Conversely, the questionnaire had a low validity and systematically underreported sedentary time compared with an accelerometer. Therefore, the SAYCARE questionnaire is a feasible and reliable tool to assess sedentary behavior time in the South American pediatric population, but not valid to estimate sedentary time.

The SAYCARE sedentary behavior questionnaire reported complete information from 83.8% of the participants; whereas, a European multicenter study about this topic reported 75% of complete information [11]. Conversely, we found important decreases in the response rate from Q1 (83.8%) to Q2 (61.8%) surveys. In addition, we found better compliance among participants from private schools and mothers with university degree to the Q2 and accelerometer assessments. We believe that the decrease in responses could be because of decreased participant motivation to complete a second questionnaire within a short lead time. In support of this finding, a comprehensive study involving six Latin American cities showed that socioeconomic status and educational level are limiting factors for education program adherence in adolescence [26]. We believe that this evidence could be extrapolated to our study. However, based on the compliance results of the Q1, we believe that the SAYCARE sedentary behavior questionnaire can be a feasible tool for future association studies in South American children and adolescents.

Reliability and validity of parent-reported sedentary behavior in children

Findings of the present study indicate that the SAYCARE questionnaire has an acceptable reliability to measure parent-reported sedentary behavior time in the South American children. The reliability performance was probably due to the fact that parents were asked to recall their children’s usual specific behaviors [18, 27]. We also found that reliability was better to identify children who followed the recommendations, than to identify time spent in sedentary behavior. This finding was particularly interesting and can likely be explained by the fact that sedentary behaviors tend to be more stable when compared to active behaviors and therefore, this can facilitate the recall process [28].

Conversely, in our work, there was a low correlation between questionnaires and accelerometers. Our results are not far from previous findings, as a prior systematic review found that the correlation between these methods ranged from − 0.16 to 0.55 [5]. The limited validity of the reported measures compared with the accelerometer was partially explained in the literature: the concomitant and intermittent natures of some sedentary activities are difficult to recall, [1] and metrics (outcome) assessed by questionnaires and accelerometers are “distinct” and “not equivalent” [7]. However, the accelerometer remains the most widely applied instrument and serves as a reference method to validate sedentary behavior questionnaires [5].

Moreover, the SAYCARE sedentary behavior questionnaire showed systematically underreport of sedentary time. The underreporting of sedentary time is not uncommon. Wen et al. showed a mean difference of 175 min/day between an sedentary behavior questionnaire and accelerometer in children [27]. In line with our findings, the authors argue that the subjective tool seems particularly useful to rank children by activity levels, but similarly to other reported tools, the parent-report overestimated time spent in physical activity and underestimate sedentary time compared with the accelerometer [27].

Reliability and validity of self-reported sedentary behavior in adolescents

In adolescents, despite an acceptable reliability for self-reported sedentary behavior time, the reliability of quartile classification was lower than the acceptable values. We also found no reliability to identify adolescents who followed the recommendations. Evidence suggests that reliability for self-reported information regarding behaviors (e.g., physical activity and sedentary behavior) is lower in young population groups [10]. In addition, sedentary behavior seems not to be settled at young ages and has been characterized as unstructured activities [10]. Moreover, interpretation or understanding of questions is a factor affecting questionnaire reliability and the quality of the reports [10]; memory also plays an important role [29]. The results of the present study are in line with previous systematic reviews that found an acceptable reliability of the questionnaire for time spent in sedentary behavior [3,4,5].

Our findings indicate that the correlation between self-reported minutes of sedentary behaviors from the SAYCARE and accelerometer-sedentary time was not acceptable. The questionnaire had inadequate ability to identify adolescents according to their sedentary time. Our results are in line with previous systematic reviews [2, 5]. In addition, findings in the present study suggest an important underestimation of the sedentary time compared to accelerometry. Similarly, Affuso et al. found a mean difference of 295 min/day between a self-reported leisure-time sedentary behavior and accelerometer in adolescents [30]. A possible explanation for the higher accelerometer measurements when compared with questionnaires could be the elevated values of absence of movement computed as sedentary time in the accelerometers whereas the questionnaire was developed to measure the time spent on four sedentary activities associated with health outcomes [31, 32].

Thus, studies drawing inferences about total sedentary time (from accelerometers) compared to a set of sedentary behavior (from questionnaires or diaries) should be interpreted with caution. In this sense, we hypothesized that the poor agreement between questionnaire and accelerometer for assessing sedentary behavior found in our study could be likely due to the choice of accelerometers (e.g., Actigraph GT3X) as a reference method rather than the subjective method per se. Although the accelerometer was the most common device used on validity studies, [5, 33] posture sensor (e.g., activPAL) emerges as a new potential reference method [1].

Strengths and limitations

Our study has some limitations. First, although the sample was robust in size and diversity, the sample was not equally distributed among cities and school types. Second, our sample size was not calculated in separately for children (parent-report) and adolescents (self-report) although the analyzes were done separately. However, in post-hoc analysis the sample size from children (N = 55; β < 1%) and adolescents (N = 106; β < 1%) remained significant in power. Third, our sample was selected out of convenience. The rationale behind our convenience sample is that the differences between private and public schools across different countries can provide a good idea of the socio-demographic characteristics present in South America [9]. Additionally, although the SAYCARE sedentary behavior questionnaire recorded information about four sedentary activities (including passive playing in children and studying in adolescents), it did not gather all the types of sedentary behaviors that adolescent were able to do [34]. In this sense, to compare with European data, [11, 34] we assessed reported sedentary behaviors, other than screen time, and ranked participants who attend media time recommendations (≤ 120 min/day) [18]. Another concern may regard questionnaire response, for total days in future inferential researches, the sedentary behavior should be restricted to individuals with complete information, due the variation of sedentary time during segments of the week [35]. In the presence of missing data, we strongly encourage the measure of sedentary behavior for week and weekend days in separately. Strengths of this study were a comparison of sedentary behavior questionnaires against an objective measurement (accelerometers) in a multicultural youth group and in low- to middle-income countries, an area of research that has previously been limited [14]; and, the implementation of a harmonized methodology. In according with the literature, this is the first multicenter study addressing comparison between sedentary behavior subjective and objective methodology in South American pediatric population.

Conclusions

The SAYCARE sedentary behavior questionnaire presents acceptable reliability in South American children and adolescents. However, time spent watching television, using a computer, playing console games, passive playing (only in children) and studying (only in adolescents) is not necessarily indicative of young people’s sedentary time. We recommend the SAYCARE questionnaire as a feasible and reliable tool to assess sedentary behavior time in the South American pediatric population, but not as a proxy of sedentary time.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available due confidential term signed up to the conclusion of the study but are available from the corresponding author on reasonable request. The SAYCARE information can be accessed on the website at “http://www.bv.fapesp.br/pt/auxilios/91579/saycare-south-american-youthchild-cardiovascular-and-environmental-study/” and “http://www.bv.fapesp.br/en/auxilios/86359/design-and-implementation-of-the-saycare-study-south-america-youthchild-cardiovascular-and-environ/”

Abbreviations

Hz:

Hertz

k:

Kappa agreement coefficient

LOA:

Limits of agreement

Q1:

Questionnaire first application

Q2:

Questionnaire second application

rho:

Spearman correlation coefficient

SAYCARE:

South American Youth Cardiovascular and Environmental

SB:

Sedentary behavior

References

  1. Atkin AJ, Gorely T, Clemes SA, Yates T, Edwardson C, Brage S, et al. Methods of measurement in epidemiology: sedentary behaviour. Int J Epidemiol. 2012;41(5):1460–71.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Lubans DR, Hesketh K, Cliff DP, Barnett LM, Salmon J, Dollman J, et al. A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents. Obes Rev. 2011;12(10):781–99.

    Article  CAS  PubMed  Google Scholar 

  3. Bryant MJ, Lucove JC, Evenson KR, Marshall S. Measurement of television viewing in children and adolescents: a systematic review. Obes Rev. 2007;8(3):197–209.

    Article  CAS  PubMed  Google Scholar 

  4. Lubans, Hesketh K, Cliff DP, Barnett LM, Salmon J, Dollman J, et al. A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents. Obes Rev. 2011;12(10):781–99.

    Article  CAS  PubMed  Google Scholar 

  5. Hidding LM, Altenburg TM, Mokkink LB, Terwee CB, Chinapaw MJ. Systematic review of childhood sedentary behavior questionnaires: what do we know and what is next? Sports Med. 2016.

  6. Guerra PH, de Farias Júnior JC, Florindo AA. Sedentary behavior in Brazilian children and adolescents: a systematic review. Rev Saude Publica. 2016;50:9.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Kelly P, Fitzsimons C, Baker G. Should we reframe how we think about physical activity and sedentary behaviour measurement? Validity and reliability reconsidered. Int J Behav Nutr Phys Act. 2016;13(1):32.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Brodersen NH, Steptoe A, Boniface DR, Wardle J. Trends in physical activity and sedentary behaviour in adolescence: ethnic and socioeconomic differences. Br J Sports Med. 2007;41(3):140–4.

    Article  PubMed  Google Scholar 

  9. Moreno LA, De Henauw S, González-Gross M, Kersting M, Molnár D, Gottrand F, et al. Design and implementation of the healthy lifestyle in Europe by nutrition in adolescence cross-sectional study. Int J Obes. 2008;32(Suppl 5):S4–11.

    Article  Google Scholar 

  10. González-Gil EM, Mouratidou T, Cardon G, Androutsos O, De Bourdeaudhuij I, Góźdź M, et al. Reliability of primary caregivers reports on lifestyle behaviours of European pre-school children: the ToyBox-study. Obes Rev. 2014;15(Suppl 3):61–6.

    Article  PubMed  Google Scholar 

  11. Rey-López JP, Ruiz JR, Ortega FB, Verloigne M, Vicente-Rodriguez G, Gracia-Marco L, et al. Reliability and validity of a screen time-based sedentary behaviour questionnaire for adolescents: the HELENA study. Eur J Pub Health. 2012;22(3):373–7.

    Article  Google Scholar 

  12. Singh AS, Vik FN, Chinapaw MJ, Uijtdewilligen L, Verloigne M, Fernández-Alvira JM, et al. Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project. Int J Behav Nutr Phys Act. 2011;8:136.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7(4):323–35.

    Article  CAS  PubMed  Google Scholar 

  14. Carvalho HB, Moreno LA, Silva AM, Berg G, Estrada-Restrepo A, González-Zapata LI, et al. Design and objectives of the south American youth/child cardiovascular and environmental (SAYCARE) study. Obesity (Silver Spring). 2018;26(Suppl 1):S5–S13.

    Article  Google Scholar 

  15. Nascimento-Ferreira MV, De Moraes ACF, Toazza Oliveira PV, Rendo-Urteaga T, Gracia-Marco L, Forjaz CLM, et al. Assessment of physical activity intensity and duration in the paediatric population: evidence to support an a priori hypothesis and sample size in the agreement between subjective and objective methods. Obes Rev. 2018.

  16. Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21(9):1331–5.

    Article  PubMed  Google Scholar 

  17. Marshall SJ, Biddle SJ, Gorely T, Cameron N, Murdey I. Relationships between media use, body fatness and physical activity in children and youth: a meta-analysis. Int J Obes Relat Metab Disord. 2004;28(10):1238–46.

    Article  CAS  PubMed  Google Scholar 

  18. Verbestel V, De Henauw S, Bammann K, Barba G, Hadjigeorgiou C, Eiben G, et al. Are context-specific measures of parental-reported physical activity and sedentary behaviour associated with accelerometer data in 2-9-year-old European children? Public Health Nutr. 2015;18(5):860–8.

    Article  PubMed  Google Scholar 

  19. Ruiz JR, Ortega FB, Martínez-Gómez D, Labayen I, Moreno LA, De Bourdeaudhuij I, et al. Objectively measured physical activity and sedentary time in European adolescents: the HELENA study. Am J Epidemiol. 2011;174(2):173–84.

    Article  PubMed  Google Scholar 

  20. Trost SG, Ward DS, Moorehead SM, Watson PD, Riner W, Burke JR. Validity of the computer science and applications (CSA) activity monitor in children. Med Sci Sports Exerc. 1998;30(4):629–33.

    Article  CAS  PubMed  Google Scholar 

  21. Janssen X, Basterfield L, Parkinson KN, Pearce MS, Reilly JK, Adamson AJ, et al. Objective measurement of sedentary behavior: impact of non-wear time rules on changes in sedentary time. BMC Public Health. 2015;15:504.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Strong WB, Malina RM, Blimkie CJ, Daniels SR, Dishman RK, Gutin B, et al. Evidence based physical activity for school-age youth. J Pediatr. 2005;146(6):732–7.

    Article  PubMed  Google Scholar 

  23. Ridgers ND, Timperio A, Crawford D, Salmon J. Validity of a brief self-report instrument for assessing compliance with physical activity guidelines amongst adolescents. J Sci Med Sport. 2012;15(2):136–41.

    Article  PubMed  Google Scholar 

  24. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.

    Article  CAS  Google Scholar 

  25. Ludbrook J. Statistical techniques for comparing measurers and methods of measurement: a critical review. Clin Exp Pharmacol Physiol. 2002;29(7):527–36.

    Article  CAS  PubMed  Google Scholar 

  26. McArthur L, Peña M, Holbert D. Effects of socioeconomic status on the obesity knowledge of adolescents from six Latin American cities. Int J Obes Relat Metab Disord. 2001;25(8):1262–8.

    Article  CAS  PubMed  Google Scholar 

  27. Wen LM, van der Ploeg HP, Kite J, Cashmore A, Rissel C. A validation study of assessing physical activity and sedentary behavior in children aged 3 to 5 years. Pediatr Exerc Sci. 2010;22(3):408–20.

    Article  PubMed  Google Scholar 

  28. Saint-Maurice PF, Welk GJ. Validity and calibration of the youth activity profile. PLoS One. 2015;10(12):e0143949.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Otter M, Mellenbergh G, Glopper K. The relation between information-processing variables and test–retest stability for questionnaire items. J Educ Meas. 1995;32:199–216.

    Article  Google Scholar 

  30. Affuso O, Stevens J, Catellier D, McMurray R, Ward D, Lytle L, et al. Validity of self-reported leisure-time sedentary behavior in adolescents. Pediatr Exerc Sci. 2010;22(3):408–20.

    Article  Google Scholar 

  31. Biddle SJ, Gorely T, Marshall SJ. Is television viewing a suitable marker of sedentary behavior in young people? Ann Behav Med. 2009;38(2):147–53.

    Article  PubMed  Google Scholar 

  32. Grøntved A, Hu FB. Television viewing and risk of type 2 diabetes, cardiovascular disease, and all-cause mortality: a meta-analysis. JAMA. 2011;305(23):2448–55.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Nascimento-Ferreira MV, Moraes ACF, Rendo Urteaga T, Oliveira PVT, Moreno LA, Barbosa CH. Impact of methodological approaches in the agreement between subjective and objective methods for assessing screen time and sedentary behavior in pediatric population: a systematic review. Nutr Hosp. 2019;36(2):449–62.

    PubMed  Google Scholar 

  34. Rey-López JP, Vicente-Rodriguez G, Ortega FB, Ruiz JR, Martinez-Gómez D, De Henauw S, et al. Sedentary patterns and media availability in European adolescents: the HELENA study. Prev Med. 2010;51(1):50–5.

    Article  PubMed  Google Scholar 

  35. Ramirez-Rico E, Hilland TA, Foweather L, Fernández-Garcia E, Fairclough SJ. Weekday and weekend patterns of physical activity and sedentary time among Liverpool and Madrid youth. Eur J Sport Sci. 2014;14(3):287–93.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

All authors acknowledge the school dean/chair of each school as well as the children, adolescents and their respective parents for their voluntary participation in SAYCARE Study. We also thank Mr. Andrew Mello Silva for managing the SAYCARE database. In Colombia, we thank the undergraduate students Carolina Alzate Echeverri, Luisa Fernanda Arroyave Zuleta, Sarah Lucía Ortiz Calderón, and Paola Zapata for helping collect information and data entry. All authors thank the General Coordinator of the GENUD Research Group Luis A. Moreno (MD, PhD, Full Professor) from Faculty of Health Sciences, University of Zaragoza for the loan and help with the accelerometers for data collection.

Funding

The SAYCARE study design, data collection and analysis were supported by the Brazilian Government from National Counsel of Technological and Scientific Development (CNPq; proc. 471266/2013–2) and São Paulo State Government from São Paulo Research Foundation (FAPESP; proc. 2014/11468–6). The SAYCARE Study has also been co-funded by other agencies in other countries as follows: (i) Collaborative Projects Fund (R.D. N°501–2015-INSN-DG-OEA) granted by the Instituto Nacional de Salud del Niño, Lima, Perú.; (ii) Sustainability Strategy at the University of Antioquia 2014–2015, Research group of social and economic determinants of health and nutrition, and Demography and Health Research Group at the University of Antioquia, Medellin, Colombia, and Interuniversity Services Corporation (CIS) from UdeA; (iii) Secretary of University Extension and Student Welfare, University of Buenos Aires, Buenos Aires, Argentina; and (iv) European Regional Development Fund (MICINN-FEDER) to GENUD Research Group.

In addition, SAYCARE study researchers were also supported for interpretation of data, and in writing the manuscript. Augusto César Ferreira De Moraes was awarded by Young Investigator grant from FAPESP (proc. 2017/20317–0 and 2019/02617–1). Marcus V. Nascimento-Ferreira received a postdoctoral scholarship from Programa Nacional de Pós-Doutorado/Capes (PNPD/CAPES) and a PhD Student Internships abroad scholarship from the National Counsel of Technological and Scientific Development (CNPq, proc. 200340/2015–8) and a Brazilian PhD Student scholarship from the São Paulo Research Foundation (FAPESP, proc.2016/18436–8 and 2017/11732–3). Claudia L M Forjaz received advanced scientist scholarship from National Counsel of Technological and Scientific Development (CNPq: proc. 304003/2014–0). Full Prof. Luis A. Moreno was given the scholarship of a visiting professor from São Paulo Research Foundation (FAPESP, proc. 2015/11406–3). Heráclito B Carvalho received a research grant from São Paulo Research Foundation (FAPESP, proc. 2014/11468–6) and an advanced scientist scholarship from National Counsel of Technological and Scientific Development (CNPq: proc. 300951/2015–9).

Author information

Author notes

  1. Augusto César Ferreira De Moraes and Marcus Vinícius Nascimento-Ferreira contributed equally to this work.

Authors and Affiliations

  1. Department of Epidemiology, School of Public Health, University of Sao Paulo, São Paulo, Brazil

    Augusto César Ferreira De Moraes

  2. YCARE (Youth/Child cArdiovascular Risk and Environmental) Research Group, Faculdade de Medicina, Universidade de Sao Paulo, São Paulo, Brazil

    Augusto César Ferreira De Moraes, Marcus Vinícius Nascimento-Ferreira & Heráclito Barbosa Carvalho

  3. Growth, Exercise, NUtrition and Development (GENUD) Research Group, Instituto Agroalimentario de Aragon (IA2), Instituto de Investigacion Sanitaria Aragon (IIS Aragon), Centro de Investigacion Biomedica en Red de Fisiopatologıa de la Obesidad y Nutricion (CIBERObn), University of Zaragoza, Zaragoza, Spain

    Marcus Vinícius Nascimento-Ferreira, Maria L. Miguel-Berges & Luis A. Moreno

  4. Exercise Hemodynamic Laboratory, School of Physical Education and Sport, University of São Paulo, São Paulo, Brazil

    Claudia Lucia de Moraes Forjaz

  5. Grupo de Investigación en Fisiología y Bioquímica (PHYSIS), Universidad de Antioquia, Medellín, Colombia

    Juan Carlos Aristizabal

  6. Escuela de Nutrición, Facultad de Medicina, Universidad de Buenos Aires, Buenos Aires, Argentina

    Leticia Azzaretti

  7. Metabolic Diseases, Exercise and Nutrition (DOMEN) Research Group, Federal University of Piaui, Teresina, Brazil

    Walter Viana Nascimento Junior

  8. Escuela de Nutrición, UdelaR, Montevideo, Uruguay

    Estela Skapino

  9. Universidad Nacional Mayor de San Marcos (UNMSM), School of Medicine, Department of Pediatrics and Instituto Nacional de Salud del Niño (INSN), Neonatal Unit, Lima, Peru

    Carlos Delgado

Authors
  1. Augusto César Ferreira De Moraes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marcus Vinícius Nascimento-Ferreira
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Claudia Lucia de Moraes Forjaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Juan Carlos Aristizabal
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Leticia Azzaretti
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Walter Viana Nascimento Junior
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Maria L. Miguel-Berges
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Estela Skapino
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Carlos Delgado
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Luis A. Moreno
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Heráclito Barbosa Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ACFM and MVNF, carried out the manuscript design, performed the statistical analysis and drafted the manuscript. CLMF, JCA, CD, LAM and HBC conceived the SAYCARE study, and participated in its design and coordination and helped to draft the manuscript. LA, WVNJ, MLMB and ES carried out the critical review of the manuscript. All authors have read and approved the final version of the manuscript, and agree with the order of presentation of the authors.

Corresponding author

Correspondence to Marcus Vinícius Nascimento-Ferreira.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Research Ethics Committee of Medical School of the University of São Paulo (Brazil), under research protocol no. 2,022,542, and also from the other centers participating at the SAYCARE Study: Buenos Aires (Argentina), no. CUDAP EXP-UBA: 54555/14, Lima (Peru) no. 00222-CEI-INSN-2015, and Medellin, (Comité de Bioética para Investigación en Humanos – Universidad de Antioquia, Colombia), no. 14–43-596. The informed consent form was signed by all the parents/guardians of the research participants, and all children/adolescents gave verbal/written agreement to participate in the study. The study was performed in accordance to the ethical guidelines of the Declaration of Helsinki of the World Medical Association for medical studies in humans.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

Samples composition for the reliability and validity study of SAYCARE sedentary behavior questionnaire.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

De Moraes, A.C.F., Nascimento-Ferreira, M.V., Forjaz, C.L.d. et al. Reliability and validity of a sedentary behavior questionnaire for South American pediatric population: SAYCARE study. BMC Med Res Methodol 20, 5 (2020). https://doi.org/10.1186/s12874-019-0893-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-019-0893-7

Keywords

BMC Medical Research Methodology

ISSN: 1471-2288

Contact us