Concordance of sibling's recall of measures of childhood socioeconomic position
BMC Medical Research Methodology volume 11, Article number: 147 (2011)
Studies of socioeconomic determinants of health often rely on recalled information on childhood socioeconomic position, despite limited evidence of the validity of this information. This study examined concordance between siblings of recalled measures of childhood socioeconomic position.
This cross-sectional study examined reports by 1280 adult sibling pairs in the National Survey of Midlife Development in the United States of seven measures of childhood socioeconomic position: father's occupation (in 9 categories), father having a professional occupation, father being a supervisor at work, father's education level, mother's education level, receipt of welfare payments, and subjective appraisal of being better or worse off financially than others.
Concordance was high for father's professional occupation (0.97; 95% confidence interval (CI) 0.96, 0.98), father's occupation in 9 categories (0.76; 95% CI 0.73, 0.80), and receipt of welfare payments (0.95; 95% CI 0.93, 0.97). Concordance was lower for father's and mother's education level, and lowest for subjective appraisal of socioeconomic position (0.60; 95% CI 0.57, 0.64). Concordance of parental education was lower for sibling pairs with high school educations or less.
Concordance of recalled measures of childhood socioeconomic position by siblings is generally but not uniformly high.
Studies of socioeconomic determinants of health have increasingly adopted a life-course perspective, examining associations not only of current socioeconomic position but also of measures of childhood socioeconomic position [1, 2]. Although some longitudinal cohort studies have collected data on childhood socioeconomic position prospectively, this approach is often not feasible in clinical and epidemiological studies. Most studies assess childhood socioeconomic position retrospectively using recall by study participants [3–5].
Few studies have assessed the validity of recall of measures of childhood socioeconomic position. In a British survey, the occupation of the subject's father was accurately recalled after 50 years by 12 of 18 subjects, but recall was assessed by a detailed interview that first established personal life histories . A larger British study reported that childhood social class, based on the father's occupation, was accurately recalled by 54% of adults when compared to prospectively collected data . In contrast, Krieger et al reported highly concordant responses to questions on father's educational attainment and work role by 352 adult twin pairs, indicating that these measures were accurately recalled . The study included only women, and examined only two measures of childhood socioeconomic position, leaving open the question of whether recall would be similarly concordant among men and for other measures of childhood socioeconomic position. Although father's occupation and father's education level have been the measures most often used to assess childhood socioeconomic position, other measures such as mother's education level, indicators of poverty or financial insecurity, and subjective appraisal of relative wealth have been included in recent surveys [3, 9, 10]. The goal of this study was to assess the validity of recall by adults of several different measures of childhood socioeconomic position by comparing responses between sibling pairs in a large national sample. We also examined if concordance varied with characteristics of the respondents.
Source of data
Data were from the National Survey of Midlife Development in the United States (MIDUS), a survey of the health, psychological well-being, and social and economic circumstances of adults in mid-life in the United States (U.S.), conducted in 1995-1996 . The survey included four samples: the main sample, siblings of participants in the main sample, a sample of twins, and dedicated samples in five selected cities. Participants in the main sample were recruited by random-digit dialing of households in the contiguous U.S. from working telephone banks to provide a representative sample of noninstitutionalized English-speaking adults. One member of each household who was age 25 to 74 was randomly selected to participate. Participants completed a telephone interview and were then asked to complete a mailed self-administered questionnaire. The response rate for telephone interview was 70% and for the questionnaire was 87%, for a final sample of 3032 participants. Siblings were recruited from a random subsample of 529 participants in the main sample who completed the interview. Only full siblings age 25 to 74 were eligible, but more than one sibling per family could be enrolled. Interviews were completed by 950 of 1480 siblings identified. Twins were referred from other national surveys that screened approximately 50,000 households for the presence of twins, of which 60% were enrolled (n = 1914). Some families had more than one twin pair enrolled, and for some pairs, both twins did not enroll. The city-specific samples were not included in this study.
From these samples, we identified 529 sibling pairs and 885 twin pairs, selecting at random one twin pair per family in cases where more than one twin pair had been enrolled. For families with more than one sibling enrolled, we selected the sibling closest in age to the participant in the main sample. One sibling pair per family was selected to avoid non-independent observations. Of these 1414 pairs, we then excluded 134 pairs for which either the identified male head of household during most of their childhood (specified as before age 17) or the identified female head of household during most of their childhood differed between members of the pair. For example, one member of the pair may have identified the biological father as the male head of household while the other member of the pair identified a step-father as the male head of household. Because information on education and occupation were specifically asked about the head of household, we required both members of each pair to reference the same individual. Eighty-six pairs were deleted because they identified different male heads of household, 32 pairs were deleted because they identified different female heads of household, and 16 pairs were deleted because both heads of household differed, resulting in 1280 pairs (476 sibling pairs and 804 twin pairs).
Measures of childhood socioeconomic position
Questions on measures of socioeconomic position before the age of 17 were asked during the telephone interview. Participants were asked to report the main job title of the male head of household (hereafter, father), which survey investigators then classified into one of nine categories of the U.S. census occupational classification system (professional, manager, technical worker, clerical, sales, craftsman, service worker, operative/laborer, farm worker) . For analysis, the father's occupation was considered both as the 9-category classification and as a dichotomous variable representing professional occupation versus other. Data were only collected for a single main job title; if respondents reported their father changed jobs, they were instructed to report the main job he had during their adolescence. Participants were also asked if their father supervised others at work. Participants were asked their father's highest level of educational attainment in 12 categories, which for analysis was collapsed into 5 categories (grade school, some high school, high school graduate or General Educational Development qualification, some college, and college graduate). Educational attainment of the female head of household (hereafter mother) was similarly classified. Participants were asked if during their childhood or adolescence their family had received welfare or Aid to Dependent Children for at least 6 months. Lastly, participants were asked if they thought that while growing up, their family was better off or worse off financially than other families at the time, on a 7-category scale ranging from "a lot better off" to "a lot worse off". For analysis, responses were collapsed into three categories (better off, the same, and worse off). Only 28.6% of participants reported that their mother worked during most or all of their childhood, so mother's occupation was not analyzed.
Percent concordant responses between members of each pair were tabulated for each measure of childhood socioeconomic position, with 95% confidence intervals based on binomial proportions. Concordance measures only identical responses and does not account for chance. Agreement was therefore also estimated using weighted kappa, with exact 95% confidence intervals. Kappa provides a measure of agreement beyond that expected due to chance alone. Weighting of the kappa takes account of the degree of discrepancy between ordinal responses, with widely divergent responses discounted more than slightly divergent responses. However, kappa is sensitive to the prevalence of responses across categories . Higher kappa indicates greater agreement. Data were missing for at least one member for father's occupation in 142 pairs (11.1%), for father's supervisory role at work in 126 pairs (9.8%), for father's education level in 174 pairs (13.6%), for mother's education level in 99 pairs (7.7%), for welfare during childhood in 20 pairs (1.5%), and for subjective appraisal of whether the family was better or worse off financially than others in 126 pairs (9.8%). These pairs were excluded from the corresponding concordance estimate because only non-missing responses are informative for concordance. Data were missing for both members of the pair for between 10% (welfare during childhood) and 38% (father's supervisory role at work) of pairs with missing data. No pairs had missing data on all measures.
To investigate if the degree of concordance was related to participant characteristics, we computed estimates for subgroups by age (younger or older than the group median of 46 years, and categorized based on the age of the younger member of the pair), sex, twin status, education level (less than high school, high school graduate, some college, or college graduate, based on the education level of the member of the pair with the lowest education level), and income (poor versus not poor). Pairs were classified as poor if either member reported an annual household income of less than $31,200, which was 200% of the 1996 federal poverty level for a family of four. Adjustment of income for household size was not possible because data on the number of members in the household was not available.
Analyses were performed using SAS programs (SAS Inc, Cary, NC).
The sample included 2560 participants (1280 pairs), of whom 44.6% were men and 89% were white; 36.3% had a high school education or less (Table 1). The age difference between siblings was 4 years or less in 71.4% of non-twin pairs. Brothers comprised 26.8% of pairs, sisters comprised 37.6% of pairs, and a brother and sister comprised 35.6% of pairs. Ninety-three percent of pairs reported on both of their biological parents.
Concordance for father's occupation, based on the 9-category classification, was 0.76 and kappa was 0.77, indicating substantial agreement (Table 2). Concordance was higher when considering only whether the father had a professional occupation or not, ignoring discrepancies in other categories of occupation. Concordance for father's supervisory role at work, father's education level, and mother's education level was slightly lower, ranging from 0.69 to 0.77, but had substantial agreement within pairs. There was high concordance on whether the family had received welfare payments for 6 months or longer. Kappa for welfare was low because few participants reported receiving welfare (13). The subjective appraisal of whether the family was better or worse off financially than others had the lowest concordance (0.60) and only fair agreement.
Concordance for all measures was similar across groups stratified by age, sex, and income level (Table 3). Results were also similar between twins and siblings, suggesting that age differences between siblings did not influence concordances for those measures that might have changed over time, such as father's occupation. However, concordance for some measures varied by education level of the participants. College graduates had higher concordances for father's occupation, father's supervisory role at work, father's education level, and mother's education level than pairs with at least one member who had a high school education or less. The high concordance for father's professional occupation and for receipt of welfare did not vary with education level, nor did the relatively low concordance for subjective appraisal of whether the family was better off or worse off financially than others.
The results of this study support the validity of recalled measures of childhood socioeconomic position. These measures included not only father's occupation, supervisory role at work, and education level, which have been the measures of childhood socioeconomic position most commonly used , but also mother's education level and receipt of welfare payments. Concordance of recall of mother's educational level has not been reported previously. This result is important given observations that mothers' and fathers' educational levels have different and unique associations with some health outcomes [14–16]. Agreement on parent's education level was somewhat lower than that for father's occupation, but at a level similar to long-term recall of education level in other studies . Father's occupation also had slightly fewer missing responses than education level, which may influence which measure is preferred. Receipt of welfare during childhood was also highly concordant, although substantial differences in childhood socioeconomic position were likely present among those whose family did not receive welfare. Concordance was lowest for the subjective appraisal of relative wealth during childhood, despite collapsing the seven response categories to three categories. This is important to note because this measure has been included in several national surveys of health and aging and has been increasingly used by researchers [18–20].
These findings support previous studies of the validity of recall of father's education level and occupation. However, concordance in our study was somewhat lower than that reported by Krieger and colleagues . For example, Krieger et al reported percent concordance for father's education level of 0.91, compared to 0.73 in our study. Two factors may largely account for this difference. Father's education level in the study by Krieger et al was classified into three categories [less than high school graduate; high school graduate or some college; college graduate], while we used five categories. Re-analysis of our data using these three categories for father's education level increased the proportion of concordant responses to 0.83. More finely-graded categories provide more opportunity for discrepant responses, and therefore may have lower estimates of concordance and agreement, but may also be more useful. Participants in the study by Krieger et al were also more highly educated, with 28% having a high school education or less, compared to 36% in this study. We found that participants with higher levels of education level tended to have more concordant responses, particularly for parental education level, and less so for father's occupation and supervisory role at work. Low education level has been associated with poorer recall in some previous studies [21, 22]. Education level was the only participant characteristic associated with differences in agreement. Agreement was similar between brothers and sisters.
The survey did not ask about residential characteristics during childhood, so recall of measures such as household crowding, plumbing, and home ownership could not be assessed. The occupation classification is specific to the United States, and these results may not be generalizable to other countries. Concordance may be higher in countries where more abbreviated occupational scales are used, such as the United Kingdom (professional; managerial and technical; skilled; partly skilled; unskilled). Data were obtained by telephone interview, which likely reduced collaboration between siblings. However, given the opportunity that a telephone interview provides for questions and clarifications, these results may not directly relate to data collected by other means, such as written questionnaires. The study included too few minorities for analyses stratified by race. In addition, the validity of recall based on the concordance of sibling responses may not replicate direct comparisons of recalled and prospectively collected data on childhood socioeconomic position.
Our results indicate that adult's recall of father's occupation and parental educational levels are sufficiently valid for use in characterizing childhood socioeconomic position. However, it is important to note that agreement of recall of these measures was lower among participants with high school educations or less, which may introduce differential bias and distort associations with health outcomes. Appraisals of relative wealth during childhood also demonstrated lower concordance, as might be anticipated for a more subjective measure. Caution should be used in relying on this as the sole measure of childhood socioeconomic position, to the exclusion of other more objective measures that can be obtained equally easily.
National Survey of Midlife Development in the United States
Ben-Shlomo Y, Kuh D: A life course approach to chronic disease epidemiology: conceptual models, empirical challenges and interdisciplinary persectives. Int J Epidemiol. 2002, 31: 285-93. 10.1093/ije/31.2.285.
Galobardes B, Lynch JW, Davey Smith G: Childhood socioeconomic circumstances and cause-specific mortality in adulthood: systematic review and interpretation. Epidemiol Rev. 2004, 26: 7-21. 10.1093/epirev/mxh008.
Chittleborough CR, Baum FE, Taylor AW, Hiller JE: A life-course approach to measuring socioeconomic position in population health surveillance systems. J Epidemiol Community Health. 2006, 60: 981-92. 10.1136/jech.2006.048694.
Moceri VM, Kukull WA, Emanual I, et al: Using census data and birth certificates to reconstruct the early-life socioeconomic environment and the relation to the development of Alzheimer's disease. Epidemiology. 2001, 12: 383-9. 10.1097/00001648-200107000-00007.
Rose KM, Perhac JS, Bang H, Heiss G: Historical records as a source of information for childhood socioeconomic status: Results from a pilot study of decedents. Ann Epidemiol. 2008, 18: 357-63. 10.1016/j.annepidem.2008.01.002.
Berney LR, Blane DB: Collecting retrospective data: Accuracy of recall after 50 years judged against historical records. Soc Sci Med. 1997, 45: 1519-25. 10.1016/S0277-9536(97)00088-9.
Batty GD, Lawlor DA, Macintyre S, Clark H, Leon DA: Accuracy of adults' recall of childhood social class: findings from the Aberdeen children of the 1950s study. J Epidemiol Community Health. 2005, 59: 898-903. 10.1136/jech.2004.030932.
Kreiger N, Okamoto A, Selby JV: Adult female twins' recall of childhood social class and father's education: A validation study for public health research. Am J Epidemiol. 1998, 147: 704-8.
Institute for Social Research, University of Michigan: Health and Retirement Study. 2010, [http://hrsonline.isr.umich.edu/index/php]
Institute for Social, Research. University of Michigan: Panel Study of Income Dynamics. 2010, [http://psidonline.isr.umich.edu]
Brim OG, Baltes PB, Bumpass LL, et al: National Survey of Midlife Development in the United States (MIDUS), 1995-1996 [Computer file]. ICPSR02760-v6. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor]. 2010
U.S. Bureau of the Census: 1960 Census of Population. Classified Index of Occupations and Industries. 1960, Washington, D.C, [http://www2.census.gov/prod2/decennial/documents/00723909.pdf]
Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.
Kuh DJL, Cooper C: Physical activity at 36 years: patterns and childhood predictors in a longitudinal study. J Epidemiol Community Health. 1992, 46: 114-119. 10.1136/jech.46.2.114.
Kaplan GA, Turrell G, Lynch JW, Everson SA, Helkala E-L, Salonen JT: Childhood socioeconomic position and cognitive function in adulthood. Int J Epidemiol. 2001, 30: 256-263. 10.1093/ije/30.2.256.
Kohler IV, Soldo BJ: Childhood predictors of late-life diabetes: the case of Mexico. Soc Biol. 2005, 52: 112-131.
Bound J, Brown C, Mathiowetz N: Measurement error in survey data. Handbook of Econometrics. Edited by: Heckman JJ, Leamer EE. 2001, Amsterdam: Elsevier, 5:
Moody-Ayers S, Lindquist K, Sen S, Covinsky KE: Childhood social and economic well-being and health in older age. Am J Epidemiol. 2007, 166: 1059-1067. 10.1093/aje/kwm185.
Luo Y, Waite LJ: The impact of childhood and adult SES on physical, mental, and cognitive well-being in later life. J Gerontol B Psychol Soc Sci. 2005, 60: S93-S101.
Haas S: Trajectories of functional health: the 'long arm' of childhood health and socioeconomic factors. Soc Sci Med. 2008, 66: 849-861. 10.1016/j.socscimed.2007.11.004.
Coughlin SS: Recall bias in epidemiologic studies. J Clin Epidemiol. 1990, 43: 87-91. 10.1016/0895-4356(90)90060-3.
Groves RM: Survey errors and survey costs. 1989, New York: John Wiley and Sons, Inc
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/11/147/prepub
This work was supported by the Intramural Research Program, National Institute of Arthritis and Musculoskeletal and Skin Diseases, National Institutes of Health.
The author declares that he has no competing interests.
MMW conceived the study, identified the data source, designed and executed the analysis, and wrote the manuscript.
About this article
Cite this article
Ward, M.M. Concordance of sibling's recall of measures of childhood socioeconomic position. BMC Med Res Methodol 11, 147 (2011). https://doi.org/10.1186/1471-2288-11-147
- Occupational groups
- Childhood socioeconomic position