- Research article
- Open Access
Norm values and psychometric properties for the German health regulatory focus scale – results of a representative survey
BMC Medical Research Methodology volume 20, Article number: 51 (2020)
The health regulatory focus is an application of Higgins’ regulatory focus theory to a health-specific context. It explains individual differences in health motivation, strategies, and behavior. Previous research found the Health Regulatory Focus Scale (HRFS) to be a reliable and valid measure for the construct. However, an evaluation of the HRFS in a representative sample has not been performed as of yet. Neither are there any normative values available.
We collected a representative sample from the German general population to perform a confirmatory factor analysis, an analysis of measurement invariance, and to calculate norm values.
A two-factor model evinced good model fit with a good reliability for the two subscales. We found evidence for strict invariance across gender groups and partial strict invariance across age groups. In addition, we are presenting normative values for the general population.
The findings of the present study are in line with previous research in confirming the HRFS as a valid and reliable tool suitable for the assessment of the health regulatory focus. The reported normative values allow for comparisons of individuals with their respective sociodemographic group.
The World Health Organization (WHO) defines health as “complete physical, mental, and social well-being and not merely the absence of disease or infirmity” [1; p. 1]. Hereby, the avoidance of risks as well as the effort toward general wellness is of importance. In order to ensure the efficacy of health interventions, the target population must be specified as accurately as possible  and the interventions modified to the specific needs  Therefore, individual differences concerning health behavior, needs, and strategies used to improve one’s health need to be taken into account.
To allow for an efficient assessment of individual differences in health motivation and behavior, Gomez and colleagues  developed the Health Regulatory Focus Scale (HRFS) evaluating the health-specific regulatory focus. The questionnaire assesses health promotion as well as health prevention. It is based on the regulatory focus theory which deals with gain- and loss-orientation in a general context  and has been adapted from general constructs to fit into the health context . Based on previous research [6, 7], health promotion items focus on seeking and seizing opportunities to improve one’s health while health prevention items capture the attempts to avert dangers to one’s health.
Correlations between health prevention focus and health promotion focus vary between r = 0.16 and r = 0.57 . In terms of convergent and discriminant validity, health promotion focus shows moderate correlations with optimism, positive self-evaluations, and approach motivation [8,9,10]. In contrast, health prevention focus is associated with neuroticism, negative self-evaluations, motivational inhibition, and impaired mental health [8, 11]. Finally, health promotion predicts health outcomes positively, while health prevention is associated negatively [12, 13].
For the German HRFS, reliability and item characteristics were found to be satisfactory . Based on confirmatory factor analysis (CFA), a two-factor solution fits best for the HRFS. However, measurement invariance for gender and age was unclear due to Heywood cases. Furthermore, the sample was collected online and made up mainly of young female participants. Thus, it cannot be considered representative of the general population. Euhus et al.  addressed these concerns to some extent, but did not analyze a representative sample either.
In order to use and interpret individual results of the HRFS, normative values of a representative sample of the general population must be available. Therefore, the purpose of the present study is twofold. First, the aim is to build upon Schmalbach and colleagues  and find additional evidence for the psychometric qualities of the HRFS. Second, we seek to establish norm values for the HRFS to allow for the evaluation of individuals based on representative data from the German population.
The full study sample consisted of 2510 participants. Of those, 2469 responded to all HRFS items and 40 responded to at least one of the items so that we were able to use their data in the factor analysis (see analysis section for more details). For descriptive statistics, comparisons, and norm values, only participants with complete data were included. Figure 1 illustrates the sample flow. A detailed sample description is reported in the Results section.
Gomez and colleagues  developed the HRFS to measure the promotion and prevention focus in health-specific contexts. Schmalbach and colleagues  translated the scale using a back-translation process and adapted it based on psychometric considerations. The German version has five items measuring the health promotion focus and two items for the health prevention focus. Response options are presented on a 7-point-scale ranging from (1) “strongly disagree” to (7) “strongly agree”. Taking the average of the items in question yields the respective scale scores for health promotion and health prevention. Apart from the HRFS, the participants gave their sociodemographic information.
In addition, we applied the Patient Health Questionnaire-4 (PHQ-4 ) to further test convergent validity. It is a screening instrument for anxiety and depression. As such it is one of the most widely-applied tools for the assessment of mental health. Respondents rate the frequency of symptoms of depression and anxiety they have experienced using two items each on a four-point scale ranging from “Not at all” to “Nearly every day”. Two subscale scores and a total score are calculated by adding up the item scores, ωAnxiety = .798 [.780; .817], ωDepression = .807 [.801; .824], ωTotal = .879 [.865; .892].
A representative sample of the general population of Germany was collected in 2016 by a demography consulting company (USUMA, Berlin). Per random-route procedure, households in all regions of Germany (based on electoral districts) were selected. Among the 4838 selected addresses, 2324 households (48%) could not be interviewed (e.g., illness, on holiday, refusal, unavailability) and 4 interviews (0.1%) were not analyzable (see Fig. 1). Within each household, the interviewee was selected based on the Kish selection grid. A trained professional then conducted the interviews with the consenting participants (oral consent in accordance with German law). The resulting sample was representative for the German community regarding age, gender, and education, as evidenced by comparisons with the Federal Statistical Office .
We conducted the statistical analysis using R and the packages lavaan and semTools [16, 17]. To enable the inclusion of participants with partially missing data and in order to address the slightly skewed and kurtotic distribution of some items, we used the robust full-information maximum likelihood estimation method with Yuan-Bentler’s scaled χ2 [18,19,20,21]. To evaluate goodness-of-fit, we utilized popular fit indices with commonly recommended cut-off criteria for good fit [22,23,24]: The χ2-test which should ideally not be significant; χ2 divided by degrees of freedom (CMIN/DF), which should be smaller than 3; the Comparative Fit Index (CFI), and the Tucker-Lewis Index (TLI), which should be larger than .95, the Root Mean Square Error of Approximation (RMSEA) and its 90% confidence interval, and the Standardized Root Means Square Residual (SRMR), which should be smaller than .08.
We tested measurement invariance across age and gender using the procedure recommended by previous research [25, 26]: We compared increasingly constrained models in a stepwise fashion to establish increasingly strict levels of invariance. Firstly, we tested metric (or weak) invariance by comparing the unconstrained model with a model that constrains factor loadings to be equal across groups. Secondly, we tested scalar (or strong) invariance by comparing the metric model to one that additionally constrains item intercepts to be equal. Finally, we tested strict invariance by comparing the scalar model to a model that also constrains residuals to be equal across tested groups. As recommended by Milfont and Fischer , we evaluated model comparisons using the χ2-test as well as differences in CFI and gamma hat (GH ;). χ2 should ideally not be significant, and ΔCFI and ΔGH should not be larger than .01 between models. As per recommendations by Trizano-Hermosilla and Alvarado , we report McDonald’s ω  as a measure of internal consistency.
We report a detailed description of the sample in Table 1. Participants were on average 48.36 years old (SD = 18.22). The mean monthly net household income was 2592.86 euros (SD = 1485.10 euros). It correlated very weakly with health promotion, r(2,362) = .026, p = .206, and health prevention focus, r(2,362) = −.078, p < .001. The sample can be considered as representative of the German population.
The Shapiro-Wilk test for normal distribution was highly significant, p < .001, for all items and both scales. Considering our sample size, however, this is not surprising. Instead, Kim  recommends the analysis of skewness and kurtosis of the distributions. Absolute values for skewness should be smaller than 2 and excessive kurtosis smaller than 4, which was the case with our items and scales. Reliability for the promotion scale is ω = .916 [910, 923] while the prevention scale had a reliability of ω = .813 [.805; .821]. Further statistics are reported in Table 2.
Overall, the model fits reasonably well, χ2(13) = 229.53, p < .001, χ2/df = 17.66, CFI = .968, RMSEA = .081 [.074; .089], TLI = .949, SRMR = .022, confirming the findings by Schmalbach and colleagues . Specifically, the χ2-test and χ2 divided by degrees of freedom indicate bad fit, which is not surprising given χ2’s sensitivity to sample size . The fit indices, on the other hand, reveal an acceptable model fit. CFI and SRMR present evidence for good fit, whereas RMSEA and TLI are barely acceptable.
We found clear evidence for strict invariance across gender groups, as evidenced by small differences in CFI and GH (see Table 3). The χ2-test was significant in one of the three comparisons. For age groups, we found evidence for metric invariance. By freeing the intercepts of items 1, 2, and 4 to vary between groups, we were able to show partial strict invariance. In addition, we tested for invariance across education, family, and employment status, utilizing these subgroups (from Table 1) that had at least 200 observations. For education and family, the evidence suggest strict invariance, whereas for employment status there were some differences with regard to item intercepts. However, partial strict invariance could be established for this grouping variable. Overall, the HRFS appears to be highly invariant across sociodemographic variables – with some minor limitations with regard to age and employment.
Confirming previous findings , we found moderate positive associations between health prevention focus and impaired mental health, r(2467) = .264, p < .001. Expanding on this, anxiety and depression exhibited comparable correlations, r(2467) = .246, r(2467) = .250, both p < .001. In contrast – again in line with  -, there were near-zero correlations for health promotion focus, rAnxiety(2467) = .059, p = .003, rDepression(2467) = .018, p = .371, rPHQ-4(2467) = .041, p = .042.
Norm values are reported in Table 4. Since there are no meaningful differences between the middle-aged (40–59 years) and the older (≥60 years) group, we merged these groups. We report means and standard deviations of the HRFS as well as quantiles to allow for the classification of individual scores.
The goal of the present study was to replicate and extend the findings by Schmalbach and colleagues  by testing the proposed HRFS model in a large sample representative of the German general population. This aim was accomplished. We found acceptable fit for the model proposed by Schmalbach and colleagues. Interestingly, the association between mental health and the health prevention focus was significantly smaller in the present study compared to the study by Schmalbach and colleagues . This might be an effect of the skewed sample they used – over-representing young individuals. It is an indication that the correlation between the health regulatory focus and related constructs may differ across age.
The novel contribution of the present study lies in the analysis of measurement invariance, which previously had been lacking. Namely, we found the HRFS to be strictly invariant across gender, education, and family status, as well as partially strictly invariant across age groups and employment status. Additionally, we report norm values for age and gender groups (see Table 4). The findings of the present study allow researchers to apply the HRFS in a wider variety of research designs. Measurement invariance is an important prerequisite for comparisons between groups. Moreover, normative values will allow for the assessment of an individual’s health regulatory focus, which will be useful for designing health-focused interventions.
The HRFS is, as of now, the only reliable and valid tool available to German researchers for the assessment of the health regulatory focus. Ferrer, Lipkus, Cerully, McBride, Shepperd, and Klein  developed and tested an alternative version of an HRFS. However, they could not confirm their model in CFA.
Applications of the HRFS to address innovative research questions are still outstanding. As a reviewer pointed out, future research should look into how chronic diseases, migration status or cultural background impact health regulatory focus. These are important and innovative questions but were beyond the scope of the present article. Some research has already tackled similar issues [33, 34], but the health-specific HRFS will allow for large-scale surveys to answer these questions on a population level.
The German HRFS was evaluated as a reliable and valid measure of the health regulatory focus. We have extended the findings by Schmalbach and colleagues  by adding an unambiguous analysis of measurement invariance and normative values. Thus, we can reiterate the original recommendation for the HRFS as a tool for psychological research into health behavior and motivation.
Availability of data and materials
The dataset used and analyzed in the current study is available from the corresponding author on reasonable request.
Confirmatory Factor Analysis
Comparative Fit Index
Minimum discrepancy divided by degrees of freedom
Health Regulatory Focus Scale
Patient Health Questionnaire
Root Mean Square Error of Approximation
Standardized Root Mean Square Residual
Unabhängiger Service für Umfragen, Methoden und Analysen [Independent Service for Surveys, Methods, and Analyses]
World Health Organization. Constitution of the World Health Organization. New York: World Health Organization; 2006. Retrieved from http://www.who.int/governance/eb/who_constitution_en.pdf.
Thacker SB, Stroup DF, Carande-Kulis V, Marks JS, Roy K, Gerberding JL. Measuring the public's health. Public Health Rep. 2006. https://doi.org/10.1177/003335490612100107.
Peeling RW, Smith PG, Bossuyt PMM. A guide for diagnostic evaluations. Nat Rev Microbiol. 2010. https://doi.org/10.1038/nrmicro1568.
Gomez P, Borges A, Pechmann C. Avoiding poor health or approaching good health: does it matter? The conceptualization, measurement, and consequences of health regulatory focus. J Consum Psychol. 2013. https://doi.org/10.1016/j.jcps.2013.02.001.
Higgins ET. Beyond pleasure and pain. Am Psychol. 1997. https://doi.org/10.1037/0003-066X.52.12.1280.
Avnet T, Higgins ET. How regulatory fit affects value in consumer choices and opinions. J Mark Res. 2006. https://doi.org/10.1509/jmkr.43.1.1.
Pham MT, Higgins ET. Promotion and prevention in consumer decision making state of the art and theoretical propositions. In: Ratneshwar SM, Mick DG, editors. Inside consumption: frontiers of research on consumer motives, goals, and desires. London: Routledge; 2005. p. 8–43.
Schmalbach B, Spina R, Steffens-Guerra I, Franke GH, Kliem S, Michaelides MP, Hinz A, Zenger M. Psychometric properties of the German version of the health regulatory focus scale. Front Psychol. 2017;8:2005.
Euhus A, Schmalbach B, Morfeld M, Berth H, Brähler E, Stobel-Richter Y, Zenger M. Psychometric evaluation of the German version of the health regulatory focus scale [Psychometrische Uberprufung der deutschen version der health regulatory focus scale]. Z Psychosom Med Psychother. 2018;64:394–411.
Grant H, Higgins ET. Optimism, promotion pride, and prevention pride as predictors of quality of life. Personal Soc Psychol Bull. 2003. https://doi.org/10.1177/0146167203256919.
Otonari J, Nagano J, Morita M, Budhathoki S, Tashiro N, Toyomura K, et al. Neuroticism and extraversion personality traits, health behaviours, and subjective well-being: the Fukuoka study (Japan). Q Life Res. 2012. https://doi.org/10.1007/s11136-011-0098-y.
Elliot AJ, Sheldon KM. Avoidance personal goals and the personality–illness relationship. J Pers Soc Psychol. 1998. https://doi.org/10.1037/0022-35220.127.116.112.
Jung M, Ramanadhan S, Viswanath K. Effect of information seeking and avoidance behavior on self-rated health status among cancer survivors. Patient Educ Couns. 2013. https://doi.org/10.1016/j.pec.2013.02.008.
Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122:86–95.
Federal Statistical Office of Germany. Bevölkerung [population]; 2016. Retrieved from https://www.destatis.de/DE/ZahlenFakten/GesellschaftStaat/Bevoelkerung/Bevoelkerung.html.
Rosseel Y. Lavaan: an R package for structural equation modeling. J Stat Softw. 2012;48:1–36 URL http://www.jstatsoft.org/v48/i02/.
semTools Contributors. semTools: useful tools for structural equation modeling. 2016. R package version 0.4–14. Retrieved from https://CRAN.R-project.org/package=semTools.
Enders CK. A primer on maximum likelihood algorithms available for use with missing data. Struct Equ Model. 2001;8:128–41.
Finney SJ, DiStefano C. Non-normal and categorical data in structural equation modeling. In: Hancock GR, Mueller RO, editors. Structural equation modeling: a second course. 2nd ed. Charlotte: Information Age Publishing; 2013. p. 439–793.
Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods. 2002;7:147–77.
Yuan KH, Bentler PM. Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociol Methodol. 2000;30:165–200.
Hu LT, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3:424–53.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6:1–55.
Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online. 2003;8:23–74.
Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9:233–55.
Milfont TL, Fischer R. Testing measurement invariance across groups: applications in crosscultural research. Int J Psychol Res. 2010;3:111–21.
Steiger JH. EzPATH: a supplementary module for SYSTAT and SYGRAPH. Evanston: Systat; 1989.
Trizano-Hermosilla I, Alvarado JM. Best alternatives to Cronbach’s alpha reliability in realistic conditions: congeneric and asymmetrical measurements. Front Psychol. 2016. https://doi.org/10.3389/fpsyg.2016.00769.
McDonald R. Test theory: a unified treatment. Mahwah: Lawrence Erlbaum Associates; 1999.
Kim HY. Statistical notes for clinical researchers: assessing normal distribution (2) using skewness and kurtosis. Restor Dent Endod. 2013;38:52–4.
Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88:588–606.
Ferrer RA, Lipkus IM, Cerully JL, McBride CM, Shepperd JA, Klein WM. Developing a scale to assess health regulatory focus. Soc Sci Med. 2017;195:50–60.
Ludolph R, Schulz PJ. Does regulatory fit lead to more effective health communication? A systematic review. Soc Sci Med. 2015;128:142–50.
Uskul AK, Sherman DK, Fitzgibbon J. The cultural congruency effect: culture, regulatory focus, and the effectiveness of gain-vs. loss-framed health messages. J Exp Soc Psychol. 2009;45:535–41.
The authors received no funding for the reported research.
Ethics approval and consent to participate
The present study was conducted in accordance with the Declaration of Helsinki. The study was approved by the ethics committee of the University of Leipzig (ref. 297/16-ek). Participants gave their written and verbal informed consent before they were allowed to participate in the study. Participants under the age of 18 were not recruited.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Schmalbach, B., Zenger, M., Brähler, E. et al. Norm values and psychometric properties for the German health regulatory focus scale – results of a representative survey. BMC Med Res Methodol 20, 51 (2020). https://doi.org/10.1186/s12874-020-00927-x
- Regulatory focus
- Short scale
- Psychometric properties
- Norm values