Multiple dimensions of health locus of control in a representative population sample: ordinal factor analysis and cross-validation of an existing three and a new four factor model
- Christiane Otto^{1}Email author,
- Gallus Bischof†^{2},
- Hans-Jürgen Rumpf†^{2},
- Christian Meyer†^{3},
- Ulfert Hapke†^{4} and
- Ulrich John†^{3}
DOI: 10.1186/1471-2288-11-114
© Otto et al; licensee BioMed Central Ltd. 2011
Received: 1 March 2011
Accepted: 12 August 2011
Published: 12 August 2011
Abstract
Background
Based on the general approach of locus of control, health locus of control (HLOC) concerns control-beliefs due to illness, sickness and health. HLOC research results provide an improved understanding of health related behaviour and patients' compliance in medical care. HLOC research distinguishes between beliefs due to Internality, Externality powerful Others (POs) and Externality Chance. However, evidences for differentiating the POs dimension were found. Previous factor analyses used selected and predominantly clinical samples, while non-clinical studies are rare. The present study is the first analysis of the HLOC structure based on a large representative general population sample providing important information for non-clinical research and public health care.
Methods
The standardised German questionnaire which assesses HLOC was used in a representative adult general population sample for a region in Northern Germany (N = 4,075). Data analyses used ordinal factor analyses in LISREL and Mplus. Alternative theory-driven models with one to four latent variables were compared using confirmatory factor analysis. Fit indices, chi-square difference tests, residuals and factor loadings were considered for model comparison. Exploratory factor analysis was used for further model development. Results were cross-validated splitting the total sample randomly and using the cross-validation index.
Results
A model with four latent variables (Internality, Formal Help, Informal Help and Chance) best represented the HLOC construct (three-dimensional model: normed chi-square = 9.55; RMSEA = 0.066; CFI = 0.931; SRMR = 0.075; four-dimensional model: normed chi-square = 8.65; RMSEA = 0.062; CFI = 0.940; SRMR = 0.071; chi-square difference test: p < 0.001). After excluding one item, the superiority of the four- over the three-dimensional HLOC construct became very obvious (three-dimensional model: normed chi-square = 7.74; RMSEA = 0.059; CFI = 0.950; SRMR = 0.079; four-dimensional model: normed chi-square = 5.75; RMSEA = 0.049; CFI = 0.965; SRMR = 0.065; chi-square difference test: p < 0.001). Results were confirmed by cross-validation. Results based on our large community sample indicated that western general populations separate health-related control-beliefs concerning formal and informal assistance.
Conclusions
Future non-clinical HLOC studies in western cultures should consider four dimensions of HLOC: Internality, Formal Help, Informal Help and Chance. However, the standardised German instrument needs modification. Therefore, confirmation of our results may be useful. Future research should compare HLOC structure between clinical and non-clinical samples as well as cross-culturally.
Background
Health locus of control (HLOC) is a psychological concept concerning control beliefs in relation to illness, sickness and health. This concept is based on the general approach of locus of control (LOC) developed within the social learning theory by Rotter [1, 2]. General LOC is of fundamental importance in psychology, relevant in established approaches concerning depression [3, 4] and helplessness [5]. Moreover it is closely connected to the concept of self-efficacy [6]. Due to the assumption that general control beliefs could differ from control beliefs concerning health, the specific construct of HLOC was developed and received increased attention in health research over the last 30 years [7, 8]. HLOC research results have been important in understanding health related behaviours, outcomes and care [7]. One main interest of this field of research concerns the compliance of patients in medical care in order to understand patients' adherence to recommended treatments including medication and health related behaviour [9].
In line with the general construct of LOC, HLOC research assumed a three-dimensional construct with control beliefs concerning Internality, Externality powerful Others (POs) and Externality Chance (Chance) [7, 8]. HLOC research revealed that patterns of HLOC scores differ for patients with specific diseases [10–12]; furthermore, higher scores on Externality scales seemed to be associated with less education [e.g.[13, 14]]. The Multidimensional Health Locus of Control scales (MHLC) [15], parallel Forms A (MHLC-A) and B (MHLC-B), were primarily used in order to assess the three HLOC dimensions [8]. MHLC-A and -B were equivalent, developers reported corresponding correlations for the scales of both forms (for Internality scales r = 0.801, for POs Scales r = 0.761 and for Chance scales r = 0.734) [15].
The MHLC scales were applied to different languages [e.g.[16, 17]] and cross-cultural differences in HLOC were investigated. A study which compared Asian women to British Caucasian women found higher scores for the Asian women on both Externality scales in line with the study's expectations [18]. These results show the Asian cultures stronger beliefs in communal values such as the importance of assisting others as well as the belief in fate as compared to more individualistic western cultures. Surprisingly, the Asian women also revealed stronger Internality compared to western women. This difference was the result of a stronger religiosity of the Asian women indicating culturally different interpretations of the MHLC items: Asian women with a strong belief in 'Allah' had simultaneously strong beliefs in their own actions assuming to help themselves by trusting in 'Allah'. However, the authors argued that the structure of HLOC has not been investigated by factor analysis in a corresponding sample, i.e. the HLOC construct may differ structurally over cultures [18].
In western cultures, several factor analyses using mostly selected clinical samples confirmed the three-dimensional structure [e.g.[19–21]]; however, a number of studies failed [e.g.[22, 23]]. Another western study analysed a mixed clinical sample (N = 588) and detected a four-dimensional HLOC structure developing and validating Form C of the MHLC (MHLC-C) for condition-specific measuring [24]. The authors confirmed original scales Internality and Chance, but had to differentiate POs scale into one scale concerning doctors and the other concerning family and friends. A latter clinical study examined the Italian version of the MHLC-C in a sample of HIV+ patients (N = 478) via methods based on structural equation modeling (SEM) and showed the superiority of the four- over the three-dimensional construct [25]. However, the four-dimensional construct is not implemented in HLOC research and has not been investigated in a non-clinical sample by now.
To our knowledge, the HLOC construct has never been factor analysed utilising a representative general population sample throughout 30 years of research. Diseases and clinical symptoms concerning a great variety of conditions are given in the general population, but the majority should be healthy. An investigation of the HLOC structure in a western general population sample could provide important results for future research and help to predict and understand the compliance of individuals concerning public health care. In addition, such a study could offer an orientation for non-clinical research. Previous factor analyses using non-clinical samples investigated selected student populations [26–28], the staff of a psychiatric hospital [29] and employees of a university voluntarily participating in a health promotion program [30]. However, a study investigating the general population is lacking.
The aim of the present study was to compare the three- and the four-dimensional construct of HLOC on grounds of a large general population sample representative for a region in Northern Germany by means of ordinal factor analyses based on SEM. We expected to find superiority of the four-dimensional construct and we aimed to confirm our results by cross-validation. Concerning the realisation of our analyses and their presentation we followed guidelines of statistical researchers [31–33]. Our analyses aimed to follow a confirmatory approach comparing theory based models which represented HLOC constructs of differing dimensionality.
Methods
Data were derived from the project "Transitions in Alcohol Consumption and Smoking" (TACOS). Detailed information about TACOS have already been published [34].
Sample
A representative sample of the general population of the northern German city of Lübeck and surrounding communities representing the catchment area was used. Individuals aged between 18 and 64 years with residence in the study area were included in the study. To avoid bias due to language problems, German nationality was defined as an additional inclusion criterion. Participants were randomly selected from the registration office files of all 47 communities representing the study area. The response rate was 70.2% and the final sample consisted of 4,075 individuals.
The study followed the ethical principles of the American Psychological Association [35]. Individuals gave written informed consent and were informed that they were free to participate and could withdraw from the study at any time. At the time of data assessment (June 1996 to March 1997), it was not mandatory at the University of Lübeck to consult the ethical committee. However, our proceeding was in line with the Helsinki Declaration [36].
Assessment
The German modification of the MHLC, i.e. the questionnaire to survey control beliefs concerning disease and health was used (KKG) [37]. The KKG was the recommended instrument to be used in German speaking samples to assess HLOC [38]. Two alternative German instruments were available, but the questionnaire named "health related control beliefs" was a short-form offering only a total of nine items (GKÜ) [39], while the questionnaire to assess health related control beliefs assumed a bipolar construct of HLOC (Externality versus Internality; FEGK) [40]. However, the KKG assumed the original three HLOC dimensions Internality, POs and Chance with seven items per scale.
The KKG is theoretically in line with the MHLC-A and -B [38]. Additionally, both instruments, MHLC-A/-B as well as the KKG, were developed based on non-clinical data [15, 37, 41]. MHLC-A and -B could be used for respondents of at least 16 years of age, while the KKG was also appropriate for younger individuals (≥ 12 years of age). Furthermore, KKG items were phrased focussing on 'sickness' (literally translated: 'physical complaints'), while MHLC-A/-B developers used words like 'health' and 'illness'. Developers of MHLC-A/-B recruited respondents at an airport (age ≥ 16 years; n = 115) offering a pool of 81 items. Items for the MHLC-A/-B were selected respecting several item criteria (i.e. mean close to the midpoint of the answering scale, wide distribution of responses, significant correlation to a priori scale, low correlation to measure of social desirability and wording). Items for the KKG were selected out of a pool of 35 items based on principal components analysis (PCA) with respect to corrected item scale correlations and retest reliabilities (n = 122; pupils ≥ 12 years of age and students). The three-dimensional structure of the KKG has been confirmed by another PCA based on a second non-clinical sample (n = 366; pupils ≥ 12 years of age and adults) [37, 41]. Further studies confirmed the validity of the KKG due to associations to external variables [42–44] and a number of studies have been published using this questionnaire [e.g. [45–47]].
KKG^{1} items translated into English and checked by back-translation
Items | item wordings |
---|---|
01 | When I feel bad physically then this is my own fault. |
02 | When I have a medical condition, I usually go to the doctor. |
03 | Whether or not my sickness continues depends on Chance. |
04 | When I feel well physically I owe this to all the advice and help of others. |
05 | When I get sick then I didn't take sufficient care of myself. |
06 | When I have a sickness I seek out the advice of others. |
07 | Bodily sickness cannot be influenced: When I am unlucky it appears suddenly. |
08 | When I take care of myself I have no sickness. |
09 | When destiny wants it I experience bodily pain. |
10 | When I am sick I ask an expert to help me. |
11 ^{ 2 } | It can be influenced whether or not I feel well. |
12 | When I don't have a good doctor I more often suffer from sickness. |
13 | Whether or not sickness disappears depends on whether or not I'm lucky. |
14 | I can avoid sickness when I take the advice of others. |
15 | I owe it to my Fate when my sickness disappears. |
16 | When I know enough about myself I can help myself when I am sick. |
17 | When I am sick I know that I can help myself. |
18 | It is up to me whether my sickness abates. |
19 | I believe that Luck and Chance play a big role in my physical health. |
20 | When I feel bad others know better than me how I feel. |
21 | It's up to me to protect myself from sickness. |
Data analyses
Software
Interactive LISREL 8.80 [50] was used for SEM based analyses. Additionally, SPSS 14.0 [51] served for calculation of Spearman correlations between item 11 and original HLOC scales. Furthermore, Mplus 5.21 [52] was exclusively used to calculate specific chi-square difference tests not offered by LISREL.
Preliminary analyses and data generation
The total sample was randomly split, subsample A served for model development (i.e. initial model comparison and further model development) and subsample B for validation. To present our ordinal raw data we calculated univariate frequency distributions of KKG items based on subsample A. Data were treated as ordinal calculating polychoric correlation and asymptotic covariance matrices and using robust diagonal weighted least squares (robust DWLS) estimation method [32, 53]. The use of polychoric correlations required underlying bivariate normality for each pair of items [32]. With respect to the rephrasing of item 11, scale allocation of this item had to be determined calculating Spearman correlations to original HLOC scales by SPSS.
Initial model comparison
A sequence of theory-driven nested models was specified starting with a very parsimonious model [33]. HLOC dimensions are represented by latent variables in the models with variances fixed to one as recommended [32, 33]. Each item (i.e. indicator) was allocated to one and only one latent variable within each specified model. Model 1 had one general latent variable, while Model 2 included two latent variables corresponding to dimensions Internality and Externality (i.e. original dimensions POs and Chance combined) [54]. Model 3 represented the original construct with dimensions Internality, POs and Chance [8, 15]. Finally, Model 4 represented the four-dimensional construct differentiating original POs dimension into Formal Help and Informal Help. We assumed correlated, but independent latent variables within our models corresponding to former research and with respect to varying correlations among HLOC scales reported in different studies [e.g. [15, 29]]. In line with this proceeding, statistical researchers have recommended allowing correlations among latent variables in SEM based confirmatory factor analyses due to methodological differences compared to exploratory methods [55].
Models were tested by confirmatory factor analysis (CFA). Satorra Bentler scaled chi-square (SB-scaled chi-square) [56] correcting for non-normality was used for our ordinal data [32]. In order to respect the complexity of our models, we calculated the normed chi-square index by dividing the SB-scaled chi-square value for each model by its degrees of freedom [57, 58]. According to known biases of chi-square statistics depending on sample size, that also affect the normed chi-square index, descriptive fit indices were considered [e.g.[59]]. The frequently used root mean square error of approximation (RMSEA) [60] accompanied by its associated 90% confidence interval (CI) and a p-value due to a close fit test (i.e. RMSEA < 0.05) were calculated. Additionally, the standardised root mean square residual (SRMR) [61] and the incremental comparative fit index (CFI) [62] were chosen. Selected indices are robust towards sample size effects [e.g.[59]]. SRMR and CFI are additionally recommended for analyses using asymptotic distribution free estimation methods as used in the present analyses [63].
For inferential model comparison chi-square difference tests are highly appreciated [59]. Note that the use of chi-square difference tests is more appropriate than the use of chi-square tests [33]. However, no Monte Carlo studies were found indicating which specific difference test would be appropriate to use in ordinal data specific analyses in LISREL. There may be a need for further developments in statistical research and theory concerning this question. In the present analyses, these tests were calculated with the alternative software Mplus using the weighted least squares means and variance adjusted estimation method (WLSMV) [64]. Robust DWLS offered by LISREL and WLSMV offered by Mplus are very similar; both procedures respect ordinal data by investigating polychoric correlations and asymptotic covariances using weighted least squares estimation methods. Concerning results of chi-square difference tests, we only interpreted resulting p-values as recommended [65]. For additional model comparison residuals and factor loadings were respected [e.g.[66]].
Further model development
Based on the recommendations of statisticians, we aimed to decide about the number of factors using SEM based CFA in our analysis of a construct that provided a solid theoretical basis [67]. However, CFA results and residual analyses indicated some problems concerning the performance of specific KKG items. Therefore, exploratory factor analysis (EFA) was used to evaluate the performances of KKG items in solutions corresponding to our CFA models. LISREL offers MINRES and ULS exploratory factor analyses both useable for ordinal data. Results of both methods are very similar [68]. With respect to our ordinal data, polychoric correlation matrices were analysed by MINRES [69] and factor loadings gained by promax rotation were considered in order to assume consistently correlated but independent factors in our study. MINRES provides factor loadings for unrotated, varimax- rotated and promax rotated solutions, while rotated solutions are transformations of the unrotated solution [68]. Additionally, minimum fit function chi-square (CMin) was calculated. Furthermore, a reference variable solution using instrumental variable methods offered t-values for factor loadings [68].
Model validation
The model specific two-sample cross-validation index (CVI) [70, 71] was used. CVI served to cross-validate our results of model comparison. Model comparison and further model development were conducted based on subsample A, results were cross-validated respecting subsamples A and B. The CVI indicated the discrepancy between the model-implied data matrix of the calibration sample (i.e. subsample A) and the empirical data matrix of the validation sample (i.e. subsample B). Due to fact that the two-sample CVI respected both data sets this index directly indicated which model cross-validated best [70, 71]. Therefore, the CVI served to check for "capitalisation on chance" [70, 71]. That is, fluctuations caused by random may appear in subsample A, while in subsample B different chance fluctuations were likely even though both samples were from the same population.
This index had to be used within a sequence of nested models respecting the so-called saturated model. The saturated model was an abstract model that fit the data perfectly, i.e. model implied and empirical data matrices were identical indicated by a chi-square of 0.0 [33]. In the present study, ordinal data specific CVI was calculated [72].
Results
Preliminary item analyses and data generation
Univariate frequency distributions of health locus of control items in subsample A
Items | Strongly disagree (1) | 2 | 3 | 4 | strongly agree (5) | missing answers | ||
---|---|---|---|---|---|---|---|---|
01 | 487 | 354 | 614 | 362 | 213 | 7 | ||
02 | 270 | 404 | 487 | 371 | 498 | 7 | ||
03 | 1079 | 343 | 378 | 124 | 97 | 16 | ||
04 | 989 | 439 | 358 | 143 | 101 | 7 | ||
05 | 459 | 412 | 586 | 358 | 209 | 13 | ||
06 | 457 | 416 | 555 | 398 | 200 | 11 | ||
07 | 549 | 389 | 451 | 310 | 327 | 11 | ||
08 | 395 | 379 | 671 | 380 | 203 | 9 | ||
09 | 922 | 293 | 427 | 202 | 181 | 12 | ||
10 | 140 | 241 | 489 | 542 | 619 | 6 | ||
11 | 288 | 209 | 573 | 544 | 417 | 6 | ||
12 | 987 | 345 | 383 | 142 | 173 | 7 | ||
13 | 1122 | 370 | 332 | 118 | 85 | 10 | ||
14 | 566 | 342 | 599 | 360 | 162 | 8 | ||
15 | 1086 | 345 | 342 | 119 | 137 | 8 | ||
16 | 167 | 195 | 635 | 624 | 404 | 12 | ||
17 | 199 | 293 | 761 | 490 | 284 | 10 | ||
18 | 282 | 382 | 757 | 401 | 202 | 13 | ||
19 | 729 | 419 | 453 | 243 | 183 | 10 | ||
20 | 1167 | 415 | 282 | 100 | 66 | 7 | ||
21 | 162 | 209 | 657 | 543 | 459 | 7 |
Listwise deletion was used due to a small number of cases with missing values (n = 69; 3.39%). Spearman correlation of item 11 to corrected original Chance scale was very low (r = 0.115; p < 0.001), while a remarkable correlation to original Internality scale occurred (r = 0.398; p < 0.001). Therefore, item 11 was allocated to dimension Internality in the following analyses. The condition of bivariate normality was not fulfilled for item pair 16 and 17 (specific RMSEA = 0.114; p = 0.01). An item sequence effect could only be considered for the latter item; thus item 17 was excluded. Subsequently, data matrices were calculated. Polychoric correlations of subsample A are presented in an additional file, we added polychoric correlations of subsample B into this file (see Additional file 1: Polychoric correlations of health locus of control items using subsamples A and B).
Initial model comparison
Fit values of analysed models representing constructs of health locus of control
Model 1^{1} | Model 2^{2} | Model 3^{3} | Model 4^{4} | |
---|---|---|---|---|
SB-scaled chi-square ^{ 5 } | 6,399 | 3,154 | 1,595 | 1,419 |
p-value | < 0.001 | < 0.001 | < 0.001 | < 0.001 |
Degrees of freedom | 170 | 169 | 167 | 164 |
Normed chi-square ^{ 6 } | 37.64 | 18.66 | 9.55 | 8.65 |
RMSEA ^{ 7 } | 0.136 | 0.095 | 0.066 | 0.062 |
Confidence interval (90%) | 0.134-0.139 | 0.092-0.098 | 0.063-0.069 | 0.059-0.065 |
p-value (RMSEA < 0.05) | < 0.001 | < 0.001 | < 0.001 | < 0.001 |
CFI ^{ 8 } | 0.701 | 0.857 | 0.931 | 0.940 |
SRMR ^{ 9 } | 0.137 | 0.096 | 0.075 | 0.071 |
In the present analyses descriptive fit indices consistently indicated poor fits for Models 1 and 2 (see Table 3). Concerning Models 3 and 4, RMSEAs and SRMRs indicated adequate fits, while normed chi-squares and CFIs were inadequate in both cases.
Concerning Models 1 to 3, all indices indicated obvious and consistent improvements in fit. Correspondingly, chi-square difference tests revealed significant differences between Models 1 and 2 as well as between Models 2 and 3 (p < 0.001 for both comparisons). For Models 3 and 4, differences in indices were smaller. Normed chi-squares, RMSEAs, CFIs and SRMRs indicated improvement in fit, but CIs of RMSEAs for both models overlapped. However, the point estimate of the RMSEA for each model was lying outside the CI of the corresponding other model and chi-square difference test indicated a significant difference between both models favouring Model 4 (p < 0.001).
However, this evaluation of model fit was based on "rules of thumb". These guidelines should not be overgeneralised; instead, fit indices should be used to identify differences in model specifications conducting a comparison of nested models as realised in the present study [76]. In order to analyse our best performing nested models more detailed residuals and factor loadings were investigated.
Standardised factor loadings resulting from confirmatory factor analyses
Internality | POs^{1} | Chance^{2} | Internality | Formal Help | Informal Help | Chance | |
---|---|---|---|---|---|---|---|
Model 3 | Model 4 | ||||||
Item 01 | 0.543 | 0.548 | |||||
Item 05 | 0.652 | 0.654 | |||||
Item 08 | 0.584 | 0.585 | |||||
Item 11 | 0.496 | 0.493 | |||||
Item 16 | 0.561 | 0.562 | |||||
Item 18 | 0.685 | 0.682 | |||||
Item 21 | 0.597 | 0.595 | |||||
Item 02 | 0.360 | 0.655 | |||||
Item 04 | 0.659 | 0.662 | |||||
Item 06 | 0.622 | 0.631 | |||||
Item 10 | 0.317 | 0.564 | |||||
Item 12 | 0.498 | 0.619 | |||||
Item 14 | 0.645 | 0.659 | |||||
Item 20 | 0.675 | 0.674 | |||||
Item 03 | 0.586 | 0.586 | |||||
Item 07 | 0.468 | 0.467 | |||||
Item 09 | 0.699 | 0.698 | |||||
Item 13 | 0.833 | 0.833 | |||||
Item 15 | 0.822 | 0.823 | |||||
Item 19 | 0.675 | 0.676 |
On the other hand, Model 4 revealed satisfactory factor loadings for all indicators and no outlying large residual. However, no outlying but large negative residuals occurred in this model concerning item 12 (ε_{0212} = -8.7; ε_{1012} = -8.1). This item referred to unpleasant states due to the absence of a good physician, whereas remaining POs items corresponded to the assistance of others (see Table 1). KKG developers had already reported inadequate values for this item within their three factorial solution (loading = 0.30; correlation to remaining POs scale = 0.19) [37, 41].
Further model development
The three-factorial EFA solution provided a normed CMin of 15.74 (CMin = 2094; df = 133), the corresponding value for the four-factorial solution was at 9.99 (CMin = 1159; df = 116) indicating a better fit of the four-factorial solution. Scale scores were means over the items of each scale [37, 41] ranging from 1 to 5 for each scale (Internality: mean = 3.10; standard deviation (SD) = 0.79; POs: mean = 2.57; SD = 0.73; Chance: mean = 2.18; SD = 0.87; Formal Help: mean = 2.97; SD = 0.94; Informal Help: mean = 2.27; SD = 0.86).
Standardised factor loadings resulting from exploratory factor analyses
Factor 1 | factor 2 | factor 3 | Factor 1 | factor 2 | factor 3 | factor 4 | |
---|---|---|---|---|---|---|---|
Three-factorial solution | Four-factorial solution | ||||||
Item 01 | 0.520 | 0.028 | -0.006 | 0.455 | 0.145 | -0.117 | -0.048 |
Item 05 | 0.572 | 0.067 | 0.029 | 0.508 | 0.182 | -0.090 | -0.015 |
Item 08 | 0.553 | 0.062 | -0.024 | 0.497 | 0.155 | -0.081 | -0.059 |
Item 11 | 0.493 | 0.074 | -0.071 | 0.507 | 0.018 | 0.048 | -0.044 |
Item 16 | 0.575 | -0.049 | 0.068 | 0.638 | -0.147 | 0.072 | 0.127 |
Item 18 | 0.690 | -0.065 | 0.104 | 0.712 | -0.078 | 0.001 | 0.129 |
Item 21 | 0.647 | 0.025 | -0.122 | 0.707 | -0.097 | 0.117 | -0.062 |
Item 02 | -0.198 | 0.595 | -0.133 | -0.103 | 0.254 | 0.623 | -0.061 |
Item 04 | 0.056 | 0.553 | 0.140 | -0.074 | 0.738 | -0.035 | 0.013 |
Item 06 | 0.087 | 0.696 | -0.053 | 0.043 | 0.620 | 0.173 | -0.083 |
Item 10 | -0.097 | 0.486 | -0.143 | 0.095 | -0.013 | 0.840 | 0.003 |
Item 12 | -0.044 | 0.323 | 0.267 | -0.033 | 0.264 | 0.157 | 0.259 |
Item 14 | 0.239 | 0.545 | 0.039 | 0.197 | 0.516 | 0.103 | 0.004 |
Item 20 | 0.025 | 0.439 | 0.302 | -0.074 | 0.592 | -0.040 | 0.198 |
Item 03 | 0.022 | 0.035 | 0.564 | -0.058 | 0.262 | -0.206 | 0.471 |
Item 07 | -0.128 | -0.025 | 0.490 | -0.044 | -0.137 | 0.149 | 0.543 |
Item 09 | -0.081 | 0.037 | 0.674 | -0.013 | -0.037 | 0.116 | 0.707 |
Item 13 | 0.043 | 0.042 | 0.797 | 0.022 | 0.170 | -0.084 | 0.737 |
Item 15 | -0.015 | -0.019 | 0.837 | 0.021 | 0.009 | 0.007 | 0.830 |
Item 19 | 0.093 | -0.110 | 0.724 | 0.119 | -0.050 | -0.051 | 0.710 |
As we excluded item 12 and recalculated EFAs, loadings of remaining items stayed satisfactory with highest loadings equal to or above 0.45 on factors indicated by theory in both solutions. The normed CMin was at 17.09 for the three-factorial solution (CMin = 1999; df = 117) and at 10.72 for the four-factorial solution (CMin = 1083; df = 101) indicating that the four-factorial solution revealed a better fit. Ranges of scores for POs scale, Formal Help and Informal Help scales remained stable (POs without item 12: mean = 2.65; SD = 0.76; Formal Help without item 12: mean = 3.41; SD = 1.12). Further EFAs forcing up to nine factors revealed no other solution which was theoretically acceptable and therefore worth further examinations.
Three- and four-dimensional CFA models without item 12 were specified (i.e. Models 3a and 4a). Model 3a revealed an adequate fit due to the RMSEA, CFI and SRMR, but the normed chi-square was not adequate (SB-scaled chi-square = 1,154; df = 149; normed chi-square = 7.74; RMSEA = 0.059; CI(90%) = 0.055-0.062; p_{(RMSEA < 0.05)} < 0.001; CFI = 0.950; SRMR = 0.079). The fit of Model 4a was also adequate, but closer due to normed chi-square, RMSEA, CFI and SRMR (SB-scaled chi-square = 840; df = 146; normed chi-square = 5.75; RMSEA = 0.049; CI(90%) = 0.046-0.052; p_{(RMSEA < 0.05)} = 0.670; CFI = 0.965; SRMR = 0.065). However, normed chi-square was better, but still not fully satisfactory. Chi-square difference test indicated a significant difference in favour of Model 4a (p < 0.001). Furthermore, Model 4a had the most satisfactory residual pattern of any model within this analysis [66].
The latent variable Formal Help of Model 4a explained only two indicators. Therefore, assessment of this dimension was rather unstable. However, methodologists suggested a number of two indicators per latent variable would be appropriate in CFAs based on sample sizes of more than 400 cases [[59]; based on [78, 79]]. "There seems to be a mutual compensatory effect of sample size and number of indicators per factor: More indicators may compensate for small sample size, and a larger sample size may compensate for few indicators." [59, page 50, lines 27 to 30].
Model validation
Results of cross-validation for two sequences of nested models
1^{ st } sequence | Model 1^{1} | Model 2^{2} | Model 3^{3} | Model 4^{4} | Saturated Model^{5} |
---|---|---|---|---|---|
CVI ^{ 6 } | 3.99 | 2.53 | 1.65 | 1.46 | 0.45 |
2^{ nd } sequence | Model 3a ^{ 7 } | Model 4a ^{ 8 } | Saturated Model a ^{ 9 } | ||
CVI | 1.48 | 1.11 | 0.41 |
Discussion
The aim of this study was to analyse the factor structure of HLOC based on the German modification of the MHLC with up-to-date methods in a representative large western general population sample. The model which represented the four-dimensional HLOC construct performed best within our study based on results of initial CFAs. This model was superior to the model which represented the original three-dimensional HLOC construct according to fit indices, chi-square difference tests, residuals and factor loadings. After exclusion of one item due to residual analyses and EFA results, the difference between the models became more obvious. Results of model comparison were confirmed by cross-validation.
Our analyses followed recommendations of statistical researchers [67]. The authors of the aforementioned study advised using SEM based CFA in order to decide about the number of factors of a construct that provides a solid theory. However, the decision to exclude item 12 was based on exploratory methods in the present study. Therefore, CFA and cross-validation were used to confirm these findings.
The present study used the German modification of the MHLC. Even though MHLC-A/-B and the KKG differ in some aspects (i.e. six versus seven items per original scale, suitable minimum age of respondents and phrasing of the items), both instruments focus on the same construct of HLOC [15, 37, 38, 41]. However, our analyses of a large general population sample pointed out weaknesses of the standardised German instrument. We could avoid double negotiation effects by rephrasing item 11 and we had to exclude item 17 due to an item sequence effect caused by repetitive items 16 and 17. Additionally, our study indicated that a rephrasing of item 12 may be needed. On the other hand, we found superiority for the four- over the three-dimensional models with and without item 12 indicated by chi-square difference tests. Methodologists recommended the use of chi-square difference tests for alternative model comparisons and pointed out shortcomings of alternative strategies [59, 80]. Concerning the KKG, we assumed that previous studies had not reported as much critique due to the fact that they analysed selected and smaller samples, did not investigate the KKG as detailed, and/or did not differ between Formal Help and Informal Help [e.g.[41, 42, 45, 46]]. However, after excluding item 12, the latent variable Formal Help in our study suffered from instability due to the fact that this dimension was assessed by only two items which were very similar. Even though this proceeding was acceptable due to the methods we used [59], Formal Help dimension needs a broader assessment.
HLOC research has already pointed out the superiority of the four-dimensional construct in clinical samples [24, 25]. However, our analysis is the first to compare the three- and four-dimensional HLOC constructs in a representative general population sample of a western culture. Furthermore, previous factor analyses of clinical data focused on the condition-specific construct of HLOC due to the MHLC-C, while we examined the general construct of HLOC. Our results are in line with findings of previous studies investigating the three-dimensional construct. A very early study had already postulated an empirical distinctiveness of professional and non-professional help due to an inadequate performance of item 7 of the MHLC-A in their clinical sample [81]. This item is the only item of this form referring directly to the family. Besides other clinical studies [e.g.[8, 22]], non-clinical studies had also reported inadequate values for this item [28, 30]. However, results of factor analyses are generally sample specific. In the present study, the representativeness and size of our sample lowered the risk of sample selection bias. Additionally, cross-validation was conducted. We recommend assuming four HLOC dimensions in future non-clinical research in western cultures.
Conclusions
Our study found evidence indicating that future non-clinical HLOC research in western populations should consider four dimensions of HLOC, i.e. Internality, Formal Help, Informal Help and Chance in order to investigate these beliefs appropriately. Otherwise important information may be missed. Health behaviour and most importantly the compliance of individuals concerning public health care (e.g. in medical care or in health promotion programs) may be better and more appropriately predicted by health related control beliefs concerning medical professionals than by attributions concerning the family and friends, or a mixture of both. However, the standardised German questionnaire to assess HLOC needs modification. Therefore, future research should confirm our findings providing a more stable and broader assessment of the four HLOC dimensions.
Future HLOC research should compare the HLOC structure in clinical and non-clinical samples to analyse and understand this construct in more detail. Only two corresponding multi-group analyses have been published, but both studies assumed the three-dimensional construct and compared individuals suffering from diabetes to healthy controls [54, 82]. One study detected differences concerning the interpretation of Internality items between patients with diabetes and healthy controls [54], while the other study found no differences focussing on elderly respondents [82]. Multi-group analyses respecting further diseases are needed. Multi-group analyses could also provide interesting information concerning measurement invariances of the HLOC construct over cultures. Such analyses could investigate the equivalence of the number of factors, factor loadings and factor correlations over samples and may reveal important findings.
Authors' information
PD Dr. phil. H-JR and Dr. phil. GB focus on research concerning early interventions for substance use disorders as scientists at the University of Lübeck, Germany. Prof. Dr. UJ and PD Dr. phil. CM concentrate on research of prevention and epidemiology as scientist at the University of Greifswald, Germany. Dr. UH is psychologist at the Robert-Koch-Institute in Berlin, Germany. Postgraduate psychologist CO is working as a scientist at the University of Göttingen, Germany. The actual paper presents main results of her PhD thesis.
Notes
Declarations
Acknowledgements and Funding
This study is part of the German research network EARLINT (EARLy INTervention). The study TACOS was funded by the German Federal Ministry of Education and Research (grant no. 01 EB 9406). The authors wish to thank Jan Felix Kersten, Biometrical Centre of the University Clinic of Hamburg-Eppendorf, for his assistance in calculating necessary parameters in Mplus. Additionally, the authors are very grateful for the English editing of the manuscript by Dr. phil. Ryan David Mullins, Medical Psychology & Sociology, University of Göttingen.
Authors’ Affiliations
References
- Rotter JB: Social learning theory and clinical psychology. 1954, New York: Prentice HallView Article
- Rotter JB: The development and application of social learning theory. Selected papers. 1982, New York: Praeger
- Beck AT: Depression: Clinical, experimental and theoretical aspects. 1967, New York: Harper & Row
- Beck AT: Cognitive models of depression. Journal of Cognitive Psychotherapy. 1987, 1: 5-37.
- Seligman MEP: Helplessness. 1975, San Francisco: Freeman
- Bandura A: Self-efficacy: Toward an underlying theory of behavioral change. Psychol Rev. 1977, 84: 191-215.View ArticlePubMed
- Luszcynska A, Schwarzer R, Wallston KA: Multidimensional health locus of control: Comments on the construct and its measurement. J Health Psychol. 2005, 10: 633-642. 10.1177/1359105305055307.View Article
- Kelly PA, Kallen MA, Suarez-Almazor ME: A combined-method psychometric analysis recommended modification of the multidimensional health locus of control scales. J Clin Epidemiol. 2007, 60: 440-447. 10.1016/j.jclinepi.2006.08.005.View ArticlePubMed
- Furnham A, Steele H: Measuring locus of control: a critique of general, children's, health- and work-related locus of control questionnaires. Br J Psychol. 1993, 84: 443-479. 10.1111/j.2044-8295.1993.tb02495.x.View ArticlePubMed
- Barlow JH, Macey SJ, Strutherrs GR: Health locus of control, self-help and treatment adherence in relation to ankylosing spondylitis patients. Patient Educ Counseling. 1993, 20: 153-166. 10.1016/0738-3991(93)90129-K.View Article
- Wallston BS, Wallston KA: Health locus of control scales. Research with the Locus of Control Construct, Volume I: Assessment methods. Edited by: Lefcourt HF. 1981, New York: Academic Press, 189-244.View Article
- Wallston KA, Wallston BS: Who is responsible for your health? The construct of health locus of control. Social psychology of health and illness. Edited by: Sanders GS, Suls J. 1982, Hillsdale NJ: Erlbaum, 65-95.
- Duetz MS, Abel T, Niemann S: Health measures: differentiating associations with gender and socio-economic status. Eur J Public Health. 2003, 13: 313-319. 10.1093/eurpub/13.4.313.View ArticlePubMed
- Wardle J, Steptoe A: Socioeconomic differences in attitudes and beliefs about healthy lifestyles. J Epidemiol Community Health. 2003, 57: 440-443. 10.1136/jech.57.6.440.PubMed CentralView ArticlePubMed
- Wallston BD, Wallston KA, De Vellis R: Development of the Multidimensional Health Locus of Control (MHLC) scales. Health Educ Monographs. 1978, 6: 160-170.View Article
- Kuwahara A, Nishino Y, Ohkubo T, Tsuji I, Hisamichi S, Hosokawa T: Reliability and validity of the Multidimensional Health Locus of Control Scale in Japan: relationship with demographic factors and health-related behavior. Tohoku J Exp Med. 2004, 203: 37-45. 10.1620/tjem.203.37.View ArticlePubMed
- Astrom AN, Blay D: Multidimensional health locus of control scales: applicability among Ghanaian adolescents. East Afr Med J. 2002, 79: 128-133.View ArticlePubMed
- Wrightson KJ, Wardle J: Cultural Variation in Health locus of control. Ethn Health. 1997, 2: 13-20. 10.1080/13557858.1997.9961811.View ArticlePubMed
- Buckelew SP, Shutty MS, Hewett J, Landon T, Morrow K, Frank RG: Health locus of control, gender differences and adjustment to persistent pain. Pain. 1990, 42: 287-294. 10.1016/0304-3959(90)91141-5.View ArticlePubMed
- Russell SF, Ludenia K: The psychometric properties of the Multidimensional Health Locus of Control Scales in an alcoholic population. J Clin Psychol. 1983, 39: 453-459. 10.1002/1097-4679(198305)39:3<453::AID-JCLP2270390323>3.0.CO;2-E.View ArticlePubMed
- Gehlert S, Chang C: Factor structure and dimensionality of the multidimensional health locus of control scales in measuring adults with epilepsy. Journal of Outcome Measurement. 1998, 2: 173-190.PubMed
- Coelho RJ: A psychometric investigation of the Multidimensional Health Locus of Control Scales with cigarette smokers. J Clin Psychol. 1985, 41: 372-376. 10.1002/1097-4679(198505)41:3<372::AID-JCLP2270410310>3.0.CO;2-Z.View ArticlePubMed
- Umlauf RL, Frank RG: Multidimensional health locus of control in a rehabilitation setting. J Clin Psychol. 1986, 42: 126-128. 10.1002/1097-4679(198601)42:1<126::AID-JCLP2270420120>3.0.CO;2-5.View ArticlePubMed
- Wallston KA, Stein MJ, Smith CA: Form C of the MHLC scales: a condition-specific measure of locus of control. J Pers Assess. 1994, 63: 534-553. 10.1207/s15327752jpa6303_10.View ArticlePubMed
- Ubbiali A, Donati D, Chiorri C, Bregani V, Cattaneo E, Maffei C, Visintinia R: The usefulness of the Multidimensional Health Locus of Control Form C (MHLC-C) for HIV+ subjects: an Italian study. AIDS Care. 2008, 20: 495-502. 10.1080/09540120701867115.View ArticlePubMed
- Winefield HR: Reliability and validity of the health locus of control scale. J Pers Assess. 1982, 46: 614-619. 10.1207/s15327752jpa4606_10.View ArticlePubMed
- O'Looney BA, Barrett PT: A psychometric investigation of the Multi-dimensional Health Locus of Control Questionnaire. Br J Clin Psychol. 1983, 22: 217-218. 10.1111/j.2044-8260.1983.tb00604.x.View ArticlePubMed
- Malcarne VL, Fernandez S, Flores L: Factorial validity of the multidimensional health locus of control scales for three American ethnic groups. J Health Psychol. 2005, 10: 657-667. 10.1177/1359105305055311.View ArticlePubMed
- Cooper D, Fraboni M: Toward a more valid and reliable Health Locus of Control scale. J Clin Psychol. 1988, 44: 536-540. 10.1002/1097-4679(198807)44:4<536::AID-JCLP2270440409>3.0.CO;2-3.View ArticlePubMed
- Casey TA, Kingery PM, Bowden RG, Corbett BS: An investigation of the factor structure of the Multidimensional Health Locus of Control scales in a health promotion program. Educ Psychol Meas. 1993, 53: 491-498. 10.1177/0013164493053002018.View Article
- Aish A-M, Jöreskog KG: A panel model for political efficacy and responsiveness: an application of LISREL 7 with weighted least squares. Quality & Quantity. 1990, 24: 405-426. 10.1007/BF00152013. [http://www.springerlink.com/content/l3x37548m7851640/]View Article
- Jöreskog KG: Structural Equation Modeling with Ordinal Variables using LISREL. 2005, [http://www.ssicentral.com/lisrel/techdocs/ordinal.pdf]
- Schumacker RE, Lomax RG: A beginner's guide to structural equation modeling. 2004, New Jersey: erlbaum, 2
- Meyer C, Rumpf H-J, Hapke U, John U: Prevalence of DSM-IV Psychiatric Disorders Including Nicotine Dependence in the General Population: Results from the Northern German TACOS study. Neurol Psychiat BR. 2001, 9: 75-80.
- American Psychological Association: Ethical principles of psychologists and code of conduct. American Psychologist. 1992, 47: 1597-1611.View Article
- World Medical Association: Declaration of Helsinki: Ethical Principles for Medical Research involving Human Subjects. 2008, [http://www.wma.net/en/30publications/10policies/b3/]
- Lohaus A, Schmitt GM: Fragebogen zu Kontrollüberzeugungen zu Krankheit und Gesundheit (KKG) - Fragebogen und Manual [Questionnaire to assess control beliefs concerning health and illness - questionnaire and manual]. 1989, Göttingen: Hogrefe
- Brähler E, Holling H, Leutner D, Petermann F: Brickenkamp Handbuch psychologischer und pädagogischer Tests [Reference book of psychological and pedagogical tests]. 2002, Göttingen: Hogrefe, 749-750. 3
- Hasenbring M: Zur Adaptivität von Kontrollüberzeugungen - Empirische Befunde bei Patienten mit Krebserkrankungen, lumbalem Bandscheibenvorfall und chronischen Schmerzsyndromen [Adaptivity of locus of control beliefs - empirical findings for patients with cancer, lumbar herniated disc and syndroms of chronic pain]. Sich gesund fühlen im Jahr 2000 [Feeling healthy in the year 2000]. Edited by: Schnüffel TW. 1988, Berlin: Springer
- Fehring D, Filipp SH: Fragebogen zur Erfassung gesundheitsbezogener Kontrollüberzeugungen (FEGK), Kurzbericht [Questionnaire to assess health related control beliefs, short report]. Zeitschrift für Klinische Psychologie. 1989, 18: 285-289.
- Lohaus A, Schmitt GM: Kontrollüberzeugungen zu Krankheit und Gesundheit (KKG): Bericht über die Entwicklung eines Testverfahrens [Questionnaire to assess control beliefs concerning health and illness: Report about the development of the questionnaire]. Diagnostica. 1989, 35: 59-72.
- Schmitt GM, Lohaus A, Salewski C: Kontrollüberzeugungen und Patienten-Compliance: Eine empirische Untersuchung am Beispiel von Jugendlichen mit Diabetes mellitus, Asthma bronchiale und Alopecia areata [Locus of Control beliefs and patients' compliance: An empirical investigation using the example of adolescents with diabetes mellitus, bronchial asthma and alopecia areata]. Psychotherapie, Psychosomatik, Medizinische Psychologie. 1989, 39: 33-40.PubMed
- Wiedebusch S, Volle B, Lohaus A, Schmitt GM: Kontrollüberzeugungen bei Erkrankungen des rheumatischen Formenkreises: Bezüge zu Art, Dauer und Schweregrad der Erkrankung [Locus of Control beliefs in patients suffering from rheumatic diseases: associations to kind, duration and severity of the disease]. Verhaltensmedizin und Verhaltensmodifikation. 1990, 11: 117-135.
- Volle B, Wiedebusch S, Lohaus A: Psychologische Korrelate der Selbsthilfegruppenzugehörigkeit bei Erkrankungen des rheumatischen Formenkreises [Psychological correlates of members of self-help groups in patients with rheumatic diseases]. Psychotherapie, Psychosomatik, Medizinische Psychologie. 1990, 40: 230-237.PubMed
- Schäfer T, Riehle A, Wichmann HE, Ring J: Alternative medicine and allergies: life satisfaction, health locus of control and quality of life. J Psychosom Res. 2003, 55: 543-546. 10.1016/S0022-3999(03)00015-1.View ArticlePubMed
- Bock J, Escobar-Pinzon LC, Riemer D, Blanch J, Hautzinger M: EUROVIHTA-Projekt zielgruppenspezifisches Interventionsprogramm für Betroffene bei der Verarbeitung von HIV als chronische Erkrankung [EUROVIHTA Project-specific intervention program for HIV infected patients to support the coping process with this chronic illness]. Psychother Psych Med. 2003, 53: 310-318.View Article
- Schmid R, Neuner T, Cording C, Spiessl H: Lebensqualität schizophren Erkrankter und ihr Zusammenhang mit Krankheitsbewältigungsstrategien und Behandlungsaspekten [Schizophrenic patients' quality of life and associations with coping, locus of control, subjective well-being, satisfaction and patient-judged caregiver burden]. Psychiatr Prax. 2006, 33: 337-343. 10.1055/s-2006-940120.View ArticlePubMed
- Evans JS, Clibbens J, Rood B: Bias in conditional inference: implications for mental models and mental logic. Q J Exp Psychol-A. 1995, 48: 644-670.View ArticlePubMed
- Schaeken W, Schroyens W: The effect of explicit negatives and of different contrast classes on conditional syllogisms. Brit J Psychol. 2000, 91: 533-550. 10.1348/000712600161970.View ArticlePubMed
- Jöreskog KG, Sörbom D: Interactive LISREL. 2004, Lincolnwood: Scientific Software International (SSI)
- Bühl A: Statistical Package for the Social Sciences SPSS (version 14.0). 2006, Chicago: SPSS Incorporation
- Muthén LK, Muthén BO: Mplus (Version 5.21). 2007, Los Angeles, CA: Muthén & Muthén
- Jöreskog KG, Sörbom D, du Toit S, du Toit M: LISREL 8: new statistic features. 2000, Lincolnwood: Scientific Software International
- Talbot F, Nouwen A, Gauthier J: Is health locus of control a 3-factor or a 2-factor construct?. J Clin Psychol. 1996, 52: 559-568. 10.1002/(SICI)1097-4679(199609)52:5<559::AID-JCLP11>3.0.CO;2-D.View ArticlePubMed
- van Prooijen J-W, van der Kloot WA: Confirmatory Analysis of Exploratively Obtained Factor Structures. Educ Psychol Meas. 2001, 61: 777-792. 10.1177/00131640121971518.View Article
- Satorra A, Bentler PM: Corrections to test statistics and standard errors in covariance structure analysis. Latent variable analysis: Applications for development research. Edited by: von Eye A, Clogg CC. 1994, Thousand Oaks, CA: Sage, 399-419.
- Jöreskog KG: A general approach to confirmatory maximum likelihood factor analysis. Psychometrika. 1969, 34: 183-202. 10.1007/BF02289343.View Article
- Jöreskog KG, Sörbom D: LISREL 8: structural equation modeling with the SIMPLIS command language. 1993, Lincolnwood: Scientific Software International
- Schermelleh-Engel K, Moosbrugger H, Müller H: Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods Psychol Res Online. 2003, 8: 23-74.
- Steiger JH: Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research. 1990, 25: 173-180. 10.1207/s15327906mbr2502_4.View ArticlePubMed
- Bentler PM: EQS structural equations programm manual. 1995, Encino, CA: Multivariate Software, Inc
- Bentler PM: Comparative fit indexes in structural models. Psychol Bull. 1990, 107: 238-246.View ArticlePubMed
- Hu LT, Bentler PM: Fit Indices in Covariance Structure Modeling: Sensitivity to Underparameterized Model Misspecification. Psychol Methods. 1998, 3: 424-453.View Article
- Muthén B, du Toit S, Spisic D: Robust inference using weighted least squares and quadratic estimation equations in latent variables modeling with categorical and continuous outcomes. 1997, [http://www.statmodel.com/wlscv.shtml]
- Muthén LK, Muthén BO: Mplus: Statistical analyses with latent variables. User's guide. 2007, Los Angeles, CA: Muthén & Muthén
- Diamantopoulos A, Siguaw JA: Introducing Lisrel: a guide for the uninitiated. 2000, London: Sage
- Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ: Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999, 4: 272-299.View Article
- Jöreskog KG: Factor analysis by MINRES. 2003, [http://www.ssicentral.com/lisrel/techdocs/minres.pdf]
- Jöreskog KG: New developments in LISREL: analysis of ordinal variables using polychoric correlations and weighted least squares. Quality & Quantity. 1990, 24: 387-404. 10.1007/BF00152012.View Article
- Browne MW: Cross-Validation Methods. J Math Psychol. 2000, 44: 108-132. 10.1006/jmps.1999.1279.View ArticlePubMed
- Cudeck R, Browne MW: Cross-Validation of covariance structure models. Multivar Behav Res. 1983, 18: 147-157. 10.1207/s15327906mbr1802_2.View Article
- du Toit M, du Toit S: Interactive LISREL: User's guide. 2001, Lincolnwood: Scientific Software International (SSI)
- Browne M, Cudeck R: Alternative ways of assessing model fit. Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park: Sage Publications, 136-162.
- Hu L, Bentler PM: Evaluating model fit. Structural equation modeling. Concepts, issues, and applications. Edited by: Hoyle RE. 1995, London: Sage, 76-99.
- Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999, 6: 1-55.View Article
- Marsh HW, Hau K-T, Wen Z: In Search of Golden rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings. Structural Equation Modeling. 2004, 11: 320-341. 10.1207/s15328007sem1103_2.View Article
- Costello AB, Osborne JW: Best Practices in exploratory Factor Analysis: Four Recommendations for Getting the Most from Your Analysis. Practical Assess Res Eval. 2005, 10: 1-9.
- Marsh HW, Hau K-T: (1999). Confirmatory factor analysis: Strategies for small sample sizes. Statistical strategies for small sample size. Edited by: Hoyle RH. 1999, Thousand Oaks, CA: Sage, 251-306.
- Boomsma A, Hoogland JJ: (2001). The robustness of LISREL modeling revisited. Structural equation models: Present and future. A Festschrift in honor of Karl Jöreskog. Edited by: Cudeck R, du Toit S, Sörbom D. 2001, Chicago: Scientific Software International, 139-168.
- Marsh HW, Hau K-T: Assessing goodness of fit: Is parsimony always desirable?. J Exp Educ. 1996, 64: 364-390.View Article
- Marshall GN, Collins BE, Crooks VC: A comparison of two multidimensional health locus of control instruments. J Pers Assess. 1990, 54: 181-190. 10.1207/s15327752jpa5401&2_18.View ArticlePubMed
- Robinson-Whelen S, Storandt M: Factorial structure of two health belief measures among older adults. Psychol Aging. 1992, 7: 209-213.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/11/114/prepub
Pre-publication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.