Skip to main content

Psychometric properties and population norms of the positive mental health instrument in a representative multi-ethnic Asian population

Abstract

Background

Measures of mental well-being and positive mental health (PMH) have been largely developed and used in Western populations, however, data on representative Asian communities are lacking. Using data from a population sample, this study sought to establish psychometric properties and norms of the PMH Instrument (PMH-I), a measure of positive mental health developed in Singapore.

Methods

We conducted a nationally representative survey among 1925 adults aged 18–79 years of Chinese, Malay, Indian or other ethnicity. Participants reported socio-demographic characteristics and completed the PMH-I along with measures of health-related quality of life (HRQoL) and psychological distress. Construct validity of the PMH-I was assessed using confirmatory factor analysis and concurrent validity was tested through correlation with other psychological measures. Normative PMH values and differences in population subgroups were estimated.

Results

The six-factor-higher-order structure of the PMH-I comprising six subscales of general coping, emotional support, spirituality, interpersonal skills, personal growth and autonomy and global affect was confirmed. Concurrent validity was shown through significant positive correlation of the total PMH score and its subscales with HRQoL and an inverse correlation with psychological distress. Weighted age, gender and ethnicity-specific norms were derived for the Singapore population. Total PMH was significantly higher in participants aged over 40 years as compared with 18–29 year olds and in non-Chinese ethnic groups as compared with Chinese. These differences were observed for all PMH-I subscales, with the exception of emotional support and interpersonal skills score differences by age. In contrast, gender, marital status, and education level were significantly associated with some of the subscales, but not with total PMH.

Conclusions

These results support the psychometric properties of the PMH-I in a multi-ethnic Asian population sample. The generalizable population-based norms support the application of the PMH-I for measuring mental health and assessing its determinants within the Singapore general population.

Peer Review reports

Background

Mental health is inherent to all individuals and is globally accepted as a determinant of overall health, well-being, and resilience [1]. There is also a broad consensus on mental health being ‘more than just absence of mental illness’ [1]. Several conceptual theories exist that propose a framework for multiple distinct but related aspects of mental health [2, 3]. Two prominent approaches that have shaped the expansion of this field are a focus on hedonic or subjective well-being and the other on eudemonic or psychological well-being [2, 4]. While the former relates to striving for positive experiences, the second emphasizes the role of psychological needs and self-actualization in well-being. The World Health Organization (WHO) operationalized a working definition for mental health as a ‘state of well-being’ in which individuals realise their own potential, are able to cope with stress, and contribute to the community [1]. This definition provided a composite of the two well-being approaches and has served as a broad theoretical opportunity to investigate mental health status of communities across the world.

Consequently, understanding how mental health influences long-term well-being and using these insights to develop interventions to prevent a decline in overall health has gained momentum as a focus area in public health research [1, 5,6,7,8]. Longitudinal studies have shown that high levels of psychological well-being serve as a protective factor against mental illnesses and psychopathology [9] and account for reduction in the risk of mood and anxiety disorders [10]. In addition, positive affect and emotional well-being may protect against disability in old age [11]. Mental well-being has also been associated with biological markers of physical health, better hormonal regulation, and a lower risk for chronic diseases and mortality [12, 13]. This growing evidence on mental well-being as a determinant of better psychological and physical health has further increased interest in interventions to improve mental well-being of individuals and populations as a whole [14]. Such initiatives require valid, reliable and generalizable estimates of mental health that go beyond the mere absence or presence of psychological distress and help in tracking population mental health status [15, 16].

Measuring mental health and well-being in individuals provides unique information on emotional and social well-being of a person, which is not provided by using psychiatric assessments alone. However, with the lack of a single universally accepted definition of mental well-being [3], a number of scales, including the Satisfaction With Life Scale [17], Psychological Well-being Scale [18], Affectometer [19], Short Form (SF)-36 [15], WHO-Five Well-being Scale [15], and the Warwick Edinburgh Mental Well-being Scale (WEMWBS) [20] have been used to assess different components of mental well-being.

More recently, the Positive Mental Health Instrument (PMH-I) and the Positive Mental Health Questionnaire (PMHQ) were developed in multi-ethnic Asian and European populations, respectively [21, 22]. There are several similarities between these two measures. Both measures were developed using mixed methods [21, 23] and present a multi-dimensional structure of PMH comprising six factors relating to hedonic and eudemonic constructs of mental well-being [3]. While the PMH-I has 47 items belonging to the domains of general coping, emotional support, spirituality, interpersonal skills, personal growth and autonomy, and global affect, the PMHQ has 39 items representing personal satisfaction, prosocial attitude, self-control, autonomy, problem-solving and self-actualization, and interpersonal relationship skills. The differences lie in their conceptual and psychometric approach and the characteristics of the populations used for the development and validation of these measures. The PMHQ was based on the Multifactor Model of positive mental health [22] that proposes ‘close inter-relationship between physical and mental health’ and the initial development of the tool was conducted in people with chronic physical health problems. Although it has since been validated in university professors and students in Europe [23, 24], to the best of our knowledge, it has not been validated among the general population or different ethnic groups.

The PMH-I was developed to assess the level of positive mental health in the multi-ethnic adult Asian population in Singapore using mixed methods guided by the theory of mental health being more than the absence of mental illness [1] and with an emphasis on only the positive aspects of mental well-being [21, 25]. Its structure and psychometric properties have been established in a general population sample and confirmed among service users with mental disorders [21, 26]. However, the previous studies were conducted in smaller samples, excluded participants who were not of Chinese, Malay and Indian ethnicity, and adopted convenience sampling to recruit participants, thereby limiting the representativeness of the findings. Because of the selective nature and size of the investigated samples, evidence supporting the structure and validity of the scale could not be generalized to the general population.

The present study therefore aimed to validate the PMH-I in a representative urban Asian population sample to establish its psychometric properties by analyzing dimensionality, reliability and concurrent validity of the PMH-I. We hypothesized that the PMH-I would fulfil the factor loading and fit requirements of a multi-dimensional six-factor-higher-order measure [21]. In addition, we expected that the PMH-I score would be positively associated with health related-quality of life (HRQoL) and inversely associated with psychological distress. The study also examined socio-demographic factors including age, gender, ethnicity, marital status and education level as determinants of PMH and its domains. In addition, the study aimed to generate normative values of the PMH-I to allow comparisons between different age, gender and ethnic groups in the population.

Methods

Ethics

Ethical approval was obtained from the National University of Singapore Institutional Review Board (NUS-IRB) prior to the start of the study (NUS IRB, reference 13–512). Written informed consent was obtained from all adult participants. For participants aged 18 to 20 years, written consent was also obtained from their parent or legal guardian. Strict confidentiality was maintained for participant’s identifiers and test results by applying de-identified collection of data, password protected data recording, and aggregate data analysis.

Study design

This study on the PMH-I used data collected in the Singapore Health (SH) - 2 study, which was a cross-sectional study conducted between April 2014 and March 2015 to assess mental and physical health and lifestyle behaviours in a nationally representative general population sample of Singapore residents aged between 18 and 79 years residing in the west, north, north-east and south-eastern central zones in Singapore. The SH-2 study collected comprehensive data from participants using self-report measures and a health screening.

Setting, sample selection and field work

The National Database on Dwellings sampling frame maintained by the Department of Statistics, Singapore had addresses of 32,100 households in 16 geographically clustered areas having at least one resident aged 15 to 79 years. The areas were clustered in the vicinity of four clinics in the survey zones that served as health screening sites for conducting laboratory investigations for the SH-2 study. A total of 15,000 household addresses were randomly selected from the sampling frame. A notification letter was sent to these addresses informing residents of the survey and the enumeration exercise that included a telephone number to contact the team for any queries. Trained enumerators then conducted the enumeration visit two weeks from the notification letter being sent out to identify all household members who met the inclusion criteria – being Singaporean or Permanent Resident, aged 18 to 79 years at the time of enumeration, residing at the address for at least four days each week and staying in the household for the next 3 months or longer. Household members who were bedridden or wheelchair bound, had severe mental retardation or mental illness, permanent disability, stroke or injury resulting in loss of speech, and pregnant women were excluded from the survey. For each household, one eligible resident was selected using Kish selection grid [27] and invited to participate in the study. A trained interviewer then contacted the selected household member to invite him/her to participate in the study. After obtaining written consent from the participant, interviewers completed the SH-2 survey questionnaire via face-to-face computer-assisted personal interviewing (CAPI).

Data quality control

Survey responses were checked for missing values, data type errors and range sensibility using CAPI embedded logic checks and prompts with built-in algorithms whereby participants had to answer each question before moving on to the next one. All interviews were audio-recorded for quality control purposes. About 20% of the surveys and interviewer-specific records were randomly selected for verification of the responses against the audio-recording of the interviews. Data errors, inconsistencies and outliers were clarified through direct verification with the participants whenever necessary. The PMH-I was self-administered by the participants using CAPI in the presence of an interviewer who assisted them if they encountered any difficulties in completing the instrument.

Survey questionnaire

A structured questionnaire was used in the survey to obtain information on the socio-demographic background, major non-communicable diseases and related risk factors, and general well-being of the participants. Survey questionnaires were pre-tested among local participants before initiating the survey. For the purpose of the current analysis, the following data and measures were used.

PMH-I [21]: The 47-item PMH-I includes six subscales: general coping (9 items), emotional support (7 items), spirituality (7 items), interpersonal skills (9 items), personal growth and autonomy (10 items), and global affect (5 items) (Additional file 1: Table S1). For the first five subscales, participants were asked to select a number showing how much the item describes them on a scale from 1 to 6, where ‘1’ represents ‘not at all like me’ and ‘6’ corresponds to ‘exactly like me’. The ‘Global affect’ subscale includes a list of five affect indicators and requires participants to indicate ‘how often over the past four weeks they felt – calm, peaceful, etc. using a 5-point response scale. The PMH-I comprises positively worded items, for example, ‘I try not to let it bother me’, ‘I try to get emotional support from family and friends’ and ‘I have confidence in the decisions I make’. Subscale and total PMH scores were obtained by adding scores of the respective items and dividing the scores by the number of items in each subscale, where higher scores indicate higher PMH. At the time of the survey, the PMH-I was available solely in English and was administered to only those participants who were literate in English.

European Quality of Life-5 Dimensions 5 levels (EQ-5D 5 L) [28]: The EQ-5D 5 L is a measure of HRQoL, developed by the EuroQol Group that measures five dimensions of health (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), within five levels — corresponding to ‘no problems”, ‘light problems,’ ‘moderate problems,’ ‘severe problems’ and ‘unable/extreme problems’ — giving a total of 3125 unique composite health states. Responses to these five dimensions were converted into one of 243 unique EQ-5D health state descriptions, which range between no problems on all five dimensions (11111) and disability/extreme problems on all five dimensions (55555). EQ-5D Index scores were derived using the time trade-off values for the UK general population. Index scores range from − 0.594 to 1.00, with negative values representing health states worse than being dead, 0 representing being dead and 1.00 representing the state of full health. The EQ-5D also has a visual analogue scale (VAS) which indicates self-rated health using a 20 cm vertical VAS with endpoints labelled ‘the best health you can imagine’ denoted by ‘100′ and ‘the worst health you can imagine’ (‘0′). Participants were instructed to write the number marked in the scale on a box to indicate their health on the day of the interview.

Kessler 6 Psychological Distress scale (K6) [29]: The K6 is a widely used measure of psychological distress that consists of six self-report questions about frequency of depressive and anxiety symptoms in the past 4 week period on a five-point rating scale from ‘none of the time’ to ‘all of the time’. A total score was obtained that ranged from 6 (indicating no distress) to 30 (indicating severe distress).

Socio-demographic information on age, gender, ethnicity, marital status and education level were also collected during the survey.

Response rate

A total of 2690 Singapore residents aged 18 to 79 years participated in SH-2, out of the 7743 eligible household members identified through the enumeration exercise, yielding a response rate of 35% for the SH-2, which is typical of door-to-door surveys in Singapore. Of the 2690 participants, 1925 participants who were literate in English and had completed the PMH-I, served as the study sample for this analysis.

Sample weights

Sample weights were calculated for the household enumeration exercise and survey. For the household enumeration exercise, sample weights (WEE) comprised weights for unequal probability of selection and non-response computed based on dwelling type (public or private housings) and region of dwelling (16 postal districts). For the study fieldwork, sample weights (WSF) comprised weights for unequal probability of selection and non-response computed based on age, gender and ethnicity (Chinese, Malay, Indian and other ethnicities) of the residents. Post-stratification weights (WPS) were computed based on the age, gender and ethnicity with reference to the Singapore resident population at June 2014. The overall sample weights were the product of WEE, WSF and WPS.

Statistical analysis

Statistical analyses were carried out using the SPSS and MPLUS software programs. The factor structure of the PMH-I was confirmed using confirmatory factor analysis (CFA). All items were treated as categorical variables. The CFA was conducted with MPLUS software using polychoric item correlations matrix with weighted least squares with mean-adjusted chi-square statistic (WLSM) estimator that provides estimates of item loadings and thresholds. Overall model fit was measured using a number of goodness-of-fit (GOF) statistics based on the following criteria: the comparative fit index (CFI), the Tucker-Lewis index (TLI), the root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR). Cut-off values suggested by Hu and Bentler were used: above 0.95 for TLI and CFI, below 0.05 for RMSEA and below 0.08 for SRMR [30]. Internal consistency reliability was estimated for each subscale with Cronbach’s alpha coefficient, with an acceptable level set at 0.7. Pearson correlation tests were used to establish the concurrent validity of the PMH-I and its subscales with other measures using known-group validity criteria based on previous studies [21, 27]– (i) Total PMH score will show significant low to moderate positive correlation with HRQoL (EQ-5D Index) and self-rated health (EQ-5D VAS), (ii) Total PMH score will show significant low to moderate negative correlation with psychological distress (K6 total score) and (iii) psychological distress will show strongest negative correlation with ‘Global affect’ domain. Floor and ceiling effects were calculated by identifying the proportion of participants that either had the lowest (1) or the highest (6) possible scores for the PMH total and subscale scores. Age, gender and ethnicity-specific norms were derived for the Singapore population and difference in their mean PMH total and subscale scores was identified through SPSS Complex Samples general linear regression models. Weighted main effects multivariable linear regression analysis was conducted after including age, gender, ethnicity, marital status and education level as covariates and total PMH and subscale scores as dependent variables to investigate the relation of the important population groups of interest with PMH. Two-sided statistical significance was set at p value of less than 0.05.

Results

The socio-demographic characteristics of the participants are presented in Table 1. The mean age of the participants was 40.1 years. The sample comprised 71.1% Chinese, 14.1% Malays, 11% Indians, and 3.9% other ethnicities. This is similar to the ethnic distribution in the Singapore population of 74.2% Chinese, 13.3% Malay, 9.2% Indian and 3.3% other ethnicities. The majority of the sample were married (59.1%) and employed (71.9%).

Table 1 Socio-demographic characteristics of the sample (N = 1925)

The CFA confirmed the six-factor-higher-order model of the PMH-I with fit indices fitting the thresholds (RMSEA = 0.047, CFI = 0.958, TLI = 0.95, SRMR = 0.043). The standardized loadings of the six-factors to the higher-order factor were high and ranged from 0.437 to 0.930. The factor loadings of the scale are illustrated in Fig. 1. The Cronbach’s alpha coefficient for the total PMH scale was 0.961. The alpha coefficients for general coping, emotional support, spirituality, interpersonal skills, personal growth and autonomy, and global affect subscales were 0.923, 0.898, 0.912, 0.958, 0.938, and 0.886, respectively. We also conducted a sensitivity analysis of the psychometric properties separately for the three major ethnic groups. Factor solutions fulfilled the set fit indices criteria [30] for these ethnicities (RMSEA, CFI, TLI: Chinese: 0.050, 0.955, 0.953; Malay: 0.045, 0.963, 0.961; Indian: 0.054, 0.941, 0.938, respectively; Additional file 1: Figure S1a-c).

Fig. 1
figure 1

Factor structure of PMH-I# in the Singapore general population

Table 2 shows the Pearson’s correlation coefficient between the PMH-I, its subscales and concurrent validity measures. PMH subscales showed significant moderate to high correlations with the total PMH score, with values ranging from 0.573 to 0.849 (p < 0.01). The total PMH and subscales (except for the Spirituality subscale) showed significant positive correlations with the EQ-5D Index for HRQoL (r ranged from 0.100 to 0.254) and self-rated health on the EQ-5D visual analogue scale (VAS; r ranged from 0.139 to 0.299) and negative correlations with the K6 scale of psychological distress (r ranged from − 0.180 to − 0.416). The global affect subscale showed highest correlations with EQ-5D Index, EQ-5D VAS and K6 scores.

Table 2 Pearson’s correlation coefficients of the PMH subscales and concurrent measures

Table 3 shows the floor and ceiling effects observed for the total PMH and subscales. Floor effect was extremely low for all domains except for spirituality while ceiling effect ranged from 9.5% to 15.3% across the PMH domains. Normative and percentile values for the PMH-I are presented in Tables 4 and 5, respectively. The mean (SD) total PMH score for the whole sample was 4.61 (0.8), while the score was 4.68 (0.9) for general coping, 4.87 (1.0) for emotional support, 3.73 (1.7) for spirituality, 4.86 (0.8) for interpersonal skills, 4.78 (0.9) for personal growth and autonomy, and 4.60 (0.9) for global affect (Table 4).

Table 3 Floor and ceiling effect for the PMH scales
Table 4 Population norms for the PMH-I and PMH levels by age, gender and ethnicity@
Table 5 PMH values in percentile by age, gender and ethnicitya

The mean PMH values increased significantly with increasing age for total PMH, with those aged 18–29 years having the lowest PMH score (4.48). Emotional support, however, decreased with age with those aged 60 years and above having significantly lower scores (4.63, p < 0.05) than those aged 18–29 years (4.96). While total PMH did not vary by gender, women had higher emotional support and spirituality scores than men (Table 4). Ethnic differences were also observed in the population, with Chinese participants showing lower total PMH scores than the other ethnic groups. Subscale scores were also lower among the Chinese for all the domains except for general coping. Most of the differences observed at bivariate level were also observed in the multivariable model after controlling for age, gender, ethnicity, marital status and education level (Table 6). In contrast to age, ethnicity and marital status, education levels were not significantly associated with total PMH values, but only with selected domains. Being married was associated with better interpersonal skills (compared to being never married) and global affect (compared to being separated/divorced/widowed) and higher education was associated with better social support.

Table 6 Socio-demographic factors associated with PMH after multivariable adjustmenta

Discussion

The findings of this multi-ethnic population-based study support the strong psychometric properties of the locally developed PMH-I for assessing positive mental health in Asian populations. A six-factor-higher-order structure was confirmed for assessing six different aspects of positive mental health: global coping, emotional support, spirituality, interpersonal skills, personal growth and autonomy, and global affect. Concurrent validity was shown through significant positive correlation of the total PMH score and its subscales with health-related quality of life and a negative correlation with psychological distress. Older age, female gender and non-Chinese ethnicities (Indian, Malay and other ethnicities) were associated with a significantly higher total PMH score. In contrast, marital status and educational level were not associated with the total PMH score, but were only associated with some of the PMH domains. In addition, age, gender and ethnicity-specific population norms were generated, allowing comparisons of individual PMH scores with population estimates. While there was minimal overall floor effect, a ceiling effect was observed for the PMH-I which was comparable to the ceiling effect found for other widely used health status measures such as the EQ-5D [31], SF-36 [32], WEMWBS [33] and the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) [34].

Prior evidence on the structure of the PMH-I was based on exploratory and confirmatory factor analyses in a smaller community sample and among mental health service users in Singapore [21, 26]. In accordance with its original multi-dimensional structure, the six-factor-higher-order structure of the PMH-I in the current representative sample of multi-ethnic Singapore residents could be replicated with GOF indices close to the cut-offs recommended for a superior model fit [30]. The scale has consistently fulfilled thresholds for GOF indices in the previous studies, with CFI between 0.95–0.96, TLI of 0.95–0.96 and a RMSEA of 0.05–0.07, which were further confirmed in the current representative sample. When compared to the RMSEA of 0.076 observed in mental health service users, the present study indicated an improvement, with RMSEA value being closer to the ideal of 0.05 (Table 2). RMSEA has been reported to be sensitive to sample size, with large samples showing better RMSEA [35, 36], which could partly explain this observation. However, since RMSEA tests the model fit to the covariance matrix, it is also possible that PMH-I data fit well to the general population sample given that it comprised a wider range of PMH scores compared to the clinical population of service users [37]. A review by Chen et al. [36] concluded that RMSEA ‘depends on the structure and size of the model in complex ways that are further confounded by sample size effects’, thus highlighting the importance of using other GOF measures. This study provided generalizable estimates of GOF for the PMH-I and met fit criteria for all the four indices. Results thus demonstrate that participants clearly differentiated between the six aspects of PMH and indicate that each domain is an independent source of PMH in the population. Results also highlight that mental health and well-being scales that fail to consider independent dimensions of PMH may miss important information needed for its measurement and development of interventions.

In terms of concurrent validity, the PMH-I fulfilled convergent and discriminant expectations, showing significant positive correlation with HRQoL and negative correlation with psychological distress (Table 2). The relation between PMH and HRQoL has been previously established in the Singapore population in a smaller convenience sample [21]. The current results in the representative sample further verify these findings and add to the extant literature on well-being. In addition, for the first time, the PMH-I was shown to be associated with K6 distress scores. This concurs with observed relationship between PMH and severity of depression and anxiety in earlier studies [21, 38, 39]. The widely-used K6 distress scale screens for severe mental illnesses and has been employed in several epidemiological case-finding and interventional studies world-wide [40, 41]. K6 has also been suggested as a useful screening tool for assessing mental health risks in primary care [29]. Findings from the current study demonstrate the importance of evaluating the association between distress and PMH to identify PMH components that can moderate the risk of mental distress at a population level. Results also provide traction for drawing international comparisons of these associations to enable the development of appropriate mental health interventions. Slade [42] proposed that ‘collation of evidence from narratives of recovery from mental illness’ and their relation with mental well-being can ‘provide a counter-balance to the traditional focus of mental health services’ that relies on deficits, and these could provide a basis for mental health promotion beyond just treatment of mental illness. The hypothesis that some domains of positive mental health may influence vulnerability to psychopathology needs to be properly investigated.

The present work provides normative values based on a representative population sample in Singapore. PMH norm levels varied by age, gender and ethnicity; weighted estimates for these were established in the study which allow for comparisons between the important population groups. Previous research in smaller samples has mostly showed consistent association of PMH with age, gender and ethnicity [43, 44]. However, the normative values in this representative general population (Table 4) were slightly higher than those reported in an earlier smaller population sample and the clinical sample of mental health service users. For example the mean total PMH observed in the earlier smaller convenience sample was 4.53 ± SD 0.74 [43] while that in service users was 3.93 ± 0.95 [44] versus the weighted mean of 4.61 ± 0.80 in this representative population. It is possible that the participants in the SH-2 cohort had better mental health than the earlier samples. Individual differences in PMH have been attributed to factors such as education, race, gender, genetics and lifestyle behaviours [3] which could have influenced the norms. The focus of this national study was to provide normative data for the basic socio-demographic groups, namely, age, gender and ethnicity. Future studies designed to establish PMH norms in other sub-groups such as the employed or individuals with chronic medical conditions would be beneficial in gauging their mental health status and informing policy for mental health promotion in these groups. Growing evidence indicates that employees’ mental health influences productivity losses, including increased absenteeism, attrition and suboptimal performance at work [45, 46]. Likewise, mental well-being in individuals with chronic illnesses such as diabetes has been associated with resilience and improved clinical and social outcomes [47, 48]. The normative scores presented in this paper can be used to study improvements or decline in PMH among national samples in Singapore, and understand how PMH is associated with a variety of health, economic, and social outcomes. PMH profiles may also be studied by monitoring temporal changes in the norms across different PMH domains which could serve valuable in developing appropriate mental health promotion strategies and interventions. Results of this study thus present several advantages to researchers and policy makers.

The strength of this study lies in its sample, drawn from a survey representative of the Singapore population in terms of age, gender and ethnicity. As a novel aspect, the study also included participants belonging to other ethnic groups and those aged below 21 and over 65 which were not investigated in the past. The current study sample was derived using a national sampling frame and weight adjusted for non-response, lending support to the reliability of these estimates. Besides these strengths, some limitations need to be acknowledged. First of all, an important limitation of the study is its low response rate of 35% potentially limiting the generalizability of the study findings. The age, gender and ethnic breakdown of the sample was, however, very close to the characteristics of the Singapore population (Table 1) and likely to represent estimates applicable to these sub groups in the local population. Secondly, the cross-sectional design of the study does not allow for drawing causal inferences. Thirdly, given that the present study was designed as a secondary investigation nested within an existing cohort, the retest for reliability analyses could not be included a priori. Due to the availability of the PMH-I in English language alone, residents who were not literate in English were excluded. Irrespective of the high English literacy in Singapore (80% in population aged over 15 years) [49], this exclusion could have influenced some of the results. In addition, a likely critique of this work could relate to the multi-ethnic nature and Singapore-specific ethnic composition. Varying ethnic compositions in other populations could influence some of the results, particularly the normative values in the overall general population which should be considered while interpreting the study findings. However, we observed that the factorial structure of the PHM-I and its subscales was essentially the same when the three major ethnic groups in our study were analysed separately. Therefore, we expect that the psychometric properties of the tool will apply to homogeneous or heterogeneous populations with Chinese, Malays and/or Indians regardless of their composition. However, given that our study population resides in a high income, urban setting, it will be of value to evaluate the properties of PMH-I in other types of settings. Research should likewise focus on other samples such as those with serious health conditions, children and the oldest old to cover the full spectrum of the population. Lastly, longitudinal studies are needed to evaluate the stability of the PMH-I and thus the construct, and further investigate the influence of time changing characteristics and life events on the PMH-I performance.

Conclusions

The assessment of positive mental health and its associated factors in clinical and non-clinical samples is important for understanding the mechanisms by which important factors and life events may influence the level of positive mental health and progression of adverse psychological outcomes in individuals and populations. The results of this study provide evidence of the strong psychometric properties of the PMH-I in a multi-ethnic Asian sample and support its use in the measurement of positive mental health in population-wide epidemiological studies. The current study provides traction for further longitudinal research on determinants of positive mental health, and for assessing the efficacy and effectiveness of interventions for mental health promotion in the population and in Asian populations outside of Singapore.

Abbreviations

CAPI:

Computer-assisted personal interviewing

CFA:

Confirmatory factor analysis

CFI :

Comparative fit index

EQ-5D 5 L:

European Quality of Life-5 Dimensions 5 levels

GOF:

Goodness-of-fit

HRQoL:

Health-related quality of life

K6:

Kessler 6 Psychological Distress scale

NUS-IRB:

National University of Singapore Institutional Review Board

PMH:

Positive mental health

PMH-I:

Positive Mental Health Instrument

RMSEA:

Root mean square error of approximation

SF-36:

Short Form-36

SH-2:

Singapore Health-2 study

SRMR:

Standardized root mean square residual

TLI:

Tucker-Lewis index

VAS:

Visual analogue scale

WEE:

Weights for enumeration exercise

WEMWBS:

Warwick-Edinburgh Mental Well-Being Scale

WHO:

World Health Organization

WHODAS:

World Health Organization Disability Assessment Schedule

WPS:

Post-stratification weights

WSF:

Weights for enumeration exercise study fieldwork

References

  1. World Health Organization. Promoting mental health: concepts, emerging evidence, practice. Geneva: WHO; 2005.

    Google Scholar 

  2. Diener E. Subjective well-being. Psychol Bull. 1984;95:542–75.

    Article  CAS  PubMed  Google Scholar 

  3. Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66.

    Article  CAS  PubMed  Google Scholar 

  4. Ryff CD, Keyes CLM. The structure of psychological well-being revisited. J Pers Soc Psychol. 1995;69:719–27.

    Article  CAS  PubMed  Google Scholar 

  5. Keyes CLM. Subjective well-being in mental health and human development research worldwide: an introduction. Soc. Ind Res. 2006;77:1–10.

    Article  Google Scholar 

  6. Keyes CLM. Promoting and protecting mental health as flourishing: A complementary strategy for improving national mental health Am Psychol 2007;62:95–108.

  7. Wyn J, Cahill H, Holdsworth R, Rowling L, Carson S. MindMatters, a whole-school approach promoting mental health and wellbeing. Aust N Z J Psychiatry. 2000;34:594–601.

    Article  CAS  PubMed  Google Scholar 

  8. Westerhof GJ, Keyes CL. Mental illness and mental health: the two continua model across the lifespan. J Adult Dev. 2010;172:110–9.

    Article  Google Scholar 

  9. Keyes CL, Dhingra SS, Simoes EJ. Change in level of positive mental health as a predictor of future risk of mental illness. Am J Public Health. 2010;100:2366.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Schotanus-Dijkstra M, Ten Have M, Lamers SM, de Graaf R, Bohlmeijer ET. The longitudinal relationship between flourishing mental health and incident mood, anxiety and substance use disorders. Eur J Pub Health. 2017;27:563–8.

    Google Scholar 

  11. Ostir GV, Markides KS, Black SA, Goodwin JS. Emotional well-being predicts subsequent functional independence and survival. J Am Geriatr Soc. 2000;48:473–8.

    Article  CAS  PubMed  Google Scholar 

  12. Ryff CD. Psychological well-being revisited: advances in the science and practice of eudaimonia. Psychother Psychosom. 2014;83:10–28.

    Article  PubMed  Google Scholar 

  13. Boylan JM, Tsenkova VK, Miyamoto Y, Ryff CD. Psychological resources and Glucoregulation in Japanese adults: findings from MIDJA. Health Psychol. 2017;36:449–57.

    Article  PubMed  Google Scholar 

  14. Weiss LA, Westerhof GJ, Bohlmeijer ET. Can we increase psychological well-being? The effects of interventions on psychological well-being: a meta-analysis of randomized controlled trials. PLoS One. 2016;11:e0158092.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Bech P, Olsen LR, Kjoller M, Rasmussen NK. Measuring well-being rather than the absence of distress symptoms: a comparison of the SF-36 mental health subscale and the WHO-five well-being scale. Int J Methods Psychiatr Res. 2003;12:85–91.

    Article  PubMed  Google Scholar 

  16. Meng X, D'Arcy C. Coping strategies and distress reduction in psychological well-being? A structural equation modelling analysis using a national population sample. Epidemiol Psychiatr Sci. 2016;25:370–83.

    Article  CAS  PubMed  Google Scholar 

  17. Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49:71–5.

    Article  CAS  PubMed  Google Scholar 

  18. Ryff CD, Singer B. Psychological well-being: meaning, measurement, and implications for psychotherapy research. Psychother Psychosom. 1996;65:14–23.

    Article  CAS  PubMed  Google Scholar 

  19. Kammann R, Flett R. Source book for measuring well-being with Affectometer 2, Dunedin, New Zealand: why not? Foundation. Psychologist. 1983;35:259–65.

    Google Scholar 

  20. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Vaingankar JA, Subramaniam M, Chong SA, Abdin E, Orlando Edelen M, Picco L, Lim YW, Phua MY, Chua BY, Tee JYS, Sherbourne C. The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population. Health Qual Life Outcomes. 2011;9:92.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lluch-Canut T, Puig-Llobet M, Sanchez-Ortega A, et al. Assessing positive mental health in people with chronic physical health problems: correlations with socio-demographic variables and physical health status. BMC Public Health. 2013;13:928.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Hurtado-Pardos B, Moreno-Arroyo C, Casas I, Lluch-Canut T, Lleixà-Fortuño M, Farrés-Tarafa M, Roldán-Merino J. Positive mental health and prevalence of psychosocial ill-being in university nursing professors in Catalonia, Spain. J Psychosoc Nurs Ment Health Serv. 2017;55:38–48.

    Article  PubMed  Google Scholar 

  24. Roldán-Merino J, Lluch-Canut MT, Casas I, Sanromà-Ortíz M, Ferré-Grau C, Sequeira C, Falcó-Pegueroles A, Soares D, Puig-Llobet M. Reliability and validity of the positive mental health questionnaire in a sample of Spanish university students. J Psychiat Ment Health Nurs. 2017;24:123–33.

    Article  Google Scholar 

  25. Vaingankar JA, Subramaniam M, Lim YW, Sherbourne C, Luo N, Ryan G, Phua A, Shahwan S, Kwok KW, Brown J, Bradley M, Orlando Edelen M, Chong SA. From well-being to positive mental health: conceptualization and qualitative development of an instrument in Singapore. Qual Life Res. 2012;21:1785–94.

    Article  PubMed  Google Scholar 

  26. Vaingankar JA, Abdin E, Chong SA, Sambasivam R, Jeyagurunathan A, Seow E, Picco L, Pang S, Lim S, Subramaniam M. Psychometric properties of the positive mental health instrument among people with mental disorders: a cross-sectional study. Health Qual Life Outcomes. 2016;14:19.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Kish L. A procedure for objective respondent selection within the household. J Am Stat Assoc. 1949;44:380–7.

    Article  Google Scholar 

  28. Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, Bonsel G, Badia X. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, Walters EE, Zaslavsky AM. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32:959–76.

    Article  CAS  PubMed  Google Scholar 

  30. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

  31. Buchholz I, Thielker K, Feng YS, Kupatz P, Kohlmann T. Measuring changes in health over time using the EQ-5D 3L and 5L: a head-to-head comparison of measurement properties and sensitivity to change in a German inpatient rehabilitation sample. Qual Life Res. 2015;24:829–35.

    Article  PubMed  Google Scholar 

  32. Bunevicius A. Reliability and validity of the SF-36 health survey questionnaire in patients with brain tumors: a cross-sectional study. Health Qual Life Outcomes. 2017;15:92.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Ringdal R, Bradley Eilertsen ME, Bjørnsen HN, Espnes GA, Moksnes UK. Validation of two versions of the Warwick-Edinburgh mental well-being scale among Norwegian adolescents. Scand J Public Health. 2017;1:1403494817735391.

    Google Scholar 

  34. Carlozzi NE, Kratz AL, Downing NR, Goodnight S, Miner JA, Migliore N, Paulsen JS. Validity of the 12-item World Health Organization disability assessment schedule 2.0 (WHODAS 2.0) in individuals with Huntington disease (HD). Qual Life Res. 2015;24:1963–71.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Bollen KA. Overall fit in covariance structure models: two types of sample size effects. Psychol Bull. 1990;107:256–9.

    Article  Google Scholar 

  36. Chen F, Curran PJ, Bollen KA, Kirby J, Paxton P. An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociol Methods Res. 2008;36:462–94.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Marsh HW, Hau K, Wen Z. In search of golden rules: comment on hypothesis testing approaches to setting cut-off values for fit indexes and dangers in over generalizing Hu and Bentler's findings. Struct Equ Model. 2004;11:320–41.

    Article  Google Scholar 

  38. Seow LS, Vaingankar JA, Abdin E, Sambasivam R, Jeyagurunathan A, Pang S, Chong SA, Subramaniam M. Positive mental health in outpatients with affective disorders: associations with life satisfaction and general functioning. J Affect Disord. 2015;190:499–507.

    Article  PubMed  Google Scholar 

  39. Jeyagurunathan A, Vaingankar JA, Abdin E, Sambasivam R, Seow E, Pang S, Picco L, Chong SA, Subramaniam M. Gender differences in positive mental health among individuals with schizophrenia. Compr Psychiatry. 2017;74:88–95.

    Article  PubMed  Google Scholar 

  40. California Health Interview Survey. CHIS 2007 Methodology series: report 4 – response rates. UCLA Center for Health Policy Research, 2009b; Los Angeles: 2009 http://healthpolicy.ucla.edu/Documents/Newsroom%20PDF/CHIS2009_method4.pdf. Accessed 5 Mar 2018.

  41. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, Howes MJ, Normand SL, Manderscheid RW, Walters EE, Zaslavsky AM. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60:184–9.

    Article  PubMed  Google Scholar 

  42. Slade M. Mental illness and well-being: the central importance of positive psychology and recovery approaches. BMC Health Serv Res. 2010;10:26.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Vaingankar JA, Subramaniam M, Abdin E, Picco L, Phua A, Chua BY, Chong SA. Socio-demographic correlates of positive mental health and differences by depression and anxiety in an Asian community sample. Ann Acad Med. 2013;42:514–23.

    Google Scholar 

  44. Sambasivam R, Vaingankar JA, Chong SA, Abdin E, Jeyagurunathan A, Seow LS, Pang S, Subramaniam M. Positive mental health in outpatients: comparison within diagnostic groups. BMC Psychiatry. 2016;16:412.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Goetzel RZ, Ozminkowski RJ, Sederer LI, Mark TL. The business case for quality mental health services: why employers should care about the mental health and well-being of their employees. J Occup Environ Med. 2002;44:320–30.

    Article  PubMed  Google Scholar 

  46. Wright TA, Cropanzano R. Psychological well-being and job satisfaction as predictors of job performance. J Occup Health Psychol. 2000;5:84–94.

    Article  CAS  PubMed  Google Scholar 

  47. Yi JP, Vitaliano PP, Smith RE, Yi JC, Weinger K. The role of resilience on psychological adjustment and physical health in patients with diabetes. Br J Health Psychol. 2008;13:311–25.

    Article  PubMed  Google Scholar 

  48. Netuveli G, Wiggins RD, Montgomery SM, Hildon Z, Blane D. Mental health and resilience at older ages: bouncing back after adversity in the British household panel survey. J Epidemiol Community Health. 2008;62:987–91.

    Article  CAS  PubMed  Google Scholar 

  49. Census of Population 2010 Statistical Release 1 Demographic Characteristics, Education, Language and Religion. www.singstat.gov.sg/docs/default-source/default-document-library/publications/publications_and_papers/cop2010/census_2010_release1/cop2010sr1.pdf. Accessed 1 Nov 2017.

Download references

Acknowledgements

Not applicable.

Funding

The Singapore Health-2 study was supported by grants from the Ministry of Health, Singapore, National University of Singapore and National University Health System, Singapore.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due to funding regulations but are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

JAV led the analysis plan and interpretation of findings and drafted the manuscript. MS was actively involved in the analysis, interpretation and manuscript content. LWLT participated in the study design, supervised the study, led the data collection and contributed to the manuscript. EA conducted the analysis and assisted in interpretation of findings and manuscript content. WYL and HLW steered the study design and concept, interpreted the findings and provided intellectual inputs into the manuscript. SAC was involved in the analysis, interpretation and manuscript content. RMVD was the main investigator of the study responsible for the study design and conduct, and assisted in the analysis, interpretation of the results, manuscript content and approval of the final draft.

Corresponding author

Correspondence to Janhavi Ajit Vaingankar.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained from the National University of Singapore Institutional Review Board (NUS-IRB) prior to the start of the study (NUS IRB, reference 13–512). Written informed consent was obtained from all adult participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1

Positive Mental Health Instrument and factor structure in the Chinese, Malay and Indian populations in Singapore. (ZIP 205 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vaingankar, J.A., Subramaniam, M., Tan, L.W. et al. Psychometric properties and population norms of the positive mental health instrument in a representative multi-ethnic Asian population. BMC Med Res Methodol 18, 29 (2018). https://doi.org/10.1186/s12874-018-0487-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12874-018-0487-9

Keywords