Evaluation of the Total Design Method in a survey of Japanese dentists
- Yukie Nakai†1,
- Peter Milgrom†2,
- Toshiko Yoshida†1,
- Chikako Ishihara†1 and
- Tsutomu Shimono1Email author
© Nakai et al; licensee BioMed Central Ltd. 2005
Received: 28 May 2005
Accepted: 23 August 2005
Published: 23 August 2005
This study assessed the application of the Total Design Method (TDM) in a mail survey of Japanese dentists. The TDM was chosen because survey response rates in Japan are unacceptably low and the TDM had previously been used in a general population survey.
Four hundred and seventy eight dentist members of the Okayama Medical and Dental Practitioner's Association were surveyed. The nine-page, 27-item questionnaire covered dentist job satisfaction, physical practice, and dentist and patient characteristics. Respondents to the first mailing or the one-week follow-up postcard were defined as early responders; others who responded were late responders. Responder bias was assessed by examining age, gender and training.
The overall response rate was 46.7% (223/478). The response rates by follow-up mailing were, 18% after the first mailing, 35.4% after the follow-up postcard, 42.3% after the second mailing, and 46.7% after the third mailing. Respondents did not differ from non-respondents in age or gender, nor were there differences between early and late responders.
The application of TDM in this survey of Japanese dentists produced lower rates of response than expected from previous Japanese and US studies.
Mail survey questionnaires of dentists as well as the general public have been used widely in the U.S. and response rates are generally high. In contrast the use of mail surveys in Japan has been less successful. Japanese textbooks on social science research techniques report return rates of no more than 20–40% [1–3]. A mail survey conducted by one of the local Japanese dental associations had a response rate of 10% (unpublished data). Mail surveys reported in the Japanese medical literature had response rates ranging from 49 to 90% [4–8]. Research subjects in the various studies were the physicians and residents working at two private University hospitals (Response rate 49.1%) , the institutions belonging to an oncology group (Response rate 90.2%) , the council members of the Japanese society of child neurology (Response rate 72.8%) , ophthalmologists in hospitals and clinics (Response rate 73%) , and psychologists (Response rate not given) . However, the publications lack methodological detail. Only two of the five, for example, provide the source of the mailing lists. In two of the surveys, questionnaires were sent to a representative at each hospital or institution rather than to individuals directly [4, 5]. None of the five papers indicated whether the studies were sponsored by a professional association, or university or other group. One of five publications indicated that an advance letter was sent before the questionnaire . Only one paper specified whether participants were told how the data would be used . None of the papers explained whether an incentive was included in the mailing of the questionnaire. Other details generally missing were the length of the questionnaire (missing in 2/5) [4, 6, 8], telephone contacts for more information (missing in all 5) or assurance of confidentiality (missing in all 5).
The Total Design Method (TDM), which was developed by Dillman and includes personalization of the cover letter and repeated follow-ups, was designed to achieve high response rates and minimize the potential influence of systemic nonresponse bias . The response rate generally is lower in surveys of the general public and higher in surveys of professionals although this varies by group and subject. Locker and colleagues reported a 71.6% response rate when an oral health questionnaire using the TDM was used to survey the general population from voters' lists . Fiset and colleagues mailed questionnaires concerning dental malpractice claims to dentists using the TDM, and reported a 69.6% response rate .
In the only application of the TDM in Japan to date, Jussaume and colleagues reported a 55.6% response rate for a survey of the general population on the subject of 748 when those surveyed were selected from telephone listings .
No work has been done on adapting the TDM to Japanese dental populations. The aim of this study was to assess the application of the TDM in a mail survey of Japanese dentists.
The questionnaire was mailed to all 482 dentist members on Okayama Medical and Dental Practitioner's Association list. Out of 482 questionnaires sent out, four dentists were excluded because they had closed their office due to sickness or had shared replying survey with a spouse dentist. The final survey population was 478 dentists. Potential subjects were informed in the cover letter that participation in the study was voluntary and that individual responses would be confidential.
The Okayama Medical and Dental Practitioner's Association agreed to participate and endorse the study.
The procedures followed were generally those recommended by Jussaume and Yamada  who had previously adapted the TDM to Japan. In designing the letters, a strong emphasis was placed on three essential features of the TDM. First, respondents were told how their names were selected, that their responses would represent those of many other Japanese dentists, and that their participation was invaluable. Second, the confidentiality of the survey was emphasized and participants were promised that their names would never be placed on the questionnaire. Finally, as an incentive for participation, a decision was made with the Association that respondents would be offered a report of the results of this study. No personal incentive was included in the survey because Japanese culture values service to the group rather than the individual .
Japanese standard number 3 size (235 × 120 mm) envelopes of an light yellow green color were used. Addresses were written on envelopes from left to right in the manner of most Japanese business correspondence.
Data handling and analysis
The data from questionnaires received within four months of the first mailing were entered into a database in Excel 2000 (Microsoft), and were checked for accuracy. Data management and analyses were conducted using SPSS version 11.5.
A two-pronged strategy was used to assess bias. First, age and gender of respondents and non-respondents, provided by the association list, were compared. Second, we compared study variables for early and late respondents. Respondents to the first mailing or the one-week follow-up postcard were defined as early responders; others who responded were late responders. Study variables included age, gender, years in practice, practice satisfaction, practice status, practice location, patient number seen per day, having postgraduate training, total hours of continuing dental education taken for the past 12 months, employment status (owner vs. non-owner), number of practice locations, yearly gross income before any expenses or taxes. T-tests, Fisher's exact test and Chi-square analyses were used to compare differences between the groups to assess respondent representativeness.
Cumulative response rate to Japanese dental questionnaire using the TDM
Responses on study variable for early/late responders
Mean age (SD)
Mean months in practice (SD)
Practice satisfaction (% dissatisfied)
Busyness (%not busy enough)
Practice location (% patients from rural areas)
Patient visits/day (mean, SD)
Postgraduate training (%no)
Total hrs CDE/12 mos (Mean, SD)
Employment status (% non owner)
>1 practice location
Annual gross income before expense/taxes (% less than ¥30,000,000
Year of graduation (mean, SD)
The TDM, as generally adapted by Jussaume and Yamada , was used in a survey of Japanese dentists. Previously Jussaume and Yamada obtained nearly identical response rates when they surveyed the general public in Japan (55.6%) and the U.S. (57.5%) using this method. The application of the TDM in this survey of dental practice produced a lower response rate (46.6%) than expected but with little response bias. The results of a low response rate (43%) without non-response bias was previously reported in the US dentist population  although other studies using this method have produced higher response rates. Dentists can be considered to have sufficiently similar education, income, and interest to be considered a homogeneous group. If there is little difference between the respondents and non-respondents, a smaller percentage of return might be acceptable. Parashos and colleagues, who reported a dentist survey in Australia and New Zealand also using the TDM, found significant differences between early and late respondents in responses to a specific survey question of topical interest despite the absence of differences in the demographic data . They emphasize the importance of using methods to achieve a high response rate to overcome such bias.
The lower than anticipated response rate of this study may have resulted from our failure to follow all aspects of the TDM fully. One of the differences found in procedures between Jussaume's  and this study was that neither Inkan (personal seal) nor signature was used to the letter in this study. Jussaume said that it could convey to the respondent the importance which researchers placed on the project. The other difference was that the letter was not written in longhand in this study. Japanese respondents are hypothesized to react more positively to a survey seeing the effort taken to write out their names in longhand. Japanese dentists may also be more reluctant to answer the questions that they feel too personal. Ten dentists had refused to participate in this study due to such reasons. One of the authors asked the primary reasons why they didn't participate to another five dentists. Two of these five dentists said the questions were too personal and that there were too many questions to answer. One dentist said that he didn't want his practice to be compared with others. Two said that topic was not interesting enough to make them want to participate.
The response rate was, however, much greater than that of another unpublished survey of Japanese dentists that achieved a 10 % response rate. The follow-up contact and repeated mailing to non-respondents increased our sample size by more than a quarter (28.7%). Before using the postcard reminder, the response rate was one-third of the final rate, suggesting that follow-up contact is critical to bolstering mail survey response rates. This is consistent with research indicating that follow-up contact has the most positive effect on return rates [11, 15–17].
Our results are encouraging, and demonstrate the feasibility of using TDM to study a population of Japanese dentists.
The application of TDM in this survey of Japanese dentists produced lower rates of response than expected from previous Japanese and US studies with little response bias.
List of abbreviations
Total Design Method
The authors wish to thank all participating dentists who responded our mail survey and Okayama Medical and Dental Practitioner's Association who agreed to participate in our mail survey. The study was supported in part by funds from Okayama University.
- Hara J, Umino M: Shakai Chosa Enshu. 1984, Tokyo: Tokyo Daigaku Shuppan Kai, in JapaneseGoogle Scholar
- Igaki S: Shakai Chosa Nyumon. 1968, Kyoto: Mineruba Shobo, in JapaneseGoogle Scholar
- Kobayashi S: Shakai Chosa Ron. 1981, Tokyo: Bunshindo, in JapaneseGoogle Scholar
- Ota H, Tanimoto S, Takayanagi K, Kimura T, Oida T: A preliminary study on the knowledge and attitudes of physicians at two university hospitals towards the medical insurance system of Japan. Tohoku J Exp Med. 2000, 190: 143-155. 10.1620/tjem.190.143.View ArticlePubMedGoogle Scholar
- Konno R, Sato S, Yajima A: A questionnaire survey on current surgical procedures for endometrial cancer in Japan. Tohoku J Exp Med. 2000, 190: 193-203. 10.1620/tjem.190.193.View ArticlePubMedGoogle Scholar
- Sakakihara Y: Ethical attitudes of Japanese physicians regarding life-sustaining treatment for children with severe neurological disabilities. Brain Dev. 2000, 22: 113-117. 10.1016/S0387-7604(99)00127-8.View ArticlePubMedGoogle Scholar
- Funatsu H, Hori S: Present status of ophthalmological care for diabetic patients in Japan. Jpn J Ophthalmol. 2000, 44: 75-81. 10.1016/S0021-5155(99)00144-6.View ArticlePubMedGoogle Scholar
- Oshima A, Higuchi T, Fujiwara Y, Iida M, Iwanami A, Kanba S, Motohashi N, Uchitomi Y, Yamada K, Yamawaki S: Questionnaire survey on the prescribing practice of Japanese psychiatrists for mood disorders. Psychiatry Clin Neurosci. 1999, 53 (Suppl): S67-72.PubMedGoogle Scholar
- Dillman DA: Mail and telephone surveys: The Total Design Method. 1978, New York: John Wiley & SonGoogle Scholar
- Locker D, Grushka M: Response trends and nonresponse bias in a mail survey of oral and facial pain. J Public Health Dent. 1988, 48: 20-25.View ArticlePubMedGoogle Scholar
- Fiset L, Milgrom P, Tarnal J: Dentists' response to financial incentives in a mail survey of malpractice liability experience. J Public Health Dent. 1994, 54: 68-72.View ArticlePubMedGoogle Scholar
- Jussaume RA, Yamada Y: A comparison of the viability of mail surveys in Japan and the United States. Public Opin Q. 1990, 54: 219-228. 10.1086/269199.View ArticleGoogle Scholar
- Hovland EJ, Romberg E, Moreland EF: Nonresponse bias to mail survey questionnaires within in a professional population. J Dent Educ. 1980, 44: 270-274.PubMedGoogle Scholar
- Parashos P, Morgan MV, Messer HH: Response rate and nonresponse bias in a questionnaire survey of dentists. Community Dent Oral Epidemiol. 2005, 33: 9-16. 10.1111/j.1600-0528.2004.00181.x.View ArticlePubMedGoogle Scholar
- Fox RJ, Crask MR, Kim J: Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opin Q. 1988, 52: 467-491. 10.1086/269125.View ArticleGoogle Scholar
- Weathers PL, Furlong MJ, Solorzano D: Mail survey research in counseling psychology: Current practices and suggested guidelines. J Couns Psychol. 1993, 40: 238-244. 10.1037//0022-0184.108.40.206.View ArticleGoogle Scholar
- Gore-Felton C, Koopman C, Bridges E, Thoresen C, Spiegel D: An example of maximizing survey return rates. Methodological issues for health professionals. Eval Health Prof. 2002, 25: 152-168. 10.1177/01678702025002002.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/5/27/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.