- Research article
- Open Access
- Published:
Frequently repeated measurements -our experience of collecting data with SMS
BMC Medical Research Methodology volume 20, Article number: 124 (2020)
Abstract
Background
As technology is advancing, so are the possibilities for new data collection methods in research, potentially improving data quality and validity of the results. In Sweden, a system using frequent repeated data collection using text messages, SMS Track, has been used in clinical research for more than a decade. In this paper, compliance with repeated text message questions was examined across five different studies, i.e. if compliance was
1: associated with study-specific factors (age or gender of the subjects, the condition, its’ severity or course, i.e. improvement, relapse or steady state) and/or.
2: associated with the methodology itself (the question being asked, the frequency and number of questions, duration of data collection, initial compliance or the management of the system).
Methods
Descriptive comparisons were done across five studies. Three studies were collecting weekly responses over at least 52 weeks (“Weekly studies”) and were used to investigate the effect of age, sex and pain severity on compliance, the effect of early compliance for late compliance, and finally the early occurrence of two successive weeks with non-compliance.
Result
Compliance was excellent across all five studies, and only influenced somewhat by age, sex and pain-level. The factor “study” remained significant in the final model thus the observed differences may be a result of the conditions studied but does not seem to be attributable to severity or development of these conditions. Number and frequency of questions did not influence compliance, nor did study duration.
Conclusions
Compliance was excellent in the included studies and was not affected by population factors. However, differences in compliance were observed that cannot be easily explained and warrant further investigation. In particular, the nature of the variables or the management of the study are potential areas for further investigations.
Background
Data in prospective studies have traditionally been collected using interviews and questionnaires, and have often been restricted to before/after measurements, i.e. how the patient was doing at baseline (before the intervention) compared to some time later (after the intervention or the passing of time), often at 3, 6 or 12 months. Previously, the administrative burden of collecting data with these methods, as well as the challenge of get responders to comply, made frequent data collection unfeasible. A recent study concluded that this method of selecting rather arbitrary time points may render the results unreliable [1]. This is certainly the case in fluctuating conditions, such as many musculoskeletal conditions and chronic illnesses, where the selected measuring point may be reflecting a random point in the individual trajectory, and not be a true measure of improvement or decline of the condition.
Recent technological advances have permitted frequently repeated measures, using mobile phones and the internet. As people worldwide are becoming more IT literate, these methods are appealing in terms of availability, user-friendliness, costs and ultimately, data quality.
In Western societies, IT penetration is close to 100%. In Sweden, nearly 100% of the population own their own mobile phone and have access to and use the internet daily [2]. The low and middle income countries are not far behind [3].
A system whereby a participant receives automated text messages, SMS, at frequent intervals, and reports their status in a reply SMS requires a minimal effort from the respondent. People carry the phone with them at all times, and the tendency is that of being constantly on-line. This means that questions via SMS can be answered in real time, with a minimum of recall bias, and in real life circumstances, known as ecological momentary assessment [4]. This term describes a new way of collecting data, reflecting the fact that the respondent may actually answer in their own environment (ecological) when the incident occurs (momentary), not waiting for an appointment in a lab after the incident of interest has passed. Research using this type of frequent assessment generally show excellent response-rates [5,6,7].
A system called SMS-Track®, specifically developed for research, has been used for about 10 years in the Scandinavian countries [8]. It has been scrutinized for user-friendliness and was found to have high compliance [9]. Subjects have been followed with up to three weekly questions for up to 2 years with a compliance of over 90% [10, 11]. Compared to using paper questionnaires, the system also carries low costs [12]. The system uses a web-based interface, whereby the data are stored instantly in an on-line file, accessible to the researcher and easily downloadable for analysis. As such, errors related to typing in and transfer of data for analysis are minimized.
In all data collection, scrutiny is warranted before relying on the data and hence, on the conclusions drawn from the study. In the case of collecting data with SMS, compliance, i.e. the response rate, is of the utmost importance if data imputation should be kept to a minimum. Specifically: it is important to assess if compliance is dependent on subject-related factors or on the method itself. Concerning text messages as a data collection tool; if there are certain individuals (who for some reason cannot manage the technology) or types of questions where this technology is not suitable. In addition, it will be important to know if measuring frequency, time of measurement (i.e. during holidays) or number of questions influence the compliance, or if the “severity” of the condition does, e.g. if individuals who are severely affected by a condition comply differently than individuals who are less affected regarding condition-specific outcomes. Finally, it will be a concern if subjects comply differently when recovering from their condition compared with experiencing a “steady state”.
Data from five studies using the SMS Track system allowed these questions to be explored. Working with the system over the years, one hypothesis was that early compliance is “key” to long-term compliance.
Specifically, this paper aimed to investigate if compliance with frequent SMS questions was
- 1:
associated with study-specific factors (age or gender of the subjects, the condition, its’ severity or course, i.e. improvement, relapse or steady state) and/or
- 2:
associated with the methodology itself (the question being asked, the frequency and number of questions, duration of data collection, initial compliance or the management of the system).
Method
Data and settings
This paper utilized data from 5 prospective studies, all conducted in Sweden from 2011 through 2017 and all using SMS-Track as a data collection tool. The investigators in each of the included studies were trained by the same coordinator regarding response management and reminding, as previously tested and described [9]. In short, to optimize compliance, the weekly responses were closely monitored, and respondents who failed to answer 2 weeks in a row were called to make sure they understood that every response was important. The studies differed in terms of aims, populations, outcomes (and thus type and number of questions asked) and frequency of measure. All of the studies also collected data by other means besides using SMS, through interviews, clinical tests, patient records, questionnaires and registers. An overview of their characteristics is seen in Table 1.
- 1:
The Maintenance Care “MC” Chiro study (principal Investigator (PI): Axén) [13]. This was a randomized clinical trial investigating 321 patients consulting a chiropractor in Sweden with low back pain (LBP). The trial aimed to investigate the effect of a preventive approach employed by chiropractors directed towards recurrent and persistent LBP and sent a weekly SMS for 52 weeks asking about the number of days with bothersome LBP: “On how many days during the past week were you bothered by your LBP (i.e. affected in your daily activities or routines)?”
- 2:
The Spinal Cord Injury Prevention “SCIP” Falls study (PI: Skavberg Roaldsen) [14, 15]. This was an observational study of 224 individuals with Spinal Cord Injury (SCI) in Norway and Sweden aiming at investigating recurrent falls both in ambulant persons and wheelchair users. The subjects received a SMS every other week for 1 year asking if they had experienced any falls: “Have you fallen the previous two weeks? (yes or no)”. If the response was “yes”, the research team would call the individual for details in order to explore the incident further.
- 3:
The Work-Up study (PI: Grahn) [16]. This was a cluster randomized controlled trial investigating a working population of 325 individuals with neck- and back-pain, who consulted in primary care. The trial aimed to investigate the effect of an improved dialogue between the patient, the employer and the physiotherapist to adapt work conditions to prevent sick listing and improve work ability. Every week for 1 year, the subjects received 3 SMS with questions concerning sick-leave, work ability and disability; 1) “Last week, how many days were you on sick leave?” 2) Last week, to what extent did your neck/back problems impair your work performance?” and 3) Last week, to what degree did your neck/back problems hinder you in carrying out daily routines in family life and leisure?”
- 4:
The Physical Activity program for people with Rheumatoid Arthritis, “PARA” study (PI: Opava) [17]. This was an observational study investigating 220 patients with rheumatoid arthritis (RA) involved in a program to facilitate health-enhancing physical activity to improve health. The aim was to investigate the adherence to a physical activity program that included support by coaches. Two weekly SMS were sent for 2 years (104 weeks) asking about the number of circuit training sessions and additional days with free-living physical activity: 1) “How many circuit-training sessions did you do the past week”? and 2) “Besides the circuit training, how many additional days of the past week did you perform at least moderate-intensity physical activity for at least 30 minutes?”
- 5:
The Stress Prevention At work “SPA” study (PI: Jensen) [18]. This was a cluster randomized controlled trial among 121 individuals working in primary health care where an intervention to prevent work-related stress was carried out. The aim was to investigate the effectiveness of this intervention. Data were recorded for two periods, SPA I (the first 13 weeks of the intervention) and SPA II (starting at months 6 after the intervention and running for 26 weeks). In both periods, the participants received a weekly SMS asking about their level of stress: “Stress means a state in which a person feels tense, restless, nervous or anxious or is unable to sleep at night because his/her mind is troubled all the time. Do you feel this kind of stress these days?”.
Ethical permission
All the studies had individual ethical permission from their local ethic committees; MC Chiro: 2007/1458–31/4, SCIP Falls: 2012/830–31/2, 2013/391–32, 2014/364–32, Work-Up: 2012/497, 2012/648, 2012/833, PARA: 2010/1232–31/1 and SPA: 2012/2200–31/5.
In addition, ethical approval for this specific merge and analysis of data was granted by the Swedish Ethical Review Authority (2017/961–31/5) for the Swedish data and by the Regional Committees for Medical and Health Research Ethics in Norway (2012/531) for the Norwegian data.
Data analysis
The data for the five studies were rearranged to get a similar structure with respect to compliance over the available weeks. Three studies (MC Chiro, Work-Up and PARA) covered a time span of (at least) 52 weeks with weekly SMS replies. Due to this similarity, data from these three studies, hereafter called the “Weekly studies” were used for comprehensive analysis. The remaining two studies did not cover 52 weeks (SPA) or weekly messaging (SCIP Falls) and they were therefore included only in the descriptive comparisons.
Pain was investigated at baseline in four studies, all except SPA. In MC Chiro, the Numeric Rating Scale with categories 0–10 were used, and in SCIP Falls, Work-Up and PARA, the Visual Analog Scale (VAS) was used, where the respondent is asked to rate their pain on a horizontal line from 0 to 100. In our analysis, the VAS-score was treated like a categorical variable, in order to aggregate data from the Weekly studies [19]. Further, the pain variable was categorized into “Painclass” with mild pain 0–5, moderate pain 6–7 and severe pain 8–10 [20] in order to explore “severity”.
Time was represented with two different settings. The first setting, used in most of the descriptions and analysis in this paper, is the study week. This refers to the consecutive weeks the subjects obtained a SMS. For subjects in the Weekly studies, this number spans from 1 to 52. The second time setting in this paper, used to study compliance in relation to holidays, was the calendar week that corresponded to the subject’s study week.
The dependent variable in this paper was “compliance”, i.e. if the subjects answered the SMS question. The variable was therefore dichotomous, 0 = no answer and 1 = answer.
For descriptive purposes, compliance was presented in figures as percentage of missing answers; for all studies for 52 study weeks and in relation to calendar week. One study (PARA) collected data for 2 years, but for comparative purposes, the responses for the second year were omitted. Then, using data from the Weekly studies, figures of compliance stratified for sex, age and for pain severity categories were presented in this paper. A lowess method calculated a smoothed curve over the analyzed time period, in this case the 52 weeks. Lowess is described by Cleveland [21] as a robust locally weighted regression, and we applied it with a bandwidth of 0.6, which is a bit smaller than the default of the method (0.8). With this smaller value we found a less extreme smoothing which allowed us to show the existence of ups and downs in compliance over the time period.
Early and late compliance in this paper was defined as the initial and last 8 weeks of the study, respectively. A Poisson regression with the outcome “number of missing SMS during 8-week periods” at the start and at the end of the 52 weeks study schedule were used for the Weekly studies. Thus, the outcome was a number in the interval 0 to 8 (i.e. the number of missing SMS). The outcome parameter was the Relative Risk (RR) for missing SMS, or non-compliance. The RR was shown with a 95% confidence interval (CI), and p-value for a test of RR = 1.0, that is, no effect on compliance. Factors that were assumed to effect compliance were “study” (with MC Chiro serving as the reference), age (with age below 50 years as the reference category), sex (with males as the reference category) and baseline pain in three categories (mild pain as reference). We also introduced a combined variable with age (below and above 50 years) crossed with sex, using the category males < 50 years as the reference category. The Poisson regression belongs to the family of generalized linear models with a distribution according to the Poisson distribution and a logarithmic link function.
Finally, a time-to-event analysis was performed for the Weekly studies, where the event in this paper was the first occurrence of two consecutive weeks without answering SMS, as this was the suggested point of making contact with the respondent to ensure that they had understood the importance of answering every week. The analysis was based on a Cox proportional hazards model with “study”, age, sex and Painclass as the included variables. Results were presented with a curve equivalent to a survival curve, where the equivalence to death was the event described above. The Cox model also gives estimates of the Hazard Ratio (HR). The proportional hazards assumption of the Cox model was tested using Schoenfield residuals.
The statistical softwares STATA (version 15) and SPSS (version 25) were used for all analyses. Statistical significance was set to p < 0.05.
Results
Some of the baseline characteristics of the individuals in the included studies are presented in Table 1. More variables were collected in each individual study, but the ones presented here were similar across studies and serve as ground for comparison of the included subjects in this paper. All studies had data on age, sex and education/work, and all had a variable describing the health of the subjects. For the three Weekly studies, pain was also recorded at baseline.
There are clearly some differences in the study populations. Overall, most of the subjects were in their 40’s, but the subjects in PARA were older. In SCIP Falls, only a fifth were female, whereas in PARA, four fifths were. In Work-Up, a fifth had a university education, and in SPA, two thirds did. Concerning the health status of these individuals, the MC Chiro subjects were rating their health as good, compared to the poorest health that were found among the SCIP Falls and PARA participants. Comparing the Weekly studies, PARA is different from the other two concerning sex (more females), age (older), and pain (milder).
Overall compliance was slightly different between studies, see Table 2 for details. The most SMS-extensive study, Work-Up, received 49,607 replies to the 54,912 questions sent, an overall compliance of 90.3%.
Overall, the compliance in all five studies started excellently (few missing SMS), and gradually lost responses over time (Fig. 1, the second year removed from PARA). The exceptions were PARA with a lower initial compliance compared to the rest, and MC Chiro, that kept a high compliance throughout.
Non-compliance (percentage of missing answers) in each of the five studies over the first 52 weeks
During the Swedish holidays of Christmas and Easter, as well as summer, compliance was clearly lower (Fig. 2; the percentage of missing responses per calendar week for MC Chiro). All studies showed a similar tendency of lower compliance for holiday periods (data not shown).
Non-compliance (percentage of missing answers) in MC Chiro over 52 weeks
In relation to age and sex of the subjects, compliance as percentage of missing answers is shown in Table 3 for the Weekly studies.
Compliance in relation to baseline pain intensity: Mild (Pain levels 0–5), Moderate (Pain levels 6–7) and Severe (Pain levels 8–10), for the Weekly studies combined, is also presented in Table 3. Overall, pain severity does not seem to affect compliance. However, studying MC Chiro alone, Fig. 3, show that the respondents with moderate and severe pain have poorer compliance compared to the respondents reporting mild pain.
Non- compliance (percentage of missing answers) in relation to baseline pain intensity level; mild (0–5), moderate (6, 7) and severe (8–10), in MC Chiro over 52 weeks
There was a tendency in PARA that those with severe pain had less compliance at the end of the study period but this observation was based on only 14 subjects and not found for the other studies.
The Poisson regression analysis for the Weekly studies, investigated first whether early and late compliance was affected by age, sex, Painclass and “study”. Further, if early compliance was predictive of late compliance, i.e. if answering the SMS the first 8 weeks was predictive of answering the last 8 weeks of the study. This model was also adjusted for “study”, age, sex and baseline pain intensity, as shown in Table 4.
Older age seems to be associated with poorer compliance the first 8 weeks of the study (although not for Work-Up) but does not influence late compliance. Women seem to be good compliers initially but late compliance has no association with sex. Pain intensity at baseline did not significantly influence early or late compliance, except for MC Chiro, where low pain was associated with better compliance at both times. The most important factor affecting compliance, however, was “study”. Thus, the available baseline characteristics explained far less of the compliance than the study itself. The initial early compliance was found to be a predictor for late compliance.
The percentage of subjects in the Weekly studies that had no early missing SMS was plotted against the study week (Fig. 4). There was a substantial difference between the three Weekly studies, where MC Chiro had the best outcome with very few individuals with missing SMS.
Curve showing occurrence of early missing SMS for the Weekly studies
The results of the Cox proportional hazard model are shown in Table 5. The hazard ratio (HR) was somewhat lower for higher age but not statistically significant. Sex and pain had none or small effects on early missing SMS, and, as with the other analyses, the statistically significant effect was found for “study”, with PARA displaying the highest value, HR 6.17 (95% CI 3.38–11.28, p < 0.001).
Discussion
We explored compliance in five studies that had used frequent SMS to collect data over a fairly long time. Overall compliance was somewhat different between the studies, ranging from 98.2% (MC Chiro) to 88.1% (PARA). However, in the great scheme of clinical research, an overall compliance of around 90% is quite remarkable. Further, a compliance around 70% at the end of a study period of 52 weeks (the lowest compliance of the Weekly studies) is in line with previous studies using SMS to collect data [7, 9], and must be considered a high figure in comparison with other means of collecting data [22, 23].
The included populations were intentionally different, in order to get a variety of factors where compliance with the SMS methodology could be explored. Four studies with working populations were included: MC Chiro, SCIP Falls, Work-Up and SPA, and two populations consisted of patients with chronic conditions, SCIP Falls and PARA. Therefore, not surprisingly, the subjects in MC Chiro, although clearly in pain when consulting for care, consisted of healthy subjects without much sick-leave. The subjects in SCIP Falls, who all lived with spinal cord injuries, reported the poorest quality of life according to the EuroQol 5 dimensions (EQ-5D) index.
Some gender differences between the populations were observed, some of which could be explained by the nature of the inclusion: PARA had the highest proportion of females, as RA is a condition affecting more females (gender ratio females/males of 80/20). In SPA, the population was also largely female, as the study was set among health care workers, traditionally female-dominated professions. In SCIP Falls, however, the participants were largely male [24]. This is also expected as the gender ratio (females/males) of SCI in Norway and Sweden is 25/75. In previous studies using the SMS technology, gender differences in compliance were minimal [6, 9].
We found that compliance was influenced to some degree by individual factors, but the factor that remained significant in the final model was “study”, i.e. the individual factors did not explain the difference in compliance as much as the study itself. We therefore need to look at the specifics of the studies to answer the questions of this paper.
Question 1: Is compliance associated with study-specific factors? There were some indications that age and gender did influence compliance (Fig. 3), but not as much as “study”. This “study effect” may reflect the condition of the subjects. Throughout, PARA experienced lower compliance than the other studies, their subjects suffering from a chronic condition, Rheumatiod Arthritis. The best compliance was found in MC Chiro, were subjects had recurrent and persistent LBP. Studying the health indicators of the subjects, participants in MC Chiro and Work-Up reported far more pain and poorer health compared to PARA participants. However, in chronic conditions such as RA, it may well be that individuals adapt to pain over the years, implying that it is not regarded as bad as if it was acute. Thus, it is difficult to conclude if condition may be a factor explaining compliance.
It is also possible that the severity of the condition explains the “study effect”, as highlighted in a previous study [9]. This was tested by using studies where categorization due to pain was possible (MC Chiro, Work-Up and PARA), but compliance was not found to be consistently different among groups of respondents with different levels in of pain intensity (Fig. 3, Tables 3, 4 and 5). Lastly, these three pain conditions are fluctuating, and it is possible that the “study effect” would be explained by changes in the condition. We calculated initial pain intensity development (from study start to 8 weeks) but did not find differences in compliance between those who improved, stayed the same or deteriorated (data not shown).
The “study effect” may be a result of the condition but does not seem to be attributable to severity or development of this condition, nor other available population factors. It may be due to other unmeasured differences in these populations, as we could only make comparisons across common variables.
Question 2: Is compliance associated with the SMS- methodology itself? In total 8 different questions (1 each from MC Chiro, SCIP Falls and SPA, 2 from PARA and 3 from Work-Up) were asked across the studies, all to some extent “sensitive”. However, in PARA, the SMS questions were about compliance with the intervention, i.e. physical activity. These questions were related to a socially desired behavior that was supposed to increase during the study period, while the other studies mainly measured disease-related symptoms. Failure in behavior change might certainly have been the case for lower compliance in PARA, while there is no expected failure related to the reporting of symptoms as in MC Chiro, SCIP Falls, Work-Up and SPA.
Questions have been raised concerning the influence of the technology itself on the outcome, i.e. does frequent questions about pain lead to more pain [25, 26], or is it stressful to answer frequent questions about stress [27]? However, that does not seem to be the case. In PARA, it could be proposed that the weekly SMS would act like a prompt to be more physically active, as hypothesized by others [28], but whether this prompting actually influences compliance is unknown.
Three studies were using weekly questions, one study was using questions every 2 weeks (SCIP Falls) and one (SPA) used a regimen of collecting data for 13 weeks, pausing for 12 weeks and then collecting data again for 26 weeks. If frequent questions were perceived as a burden, SCIP Falls and possibly SPA should show the highest compliance, which was not the case. It was, however, clear that holidays rendered somewhat lower compliance, as this was observed even in MC Chiro. The longest study (PARA) admittedly had the lowest compliance, but examining only the first year of PARA, compliance was lower already. Thus, the number and frequency of questions asked, as well as the study duration, did not explain differences in compliance between the studies.
In these five studies, all PI’s were given the same instructions how to oversee the data collection, send reminders and call non-compliers. It is possible that compliance with the rigorous execution of these management procedures was explaining the “study effect”, that it was a “management effect”. Indeed, early compliance was found to influence “stamina”, i.e. compliance throughout the study. As found in a previous scrutiny of the SMS method, it is important to motivate the non-responders early on [9]. In SCIP Falls, the participants were called by the investigators if answering “yes” (= I did fall), and this attention may also have contributed to the high compliance.
Conclusions
Compliance with frequent SMS questions was high across these studies. Individual factors, number and frequency of questions or duration of the study only marginally affected compliance and only partly explained the differences in compliance between the included studies. The “study effect” found in our analysis could however be due to the nature of the variables measured (such as a socially desirable outcome) or the management of the study. Future studies should aim to follow up on non-responders early to ensure good compliance throughout, and avoid questions relating to socially desirable behavior.
Availability of data and materials
The datasets analysed during the current study are not publicly available due to Swedish Ethics regulations but are available from the corresponding author on reasonable request.
Abbreviations
- IT:
-
Information Technology
- SMS:
-
Short Message System
- MC:
-
Maintenance Care
- PI:
-
Principal Investigator
- LBP:
-
Low Back Pain
- SCIP:
-
Spinal Cord Injury Prevention
- SCI:
-
Spinal Cord Injury
- PARA:
-
Physical Activity program for people with Rheumatoid Arthritis
- RA:
-
Rheumatoid Arthritis
- SPA:
-
Stress Prevention At work
- VAS:
-
Visual Analog Scale
- RR:
-
Relative Risk
- CI:
-
Confidence Interval
- HR:
-
Hazard Ratio
- EQ-5D:
-
EuroQol 5 Dimensions
References
- 1.
Axen I, Bergstrom G, Bodin L. Using few and scattered time points for analysis of a variable course of pain can be misleading: an example using weekly text message data. Spine J. 2014;14(8):1454–9.
- 2.
Swedish, and P, Agency T. Tillgång till telefoni och grundläggande internet; 2018.
- 3.
GeoPoll. Better, Faster Data from Emerging Markets. 2016 [Available from: https://research.geopoll.com/methodology.html.
- 4.
Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1–32.
- 5.
Burke LE, Shiffman S, Music E, Styn MA, Kriska A, Smailagic A, et al. Ecological momentary assessment in behavioral research: addressing technological and human participant challenges. J Med Internet Res. 2017;19(3):e77.
- 6.
Fuglkjaer S, Vach W, Hartvigsen J, Wedderkopp N, Junge T, Hestbaek L. Does lower extremity pain precede spinal pain? A longitudinal study. Eur J Pediatr. 2018;177(12):1803–10.
- 7.
Hartvigsen L, Kongsted A, Vach W, Salmi LR, Hestbaek L. Does a diagnostic classification algorithm help to predict the course of low Back pain? A study of Danish chiropractic patients with 1-year follow-up. J Orthop Sports Phys Ther. 2018;48(11):837–46.
- 8.
SMS-Track. SMS -Track Questionnaire 1.1.3.: http://www.sms-track.com/; 2007 [Available from: http://www.webcitation.org/6gXQNcMgT.
- 9.
Axen I, Bodin L, Bergstrom G, Halasz L, Lange F, Lovgren PW, et al. The use of weekly text messaging over 6 months was a feasible method for monitoring the clinical course of low back pain in patients seeking chiropractic care. J Clin Epidemiol. 2012;65(4):454–61.
- 10.
Jensen RK, Leboeuf-Yde C, Wedderkopp N, Sorensen JS, Manniche C. Rest versus exercise as treatment for patients with low back pain and Modic changes. A randomized controlled clinical trial. BMC Med. 2012;10:22.
- 11.
Kongsted A, Leboeuf-Yde C. The Nordic back pain subpopulation program - individual patterns of low back pain established by means of text messaging: a longitudinal pilot study. Chiropr Osteopat. 2009;17:11.
- 12.
Johansen B, Wedderkopp N. Comparison between data obtained through real-time data capture by SMS and a retrospective telephone interview. Chiropr Osteopat. 2010;18(1):10.
- 13.
Eklund A, Jensen I, Lohela-Karlsson M, Hagberg J, Leboeuf-Yde C, Kongsted A, et al. The Nordic maintenance care program: effectiveness of chiropractic maintenance care versus symptom-guided treatment for recurrent and persistent low back pain-a pragmatic randomized controlled trial. PLoS One. 2018;13(9):e0203029.
- 14.
Forslund EB, Jorgensen V, Franzen E, Opheim A, Seiger A, Stahle A, et al. High incidence of falls and fall-related injuries in wheelchair users with spinal cord injury: a prospective study of risk indicators. J Rehabil Med. 2017;49(2):144–51.
- 15.
Jorgensen V, Butler Forslund E, Opheim A, Franzen E, Wahman K, Hultling C, et al. Falls and fear of falling predict future falls and related injuries in ambulatory individuals with spinal cord injury: a longitudinal observational study. Aust J Phys. 2017;63(2):108–13.
- 16.
Sennehed CP, Holmberg S, Axen I, Stigmar K, Forsbrand M, Petersson IF, et al. Early workplace dialogue in physiotherapy practice improved work ability at 1-year follow-up-WorkUp, a randomised controlled trial in primary care. Pain. 2018;159(8):1456–64.
- 17.
Nordgren B, Friden C, Demmelmaier I, Bergstrom G, Lundberg IE, Dufour AB, et al. An outsourced health-enhancing physical activity programme for people with rheumatoid arthritis: exploration of adherence and response. Rheumatology (Oxford). 2015;54(6):1065–73.
- 18.
Arapovic-Johansson B, Wahlin C, Kwak L, Bjorklund C, Jensen I. Work-related stress assessed by a text message single-item stress question. Occup Med (Lond). 2017;67(8):601–8.
- 19.
Bijur PE, Latimer CT, Gallagher EJ. Validation of a verbally administered numerical rating scale of acute pain for use in the emergency department. Acad Emerg Med. 2003;10(4):390–2.
- 20.
Cepeda MS, Africano JM, Polo R, Alcala R, Carr DB. What decline in pain intensity is meaningful to patients with acute pain? Pain. 2003;105(1–2):151–7.
- 21.
Cleveland W. Robust locally weighted regression and smoothing scatterplots. J Am Stat Assoc. 1979;74:829–36.
- 22.
O’Keeffe M, O’Sullivan P, Purtill H, Bargary N, O’Sullivan K. Cognitive functional therapy compared with a group-based exercise and education intervention for chronic low back pain: a multicentre randomised controlled trial (RCT). Br J Sports Med. 2019;bjsports-2019-100780. [published online ahead of print, 2019 Oct 19].
- 23.
Ibrahim ME, Weber K, Courvoisier DS, Genevay S. Recovering the capability to work among patients with chronic low Back pain after a four-week, multidisciplinary biopsychosocial rehabilitation program: 18-month follow-up study. BMC Musculoskelet Disord. 2019;20(1):439.
- 24.
DeVivo MJ, Chen Y. Trends in new injuries, prevalent cases, and aging with spinal cord injury. Arch Phys Med Rehabil. 2011;92(3):332–8.
- 25.
Broderick JE, Vikingstad G. Frequent assessment of negative symptoms does not induce depressed mood. J Clin Psychol Med Settings. 2008;15(4):296–300.
- 26.
Hestbaek L, Saxtorph AC, Krogsgaard-Jensen CE, Kongsted A. Are frequent measurements in back pain research harmful? Two comparisons of back pain in groups with or without frequent follow-up. Chiropr Man Therap. 2018;26:51.
- 27.
Pryss R, John D, Schlee W, Schlotz W, Schobel J, Kraft R, et al. Exploring the time trend of stress levels while using the Crowdsensing Mobile health platform, TrackYourStress, and the influence of perceived stress reactivity: ecological momentary assessment pilot study. JMIR Mhealth Uhealth. 2019;7(10):e13978.
- 28.
Fischer X, Kreppke JN, Zahner L, Gerber M, Faude O, Donath L. Telephone-based coaching and prompting for physical activity: short- and long-term findings of a randomized controlled trial (Movingcall). Int J Environ Res Public Health. 2019;16(14):2626.
Acknowledgements
None.
Funding
Open access funding provided by Karolinska Institute.
Author information
Affiliations
Contributions
IA and IJ instigated this study and were responsible for data concerning the MC Chiro and the SPA studies, respectively. EBF and VJ were responsible for data concerning the SCIP Falls study, BG for data concerning the Work-Up study, and CHO for data concerning the PARA study. All authors contributed with ideas on data-analysis, and LB was responsible for the analysis. IA wrote the first manuscript draft, and all the authors contributed to and approved the final draft.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All the studies had individual ethical permission from their local ethic committees; MC Chiro: 2007/1458–31/4, SCIP Falls: 2012/830–31/2, 2013/391–32, 2014/364–32, Work-Up: 2012/497, 2012/648, 2012/833, PARA: 2010/1232–31/1 and SPA: 2012/2200–31/5.
In addition, ethical approval for this specific merge and analysis of data was granted by the Swedish Ethical Review Authority (2017/961–31/5) for the Swedish data and by the Regional Committees for Medical and Health Research Ethics in Norway (2012/531) for the Norwegian data.
Consent for publication
Not applicable.
Competing interests
The authors declare they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Axén, I., Jensen, I., Butler Forslund, E. et al. Frequently repeated measurements -our experience of collecting data with SMS. BMC Med Res Methodol 20, 124 (2020). https://doi.org/10.1186/s12874-020-01013-y
Received:
Accepted:
Published:
Keywords
- Ecological momentary assessment
- Repeated measures
- Text message
- Compliance
