 Research Article
 Open access
 Published:
Developing a system that can automatically detect health changes using transfer times of older adults
BMC Medical Research Methodology volume 16, Article number: 23 (2016)
Abstract
Background
As gait speed and transfer times are considered to be an important measure of functional ability in older adults, several systems are currently being researched to measure this parameter in the home environment of older adults. The data resulting from these systems, however, still needs to be reviewed by healthcare workers which is a timeconsuming process.
Methods
This paper presents a system that employs statistical process control techniques (SPC) to automatically detect both positive and negative trends in transfer times. Several SPC techniques, Tabular cumulative sum (CUSUM) chart, Standardized CUSUM and Exponentially Weighted Moving Average (EWMA) chart were evaluated. The best performing method was further optimized for the desired application. After this, it was validated on both simulated data and reallife data.
Results
The best performing method was the Exponentially Weighted Moving Average control chart with the use of rational subgroups and a reinitialization after three alarm days. The results from the simulated data showed that positive and negative trends are detected within 14 days after the start of the trend when a trend is 28 days long. When the transition period is shorter, the number of days before an alert is triggered also diminishes. If for instance an abrupt change is present in the transfer time an alert is triggered within two days after this change. On average, only one false alarm is triggered every five weeks. The results from the reallife dataset confirm those of the simulated dataset.
Conclusions
The system presented in this paper is able to detect both positive and negative trends in the transfer times of older adults, therefore automatically triggering an alarm when changes in transfer times occur. These changes can be gradual as well as abrupt.
Background
Although ageing is often associated with a decline in health, most older adults want to live in their own home environment as long as possible. Automated homecare systems that can help older adults maintain their independence are therefore in high demand [1–3] and the development of these systems is receiving a lot of research attention. Research groups aim to develop systems which can automatically monitor the health of older adults enabling the detection of both acute events, such as fall incidents, and gradual changes in health or functional ability [4].
Because a decline in gait speed has a predictive value for a broad array of adverse events such as physical functional decline [5–8], cognitive impairment [9–12] and fall incidents [7, 9, 10, 13–15] it is one of the parameters often monitored in these systems. For the monitoring of gait speed as well as the closely related transfer times (the time needed to cross a predefined transfer zone) both wearable sensors such as accelerometers and gyroscopes [11, 16, 17] and contactless sensors, such as motion detection systems [18], radar [19] and cameras [20, 21] are used. Although these systems provide accurate measurements for healthcare workers, the majority of this research does not further process this data. Consequently, the data still needs to be reviewed for each patient individually, which can be very timeconsuming and not feasible for healthcare workers who have a high number of patients. Additionally, specialized knowledge is needed to interpret these measurements.
The goal of our research therefore was the development of a system that could automatically detect deviating trends in transfer times of older adults. When a deviating trend is detected, an alarm is triggered alerting the healthcare worker. Said triggering of an alarm will reduce the time healthcare workers need to spend on reviewing the data. These alarms will furthermore allow for quicker interventions, before major health problems arise, and will consequently improve the quality of care and quality of life of older adults.
To automatically detect these deviations in the transfer times of older adult this study suggests the use of Statistical Process Control (SPC) techniques. Three statistical process control techniques: Tabular CUmulative SUM (CUSUM) chart, Standardized CUSUM and Exponentially Weighted Moving Average (EWMA) chart, were evaluated on simulated data. The best performing SPC method was selected and optimized to suit the application. After optimization the results were extensively validated on both simulated as well as on reallife datasets showing that chosen SPC technique is wellsuited to detect gradual changes in the transfer times of older adults.
Although in previous studies SPC techniques are sometimes used to predict future events when monitoring healthrelated variables [22, 23], the use of SPC techniques for the monitoring of transfer times is, however, new. We published a first proof of concept in which the basic SPC techniques were tested on a limited set of simulated data in [24].
The remainder of the paper is structured as follows. First, a general description of the evaluated statistical process control methods is provided. Thereafter, the different simulated datasets for both training and validation, as well as the reallife dataset are discussed. This is followed by the empirical evaluation of the different SPC techniques. Finally, an indepth discussion of the results and a general conclusion is presented. An overview of the different abbreviations used in the paper and their meaning is given at the end of the paper.
Methods
In this section first the different datasets used to evaluate and optimize the different statistical process control techniques are discussed. This is followed by a general description of statistical process control and the used control charts. Lastly, the experimental setup is discussed.
The dataset
Four reallife datasets were acquired during previous research [20, 21]. This limited number of datasets was, however, deemed insufficient to evaluate the different SPC techniques as well as to optimize and validate the best performing method. Simulated data were thus generated for evaluation, optimization and a first validation. The reallife dataset was used for further validation of the optimized technique.
Reallife data
To acquire reallife data, four camera systems consisting of multiple wallmounted webcams, were installed in the homes of four older adults for two to three months. From the resulting video data transfer times (the time a person needs to cross a predefined transfer zone) were measured. To reduce the influence of noise on the system a median of the measured transfer times was calculated per day, thus resulting in four datasets of medians of measured transfer times. An indepth discussing of the measured transfer times is given in [21]. During this previous study it was shown that a person in good health also had a stable gait model which is defined by short transfer times and small fluctuations in the measured times (see Fig. 1(a) and (b)). It was also shown that a person with different health issues (e.g. high fall risk, cognitive problems, etc.) had an unstable gait model which is identified by long transfer times and large fluctuations in the measured times (see Fig. 1(c)). Lastly, it was also observed that an improving health presents itself in the shortening of the transfer time and a smaller variability in these transfer times. A declining health in turn was visible by an increase in the transfer time and a larger variability (see Fig. 1(d)). It is therefore important that the designed method is able to detect deviating trends without triggering alerts when ’normal’ fluctuations in the transfer times occur.
Ethical approval for the study was provided by the Medical Ethics Committee of the Leuven University Hospitals (Trial registration numbers ML9820 and S55834 Registered 18 October 2013) and a written informed consent was obtained from all participants for both the data acquisition as well as for the publication of individual results.
More indepth information concerning the algorithm used to automatically detect and time the transfer zones and the acquired data can be found in [21].
Simulated data generation
There are several aspects that were taken into account when generating the simulated transfer times. First of all, the type of distribution used to generate the transfer times was determined. This was done based on the reallife transfer times. Several distributions types: Normal, LogNormal, Gamma, Nakagami, Logistic, LogLogistic, BirnbaumSaunders and Weibull, were selected based on visual inspection of the different datasets. To assess which of these distributions was the best fit, the parameters for each distribution and for each dataset were estimated using maximum likelihood estimation [25]. Subsequently, the KolmogorovSmirnov test was used to determine the probability that the evaluated distribution matched with the data [26]. The distribution with the highest average Pvalue (see Table 1) was the loglogistic distribution. This distribution is therefore used to generate the simulated data.
The LogLogistic distribution is a continuous probability distribution for a nonnegative random variable. It is the probability distribution of a random variable whose logarithm has a logistic distribution [27]. The probability density function (pdf) is defined through
and
with

μ = the location parameter

σ = the scale parameter

x = transfer time.
Using maximum likelihood estimation, μ and σ were estimated for a stable gait model based on the data in Fig. 1(b). As an unstable gait model typically has longer transfer times and more variability [21], μ and σ of an unstable gait model were therefore determined using this knowledge. A stable model was therefore defined by a small value for both μ and σ an unstable gait model in turn was defined by an increase in both μ and σ. The resulting probability density functions are shown in Fig. 2. Additionally, two models were defined combining the properties of both the stable gait model and the unstable gait model. An overview of the different parameters for each model is given in Table 2.
To determine the number of measurements on a certain day, a poisson distribution was used. Poisson distributions are typically used to express the probability of a given number of events occurring in a fixed interval of time [28], which is a good match with our application. The probability density function used to sample the number of measurements per day is:
with λ=5 chosen as the mean of the distribution.
Lastly, the method used to alter from a stable gait model to an unstable gait model and vice versa was implemented. During the transition period, the parameters of the gait model were determined using linear interpolation between the original and the new model. For each day in the transition period, a new set of distribution parameters was calculated.
The simulated data generator was built using MathWorks’ Matlab. The code will become available for download.
Simulated trainings dataset
To select and optimize the best method, three different types of simulation scenarios were chosen based on those observed in the reallife dataset: no trend present, one trend present and two trends present. For each type, two different scenarios were defined. An overview can be found in Table 3, one column corresponds with one scenario. Transfer time data for each possible simulation scenario was generated 20 times, resulting in 120 different datasets in total.
Simulated validation dataset
To validate the resulting method, an extended validation dataset was generated. The goal of this dataset was firstly, to validate the results acquired with the training set and secondly, to find the limitations of the selected method. To validate the results on the training set, the basic scenarios similar to the training set were generated. Additionally, the basic scenarios were generated with different transition lengths (0,4,8 and 12 weeks). Moreover, transition scenarios were also generated with a change in either μ or σ, resulting in transitions to TGM1 and TGM2 as defined in Table 2. Lastly, the number of measurements per day was halved. Each additional scenario type was simulated 20 times and was 52 weeks long resulting in 520 different validation simulation scenarios. An overview of the different simulation scenarios is given in Table 4, again one column corresponds with one scenario.
SPC techniques
SPC techniques are commonly used to check a process during its run and trigger an alert when variations, not inherent to the process, occur using control charts. In our research, control charts are consequently used to detect when one gait model transitions to another one which is consistent with the detection of small deviations from the first gait model. As the CUSUM and EWMA control charts are best fitted [29] the desired application, the remainder of this paper therefore focuses solely on CUSUM and EWMA control charts.
Typically a control chart has three lines: the Upper Control Limit (UCL), Lower Control Limit (LCL) and the Centre Line (CL). From the medians of the transfer times a sample statistic is calculated and subsequently plotted on the control chart. When a deviation occurs, the sample statistic is plotted outside the control limits and an alarm is triggered. To determine the range of natural variation in the transfer times, an initialization period of 14 days was defined. The mean of the measurements conducted in this period is used as the Central Line and a multiple of the standard deviation is used to define the Upper and Lower Control Limits.
CUSUM
CUSUM charts calculate the cumulative sum of the deviations of the observations from the target value. The deviations above the target value are accumulated in the positive CUSUM, whereas the deviations below the target value are accumulated in the negative CUSUM. Using this method, the information contained in the current time point and in the previous time points is taken into account, thus facilitating the detection of smaller shifts [29]. In our application one time point coincides with the median of the transfer times measured during one day.
When the transfer times remain stable at the target value, both the positive and negative CUSUM remain around zero. However, when the transfer time increases, a positive drift will develop in the positive CUSUM. If a trend develops in the medians of the transfer times, one of the Control Limits will be exceeded and an alarm will be triggered.
The literature differentiates between Tabular CUSUM and Standardized CUSUM. Both are therefore incorporated in this study.
Tabular CUSUM
With the Tabular CUSUM, the positive and negative CUSUM values are calculated using formulas:
and
In both formulas, μ _{0} is defined as the target value, which in our application corresponds to the mean of the measured transfer times during the initialisation period and x _{ i } is the current time point. K refers to the allowance or the slack value of μ _{0} and is often chosen halfway between the target value and the out of control value [29]. In our application K is expressed as a multiple of the standard deviation of the transfer times measured during the initialisation period:
As seen in formulas (4) and (5), both positive and negative CUSUMs accumulate deviations from the target value that are greater than K. If either exceeds the control limits:
an alarm is triggered. Both h and k are parameters that need to be set for an effective detection.
Standardized CUSUM
Standardized CUSUM uses similar formulas to those of the Tabular CUSUM chart. The value of x _{ i }, however, is first standardized using
After this standardization, the CUSUM chart is applied on these standardized values.
EWMA
The Exponentially Weighted Moving Average (EWMA) control chart is an alternative to the CUSUM chart when one is interested in detecting small shifts [29]. It accumulates the exponentially weighted moving average of all prior sample means. The samples are weighted in decreasing order so that the most recent sample gets the highest weight while the most distant samples contribute very little. The exponentially weighted moving average is calculated as
with λ the weighing factor chosen between 0 and 1. The starting value of z _{0} is chosen the same as the central value μ _{0}.
Upper control limit and lower control limit are calculated as
and
In these formulas, L determines the width of the control limits. Note that the term 1−(1−λ)^{2i} will become one when i gets larger. The Control Limits will therefore reach a steady state after several days. However, for small values of i this term will reduce the width of the Control Limits facilitating the detection of a process deviation immediately after the EWMA chart is started. Similar to both CUSUM control charts, μ _{0} corresponds with the mean of the measured transfer times during the initialization period and σ with the standard deviation of the same period.
Rational Subgroups
In literature a rational subgroup typically is a group of samples which are collected under the same set of conditions. The variation between the samples in the same subgroup is similar to the inherent variation of the process [29]. As the median per day is used as input for the control charts a form of rational subgroups is already implemented in the basic methods. If however there is a difference in the number of measurements within a subgroup, which is the case in our application, Montgomery et al. advise to take this number into account. Within the suggested methodology the number of measurements is used to determine the width of the control limits [29]. This is done in the CUSUMbased methods by dividing K, UCL and LCL with \({\sqrt {n_{i}}}\) and in the EWMAbased methods by dividing L with \({\sqrt {n_{i}}}\), where n _{ i } is the number of measurements that are used to calculate the median per day.
Reinitialization
Multiple trends can present themselves subsequently in the transfer times. As the control charts are initialized based on the first two weeks of acquisition data, a subsequent trend could remain undetected. To ensure the detection of any subsequent trends, the control charts can be reinitialized after three consecutive alarm days. This reinitialization is done by replacing the mean and standard deviation of the measured transfer times calculated during initialization period, with those calculated during the 14 days prior to the last alarm day. When the first trend is detected, the control chart will therefore be reinitialized based on the more recent data, facilitating the detection of any subsequent trends.
Experimental setup
The previously described SPC techniques were evaluated on the training set. From this evaluation, the two best performing methods were optimized for the desired application. Next, the validation data was used to validate the training set results and the best performing method was selected. This was followed by an assessment of the limits of the chosen method.
General approach
To assess if the different methods can successfully detect transitions in the data during the transition period, three evaluation criteria were selected. These criteria were calculated over multiple datasets of the same type (e.g. all the simulation datasets containing a SGM to UGM), and are as follows:

1.
Detection Rate (DR)
The Detection Rate is the percentage of the detected transitions. For our application, it is necessary that the number of transitions that are not detected is kept as low as possible. Ideally, all transitions trigger an alert (=100 % Detection Rate).

2.
Average Run Length (ARL)
Montgomery et al. defined the ARL of a control chart as the number measurements or subgroups needed to detect a transition [29]. In our application this corresponds with the number medians and thus the number of days which pass between the start of a transition and the detection of this transition. This time needs to be kept as short as possible to enable healthcare workers to respond quickly to changes in health. If there is no detection, no ARL is calculated.

3.
Average number of false alerts per week (FPR)
This is the average number of alerts triggered during one week for one person when there is no transition. As the median per day is used as input of the control charts only one false alert can be triggered per day. The number of measurements per day or per week do not influence this number.
If the sample statistic is plotted outside the control limits for more than two consecutive days this is counted as one alarm. An alarm is considered correct when it occurs during the transition period. An alarm is a false alarm when it presents itself at least two days prior to the transition period or after the transition period. One exception was applied to these rules in simulation scenarios where a sudden change in gait model was present (a transition period of 0 days). In this case an alarm was deemed correct when it occurred within 4 days after the sudden change. Before or after this 4 day period, an alarm is deemed as a false alarm.
Evaluation of the different SPC techniques
The training set was used to evaluate the performance of the different SPC techniques. The parameters for both CUSUM and EWMA charts were chosen based on a rule of thumb when aiming for a fast detection of small changes with \(k=\frac {1}{2}\) and h=3 for both types of CUSUM charts and with λ=0.15 and L=3 for the EWMA chart [29].
Optimization
After the evaluation of the different SPC techniques, the two topranked methods were selected. Subsequently, the parameters of these methods were further optimized. This was done by calculating DR, ARL and FPR for the training set using a wide variety of parameter combinations. For the CUSUMbased method k varied between 0 and 1, and h varied between 2 and 4. For the EWMA based method λ varied between 0 and 1, and L varied between 2 and 4.
After this, the mean of the DR, ARL and FPR was calculated for each possible combination of both parameters over the different simulation scenarios. This was subsequently plotted in a ROClike plot with DR and ARL on the X and Yaxis, adding color information for the number of false alarms. The operating point with the best possible combination for all three criteria, giving higher importance to DR and ARL, was subsequently determined based on this plot. After determining the new operating point and comparing the results for both topranked methods, the best performing method was selected.
Validation & experimental methodology
The validation of the best method was performed in three stages. First, the results after optimization were compared to those on a validation set consisting of similar scenarios as the training set. After this the following items were investigated:

The effect of a variation in the transition length on the detection results;

The effect of a change in simulation parameters on the detection results;

The effect of a reduction in the average number of measurements per day on the detection results;

The effect of the initialization period length on the detection results.
Lastly, the optimized method was validated on the reallife dataset.
Results
Evaluation of the different SPC techniques
The results of evaluating the different SPC techniques are given in Table 5. From this table the following observations can be made:
Firstly, there is a lower detection rate when using the standard SPC techniques with transitions from stable to unstable as opposed to transitions from unstable to stable. This is mainly due to the small zone which is defined between the control limits based on the stable gait model, combined with the wide variability present in an unstable gait model. It is therefore less likely to have two consecutive days, during the transition period, on which the data points reside at the same side of the upper and lower control limits.
Next, it can be observed that the ARL of the different methods increases when the rational subgroups method is implemented. When implementing this method, days on which a small number of measurements are present have a smaller influence on the calculated CUSUM or EWMA values. Following this, if at the beginning of the transition period some days have fewer measurements they will delay the detection of the transition.
Moreover, the same increase of ARL can be seen when implementing the reinitialization after three consecutive alarm days. This is caused by the reinitialization when three consecutive days trigger a false alarm. The wider control limits that result from this reinitialization increase the number of days needed to detect an actual transition. If, however, no reinitialization is done, subsequent trends could not be detected.
The Standardized CUSUM has the lowest detection rate, making it not suitable for our application. EWMA and Tabular CUSUM both have better detection rates. The detection rates for both EWMA and Tabular CUSUM were further improved by implementing the reinitialization after three alarm days and by using the rational subgroups method. After this, EWMA has slightly better detection rates than Tabular CUSUM. FPR and ARL of both Tabular CUSUM with a reinitialization after three alarm days (TCRA) and EWMA with reinitialization and rational subgroups (ERSRA) are however similar to each other. Both methods were therefore further optimized for our application.
Optimization
The optimization graphs for both topranked methods (Fig. 3) show that a small improvement in detection rates can be reached and that a shorter ARL causes an increase in the average number of false alarms per week. However, since the number of false alarms per week remains very low and due to the fact that a transition from one gait model to another needs to be detected as fast as possible, an improvement in the ARL is desirable. The choice was therefore made to determine a new operating point on these graphs by aiming to raise the detection rate further and to shorten the ARL.
The new operating point, as well as the point resulting from the parameters, as chosen by the rule of thumb, are both plotted on the graphs. The improvements made by changing the operating point are given in Table 6.
As both the values for λ and k remain close to those chosen by the rule of thumb (see Table 6), the improvement in both ARL and DR are mainly due to the lowering of L for EWMA and h for Tabular CUSUM. This corresponds with lowering the control limits, therefore creating a smaller zone in which variations in the transfer times are considered normal.
Both Table 6 and Fig. 3 show that the highest DR and shortest ARL can be achieved with the EWMA method with rational subgroups implemented and a reinitialization after three consecutive alarm days. λ and L were optimized into resp. 0.18 and 2. This method will be further validated in the paper.
Validation
Validation on the training set
After optimization the results from the training set were validated using a set of similar simulation scenarios (see Table 4). The results from this validation, shown in Table 7, confirm the prior results for DR as well as ARL and FPR.
Variation in transition length
The scenarios from the training set had a transition length of four weeks. The different simulation scenarios were also generated with varying transition lengths of 0, 4, 8 and 12 weeks.
Table 8 demonstrates that a longer transition length causes a longer ARL. Since the model parameters during the transition period are determined through interpolation, a longer transition period causes smaller daily changes and hence it takes longer for the algorithm to detect a significant change. In contrast, when a sudden change in transfer time is present, the ARL is substantially shorter. DR and FPR are not influenced by a change in transition length.
Change in the gait model parameters
Based on the reallife data a change in gait model was characterized by a change in both parameters μ and σ. A dataset containing transitions characterized by a change in either μ or σ was also included in the validation set (gait models TGM1 and TGM2).
The results from these datasets compared to those of the training set (see Table 9) demonstrate that a transition characterized by a single change in μ yields similar results to those where a change in both parameters was present. If in contrast only σ changes during the transition, the detection rate is much lower.
Change in the number of measurements per day
The training set was generated with a varying number of measurements each day (between 0 and 10). A dataset was added to the validation set in which only half the number of measurements was used to generate the data.
Table 10 indicates that a reduction in the number of measurements per day does not influence the performance of the control chart.
Change in the length of the initialization period
To assess the necessary length of the initialization period, the ARL, DR and FPR were calculated for all scenarios with a transition period of four weeks and with an initialization period varying from 1 to 60 days. The three criteria were averaged for each initialization period length. This resulted in one value per criteria and per initialization period length. These are shown per criteria in Fig. 4. An optimal Detection Rate is reached with an initialization period of 4 days. For both ARL and the average number of FPR, a longer initialization period is needed. Both, however, show that an initialization period of more than 14 days does not result in an important improvement of the results.
Validation on the reallife datasets
After training and validation on simulation data, the algorithm was further validated on the reallife dataset. Three different scenarios were collected during the reallife acquisition. Firstly, two participants were monitored who had a stable gait during the whole acquisition period. Secondly, transfer times of a participant with a very unstable gait during the whole acquisition period were collected. Lastly, a person who transitioned from an unhealthy gait to a healthy gait and transitioned back to an unhealthy gait was monitored.
The first participant (Fig. 5(a) and (b)) had a stable gait model during the whole acquisition period and triggered no false alarms during this period.
Although the second participant was reported being in good health during the acquisition period two consecutive alarms were triggered (Fig. 5(c) and (d)). These alarms were caused by the three consecutive days prior to these alarms. On these days, longer transfer times were recorded which could indicate that some healthrelated problems were present during these days prior to the alarm.
The third participant had a very unstable gait during the whole acquisition period (Fig. 6(e) and (f)). Although this was a very unstable gait, no changes in health were reported and no alerts were triggered by our algorithm.
The last participant started the acquisition period with an unstable gait. The gait improved slightly during the acquisition period, but given that this improvement was quite small, no alerts were triggered. After this improvement, the participant experienced a rapid decline in health after a stroke, which is visible in the measured transfer times. This resulted in two alarms (Fig. 6(g) and (h)).
Discussion
This study reports on the selection, optimization and extensive validation of a system to automatically detect changes in the health of older adults using transfer times. The best performing method was the EWMA control chart implemented with rational subgroups and a reinitialization after three consecutive alarm days. After optimization, the selected method had a detection rate of 100 % and an average run length of 9.65 days when the length of the transition period was 28 days. These results were confirmed using a separate validation dataset, confirming the suitability of the presented method for the application at hand.
There are still some aspects of the system that warrant further clarification.
The design process
The tabular CUSUM, standardized CUSUM and EWMA control charts were evaluated because of their ability to detect small shifts in the data and their good performance with skewed distributed data. These control charts, however, still assume that the data is normally distributed. Some control charts can be optimized for a loglogistic distribution such as the Shewart Chart and the Range Chart. These charts are in comparison with the EWMA and CUSUM control charts, less suited to detect small shifts. They were therefore not incorporated in this research.
To evaluate the different control charts simulated data, generated based on previously acquired reallife data was used. The number of reallife datasets was limited. When generating simulated data some scenarios which did not fit the reallife data were also incorporated to reduce the risk of overfitting on the reallife data. Theoretical gait models were incorporated in these scenarios as well as different transition period lengths and a varying number of measurements per day.
Furthermore, in previous studies it was shown that some noise is present in the measured transfer times. This noise is due to imperfect preprocessing steps and changes in the used walking aid [21]. To reduce the influence of noisy measurements on the control charts a median was calculated per day and used as input for the control charts. The rational subgroups methods was also implemented to reduce the influence of a day with a small number of measurements on the performance of the control charts and therefore reducing the number of false alarms.
The Western Electric rules were implemented to further improve the performance of the control charts. These are decision rules used for the detection of outofcontrol conditions on control charts. Since the desired goal was the detection of process instabilities the socalled zone rules were applied. These rules specify that a process is out of control when two or three consecutive points fall beyond a predefined zone [30]. Based on this an alert is triggered when either the positive/negative CUSUM value or the EWMA value is outside the Control Limits for at least two consecutive days.
Lastly, a reinitialization after three consecutive alarm days was implemented to facilitate the detection of subsequent trends.
Strengths and weaknesses of the presented method
Based on the simulated data, the proposed system will report one false alert every five weeks. Although some of these false alarms are due to outliers in the generated data and hence still of interest, the system should under ideal conditions produce less false alerts whilst maintaining the current detection rate. When one would widen the control limits to decrease the number of false alerts, the ARL will generally lengthen and the detection rate will decrease. Similarly, when the control limits are tightened, the opposite happens. However, since a false alert is triggered when the measurements of two subsequent days are substantially different to those of the previous days, it could indicate that some health problems are apparent during those days. Although no transition is present when such an alarm is triggered, a visit of a healthcare professional might still be needed. A compromise was therefore sought between detection rate, ARL and the average number of false alerts per week.
When using the presented methodology, it is assumed that all values between the Upper Control Limit and the Lower Control Limit are good. However, a value closer to the Central Line is better than one closer to the Control Limits. It could therefore be useful to trigger a first alarm if on several subsequent days the time points reside close to the Control Limits. This can be done by implementing more of the Western Electric zoning rules. These rules also describe when an alarm should be triggered, even when a time point lies between the Control Limits, depending on its distance to the Central Line and the previous points.
A transfer could remain undetected when a transition period starts and ends during the initialization period. If it starts at the end of the initialization period and ends after the initialization period, the transition, however, can still be detected depending on the length of the transition period and the change in μ after the initialization period. The number of days needed to detect the transition will increase. It is therefore advised to keep the initialization period as short as possible.
The major strength of the presented method is that it is a generic method. Although the presented research monitored changes in transfer times, it could equally well be applied to gait speed or other quality characteristics such as step length, stride length and activity level. However, a new optimization phase might be necessary to find the optimal values for both λ and L.
Conclusion
The system presented in this paper is able to detect both positive and negative trends in the transfer times of older adults, therefore automatically triggering an alarm when gradual and abrupt changes in transfer times, which are closely linked to gait speed, occur. Since previous research has shown that changes in gait speed can have a predictive value for a broad array of adverse events, several research groups have already designed and validated systems which can measure the gait speed of a person on a daily basis. They however do not trigger alerts and a healthcare worker is needed to review the data. It is therefore anticipated that the presented technique can provide a valuable addition to existing gait monitoring systems.
Availability of supporting data
The simulated data generator was built using MathWorks’ Matlab. The code will become available for download on the website: www.kuleuven.be/advise/datasets. Due to ethical regulations the reallife datasets are not publicly available.
Abbreviations
 ARL:

average run length
 CUSUM:

CUmulative SUM control chart
 CL:

central line
 DR:

detection rate
 EWMA:

exponentially weighted moving average (EWMA) control chart
 E:

EWMA
 ERA:

EWMA reinitialize alarm
 ERS:

EWMA rational subgroups
 ERSRA:

EWMA reinitialize alarm rational subgroups
 FPR:

false positive rate
 LCL:

lower control limit
 SPC:

statistical process control
 SC:

standardized CUSUM
 SCRA:

standardized CUSUM reinitialize alarm
 SCRS:

standardized CUSUM rational subgroups
 SCRSRA:

standardized CUSUM reinitialize alarm rational subgroups
 SGM:

stable gait model
 TC:

tabular CUSUM
 TCRA:

tabular CUSUM reinitialize alarm
 TCRS:

tabular CUSUM rational subgroups
 TCRSRA:

tabular CUSUM reinitialize alarm rational subgroups
 TGM:

theoretical gait model
 TGUG:

timedgetupandgo
 UCL:

upper control limit
 UGM:

unstable gait model
References
Steele R, Lo A, Secombe C, Wong YK. Elderly persons’ perception and acceptance of using wireless sensor networks to assist healthcare. Int J Med Inform. 2009; 78(12):788–801.
Demiris G, Hensel BK, Skubic M, Rantz M. Senior residents’ perceived need of and preferences for “smart home” sensor technologies. Int J Technol Assess Health Care. 2008; 24(01):120–4.
Wild K, Boise L, Lundell J, Foucek A. Unobtrusive inhome monitoring of cognitive and physical health: Reactions and perceptions of older adults. J Appl Gerontol. 2008; 27(2):181–200.
Celler B, Earnshaw W, Ilsar E, BetbederMatibet L, Harris M, Clark R, Hesketh T, Lovell N. Remote monitoring of health status of the elderly at home. a multidisciplinary project on aging at the university of new south wales. Int J Biomed Comput. 1995; 40(2):147–55.
Viccaro LJ, Perera S, Studenski SA. Is timed up and go better than gait speed in predicting health, function, and falls in older adults?J Am Geriatr Soc. 2011; 59(5):887–92.
Peel NM, Kuys SS, Klein K. Gait speed as a measure in geriatric assessment in clinical settings: a systematic review. J Gerontol Ser A Biol Sci Med Sci. 2013; 68(1):39–46.
Van Kan GA, Rolland Y, Andrieu S, Bauer J, Beauchet O, Bonnefoy M, Cesari M, Donini L, GilletteGuyonnet S, Inzitari M, et al. Gait speed at usual pace as a predictor of adverse outcomes in communitydwelling older people an international academy on nutrition and aging (iana) task force. J Nutr Health Aging. 2009; 13(10):881–9.
Rochat S, Büla CJ, Martin E, SeematterBagnoud L, Karmaniola A, Aminian K, PiotZiegler C, SantosEggimann B. What is the relationship between fear of falling and gait in wellfunctioning older persons aged 65 to 70 years?Arch Phys Med Rehabil. 2010; 91(6):879–84.
Bautmans I, Jansen B, Van Keymolen B, Mets T. Reliability and clinical correlates of 3daccelerometry based gait analysis outcomes according to age and fallrisk. Gait & Posture. 2011; 33(3):366–72.
Taylor ME, Ketels MM, Delbaere K, Lord SR, Mikolaizak AS, Close JC. Gait impairment and falls in cognitively impaired older adults: an explanatory model of sensorimotor and neuropsychological mediators. Age Ageing. 2012; 41(5):665–9.
Stone EE, Skubic M. Capturing habitual, inhome gait parameter trends using an inexpensive depth camera. In: Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. IEEE: 2012. p. 5106–9. doi:10.1109/EMBC.2012.6347142.
MonteroOdasso M, Verghese J, Beauchet O, Hausdorff JM. Gait and cognition: a complementary approach to understanding brain function and the risk of falling. J Am Geriatr Soc. 2012; 60(11):2127–136.
Bridenbaugh SA, Kressig RW. Laboratory review: the role of gait analysis in seniors’ mobility and fall prevention. Gerontology. 2011; 57(3):256–64.
Espy DD, Yang F, Bhatt T, Pai YC. Independent influence of gait speed and step length on stability and fall risk. Gait & Posture. 2010; 32(3):378–82.
MonteroOdasso M, Schapira M, Soriano ER, Varela M, Kaplan R, Camera LA, Mayorga LM. Gait velocity as a single predictor of adverse events in healthy seniors aged 75 years and older. J Gerontol Ser A Biol Sci Med Sci. 2005; 60(10):1304–1309.
Hagler S, Austin D, Hayes TL, Kaye J, Pavel M. Unobtrusive and ubiquitous inhome monitoring: a methodology for continuous assessment of gait velocity in elders. IEEE Trans Biomed Eng. 2010; 57(4):813–20.
Ibrahim RK, Ambikairajah E, Celler B, Lovell NH, Kilmartin L. Gait patterns classification using spectral features. Dublin: IET Ireland; 2008.
Hayes TL, Hagler S, Austin D, Kaye J, Pavel M. Unobtrusive assessment of walking speed in the home using inexpensive pir sensors. In: Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE. IEEE: 2009. p. 7248–251.
Phillips CE, Keller J, Popescu M, Skubic M, Rantz MJ, Cuddihy PE, Yardibi T. Radar walk detection in the apartments of elderly. In: Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE. IEEE: 2012. p. 5863–866.
Baldewijns G, Debard G, Mertens M, Devriendt E, Milisen K, Tournoy J, Croonenborghs T, Vanrumste B. Semiautomated videobased inhome fall risk assessment. Assistive Technology: From Research to Practice: AAATE 2013. 2013; 33:59.
Baldewijns G, Debard G, Mertens M, Devriendt E, Milisen K, Tournoy J, Croonenborghs T, Vanrumste B. Automated inhome gait transfer time analysis using video cameras. J Ambient Intell Smart Environ. 2015. (Accepted).
Boggs P, Hayati F, Washburne W, Wheeler D. Using statistical process control charts for the continual improvement of asthma care. Jt Comm J Qual Improv. 1999; 25(4):163–81.
Cornélissen G, Halberg F, Hawkins D, Otsuka K, Henke W. Individual assessment of antihypertensive response by selfstarting cumulative sums. J Med Eng Technol. 1997; 21(3–4):111–20.
Baldewijns G, Luca S, Nagels W, Vanrumste B, Croonenborghs T. Automatic detection of health changes using statistical process control techniques on measured transfer times of elderly. In: Engineering in Medicine and Biology Society (EMBC), 2015 Annual International Conference of the IEEE. IEEE: 2015.
Hamilton JD. Time Series Analysis vol. 2: Princeton university press Princeton; 1994.
Wilcox R. Kolmogorov–smirnov test. Encycl Biostat. 2005; 4:2174–6.
Shoukri M, Mian I, Tracy D. Sampling properties of estimators of the loglogistic distribution with application to canadian precipitation data. Can J Stat. 1988; 16(3):223–36.
Consul PC, Jain GC. A generalization of the poisson distribution. Technometrics. 1973; 15(4):791–9.
Montgomery DC. Introduction to Statistical Quality Control. Hoboken, NJ: John Wiley & Sons; 2007.
Noskievičová D. Complex control chart interpretation. Int J Eng Bus Manag. 2013; 5:1–7.
Acknowledgements
This work is funded by the iMinds FallRisk project and through the “ingenieurs@WZC”project which was funded by ‘Provincie VlaamsBrabant’.
This work is also funded by the FWO via project G039811N: “Monitoring van gedrag en ongebruikelijke menselijke activiteit met meerdere camera’s”, by the IWT via TETRA project 80150 “Fallcam: Detection of fall in older persons with a camera system” and by the EU via ERASME (FP7) project IWT 100404 “AMACS: AutomaticMonitoring of Activities using Contactless Sensors.”
The authors would like to acknowledge the following projects: ICT cost action IC1303 “Algorithms, Architectures and Platforms for Enhanced Living Environments (AAPELE)” and “Prevention of Falls Network for Dissemination (ProFouND)”.
The authors would furthermore like to thank the persons who participated in the research by giving their permission to be monitored for several months.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
GB jointly conceived the study with SL and TC. The data was simulated and the different SPC techniques were evaluated by GB and SL with advice from TC and BV. GB and TC performed the optimization and the validation on both simulated data and reallife data with advice from SL and BV. GB wrote the manuscript. SL, BV and TC critically reviewed the manuscript before submission. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Baldewijns, G., Luca, S., Vanrumste, B. et al. Developing a system that can automatically detect health changes using transfer times of older adults. BMC Med Res Methodol 16, 23 (2016). https://doi.org/10.1186/s1287401601244
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1287401601244