Estimating the size of hidden populations from register data
 Anders Ledberg^{1}Email author and
 Peter Wennberg^{1}
DOI: 10.1186/147122881458
© Ledberg and Wennberg; licensee BioMed Central Ltd. 2014
Received: 14 January 2014
Accepted: 15 April 2014
Published: 27 April 2014
Abstract
Background
Prevalence estimates of drug use, or of its consequences, are considered important in many contexts and may have substantial influence over public policy. However, it is rarely possible to simply count the relevant individuals, in particular when the defining characteristics might be illegal, as in the drug use case. Consequently methods are needed to estimate the size of such partly ‘hidden’ populations, and many such methods have been developed and used within epidemiology including studies of alcohol and drug use. Here we introduce a method appropriate for estimating the size of human populations given a single source of data, for example entries in a healthcare registry.
Methods
The setup is the following: during a fixed timeperiod, e.g. a year, individuals belonging to the target population have a nonzero probability of being “registered”. Each individual might be registered multiple times and the timepoints of the registrations are recorded. Assuming that the population is closed and that the probability of being registered at least once is constant, we derive a family of maximum likelihood (ML) estimators of total population size. We study the ML estimator using Monte Carlo simulations and delimit the range of cases where it is useful. In particular we investigate the effect of making the population heterogeneous with respect to probability of being registered.
Results
The new estimator is asymptotically unbiased and we show that high precision estimates can be obtained for samples covering as little as 25% of the total population size. However, if the total population size is small (say in the order of 500) a larger fraction needs to be sampled to achieve reliable estimates. Further we show that the estimator give reliable estimates even when individuals differ in the probability of being registered. We also compare the ML estimator to an estimator known as Chao’s estimator and show that the latter can have a substantial bias when applied to epidemiological data.
Conclusions
The population size estimator suggested herein complements existing methods and is less sensitive to certain types of dependencies typical in epidemiological data.
Keywords
Prevalence Hidden population Capturerecapture Truncated Poisson Opiates Heroin MortalityBackground
We consider the problem of estimating the size of an incompletely sampled population. That is, given “information” on some individuals from a more less welldefined population we want to estimate the total number of individuals in this population. A typical example could be to estimate the total prevalence of “problem drug use” from known cases in healthcare or judiciary records. This is a question of some priority both at national (e.g. [1, 2]) and international (e.g. [3]) levels.
There are two related approaches that have been previously applied to similar problems given epidemiological data, including data on alcohol and drug misuse (e.g. [4, 5]). In the first approach individual data from a number of different sources are collected and matched. Prevalence estimates are then formed using socalled capturerecapture techniques (e.g. [6]). The types of data sources used obviously depend on the target population and might include records from: health care, treatment programs, needle exchange program, police, and prison system (e.g. [7, 8]).
In the second approach, data from only one source is used and a probability model of the registration frequencies is assumed. This probability model is typically a zerotruncated distribution, for example truncated Poisson. The zero frequency is estimated from data and an estimate of the population size is then obtained [9–12].
Both these approaches rely on a number of assumptions that may or may not hold in real situations (e.g. [4, 13]). The approach using multiple sources suffer from a nonclear definition of the target population (e.g. do needle exchange program and police records for drug offenses really target the same population?) as well as general problems of dependencies between samples. The second approach, relying on a single source, avoids the first problem but might give strongly biased estimates unless a reasonable model of the frequency distribution is chosen.
Here we suggest a novel approach to population size estimation from a single source of data. This approach is tailored to epidemiological data and relies on a minimum of assumptions. We assume that all individuals in the target population have a nonzero probability of being registered during a given time interval. By using only the timepoints of first contact with the registry we avoid effects of previous registrations. Given this setup, it is straight forward to derive the maximum likelihood (ML) estimator of the population size (N). We note that the resulting approach is formally identical to the captureandremove approach previously used in populationbiology (cf. [14–16]).
We evaluate the ML estimator of N using extensive Monte Carlo simulations and further compare its performance to another estimator known as Chao’s estimator [17]. The two estimators are also applied to health care registry data in a case where the true N is known.
Methods
Outline and notation
Next we will detail how such register data can be used to estimate the total size N of the population. First we will describe the novel ML approach and then an approach that has been previously used with data of thistype.
Maximum likelihood estimation of N
Here we describe how the data in the register can be used to estimate N using ML (see Figure 1 for illustration). First the observation interval is divided into M nonoverlapping epochs with equal duration d. That is, the jth epoch, I _{ j } is given by I _{ j }=[t _{0}+d(j−1),t _{0}+d j) where t _{0} denotes the time point when the observations start and j=1,2,…,M. We will assume that time is discrete and that there are d opportunities to be registered in an interval of duration d. For each of the M epochs we count the number of new persons being registered in that epoch. That is, we count the persons registered during epoch I _{ j } that were not registered in any of the previous epochs. These numbers will be called n _{1},n _{2},…,n _{ M } and are used in the following to represent both random variables and samples of these random variables. It is n _{1},n _{2},…,n _{ M } that constitute the data we will use to estimate the total number of persons in the population (i.e. N). The number of intervals M>1 is a parameter in the suggested method and we will study how the estimate of N depend on M below.
Given the loglikelihood function (Eq. 2) we take as our estimate of population size the value of N that maximizes that expression (henceforth denoted N _{ M L }). Note that we simultaneously estimate the registration probability p, but since this is not the parameter of main interest, we will focus on the estimator of N.
For the case M=2 the maximum of the likelihood function is given by ${N}_{\mathit{\text{ML}}2}={n}_{1}^{2}/({n}_{1}{n}_{2})$. However, in the general case, the maximum likelihood estimates are easiest found by maximizing Eq. 2 numerically, for example using Newton’s method. It should be noted that the ML estimator is not applicable for all samples. For the case M=2, for example, n _{1} must be greater than n _{2}. General conditions for when the ML estimator is applicable have been derived before [18]. As we will show later, in cases where the ML estimator give good estimates of N, it is very unlikely to get a sample for which the ML estimator does not exist.
Truncated poisson estimate of N
Given a single source of data with possible multiple registrations per person there are alternative estimates of populations size that can be (and have been) used. The simplest of these estimates can be derived if one assumes that the sampled data follow a zerotruncated Poisson distribution (this is just a reweighted standard Poisson distribution in which the zero bin is not observed). We note that if the probability π of being registered at each time point is independent of previous registrations, and there are T time points in total, then the number of registrations for each subject is distributed as a binomial variable with parameters T and π. Given reasonable values of these parameters, the distribution of the number of registrations will closely follow a Poisson distribution with parameter λ=defT π (e.g. [19]). Consider for example that observations are made daily for a year, then T=365, and if the probability of being registered at least once in a year is 0.3 then π≃0.001 which gives λ≃0.36. These are values for which the Poisson approximation of the Binomial distribution is very good and, consequently, a zero truncated Poisson distribution is a natural choice to model the distribution of the registrations.
By the law of large numbers we know that N _{ C } will be close to N when N is large. We will investigate the convergence further below. This estimator (N _{ C }) was first derived in [17], using a more general formalism and we will refer to N _{ C } also as Chao’s estimator.
This estimate was derived in [10] using a different approach.
Monte Carlo simulations
To evaluate the performance of the estimators we performed Monte Carlo simulations. In these simulations we generated data for 512 ‘time steps’ (e.g. days) where each of N individuals has a probability p of being registered. Simulations where run for different values of N and different values of p (described in the Results). All simulation results were based on 5000 realizations. For the ML estimator the maximum of the likelihood (Eq. 2) was found numerically (for M>2) using Newtons method. In some cases the method did not converge, something that often was due to a failure of automatically specifying initial conditions within the region of convergence. In such cases a small change to the initial conditions is often sufficient for convergence. Since there is an explicit expression for the case M=2, the corresponding estimate is a good starting point for the algorithm. Although it is possible (in particular for small samples) to get data for which the ML estimator does not exists [18], for our purposes problems of convergence were very rare in all cases where the estimator will be useful in practice (see Results). An indication that a sample is not suited for the ML estimator is if n _{1}≤n _{2} (for the case of M=2), and if so other methods of estimation must be used.
The ML estimator was derived assuming that all the individuals in the population have the same registration probability, something that translates to p in the simulations is the same for individuals. To model the effect of heterogeneity in the target population we run simulations where we allowed p to vary from individual to individual. In particular, the ps were randomly sampled from a normal distribution with a fixed mean value. The parameter used to control population heterogeneity was the standard deviation of the normal distribution. This way the effect of increasing population heterogeneity can be studied systematically from a constant p (zero standard deviation) to ps that vary a lot between individuals (large standard deviation). We also run simulations where we sampled ps from uniform distributions but the results were similar to those obtained using a normal distribution and are therefore not shown.
Empirical data
Apart from the evaluation done on simulated data, we also wanted to use the suggested method on ‘real’ data. Here it was deemed important to use a data set where N could be assumed known, since then we can evaluate how close to the true value the different estimates are. We approached this by using as our target ‘population’ the accidentally deceased opiate misusers (fatal overdoses) in Sweden during 2006–2011. Most such cases occur outside of hospitals and the causes of death are therefore investigated in detailed forensic autopsies (including a toxicological analysis). We can therefore use the central Swedish Causes of Death registry held by The National Board of Health and Welfare (Socialstyrelsen) to count these cases and get a reasonably precise value of N.
To identify the deceased persons making up the target population we proceeded as follows. We selected all persons between 23 and 60 years of age at the time of death who were listed in the causes of death registry with heroin or methadone poisoning (ICD10 codes T40.1 and T40.3) as contributing cause of death. This choice of substances should be obvious. However, there are also a substantial number of cases with morphine poisoning (T40.2) but these were not included as they were judged to constitute a mixed group of individuals, where only some are opiate misusers in the sense relevant here. The upper age limit was to minimize the number of cases where methadone had been medically prescribed and used in pain management therapy. The lower age limit was to enable a search of five year medical history for all individuals (we are tacitly assuming that most younger persons in this population had started their opiate misuse by the time they were 18 years old). We furthermore excluded all cases that were judged to be suicides. After applying these criteria there were 486 persons remaining who can be assumed to have misused opiates on a regular basis and these 486 will constitute our target population. To evaluate the population size estimators we will now see how well we can estimate the size of this population from another set of data. For this we will use health care data as described next.
For each of the N=486 individuals in the population we extracted information on previous contacts with the Swedish health care system by using the National Patient Registry (held by The National Board of Health and Welfare). This registry contains all instances of inpatient care in Sweden with good coverage and contains the main diagnosis (classified according to the WHO ICD10 classification system) and time points for care. For the target population we extracted for all occurrences of inpatient care under diagnoses indicative of substance misuse. In particular, we used the following ICD10 diagnoses: F11F16, F18, and F19 and restricted the search to five years immediately preceding the time of death. During these time intervals 262 of the 485 persons (54%) had been receiving care under these diagnoses. We note that this might be taken as support for the assumption that the 485 persons constitute a relatively homogeneous population with respect to substance misuse. There were a total of 1165 hospital records from these 262 persons and most individuals had more than one care occasion. These healthcare records will be used below to estimate N.
Since the individuals were all deceased at the time of project initiation, ethics committee approval was not necessary according to the regional research ethics board (Etikprövningsnä mnden i Stockholm).
Results
This section starts with a study of the ML estimator and its performance under variations of total population size and fraction of the populations actually sampled. We then go on to study the effect of introducing variability (from unit to unit) in the registration probability (i.e. we make the population heterogeneous) and then the effect of the number of epochs that the sampling interval is divided into. Subsequently we will study Chao’s estimator and describe when it will fail to provide good estimates. Finally we apply the estimators to a real data set.
Variability and bias of the ML estimator
Ideally, an estimator of population size should always give the right answer. However, since the estimator is computed from data (assumed to be random) it will both be variable (i.e. will give different results for different realizations) and it might have a bias (i.e. the expected value of the estimator might differ from the true value). In this section we study how the variance and bias of the estimator depend on total population size (N) and the fraction of N that is sampled (observed).
To investigate the bias of the estimator we divided the sample means from the simulations with their corresponding theoretical value (i.e. with the corresponding Ns). The resulting measure will be referred to as relative bias. Note that a relative bias of one means that the estimator is unbiased. Figure 2B shows the relative bias for the parameter values investigated. For sufficiently large fraction of sampled units, the bias goes to zero independently of population size N. However, for smaller fractions sampled, the bias can be substantial and for the two smallest populations (N=500 and N=1000) the bias is a nonmonotonous function of sample size; it starts of with a substantial negative bias that later becomes positive before going to zero (relative bias going to one).
If we consider these bias and variance results together they show that whether the ML estimator is useful or not depends strongly on both N and the sample size. For example, if the true N is in the order of 50000 then already with a sampled fraction of about 15% (i.e. a sample size of 7500) very good estimates are typically obtained. If, on the other hand, the true N is around 500 the sampled fraction should not be less than 55% (sample size of 275) for the estimator to be reasonably accurate.
Population heterogeneity
So far we have assumed that the population is homogeneous with respect to the probability of being registered in each time interval (at least before being registered the first time). This translates to a constant p for all ‘subjects’ in the simulations. In the real world this assumption is obviously unrealistic and in this section we study the effects of relaxing it (see Methods).
Choosing M
In applications of the captureandremove method in population biology the number of observation occasions (captures) might often be determined by the design of the study. In epidemiology, on the other hand, we typically have a certain freedom to choose the number of ‘observation occasions’ (epochs, denoted M herein). Indeed, we might have access to daily registrations for a year or more and it is therefore of interest to see how dividing the total time interval into epochs of different length will influence the performance of the estimator. We investigated this by running Monte Carlo simulations for different values of M. We used M=2,4,8,16,32, and since the total time interval consisted in 512 observation units (‘days’) we used exactly the same data in all these five cases. Note that the case M=2 is special in that a closedform expression exists whereas for M>2 the ML estimate has to be found iteratively.
For smaller fractions of the population size the different estimators have less regular behavior, and correlation between different estimates might be as low as 0.35. Varying M and comparing the resulting estimates might therefore constitute a check that a sufficient fraction of the total population has been sampled.
Truncated poisson estimation
A simple alternative to the estimator we are suggesting when having data from one source is to assume that the samples come from a zerotruncated distribution and use all, or parts of the data to estimate the unobserved zero bin (e.g. [10]). For the type of data considered here a powerful and often used estimator goes under the name of Chao’s estimator. For the truncated Poisson distribution this estimator is easy to derive (Methods) but it was originally derived in a more general setting [17]. In this section we investigate the performance of this estimator (N _{ C }) and will see how it fails when we introduce simple dependencies between the probabilities of beingregistered.
We note that there are alternative ‘truncated Poisson’ estimators and one that has been applied was suggested in [10] and is also derived in the Methods. We made extensive tests using also this estimator and on our simulated data it behaved very similar to N _{ C } but had a slightly larger variance. We will therefore focus on N _{ C } in thefollowing.
Variability and bias of Chao’s estimator
Systematic error in Chao’s estimator
One crucial assumption for any estimator relying on a truncated Poisson distribution is that the probability of being registered at any time is independent of previous registrations. In epidemiological data in general, and in health care records in particular, it is unlikely that this assumption holds. We will investigate this in an example data set below.
which implies that Chao’s estimator will have an arbitrarily large positive bias.
Application to real data
We next apply N _{ M L } and N _{ C } to a real data set. We wanted to use the estimators on a population where we already knew (or at least had a very good approximation of) the size from other sources. This can be viewed as an attempt to validate the methods using real data; only by knowing the true size can we determine which of the methods that give the best estimate. As explained in Methods, the cases of fatal opiate overdoses in Sweden from 2006 to 2011 is a candidate for such a population. We took the total size of this population to be number of deceased as reported by The National Board of Health and Welfare. It totaled 486 persons. Now we will now see how well we can ‘estimate’ this number from the available health care records from the deceased persons. There were 262 of these individuals that had received inpatient care under the diagnoses of interest (see Methods) during this time.
Application of N _{ ML }
To estimate the number of cases using the ML estimator we need to keep track of the date of the first care instance for each of the 262 persons. Then we divide the five years into a number (M) of epochs. As shown above, given this sample size we should expect about the same performance for M=2 as for higher values of M. When applied to the data we got the following estimate for M=2: 462, which is in reasonable agreement with the true N. Increasing M had relatively small effects on the estimate: (N _{ M L:5}=461; N _{ M L:10}=431; N _{ M L:20}=435).
Application of N _{ C }
To use N _{ C } to estimate the population size we used all the 1156 observations from the health care registry. We count how many persons that received care 1 and 2 times and then use the formula stated in the Methods (Eq. 4). Doing this showed that 75 persons had been in care one time only and 55 persons had been in care twice. This lead to an estimate of N _{ C }=313, i.e. a substantial underestimate.
For the data from the opiate overdose cases we get that $\frac{{h}_{0}}{{h}_{1}}=2.49$ and $\frac{{h}_{1}}{2{h}_{2}}=0.68$ which can be interpreted that once a person has been registered (in care for substance misuse) the probability of being registered again is substantially increased.
Discussion
We have studied the performance of a novel (in this context) population size estimator and delimited the situations when it might be useful. The method is tailored to epidemiological data and can, for example, be used to track the prevalence of drug misuse. It relies on two assumptions: first that the population is closed, i.e. that individuals do not enter or exit the population during the time of study. Second, that the probability of being registered at least once is constant among the members of the population. We showed that reasonable violations of the second assumption does not invalidate the estimator (Figure 3).
The first assumption is unlikely to hold exactly in real cases but can be partly circumvented by restricting the analysis to a short period of time. Assume for example that it is of interest to estimate the number of problem drug users in a region. Now, clearly this population is not closed, someone can be a problem drug user for a given time period and then quit, whereas new individuals can enter at any time point. Still, if we restrict the time horizon to a few years the population flux presumably becomes much smaller. Also, whether the closed population assumption is reasonable or not depend on the temporal stability of the feature of interest, and on the total size of the population. If the population size is small and the conditions for being in the population are variable, it might be better to use other methods of estimation.
We also studied a different population size estimator (Chao’s estimator) and under the assumption that the registrations follow a zerotruncated Poisson distribution this method outperforms the ML estimator (Figure 5). In other words, when there are good reasons to believe that the registrations follow the Poisson assumption, one should use Chao’s estimator. We also note that in this case the performance of this estimator was slightly superior (smaller variance) to an alternative estimate also derived from truncated Poisson data (Zelterman’s estimator). However, and importantly, we also showed that Chao’s estimator can have a substantial bias (systematic error) when the Poisson assumption is violated (Figure 6). In the real data set we analyzed, Chao’s estimate was a substantial underestimation of the true value. This is a strong indication of that having had contact with the health care system changes the propensity for future contacts. As this could certainly be a general feature of similar data it questions the use of Chao’s estimator in suchsituations.
In practice it might be difficult to investigate if the probability of being registered is dependent on previous registrations or not. However, an indication of this can be obtained by analyzing parts of the data separately. Assume that registrations are followed over a period of time. Since estimates obtained by Chao’s estimator should not strongly depend on the duration of the time period used, similar estimates should be obtained if the first half of the time period is used compared to if the whole time period is used. Of course, as the sample size increase the estimates become more precise, but large dependencies on the time period is a clear indication of that truncated Poisson estimators might have a substantial bias and should preferably not be used.
There are generalizations of the zerotruncated distribution approach that might fare better under the perturbations we introduced and that are better suited to the type of data we have in mind. More generally, one can divide the observation interval into epochs (as we have done) and model observations in each epoch and overlaps between the different epochs, for example using generalized linear models. This would be similar in spirit to the standard capturerecapture approach [6]. However, such approaches rely on more knowledge of the data generating process, knowledge that often might not be available. Alternatively, more parameters must be estimated from data and it is therefore unclear what would be gained in terms of power. We therefore believe that it is important to use estimators that depend on as few assumptions as possible, such as the ML estimator we have studied here. Of course, in practice, and depending on the data available, it typically would make sense to use different estimators of population size. If results differ wildly in unexplainable ways one should perhaps use completely different methods to estimate the population size.
We end with some practical notes. The input to the ML estimator should be the time point of first registration (e.g. care under a certain diagnosis). But since it will often be necessary to limit the time period used in the analysis, it might be important to make sure that the registrations in the first epoch actually reflect the first time of registration (and not the first time of registration within the time window of the study). For example, in the data we analyzed here we used registrations in a time interval of five years preceding time of death. However, any registration during the first epoch could in fact be the nth registration, where the previous n−1 fell outside the five year interval. One way of circumventing this is to not use the data from the first half year or so. That way we can make sure that the first registrations used in the estimation are at least not part of a high frequency sequence of visits. In fact, when we excluded the first six month of data in our application of the method, the ML estimator gave a slightly more accurate result (e.g. N _{ M L20}=509).
Another practical issue relates to the choice of M. Given data acquired on a daily basis it is up to the user to choose a reasonable value for this parameter. When the observed sample constitute a substantial fraction of the total population the estimate does depend strongly on M and we showed that a value of M around 8 would be enough to get a close to optimal performance. However, it is still instructive to try different values of this parameter since a substantial dependence on M indicates that the estimated values should not be trusted.
Conclusion
The population size estimator we have introduce here complements existing methods and is less sensitive to certain types of dependencies that might be typical in epidemiological data. When given a single source of data it should therefore be considered the method of choice.
Abbreviations
 ML:

maximum likelihood
 WHO:

World Health Organization
 ICD10:

International Statistical Classification of Diseases and Related Health Problems, 10th Revision.
Declarations
Acknowledgments
This research has been financed by the Swedish Council for Working Life and Social Research (FAS 2006–1523).
Authors’ Affiliations
References
 UNO: Tungt Narkotikamissbruk: en Totalundersökning 1979 [Heavy Drug Abuse: A Complete Population Stud 1979]. 1980, Stockholm: SocialdepartementetGoogle Scholar
 Olsson B, Adamsson Warhen C, Byqvist S: Det Tunga Narkotikabrukets Omfattning i Sverige 1998. 2001, Stockholm: CANGoogle Scholar
 European Monitoring Centre for Drugs and Drug Addiction: Annual Report 2012. The State of the Drug Problem in Europe. 2012, Luxembourg: Publications Office of the European UnionGoogle Scholar
 Hook E: Capture recapture methods in epidemiology: methods and limitations. Epidemiol Rev. 1995, 17 (2): 243264.PubMedGoogle Scholar
 Yip P, Bruno G, Tajima N, Seber G, Buckland S, Cormack R, Unwin N, Chang Y, Fienberg S, Junker B, LaPorte R, Libman I, McCarty D: Capturerecapture and multiplerecord systems estimation II applications in humandiseases. Am J Epidemiol. 1995, 142 (10): 10591068.Google Scholar
 Chao A, Tsay P, Lin S, Shau W, Chao D: The applications of capturerecapture models to epidemiological data. Stat Med. 2001, 20 (20): 31233157. 10.1002/sim.996.View ArticlePubMedGoogle Scholar
 Frischer M, Leyland A, Cormack R, Goldberg D, Bloor M, Green S, Taylor A, Covell R, McKeganey N, Platt S: Estimating the population prevalence of injectiondrug use and infection with humanimmunodeficiencyvirus among injectiondrug users in Glasgow, Scotland. Am J Epidemiol. 1993, 138 (3): 170181.PubMedGoogle Scholar
 DomingoSalvany A, Hartnoll R, Maguire A, Brugal M, Albertin P, Cayla J, Casabona J, Suelves J: Analytical considerations in the use of capturerecapture to estimate prevalence: case studies of the estimation of opiate use in the metropolitan area og Barcelona, Spain. Am J Epidemiol. 1998, 148 (8): 732740. 10.1093/oxfordjournals.aje.a009694.View ArticlePubMedGoogle Scholar
 Chao A: Estimating the populationsize for capture recapture data with unequal catchability. Biometrics. 1987, 43 (4): 783791. 10.2307/2531532.View ArticlePubMedGoogle Scholar
 Zelterman D: Robust estimation in truncated discretedistributions with application to capture recapture experiments. J Stat Plan Infer. 1988, 18 (2): 225237. 10.1016/03783758(88)900079.View ArticleGoogle Scholar
 Hay G, Smit F: Estimating the number of drug injectors from needle exchange data. Addict Res Theory. 2003, 11 (4): 235243. 10.1080/1606635031000135622.View ArticleGoogle Scholar
 Bohning D, Suppawattanabodee B, Kusolvisitkul W, Viwatwongkasem C: Estimating the number of drug users in Bangkok 2001 : a capturerecapture approach using repeated entries in one list. Eur J Epidemiol. 2004, 19 (12): 10751083. 10.1007/s1065400430068.View ArticlePubMedGoogle Scholar
 Cormack R: Problems with using capturerecapture in epidemiology: an example of a measles epidemic. J Clin Epidemiol. 1999, 52 (10): 909914.View ArticlePubMedGoogle Scholar
 Hayne D: Two methods for estimating population from trapping records. J Mammal. 1949, 30 (4): 399411. 10.2307/1375218.View ArticlePubMedGoogle Scholar
 Moran P: A mathematical theory of animal trapping. Biometrika. 1951, 38 (3–4): 307311.View ArticleGoogle Scholar
 Zippin C: An evaluation of the removal method of estimating animal populations. Biometrics. 1956, 12 (2): 163189. 10.2307/3001759.View ArticleGoogle Scholar
 Chao A: Nonparametric estimation of the number of classes in a population. Scand J Statist. 1984, 11: 265270.Google Scholar
 Seber G, Whale J: The removal method for two and three samples. Biometrics. 1970, 26 (3): 393400. 10.2307/2529096.View ArticlePubMedGoogle Scholar
 Feller W: An Introduction to Probability Theory and Its Applications. 1968, Stockholm: WileyGoogle Scholar
 The prepublication history for this paper can be accessed here:http://www.biomedcentral.com/14712288/14/58/prepub
Prepublication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.