This article has Open Peer Review reports available.
Graphical modeling of binary data using the LASSO: a simulation study
 Ralf Strobl^{1}Email author,
 Eva Grill^{1, 2} and
 Ulrich Mansmann^{1}
https://doi.org/10.1186/147122881216
© Strobl et al; BioMed Central Ltd. 2012
Received: 19 August 2011
Accepted: 21 February 2012
Published: 21 February 2012
Abstract
Background
Graphical models were identified as a promising new approach to modeling highdimensional clinical data. They provided a probabilistic tool to display, analyze and visualize the netlike dependence structures by drawing a graph describing the conditional dependencies between the variables. Until now, the main focus of research was on building Gaussian graphical models for continuous multivariate data following a multivariate normal distribution. Satisfactory solutions for binary data were missing. We adapted the method of Meinshausen and Bühlmann to binary data and used the LASSO for logistic regression. Objective of this paper was to examine the performance of the Bolasso to the development of graphical models for high dimensional binary data. We hypothesized that the performance of Bolasso is superior to competing LASSO methods to identify graphical models.
Methods
We analyzed the Bolasso to derive graphical models in comparison with other LASSO based method. Model performance was assessed in a simulation study with random data generated via symmetric local logistic regression models and Gibbs sampling. Main outcome variables were the Structural Hamming Distance and the Youden Index.
We applied the results of the simulation study to a reallife data with functioning data of patients having head and neck cancer.
Results
Bootstrap aggregating as incorporated in the Bolasso algorithm greatly improved the performance in higher sample sizes. The number of bootstraps did have minimal impact on performance. Bolasso performed reasonable well with a cutpoint of 0.90 and a small penalty term. Optimal prediction for Bolasso leads to very conservative models in comparison with AIC, BIC or crossvalidated optimal penalty terms.
Conclusions
Bootstrap aggregating may improve variable selection if the underlying selection process is not too unstable due to small sample size and if one is mainly interested in reducing the false discovery rate. We propose using the Bolasso for graphical modeling in large sample sizes.
Background
A common problem in contemporary biomedical research is the occurrence of a large number of variables that accompany relatively few observations. Thus, studying associations in highdimensional data is not straightforward. Including all variables would result in a highly over parameterized model, computational complexity and unstable estimation of the associations [1]. This methodological problem has been solved for the domain of genomic medicine by using graphical modeling. Graphical models were identified as a promising new approach to modeling clinical data [2], and thereby the systems approach to health and disease.
A promising approach to describe such complex relationships is graphical modeling. Graphical models [3] provide a probabilistic tool to display, analyze and visualize the netlike dependence structures by drawing a graph describing the conditional dependencies between the variables. A graphical model consists of nodes representing the variables and edges representing conditional dependencies between the variables. In order to understand graphical models it is important to understand the concept of conditional independence. Two variables X and Y are considered conditional independent given Z, if f(xy, z) = f(xz). Thus, learning information about Y does not give any additional information about X, once we know Z.
Beyond association, this method has also been developed for estimating causal effects [4]. Recently, graphical modeling has been outlined as a tool for investigating complex phenotype data, specifically for the visualization of complex associations [5], dimension reduction, comparison of substructures and the estimation of causal effects from observational data [6]. Until now, the main focus of research was on building Gaussian graphical models for continuous multivariate data following a multivariate normal distribution [7]. A popular way to built Gaussian graphical models are covariance selection methods [8]. These methods are used to sort out conditionally independent variables. They aim to identify the nonzero elements in the inverse of the covariance matrix since the nonzero entries in the inverse covariance matrix correspond to conditional dependent variables. However, this method is not reliable for highdimensional data, but can be improved by concentrating on loworder graphs [9].
Another approach to identifying the nonzero elements in the inverse covariance matrix has been proposed by Meinshausen and Buehlmann [10]. They propose the Least Absolute Shrinkage and Selection Operator (LASSO) [11] as a variable selection method to identify the neighborhood of each variable, thus the nonzero elements. A neighborhood is the set of predictor variables corresponding to nonzero coefficients in a prediction model by estimating the conditional independence separately for each variable. Meinshausen and Buehlmann showed that this method is superior to common covariance selection methods, in particular if the number of variables exceeds the number of observations. They also proved that the method asymptotically recovers the true graph.
The LASSO was originally proposed for linear regression models and has become a popular model selection and shrinkage estimation method. LASSO is based on a penalty on the sum of absolute values of the coefficients (ℓ _{1} type penalty) and can be easily adapted to other settings, for example Cox regression [12], logistic regression [13–15] or multinomial logistic regression [16] by replacing the residual sum of squares by the corresponding negative loglikelihood function. Important progress has been made in recent years in developing computational efficient and consistent algorithms for the LASSO with good properties even in highdimensional settings [17, 18]. The socalled graphical lasso by Friedman et al. [19] uses a coordinate descent algorithm for the LASSO regression to estimate sparse graphs via the inverse covariance matrix. They describe the connection between the exact problem and the approximation suggested by Meinshausen and Bühlmann [10].
However, the determination of the right amount of penalization for these methods has remained a main problem for which no satisfactory solution exists [20].
The current methodology primarily provides solutions for continuous data. The relationship of binary data is difficult to identify using classical methods. Building binary graphical models for dichotomous data is based on the corresponding contingency tables and loglinear models [21]. The interaction terms are used to control for conditional dependencies. With a growing number of variables model selection becomes computationally demanding and quickly exceeds feasibility, thereby making the method difficult to adapt to highdimensional data. For a fully saturated loglinear model one would need 2 p parameters, with p being the number of variables. A common solution is to reduce the problem to firstorder interaction where conditional independence is determined by firstorder interaction terms.
The properties of the LASSO for logistic regression have recently been investigated. Van de Geer [22] focused on the prediction error of the estimator and not on variable selection. She proposed a truncation of the estimated coefficients to derive consistent variable selection. Bunea [23] showed the asymptotic consistency of variable selection under certain conditions for ℓ _{1} type penalization schemes.
The adaptation of local penalized logistic regression to graphical modeling has been proposed by Wainwright [24]. Under certain conditions on the number of variables n, the number of nodes p and the maximum neighborhood size, the ℓ _{1} penalized logistic regression for highdimensional binary graphical model selection gives consistent neighborhood selection [24, 25]. Wainwright et al. showed that a logarithmic growth in n relative to p is sufficient to achieve neighborhood consistency. Another new approach is based on an approximate sparse maximum likelihood (ASML) problem for estimating the parameters in a multivariate binary distribution. Based on this approximation a consistent neighborhood could be selected and a sensible penalty term can be identified [17].
However, when analyzing highdimensional categorical data the main problem that there is no rationale for the choice of the amount of penalization controlled by the value of the penalty term for consistent variable selection still remains [20].
A possible solution might be to adapt bootstrap aggregating to these problems. Bootstrap aggregating (bagging) generates multiple versions of a classifier and aggregates the results to get a single enhanced classifier. By making bootstrap replicates of the original data multiple versions are formed, each acting as single learning data for a classification problem. Also, for linear regression it has been shown that bagging provides substantial gains in accuracy for variable selection and classification [26]. This idea has been carried further by Bach [27], resulting in the Bolasso (bootstrapenhanced least absolute shrinkage operator) algorithm for variable selection in linear regression. Here, the LASSO is applied to several bootstrapped replications of a given sample. The intersection of each of these models leads to consistent model selection.
In this paper we adapted the method of Meinshausen and Bühlmann to binary data and used the LASSO for logistic regression to identify the conditional dependence structure. We applied bagging to improve variable selection, hence adapted the Bolasso. Performances are tested on a data set with known structure. This data set was simulated by Gibbs sampling [28]. We also applied graphical modeling methods to reallife data.
Objective of this paper was to examine the performance of the Bolasso to the development of graphical models for high dimensional binary data with various values for the penalty term and various numbers of bootstraps. We hypothesized that the performance of Bolasso is superior to competing LASSO based methods to identify graphical models. Specifically, the hypothesis was that the choice of the penalty is not critical as long as it is chosen sensibly, i.e. corresponding to a reasonable number of selected variables.
Methods
Data generation
This section presents an approach to simulate highdimensional binary data from a given distribution and dimension by analyzing the results on a data set with known dependence structure. This analysis is performed in order to investigate the performance of the proposed methods.
All calculations are done using the statistical computing software R (V 2.9.0) [29].
We propose to generate the data via symmetric local logistic regression models and Gibbs sampling [28] as follows:
(1) Define the p × p matrix M of odds ratios as: diag(M) = p _{ ii } , i = 1,..., p with p _{ ii }the baseline odds of variable ${X}^{\left(i\right)}{m}_{i}^{j}={p}_{ij}$ with P _{ ij }as the corresponding odds ratio of X ^{(i)}on X ^{(j)}and vice versa.
(2) Start with k = 0.
(3) Choose starting values x ^{(k)}= {x _{1},..., x _{ p }) according to diag(M).
(4) For each i in 1, ...., p generate new ${x}_{i}^{\left(k+1\right)}$ from a Bernoulli distribution $B\left({p}_{i}^{*}\right)$ according to $\mathsf{\text{logit}}\left({p}_{i}^{*}\right)={\sum}_{j\ne i}{m}_{i}^{j}\cdot {x}_{j}^{\left(k\right)}$
(5) Repeat for k = k + 1.After a burnin phase the ${x}_{i}^{\left(k+1\right)}$ will reflect the true underlying binary distribution generating X =(X ^{(1)} , ..., X ^{(p)}) ∈ {0,1}^{ p }We chose a burnin phase of 5000 iterations.
Reallife data: Aspects of functioning in head and neck cancer patient
We evaluated the method to data measuring aspects of functioning of patients having head and neck cancer (HNC). The data originated from a crosssectional study with a convenience sample of 145 patients with HNC. The data has previously been used for graphical modelling and has been published [30].
The patients had at least one cancer at one of the following locations: oral region, salivary glands, oropharynx, hypopharynx or larynx. Human functioning for each of the patients were assessed using the International Classification of Functioning, Disability and Health (ICF) as endorsed by the World Health Organization in 2001 [31]. The ICF provides a useful framework for classifying the components of health and consequences of a disease and can be used. According to the ICF the consequences of a disease may concern body functions (b) and structures (s), the performance of activities and participation (d) in life situations depending on environmental factors (e).
Short description of the ICF categories used for the graphical models on the HNC data
ICF Code  ICF Code description 

b130  Energy and drive functions 
b280  Sensation of pain 
b310  Voice functions 
b320  Articulation functions 
b340  Alternative vocalization functions 
b440  Respiration functions 
b450  Additional respiratory functions 
b460  Sensations associated with cardiovascular and respiratory functions 
b510  Ingestion functions 
b515  Digestive functions 
b530  Weight maintenance function 
b710  Mobility of joint functions 
d175  Solving problems 
d310  Communicating with  receiving  spoken messages 
d315  Communicating with  receiving  nonverbal messages 
d330  Speaking 
d335  Producing nonverbal messages 
d350  Conversation 
d360  Using communication devices and techniques 
d550  Eating 
d560  Drinking 
d570  Looking after one's health 
d720  Complex interpersonal interaction 
d760  Family relationship 
d770  Intimate relationship 
d850  Remunerative employment 
d920  Recreation and leisure 
s320  Structure of mouth 
s430  Structure of respiratory system 
s710  Structure of head and neck region 
e125  Products and technology for communication 
e225  Climate 
e310  Immediate family 
e580  Health services, systems and policies 
Principles of graphical models
We can regard this as a subset selection problem in a regression setting and to the detection of zero coefficients. The use of shrinkage as the subset selection tool used to identify the neighborhood and to estimate ${\beta}_{b}^{a}$ has become popular in recent years.
Principles of LASSO for logistic regression
subject to $\sum _{j}\left{\beta}_{\left(j\right)}^{LASSO}\right<t$. In this paper, the variables are first standardized to zero mean and variance one. The penalty term t can be used to control the number of predictors, i.e. the size of the neighborhood.
Binary graphical model using single LASSO regressions
The first method considered here to construct graphical models is based on an optimal penalty term to identify an optimal neighborhood. We consider three procedures for selecting optimal penalty, namely crossvalidation (CV), Akaike Information Criteria (AIC) and Bayesian Information Criteria (BIC). These approaches have although been suggested in recent publications by Viallon [32] and Wang [33]. The first one is proposed by Goeman in the context of Cox regression [34], while the latter two are computational more efficient and wellknown classical tools. BIC has shown to be superior as suggested by Yuan and Lin and demonstrated superior performance through simulation studies in Gaussian graphical modes [35, 36]. Other possible approaches include the methods by Wainwright [24] and Banerjee [17] which control the rate of falsely detected edges in the graph. However, these penalties are too conservative as outlined in Ambroise et al. [37]. The LASSO and crossvalidation are calculated using the efficient gradientascent algorithm as proposed by Goeman and are implemented in the 'penalized' package [38].
 1.
Estimate the coefficients ${\widehat{\beta}}^{LASSO}$ in local penalized logistic regression models using each variable as outcome and the remainder as predictors for each X ^{(i)}corresponding to an optimal penalty term t.
 2.
For each variable a define the neighborhood $n{e}_{a}^{*}$ as the set of variables b corresponding to nonzero penalized coefficients ${\widehat{\beta}}_{b}^{a}:n{e}_{a}^{*}=\left\{b\in \upsilon :{\widehat{\beta}}_{b}^{a}\ne 0\right\}$.
 3.
Define the set of conditional relationships (the edge set) E as: $E=\left\{\left(a,b\right)a\in n{e}_{b}^{*}\vee b\in n{e}_{a}^{*}\right\}$.
Binary graphical model using bolasso
Another method to construct binary graphical models is based on the Bolasso algorithm which takes advantage of bootstrap aggregating. Bootstrap aggregating, also called 'bagging', generates multiple versions of a predictor, e.g. a coefficient in a generalized linear model, or classifier. It constitutes a simple and general approach to improve an unstable estimator θ(X) with X being a given data set. Bagging is based on the concept of resampling the data {(y _{ n }, x _{ n }), n = 1,..., p} by drawing new pairs $\left\{\left({y}_{n}^{*},{x}_{n}^{*}\right)\right\}$ with replacement from the p original data pairs. For simple classification the bootstrap aggregating algorithm proceeds as follows:
(1) Generate a bootstrap sample b* with replacement from the original data. Repeat this process B times.
(2) For each data sample b* calculate the classifier θ*(b*).
(3) Count the times an object is classified ${\mu}_{x}=\sum _{i=1..B}{\theta}_{i}^{*}\left({b}_{i}^{*}\right)$.
(4) Define the set of classified objects as S = {y: μ _{ y }≥ π _{ cut }} with 0 ≤ π _{ cut }≤ 1.
Using Bolasso as a basis, we can now construct graphical models. The algorithm proceeds as follows:
(1) Generate a bootstrap sample b* with replacement from the original data. Repeat this process B times.
(2) For each b*, estimate the coefficients ${\widehat{\beta}}^{LASSO}$ in local penalized logistic regressions using each variable as outcome variable and the remainder as predictors for a penalty term t.
(3) For each variable a define the neighborhood $n{e}_{a}^{*}$ as the set of variables b corresponding to nonzero penalized coefficients ${\widehat{\beta}}_{b}^{a}:n{e}_{a}^{*}=\left\{b\in \upsilon :{\widehat{\beta}}_{b}^{a}\ne 0\right\}$.
(4) Calculate the percentage variable b is in the neighborhood of a in each bootstrap sample b* as ${\mu}_{b}^{a}$.
(5) Define the neighborhood of variable a as: $n{e}_{a}^{*}=\left\{b{\mu}_{b}^{a}\ge {\pi}_{cut}\right\}$
(6) Define the set of conditional relationships (the edge set) E as: $E=\left\{\left(a,b\right)a\in n{e}_{b}^{*}\vee b\in n{e}_{a}^{*}\right\}$.
Three parameters have to be chosen here:

B: number of bootstraps

t: penalty parameter

π _{ cut }: cutoff value for the definition of neighborhood
In our study, we investigated the influence of these parameters for different sample sizes in a study based on simulated data as described earlier. We also considered using a crossvalidated penalty as a basis for the Bolasso and refer to this approach by BolassoCV.
Assessment of performance
We analyzed the performance of the methods by comparing the identified structure with a predefined known structure. Thus, each edge yielded by one method can be either correct or incorrect. A falsely identified (false positive) edge is an edge which is identified by one or both of the two methods but does not exist in the predefined structure. A falsely not identified (false negative) edge is an edge which is not identified by one or both of the two methods but does exist in the predefined structure. A correctly identified (true positive) edge is an edge which is identified by one or both of the two methods and which exists in the predefined structure. Likewise, a true negative edge is an edge correctly identified as missing.
We report the Structural Hamming Distance (SHD) and the Youden index (J). The SHD between two graphs is the number of edge insertions or deletions needed to transform one graph into the other. Thus, the number of changes needed to transform the graphical model identified by one or both of the two methods to the known structure defined by the matrix M. The SHD measures the performance of LASSO and Bolasso by counting the number of false positive and false negative edges.
It may occur that bagging causes the exclusion of all edges yielding a SHD equal to the number of true edges. This might reduce the error rate, but an empty model without edges is not always desirable, even if it has a low error rate. In order to assess both, the ability to find true positive and true negative edges, the Youden Index is more appropriate.
Sensitivity is the proportion of true positive edges among all identified edges and specificity the proportion of true negative edges among all not identified edges.
Smaller values of the SHD indicate better choice, as do larger values of the J. Thus, a choice is to be preferred that yields small SHD at large J values.
We chose the penalty term to be either crossvalidated, AIC or BIC optimal or to correspond to a certain neighborhood size ranging from one to the maximum neighborhood size, i.e. l ∈ (1,2,...,18) in the original data. In addition, we varied the number of bootstrap replicates B ∈ (40,80,120,160,200), the threshold for a variable to be included in a neighborhood π _{ cut }∈ (0.90,0.95,0.99,1.00) and the sample size n ∈ (50,100,200,500,1000). Usually, B lies in the range of 50. However, the best choice is not clear, e.g. Bach investigated also B =256, and may be important as the method itself is unstable. The choice of thresholds was also motivated by the work of Bach who proposed the soft Bolasso with a threshold of 0.90 as opposed to the Bolasso with a threshold of 1.00. We chose a wide range of values for B, thresholds and sample size to simultaneously study the performance of B and thresholds in small samples and in big samples. Ideally, for a sample size of 1000 the methods should perform with negligible error. In order to estimate model performances dependent on the parameters π _{ cut } , B and l and the interaction between π _{ cut }and l we calculated generalized linear models with either SHD or J as outcome variable.
Result
Simulations results
We calculated the Structural Hamming Distance and Youden Index for the simulation setting for each combination of B, π _{ cut }and l. We give the detailed results in table form in the electronic supplement (see additional file 1 and additional file 2: Summary statistics for the simulation study). Using generalized linear model yielded the following optimal regularization for minimal SHD: π _{ cut } =0.90, B =200 and l = 5 . For a maximal J a larger neighborhood size is preferred: π _{ cut } =0.90, B =200 and l = 10. It turned out, that the number of bootstrap replicates B has the least influence on model performance with higher B performing slightly better.
Considering SHD as the main outcome renders LassoCV and LassoAIC as clearly inferior. For smaller sample sizes LassoBIC, BolassoCV and Bolasso90 reject almost or all edges eading to a null model with SHD equal to 19. For sample sizes greater than 500 BolassoCV and Bolasso90 are clearly superior to LassoBIC. Additionally, for each approach the ANDrule was superior to the ORrule for most sample sizes.
A similar result can be seen when considering the Youden Index with the exception that LassoCV and LassoAIC are real contenders here, as they are not as conservative as the others, such gaining performance regarding sensitivity.
HNC data
In all models similar aspects can be seen. The CV and AIC optimal penalty term leads to a very complicated model, while the BIC criteria yielded reasonable results in terms of interpretability. The Bolasso90 is the most conservative approach while using BolassoCV yielded similar results than the LassoBIC.
As a case in point, we describe the model for the Bolasso90 with a neighborhood size of 10, i.e. the model with the highest performance regarding the Youden Index.
Similar to Becker et al. [30] we identified a circlelike association around the speaking capability, i.e. between d330 Speaking, b310 Voice functions, b320 Articulation functions, s320 Structure of mouth, b510 Ingestion functions, d350 Conversation, d360 Using communication devices and techniques. The latter had further associations to e125 Products and technologies for communication and d920 Recreation and leisure. The category s320 Structure of mouth had a meaningful connection to d560 Drinking which was further connected to d550 Eating. Furthermore, b510 Ingestion functions had an association to b280 Sensation of pain. On the left side of the graph we have a group around respiration functions, namely b440 Respiration functions, b450 Additional respiratory functions, b460 Sensations associated with cardiovascular and respiratory functions and s430 Structure of respiratory system. A further like path could be visualized between the categories d335 Producing nonverbal messages, d315 Communicating with  receiving  nonverbal messages, d310 Communicating with  receiving  spoken messages, d720 Complex interpersonal interaction, d570 Looking after one's health and b130 Energy and drive functions. The big circle is closed by the connection of b130 and d920 Recreation and leisure.
Many of these association structures were also present in the original work and are discussed in detail there [30].
Discussion
We compared the performance of the Bolasso to the development of graphical models for highdimensional data with known dependency structure. One of the main points of critique for graphical models is that the retrieved structures might not be statistically stable, since the results might depend on the choice of model parameters, and are susceptible to small changes in the data set [6]. Interestingly, we found that using a BIC penalty and Bolasso were both able to correctly identify predefined existing dependency structures.
We have analyzed several LASSO based methods to derive graphical models in the presence of binary data and compared their performance in detecting known dependency structures. All methods are taking advantage of penalized logistic regression models as a tool to identify the explicit neighborhoods. We could show that bootstrap aggregating can substantially improve the performance of model selection, especially in the case of large samples. Arguably, LASSO is inferior in certain situations because in a given LASSO coefficient path the optimal solution might not exist. A LASSO coefficient path is given by the coefficient value of each variable over all penalty terms. In contrast, bagging opens the window for a whole class of new models, because it selects all variables intersecting over the bootstrap samples. The intersection itself must not be a solution in any of the bootstrap samples.
In LASSO, the choice of the penalty often determines the performance of the model. Thus, the correct choice of the penalty term is important. However, in our study, the initial choice of penalization had surprisingly little impact on the performance of the model if bagging was applied and the penalty was chosen in sensibly. Similar results have been obtained with stability selection [20]. Stability selection is also based on bootstrap in combination with (highdimensional) selection algorithms. It applies resampling to the whole LASSO coefficient path and calculates the probability for each variable to be selected when randomly resampling from the data.
In our study, bagging largely improved the performance of LASSO, but only by reducing the number of false positive and false negative edges. This, however, might lead to a conservative and underspecified model with a low number of edges, if any, especially in small samples.
Although the choice of the penalty term is not crucial when bagging is applied, a cutoff value for the definition of neighborhood has to be defined, and this arbitrary choice will determine the size of the graphical model. Reducing the cutoff value would include more variables at the expense of a higher false positive rate.
This study illustrates that in graphical modeling, it is essential not only to control the number of false positive and false negative edges but also the ability of a method to identify true positive edges.
Conclusion
Bootstrap aggregating improves variable selection if the underlying selection process is not too unstable, e.g. due to small sample sizes. These properties have been shown on simulated data using various parameters. As a consequence, we propose using Bolasso for graphical modeling in large sample size cases as a real contender to the classical neighborhood estimation methods.
Declarations
Acknowledgements
The authors thank Emmi Beck for manuscript revision and Sven Becker for providing the data for the realdata study.
This study was funded by the German Research Foundation (Deutsche Forschungsgemeinschaft) (GR 3608/11).
Authors’ Affiliations
References
 Breiman L: Heuristics of Instability and Stabilization in Model Selection. Ann Stat. 1996, 24: 23502383.View ArticleGoogle Scholar
 Tsai CL, Camargo CA: Methodological considerations, such as directed acyclic graphs, for studying "acute on chronic" disease epidemiology: chronic obstructive pulmonary disease example. J Clin Epidemiol. 2009, 62: 982990. 10.1016/j.jclinepi.2008.10.005.View ArticlePubMedGoogle Scholar
 Edwards D: Introduction to Graphical Modelling. 2000, New York: SpringerView ArticleGoogle Scholar
 Hernan MA, Robins JM: Instruments for causal inference: an epidemiologist's dream?. Epidemiology. 2006, 17: 360372. 10.1097/01.ede.0000222409.00878.37.View ArticlePubMedGoogle Scholar
 Strobl R, Stucki G, Grill E, Muller M, Mansmann U: Graphical models illustrated complex associations between variables describing human functioning. J Clin Epidemiol. 2009, 62: 922933. 10.1016/j.jclinepi.2009.01.018.View ArticlePubMedGoogle Scholar
 Kalisch M, Fellinghauer BA, Grill E, Maathuis MH, Mansmann U, Buhlmann P, Stucki G: Understanding human functioning using graphical models. BMC Med Res Methodol. 2010, 10: 1410.1186/147122881014.View ArticlePubMedPubMed CentralGoogle Scholar
 Wong F, Carter CK, Kohn R: Efficient estimation of covariance selection models. Biometrika. 2003, 90: 809830. 10.1093/biomet/90.4.809.View ArticleGoogle Scholar
 Dempster AP: Covariance Selection. Biometrics. 1972, 28: 157175. 10.2307/2528966.View ArticleGoogle Scholar
 Wille A, Bühlmann P: Loworder conditional independence graphs for inferring genetic networks. Stat Appl Genet Mol Biol. 2006, 5: 132.Google Scholar
 Meinshausen N, Buehlmann P: Highdimensional graphs and variable selection with the Lasso. Ann Stat. 2006, 34: 14361462. 10.1214/009053606000000281.View ArticleGoogle Scholar
 Tibshirani R: Regression shrinkage and selection via the lasso. J R Stat Soc. 1996, 58: 267288.Google Scholar
 Tibshirani R: The lasso method for variable selection in the Cox model. Stat Med. 1997, 16: 385395. 10.1002/(SICI)10970258(19970228)16:4<385::AIDSIM380>3.0.CO;23.View ArticlePubMedGoogle Scholar
 Genkin A, Lewis DD, Madigan D: LargeScale Bayesian Logistic Regression for Text Categorization. Technometrics. 2007, 49: 291304. 10.1198/004017007000000245.View ArticleGoogle Scholar
 Lokhorst J: The LASSO and Generalised Linear Models. 1999, Honours Projects Department of Statistics. South Australia, Australia: The University of AdelaideGoogle Scholar
 Shevade SK, Keerthi SS: A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics. 2003, 19: 22462253. 10.1093/bioinformatics/btg308.View ArticlePubMedGoogle Scholar
 Krishnapuram B, Carin L, Figueiredo MA, Hartemink AJ: Sparse multinomial logistic regression: fast algorithms and generalization bounds. IEEE Trans Pattern Anal Mach Intell. 2005, 27: 957968.View ArticlePubMedGoogle Scholar
 Banerjee O, El Ghaoui L, d'Aspremont A: Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data. J Mach Learn Res. 2008, 9: 485516.Google Scholar
 Rothman AJ, Bickel PJ, Levina E, Zhu J: Sparse permutation invariant covariance estimation. Electronic Journal of Statistics. 2008, 2: 494515. 10.1214/08EJS176.View ArticleGoogle Scholar
 Friedman J, Hastie T, Tibshirani R: Sparse inverse covariance estimation with the graphical lasso. Biostatistics. 2008, 9: 432441.View ArticlePubMedGoogle Scholar
 Meinshausen N, Buehlmann P: Stability Selection. Journal of the Royal Statistical Society Series B. 2010, 72: 417473. 10.1111/j.14679868.2010.00740.x.View ArticleGoogle Scholar
 Agresti A: Categorical Data Analysis. 2002, New Jersey: WileyView ArticleGoogle Scholar
 van der Geer SA: Highdimensional generalized linear models and the Lasso. Ann Stat. 2008, 36: 614645. 10.1214/009053607000000929.View ArticleGoogle Scholar
 Bunea F: Honest variable selection in linear and logistic regression models via ℓ1 and ℓ1 + ℓ2 penalization. Electronic Journal of Statistics. 2008, 2: 11531194. 10.1214/08EJS287.View ArticleGoogle Scholar
 Wainwright MJ, Ravikumar P, Lafferty JD: Highdimensional graphical model selection using l1regularized logistic regression. Advances in Neural Information Processing Systems. 2007, 19: 14651472.Google Scholar
 Ravikumar P, Wainwright MJ, Lafferty JD: Highdimensional Ising model selection using ℓ1regularized logistic regression. Ann Stat. 2010, 38: 12871319. 10.1214/09AOS691.View ArticleGoogle Scholar
 Breiman L: Bagging predictors. Mach Learn. 1996, 24: 123140.Google Scholar
 Bach FR: Bolasso: Model consistent lasso estimation through the bootstrap. preprint. 2008Google Scholar
 Robert CP, Casella G: Monte Carlo Statistical Method. 2004, New York: Springer, 2View ArticleGoogle Scholar
 R Development Core Team: R: A Language and Environment for Statistical Computin. 2009, Vienna, Austria: R Foundation for Statistical ComputingGoogle Scholar
 Becker S, Strobl R, Cieza A, Grill E, Harreus T, Schiesner U: Graphical modeling can be used to illustrate associations between variables describing functioning in head and neck cancer patients. J Clin Epidemiol. 2011Google Scholar
 World Health Organization: International Classification of Functioning, Disability and Health: ICF. Book International Classification of Functioning Disability and Health: ICF. 2001, City: WHO, (Editor ed.^eds).Google Scholar
 Viallon V, Banerjee O, Rey G, Jougla E, Coste J: An empirical comparative study of approximate methods for binary graphical models; application to the search of associations among causes of death in French death certificates. 2010, http://arxiv.org/pdf/1004.2287, ,Google Scholar
 Wang P, Chao DL, Hsu L: Learning networks from high dimensional binary data : An application to genomic instability data. 2010, http://arxiv.org/pdf/0908.3882, ,Google Scholar
 Goeman JJ: L1 penalized estimation in the Cox proportional hazards model. Biom J. 2009, 52: 7084.Google Scholar
 Gao X, Pu DQ, Wu Y, Xu H: Tuning parameter selection for penalized likelihood estimation pf inverse covariance matrix. 2010, http://arxiv.org/pdf/0909.0934, ,Google Scholar
 Yuan M, Lin Y: Model selection and estimation in the Gaussian graphical model. Biometrika. 2007, 94: 1935. 10.1093/biomet/asm018.View ArticleGoogle Scholar
 Ambroise C, Chiquet J, Matias C: Inferring sparse Gaussian graphical models with latent structure. Electronic Journal of Statistics. 2009, 3: 205238. 10.1214/08EJS314.View ArticleGoogle Scholar
 Goeman J: Penalized: L1 (lasso) and L2 (ridge) penalized estimation in GLMs and in the Cox model. R package version 0921. 2008Google Scholar
 The prepublication history for this paper can be accessed here:http://www.biomedcentral.com/14712288/12/16/prepub
Prepublication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.