Bayesian Hetero-Elasticnet (A Gibbs Sampler Approach)

Abstract

Combined heteroscedasticity and multicollinearity as dual non-spherical disturbances were experimented asymptotically. A Gibbs Sampler technique was used to investigate the asymptotic properties of hetero-elasticnet estimator with mean squares error (MSE) and bias as performance metrics. The seed was set to 12345;  is set at ; Xs variables were generated as follow: the design matrix was generated from the multivariate normal distribution with mean > 0 and variance .  and  are truncated with Harvey (1976) heteroscedastic error structure;  are collinear covariate with pairwise correlation between 0.6 and 0.9, the sample sizes were 25, 100 and 1000. The number of replications of the experiment was set at 10,000 with burn-in of 1000 which specified the draws that were discarded to remove the effects of the initial values. The thinning was set at 5 to ensure the removal of the effects of autocorrelation in the MCMC simulation. The study found that there is consistency of estimator asymptotically as the sample sizes increases from 25 to 50 so also to 1000, the larger sample size depicted least bias. The estimator exhibited efficiency asymptotically as larger sample sizes depicted least mean squares error. The study therefore recommended Bayesian hetero-elasticnet when data exhibit both heteroscedasticity and multicollinearity.

Keywords: Elasticnet, Bayesian Inference and Gibbs sampler