Efficient Bayesian Multivariate Surface Regression
2013 (English)In: Scandinavian Journal of Statistics, ISSN 0303-6898, E-ISSN 1467-9469, Vol. 40, no 4, 706-723 p.Article in journal (Refereed) Published
Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. While most of these methods are in principle directly extendable to non-additive surface models, they are likely to be less successful in that setting because of the curse of dimensionality, especially when there are more than a couple of covariates. We propose a regression model for a multivariate Gaussian response that combines both additive splines and interactive splines, and a highly efficient MCMC algorithm that updates all the multivariate knot locations jointly. We use shrinkage priors to avoid overfitting with different estimated shrinkage factors for the additive and surface part of the model, and also different shrinkage parameters for the different response variables. This makes it possible for the model to adapt to varying degrees of nonlinearity in different parts of the data in a parsimonious way. Simulated data and an application to firm leverage data show that the approach is computationally efficient, and that allowing for freely estimated knot locations can offer a substantial improvement in out-of-sample predictive performance.
Place, publisher, year, edition, pages
2013. Vol. 40, no 4, 706-723 p.
Bayesian inference, free knots, Markov chain Monte Carlo, surface regression, splines
Probability Theory and Statistics
Research subject Statistics
IdentifiersURN: urn:nbn:se:su:diva-70927DOI: 10.1111/sjos.12022ISI: 000327258100004OAI: oai:DiVA.org:su-70927DiVA: diva2:483078