Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Bayesian Sequential Inference for Dynamic Regression Models
Stockholm University, Faculty of Social Sciences, Department of Statistics.ORCID iD: 0000-0002-3902-3846
Number of Authors: 552020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Many processes evolve over time and statistical models need to be adaptive to change. This thesis proposes flexible models and statistical methods for inference about a data generating process that varies over time. The models considered are quite general dynamic predictive models with parameters linked to a set of covariates via link functions. The dynamics can arise from time-varying regression coefficients and from changes in the link function over time. The covariates can be time-varying and may also have incomplete information.

An efficient Bayesian inference methodology is developed for analyzing the posterior of dynamic regression models sequentially, with a particular focus on online learning and real-time prediction. The core inferential algorithm belongs to a family of sequential Monte Carlo methods commonly known as particle filters, and a key contribution is the development of a tailored proposal distribution. The algorithm is shown to outperform a state-of-the-art Markov Chain Monte Carlo method and is also extended to mixture-of-experts models.

The performance of the inference methodology is assessed through various simulation experiments and real data from clinical and social-demographic studies, as well as from an industrial software development project.

Place, publisher, year, edition, pages
Stockholm: Department of Statistics, Stockholm University , 2020.
Keywords [en]
Bayesian sequential inference, Dynamic regression models, Particle filter, Online prediction, Particle smoothing, Linear Bayes
National Category
Other Social Sciences not elsewhere specified
Research subject
Statistics
Identifiers
URN: urn:nbn:se:su:diva-186121ISBN: 978-91-7911-336-0 (print)ISBN: 978-91-7911-337-7 (electronic)OAI: oai:DiVA.org:su-186121DiVA, id: diva2:1479084
Public defence
2020-12-11, hörsal 6, hus C, Universitetsvägen 10 C, and digitally via Zoom. A link will be published at https://www.statistics.su.se/, Stockholm, 10:00 (English)
Opponent
Supervisors
Available from: 2020-11-18 Created: 2020-10-25 Last updated: 2022-02-25Bibliographically approved
List of papers
1. Efficient Particle Smoothing for Bayesian Inference in Dynamic Survival Models
Open this publication in new window or tab >>Efficient Particle Smoothing for Bayesian Inference in Dynamic Survival Models
(English)Manuscript (preprint) (Other academic)
Abstract [en]

This article proposes an efficient Bayesian inference for piecewise exponential hazard (PEH) models, which allow the effect of a covariate to change over time. The proposed inference methodology is based on a particle smoothing (PS) algorithm that depends on three particle filters. Efficient proposal (importance) distributions for the particle filters tailored to the nature of survival data and PEH models are developedusing the Laplace approximation of the posterior distribution and linear Bayes theory. The algorithm is applied to both simulated and real data, and the results show that it generates an effective sample sizethat is more than two orders of magnitude larger than a state-of-the-art MCMC sampler for the samecomputing time, and scales well in high-dimensional and relatively large data.

Keywords
Hazard function, Linear Bayes, particle filter, particle smoothing, piecewise exponential, Survival function
National Category
Other Social Sciences
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-186096 (URN)
Available from: 2020-10-24 Created: 2020-10-24 Last updated: 2022-02-25Bibliographically approved
2. Dynamic Bayesian adjustment of anticipatory covariates in retrospective data: application to the effect of education on divorce risk
Open this publication in new window or tab >>Dynamic Bayesian adjustment of anticipatory covariates in retrospective data: application to the effect of education on divorce risk
2022 (English)In: Journal of Applied Statistics, ISSN 0266-4763, E-ISSN 1360-0532, Vol. 49, no 6, p. 1382-1401Article in journal (Refereed) Published
Abstract [en]

We address a problem in inference from retrospective studies where the value of a variable is measured at the date of the survey but is used as covariate to events that have occurred long before the survey. This causes problem because the value of the current-date (anticipatory) covariate does not follow the temporal order of events. We propose a dynamic Bayesian approach for modelling jointly the anticipatory covariate and the event of interest, and allowing the effects of the anticipatory covariate to vary over time. The issues are illustrated with data on the effects of education attained by the survey-time on divorce risks among Swedish men. The overall results show that failure to adjust for the anticipatory nature of education leads to elevated relative risks of divorce across educational levels. The results are partially in accordance with previous findings based on analyses of the same data set. More importantly, our findings provide new insights in that the bias due to anticipatory covariates varies over marriage duration.

Keywords
Anticipatory covariates, Bayesian inference, current-date covariates, dynamic modelling, educational gradients in divorce-risks, observational studies, retrospective surveys, Sweden
National Category
Other Social Sciences Probability Theory and Statistics
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-186097 (URN)10.1080/02664763.2020.1864812 (DOI)2-s2.0-85098006527 (Scopus ID)
Available from: 2020-10-24 Created: 2020-10-24 Last updated: 2022-04-22Bibliographically approved
3. Dynamic mixture of experts models for online prediction
Open this publication in new window or tab >>Dynamic mixture of experts models for online prediction
(English)Manuscript (preprint) (Other academic)
Keywords
Bayesian sequential inference, Discount factor, Mixture of experts, Online prediction, Particle filter
National Category
Other Social Sciences
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-186119 (URN)
Available from: 2020-10-25 Created: 2020-10-25 Last updated: 2022-02-25Bibliographically approved
4. Generalized linear models with dynamic link functions
Open this publication in new window or tab >>Generalized linear models with dynamic link functions
(English)Manuscript (preprint) (Other academic)
Keywords
Bayesian sequential inference, Discount factor, Dynamic link function, Generalized linear models, Online prediction, Particle filter
National Category
Other Social Sciences
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-186120 (URN)
Available from: 2020-10-25 Created: 2020-10-25 Last updated: 2022-02-25Bibliographically approved

Open Access in DiVA

Bayesian Sequential Inference for Dynamic Regression Models(1781 kB)1150 downloads
File information
File name FULLTEXT01.pdfFile size 1781 kBChecksum SHA-512
8a127cb214d066fd48b5f2321df90598734356a8558332e6a54b17e60f7ff09d9196c25e1150a30312d56d0116ff04103abd3d4818394b21348347b509abc947
Type fulltextMimetype application/pdf

Authority records

Munezero, Parfait

Search in DiVA

By author/editor
Munezero, Parfait
By organisation
Department of Statistics
Other Social Sciences not elsewhere specified

Search outside of DiVA

GoogleGoogle Scholar
Total: 1151 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1239 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf