Change search
Link to record
Permanent link

Direct link
Andersson, Per GöstaORCID iD iconorcid.org/0000-0002-3148-1690
Publications (10 of 15) Show all publications
Andersson, P. G. (2025). Confidence interval construction for the difference of two binomial parameters. Communications in Statistics - Theory and Methods
Open this publication in new window or tab >>Confidence interval construction for the difference of two binomial parameters
2025 (English)In: Communications in Statistics - Theory and Methods, ISSN 0361-0926, E-ISSN 1532-415XArticle in journal (Refereed) Epub ahead of print
Abstract [en]

The two-sample problem for interval estimation of the difference of two binomial p:s is considered. A new interval, the (AN) Andersson–Nerman, is presented and compared with the standard Wald interval and another good alternative, the Agresti interval. The AN interval turns out not to be without defects, but in its construction, where we seek to compensate for the correlation between the point estimator and its standard error, we will get an insight as to why the Wald interval does not work well. This seems not to have been previously taken into account for the two-sample case.

National Category
Probability Theory and Statistics
Research subject
Mathematical Statistics
Identifiers
urn:nbn:se:su:diva-240141 (URN)10.1080/03610926.2024.2447833 (DOI)
Available from: 2025-03-03 Created: 2025-03-03 Last updated: 2025-04-03
Andersson, P. G. (2024). A Note on Confidence Intervals for a Binomial p: Andersson–Nerman vs. Wilson. Stat, 13(4)
Open this publication in new window or tab >>A Note on Confidence Intervals for a Binomial p: Andersson–Nerman vs. Wilson
2024 (English)In: Stat, E-ISSN 2049-1573, Vol. 13, no 4Article in journal (Refereed) Published
Abstract [en]

Numerous approximate confidence intervals in closed form have been suggested over the years for the parameter p in the bino-mial distribution. One of the oldest and still most advocated is the Wilson (score) interval, which in this article will be comparedwith the less well-known Andersson–Nerman (henceforth AN) interval. These intervals are quite closely related, but it will beshown analytically and illustrated by examples that the coverage probability of the AN interval always equals or exceeds that ofthe Wilson interval, while also having uniformly larger expected length. Asymptotic expressions for the coverage probability andexpected length of the AN interval are provided, using Edgeworth and Taylor expansions, respectively. The well-behaved Wilsonand AN pivots are furthermore contrasted with the problematic Wald pivot. The latter gives rise to the Wald interval, which isprobably one of the best known and most used procedures altogether in the history of statistical inference. Unfortunately, this in-terval performs poorly, but even to this day it is to be found in many current textbooks. Therefore, it is still of relevance to searchfor attractive alternatives based on sound statistical principles.

Keywords
correlation, Edgeworth expansion, pivot, score statistic, Wald statistic
National Category
Probability Theory and Statistics
Research subject
Mathematical Statistics
Identifiers
urn:nbn:se:su:diva-239648 (URN)10.1002/sta4.70027 (DOI)001369862600001 ()2-s2.0-85210500257 (Scopus ID)
Available from: 2025-02-18 Created: 2025-02-18 Last updated: 2025-03-21
Andersson, P. G. (2024). Confidence Interval for a Binomial p: Recommend the Wilson Interval to Students. CHANCE: New Directions for Statistics and Computing, 37(2), 13-15
Open this publication in new window or tab >>Confidence Interval for a Binomial p: Recommend the Wilson Interval to Students
2024 (English)In: CHANCE: New Directions for Statistics and Computing, ISSN 0933-2480, Vol. 37, no 2, p. 13-15Article in journal (Refereed) Published
Abstract [en]

The Wald confidence interval for a binomial p should be completely gone by now from teaching as the interval to present and recommend. In reality, this unfortunately not so. This article makes a strong case for instead introducing the Wilson interval even in a first course in statistical inference.

National Category
Probability Theory and Statistics
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-234405 (URN)10.1080/09332480.2024.2348953 (DOI)
Available from: 2024-10-15 Created: 2024-10-15 Last updated: 2024-11-06Bibliographically approved
Andersson, P. G. (2023). The Wald Confidence Interval for a Binomial p as an Illuminating “Bad” Example. American Statistician, 77(4), 443-448
Open this publication in new window or tab >>The Wald Confidence Interval for a Binomial p as an Illuminating “Bad” Example
2023 (English)In: American Statistician, ISSN 0003-1305, E-ISSN 1537-2731, Vol. 77, no 4, p. 443-448Article in journal (Refereed) Published
Abstract [en]

When teaching we usually not only demonstrate/discuss how a certain method works, but, not less important, why it works. In contrast, the Wald confidence interval for a binomial p constitutes an excellent example of a case where we might be interested in why a method does not work. It has been in use for many years and, sadly enough, it is still to be found in many textbooks in mathematical statistics/statistics. The reasons for not using this interval are plentiful and this fact gives us a good opportunity to discuss all of its deficiencies and draw conclusions which are of more general interest. We will mostly use already known results and bring them together in a manner appropriate to the teaching situation. The main purpose of this article is to show how to stimulate students to take a more critical view of simplifications and approximations. We primarily aim for master’s students who previously have been confronted with the Wilson (score) interval, but parts of the presentation may as well be suitable for bachelor’s students. 

Keywords
Correlation, Coverage probability, Score statistic, Skewness, Wald statistic
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:su:diva-216719 (URN)10.1080/00031305.2023.2183257 (DOI)000963213900001 ()2-s2.0-85152372043 (Scopus ID)
Available from: 2023-04-27 Created: 2023-04-27 Last updated: 2024-01-16Bibliographically approved
Andersson, P. G. (2022). Approximate Confidence Intervals for a Binomial p—Once Again. Statistical Science, 37(4), 598-606
Open this publication in new window or tab >>Approximate Confidence Intervals for a Binomial p—Once Again
2022 (English)In: Statistical Science, ISSN 0883-4237, E-ISSN 2168-8745, Vol. 37, no 4, p. 598-606Article in journal (Refereed) Published
Abstract [en]

The problem of constructing a reasonably simple yet wellbehaved confidence interval for a binomial parameter p is old but still fascinating and surprisingly complex. During the last century, many alternatives to the poorly behaved standard Wald interval have been suggested. It seems though that the Wald interval is still much in use in spite of many efforts over the years through publications to point out its deficiencies. This paper constitutes yet another attempt to provide an alternative and it builds on a special case of a general technique for adjusted intervals primarily based on Wald type statistics. The main idea is to construct an approximate pivot with uncorrelated, or nearly uncorrelated, components. The resulting AN (Andersson–Nerman) interval, as well as a modification thereof, is compared with the well-renowned Wilson and AC (Agresti–Coull) intervals and the subsequent discussion will in itself hopefully shed some new light on this seemingly elementary interval estimation situation. Generally, an alternative to the Wald interval is to be judged not only by performance, its expression should also indicate why we will obtain a better behaved interval. It is argued that the well-behaved AN interval meets this requirement.

Keywords
Correlation, Coverage probability, Score statistic, Skewness, Wald statistic
National Category
Mathematics
Identifiers
urn:nbn:se:su:diva-211758 (URN)10.1214/21-STS837 (DOI)000898567900008 ()2-s2.0-85140603978 (Scopus ID)
Available from: 2022-11-25 Created: 2022-11-25 Last updated: 2024-06-11Bibliographically approved
Andersson, P. G. (2020). A classroom approach to the construction of Bayesian credible intervals of a Poisson mean. Communications in Statistics - Theory and Methods, 49(22), 5493-5503
Open this publication in new window or tab >>A classroom approach to the construction of Bayesian credible intervals of a Poisson mean
2020 (English)In: Communications in Statistics - Theory and Methods, ISSN 0361-0926, E-ISSN 1532-415X, Vol. 49, no 22, p. 5493-5503Article in journal (Refereed) Published
Abstract [en]

The Poisson distribution is here used to illustrate Bayesian inference concepts with the ultimate goal to construct credible intervals for a mean. The evaluation of the resulting intervals is in terms of mismatched priors and posteriors. The discussion is in the form of an imaginary dialog between a teacher and a student, who have met earlier, discussing and evaluating the Wald and score confidence intervals, as well as confidence intervals based on transformation and bootstrap techniques. From the perspective of the student the learning process is akin to a real research situation. The student is supposed to have studied mathematical statistics for at least two semesters.

Keywords
Gamma distribution, posterior, prior
National Category
Probability Theory and Statistics Educational Sciences
Identifiers
urn:nbn:se:su:diva-170021 (URN)10.1080/03610926.2019.1619768 (DOI)000469605900001 ()
Available from: 2019-06-24 Created: 2019-06-24 Last updated: 2022-02-26Bibliographically approved
Andersson, P. G. (2020). Approximate Confidence Intervals for a Binomial p - Once Again. Stockholm: Department of Statistics, Stockholm University
Open this publication in new window or tab >>Approximate Confidence Intervals for a Binomial p - Once Again
2020 (English)Report (Other academic)
Place, publisher, year, edition, pages
Stockholm: Department of Statistics, Stockholm University, 2020. p. 15
Series
Research Report / Department of Statistics, Stockholm University, ISSN 0280-7564 ; 2020:1
Keywords
Correlation, Coverage probability, Score statistic, Skewness, Wald statistic.
National Category
Other Natural Sciences Other Social Sciences
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-188249 (URN)
Available from: 2020-12-29 Created: 2020-12-29 Last updated: 2022-02-25Bibliographically approved
Andersson, P. G. (2019). “Optimal” calibration weights under unit nonresponse in survey sampling. Survey Methodology, 45(3), 533-542
Open this publication in new window or tab >>“Optimal” calibration weights under unit nonresponse in survey sampling
2019 (English)In: Survey Methodology, ISSN 0714-0045, E-ISSN 1492-0921, Vol. 45, no 3, p. 533-542Article in journal (Refereed) Published
Abstract [en]

High nonresponse is a very common problem in sample surveys today. In statistical terms we are worried about increased bias and variance of estimators for population quantities such as totals or means. Different methods have been suggested in order to compensate for this phenomenon. We can roughly divide them into imputation and calibration and it is the latter approach we will focus on here. A wide spectrum of possibilities is included in the class of calibration estimators. We explore linear calibration, where we suggest using a nonresponse version of the design-based optimal regression estimator. Comparisons are made between this estimator and a GREG type estimator. Distance measures play a very important part in the construction of calibration estimators. We show that an estimator of the average response propensity (probability) can be included in the “optimal” distance measure under nonresponse, which will help to reduce the bias of the resulting estimator. To illustrate empirically the theoretically derived results for the suggested estimators, a simulation study has been carried out. The population is called KYBOK and consists of clerical municipalities in Sweden, where the variables include financial as well as size measurements. The results are encouraging for the “optimal” estimator in combination with the estimated average response propensity, where the bias was reduced for most of the Poisson sampling cases in the study.

Keywords
Unit nonresponse, Calibration weights, Poisson sampling
National Category
Other Social Sciences Mathematics
Research subject
Statistics
Identifiers
urn:nbn:se:su:diva-177327 (URN)000503194700007 ()
Available from: 2019-12-28 Created: 2019-12-28 Last updated: 2022-02-26Bibliographically approved
Andersson, P. G. (2018). A Classroom Approach to the Construction of Bayesian Credible Intervals of a Poisson Mean.
Open this publication in new window or tab >>A Classroom Approach to the Construction of Bayesian Credible Intervals of a Poisson Mean
2018 (English)Report (Other academic)
Abstract [en]

The Poisson distribution is here used to illustrate Bayesian inference concepts with the ultimate goal to construct credible intervals for a mean. The evaluation of the resulting intervals is in terms of potential negative effects of mismatched priors and posteriors. The discussion is in the form of an imaginary dialogue between a teacher and a student, who have met earlier, discussing and evaluating the Wald and score confidence intervals, as well as confidence intervals based on transformation and bootstrap techniques. From the perspective of the student the learning process is akin to a real research situation. By this time the student  is supposed to have studied mathematical statistics for at least two semesters.

Publisher
p. 11
Series
Research Report / Department of Statistics, Stockholm University, ISSN 0280-7564 ; 4
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:su:diva-160338 (URN)
Available from: 2018-09-19 Created: 2018-09-19 Last updated: 2022-02-26Bibliographically approved
Andersson, P. G. (2018). Design-based "Optimal" Calibration Weights Under Unit Nonresponse in Survey Sampling. Stockholm: Statistiska institutionen, Stockholms universitet
Open this publication in new window or tab >>Design-based "Optimal" Calibration Weights Under Unit Nonresponse in Survey Sampling
2018 (English)Report (Other academic)
Abstract [en]

High nonresponse is a very common problem in sample surveys today. In statistical terms we are worried about increased bias and variance of estimators for population quantities such as totals or means. Different methods have been suggested in order to compensate for this phenomenon. We can roughly divide them into imputation and calibration and it is the latter approach we will focus on here. A wide spectrum of possibilities is included in the class of calibration estimators. We explore linear calibration, where we suggest using a nonresponse version of the design-based optimal regression estimator. Comparisons are made between this estimator and a GREG type estimator. Distance measures play a very important part in the construction of calibration estimators. We show that an estimator of the average response propensity (probability) can be included in the "optimal" distance measure under nonresponse, which will help reducing the bias of the resulting estimator.  To illustrate empirically the theoretically derived results for the suggested estimators, a simulation study has been carried out. The population is called KYBOK and consists of clerical municipalities in Sweden, where the variables include financial as well as size measurements. The  results are encouraging for the "optimal" estimator in combination with the estimated average response propensity, where the bias was highly reduced for the Poisson sampling cases in the study. 

Place, publisher, year, edition, pages
Stockholm: Statistiska institutionen, Stockholms universitet, 2018. p. 12
Series
Research Report / Department of Statistics, Stockholm University, ISSN 0280-7564 ; 2018:2
National Category
Probability Theory and Statistics
Identifiers
urn:nbn:se:su:diva-155761 (URN)
Available from: 2018-04-27 Created: 2018-04-27 Last updated: 2022-02-26Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-3148-1690

Search in DiVA

Show all publications