Model averaging prediction by K-fold cross-validation

X Zhang, CA Liu - Journal of Econometrics, 2023 - Elsevier
This paper considers the model averaging prediction in a quasi-likelihood framework that
allows for parameter uncertainty and model misspecification. We propose an averaging …

Statistical model choice

G Claeskens - Annual review of statistics and its application, 2016 - annualreviews.org
Variable selection methods and model selection approaches are valuable statistical tools
that are indispensable for almost any statistical modeling question. This review first …

Weighted‐average least squares (WALS): a survey

JR Magnus, G De Luca - Journal of Economic Surveys, 2016 - Wiley Online Library
Abstract Model averaging has become a popular method of estimation, following increasing
evidence that model selection and estimation should be treated as one joint procedure …

Optimal model averaging estimation for generalized linear models and generalized linear mixed-effects models

X Zhang, D Yu, G Zou, H Liang - Journal of the American Statistical …, 2016 - Taylor & Francis
Considering model averaging estimation in generalized linear models, we propose a weight
choice criterion based on the Kullback–Leibler (KL) loss with a penalty term. This criterion is …

Model averaging by jackknife criterion in models with dependent data

X Zhang, ATK Wan, G Zou - Journal of Econometrics, 2013 - Elsevier
The past decade witnessed a literature on model averaging by frequentist methods. For the
most part, the asymptotic optimality of various existing frequentist model averaging …

Distribution theory of the least squares averaging estimator

CA Liu - Journal of Econometrics, 2015 - Elsevier
This paper derives the limiting distributions of least squares averaging estimators for linear
regression models in a local asymptotic framework. We show that the averaging estimators …

Parsimonious model averaging with a diverging number of parameters

X Zhang, G Zou, H Liang, RJ Carroll - Journal of the American …, 2020 - Taylor & Francis
Abstract Model averaging generally provides better predictions than model selection, but the
existing model averaging methods cannot lead to parsimonious models. Parsimony is an …

Model averaging based on leave-subject-out cross-validation

Y Gao, X Zhang, S Wang, G Zou - Journal of Econometrics, 2016 - Elsevier
This paper develops a frequentist model averaging method based on the leave-subject-out
cross-validation. This method is applicable not only to averaging longitudinal data models …

Optimal parameter-transfer learning by semiparametric model averaging

X Hu, X Zhang - Journal of Machine Learning Research, 2023 - jmlr.org
In this article, we focus on prediction of a target model by transferring the information of
source models. To be flexible, we use semiparametric additive frameworks for the target and …

Inference after model averaging in linear regression models

X Zhang, CA Liu - Econometric Theory, 2019 - cambridge.org
This article considers the problem of inference for nested least squares averaging
estimators. We study the asymptotic behavior of the Mallows model averaging estimator …